sqoop

Default Number of mapper and reducer in SQOOP job

Updated: Dec 12, 2018 #hadoop #sqoop #defaultmapper #defaultreducer #hadoopinterviewquestion In this post we are going to focus the default number of mappers and reducers in the sqoop. scope is the part of Hadoop ecosystem which is mainly useful to move the data from the RDBMS database to hdfs file system or to directly hive tables and …

Default Number of mapper and reducer in SQOOP job Read More »

Sqoop command to import data from mysql database to HDFS

Step 1. Login to Mysql database. cloudera@cloudera-vm:~$ mysql -uroot -p Enter password: Welcome to the MySQL monitor. Commands end with ; or \g. Your MySQL connection id is 54 Server version: 5.1.61-0ubuntu0.10.10.1 (Ubuntu) Copyright (c) 2000, 2011, Oracle and/or its affiliates. All rights reserved. Oracle is a registered trademark of Oracle Corporation and/or its affiliates. …

Sqoop command to import data from mysql database to HDFS Read More »

Exclude parameter in SQOOP to exclude import tables

STEP 1. Check the no of tables in mysql database. mysql> show tables; +—————-+ | Tables_in_test | +—————-+ | company | | student | | transactions | +—————-+ 3 rows in set (0.00 sec) 3 rows in set (0.00 sec) STEP 2. Use import-all-tables command to import all tables from test database excluding company table. …

Exclude parameter in SQOOP to exclude import tables Read More »

Sqoop Command with Secure Password

There are different way to secure sqoop password. following are the different method to secure sqoop password while running script. 1. Use — password Option with Sqoop Command $sqoop import –connect jdbc:mysql://localhost/MYDB \ –username testuser \ –password **** \ –table EMPLOYEE 2. Use — P Option with Sqoop Command $sqoop import –connect jdbc:mysql://localhost/MYDB \ –username …

Sqoop Command with Secure Password Read More »

Exclude parameter in SQOOP to exclude import tables

Exclude parameter is useful to exclude the tables from sqoop export operation. exclude parameter work with import-all-tables parameter. here import-all-tables will import all tables but exclude the tables in exclude list. STEP 1. Check the no of tables in mysql database. mysql> show tables; +—————-+ | Tables_in_test | +—————-+ | company | | student | …

Exclude parameter in SQOOP to exclude import tables Read More »

Sqoop Command with Secure Password

There are different way to secure sqoop password. following are the different method to secure sqoop password while running script. 1. Use — password Option with Sqoop Command $sqoop import –connect jdbc:mysql://localhost/MYDB \ –username testuser \ –password **** \ –table EMPLOYEE 2. Use — P Option with Sqoop Command $sqoop import –connect jdbc:mysql://localhost/MYDB \ –username …

Sqoop Command with Secure Password Read More »