Big Data Developer

Job Description

<p><strong>Role: Big Data Developer</strong></p><p><strong>Job Location: Mississauga, ON (Remote)</strong></p><p><strong>Job Type: FTC/ Full time</strong></p><p><br></p><p>Total Experience: 7-12 years</p><p>Role Description:</p><ul><li>Design high quality deliverables adhering to business requirements with defined standards and design principles, patterns</li><li>Develop and maintain highly scalable, high performance Data transformation applications using Apache Spark framework</li><li>Develop/Integrate the code adhering to CI/CD, using Spark Framework in Scala/Java</li><li>Provide solutions to big data problems dealing with huge volumes of data using Spark based data transformation solutions, Hive, MPP processes like IMPALA.</li><li>Create Junit tests and ensure code coverage is met as per the agreed standards</li><li>Should be able to work with a team who might be geographically distributed. Review the code modules developed by other juniors.</li></ul><p>Required Skill Sets:</p><ul><li>Must-Have Hands on development experience in programming languages such as JAVA, SCALA using Maven, Apache Spark Frameworks and Unix Shell scripting</li><li>Should be comfortable with Unix File system as well as HDFS commands</li><li>Should have worked on query languages such as Oracle SQL, Hive SQL, Spark SQL, Impala, HBase DB</li><li>Should be flexible</li><li>Should have good communication and customer management skills</li></ul><p>Desired Skill Sets:</p><ul><li>Good-to-Have Should have knowledge on Big data Data Ingestion tools such as SQOOP and KAFKA.</li><li>Should be aware of the components in Big Data ecosystem.</li><li>Should have worked on building projects using Eclipse IDE, Tectia Client, Oracle SQL Developer.</li></ul><p></p>