Data Engineer (Hadoop)

We're looking for an experienced and enthusiastic Data Engineer to join the engineering team at Modus. Want to help our client’s build awesome solutions to accomplish their goals and vision? Are you interested in working from home with some of the best talent on the planet? Then keep reading.

You love being in charge of optimization and automation across multiple platforms and applications. Driving consistency for deployment and build processes is second nature for you. If you walk the line between software development and IT operations, we want to speak to you! We use modern tools, which means you’ll have the opportunity to work with software like Jenkins, Docker, Kubernetes, Amazon Web Services, Heroku, Ansible, Terraform and much more. 

You have a Bachelor’s degree in Computer Science, or other related field and/or discipline and proven experience and demonstrated proficiency in Database development supporting complex information technology systems. You have experience designing and building data processing pipelines using tools and frameworks in the Hadoop ecosystem, you also have experience designing and building ETL pipelines to automate ingestion of structured and unstructured data. You are proficient and knowledgeable of best practices with the Hadoop (YARN, HDFS, MapReduce, Kylin, Airflow). You know how to implement and configure big data technologies as well as tune processes for performance at scale You have experience with GIT and ETL testing in Python.

You will be implementing the database management system, managing the development and implementation of the data model and support the developers as they begin to use the database. You will provide refinement and enhancements with analytic techniques such as Map/Reduce, High Performance Computing and Cloud Services such as Amazon AWS and maintain detailed database designs which include data and process models, program specifications, control specification, structure charts, module definition and unit and usage definitions. You will monitor applications supported by the client’s database servers using industry standard monitoring and troubleshooting tools and actively contribute to ongoing process improvement, innovation planning, best practice implementation, and risk management.

You love learning. Engineering is an ever-evolving world. You enjoy playing with new tech and exploring areas that you might not have experience with yet.  You are self-driven, self-learner willing to share knowledge and participate actively in your community.

Linux is required, one of the following: Ubuntu 14.04 LTS or higher, Red Hat Enterprise Linux / CentOS 6 or higher, Fedora 25 or higher, Debian 8.0 or higher.

Having overlap with your team is critical when working in a global remote team. Modus requires all team members to overlap 100% with EST hours daily. In addition, reliable high speed internet is a must and a personal development environment running Mac OSX, Windows 10Pro or Linux.

Additionally, as part of this role you will be expected to adhere to our customers information security requirements. This includes but is not limited to installing BitDefender endpoint security, provided by Modus Create, on the machine you will be connecting to the client’s network and systems with. BitDefender provides the following features: AntiVirus/AntiMalware, Intrusion detection systems, Blocking of phishing/compromised websites, full disk encryption (using native tools to the operating system), disable external storage, automatic patch deployment and Windows risk management.

Modus is a fast-growing, and remote-first company, so you'll likely get experience on many different projects across the organization. That said, here are some things you'll probably do: