logo

View all jobs

Senior BigData Engineer – Python, spark (pyspark), AWS

Beaverton, OR
Our client is seeking a motivated and experienced Software engineer to join their Advanced Analytics & Machine Learning team. This is a unique opportunity to enhance & upgrade our next generation Data Science Platform that supports a dynamic team of data scientists, data engineers, and data analysts, all working on Demand Sensing related projects.

We are looking for strong experience in Python, AWS, Machine Learning/Data Science, CI/CD integration and the ability work with cross functional team. The work will also involve building and incorporate automated unit & integration tests into the Data science platform

Job Title: Senior BigData Engineer – Python, spark (pyspark), AWS
Duration: 6 months (contract); remote ok (PST time zone) but, prefer Onsite
Location: Beaverton, Oregon
Remote ok, noting majority of the team is based in PST prefer Onsite

Required Skills: Python, spark (pyspark), AWS; Big Data / Hadoop
Data Modeling; Software Architecture; Cloud Infrastructure - Kubernetes, Docker, Jenkins, Terraform; Agile/Kanban/Scrum

Must Have: Solid Python Programming, minimum 2 years of AWS development
Experience building Machine Learning/Data Science applications
Data structures, data modeling software architecture on cloud-based infrastructure
Experience with technologies like Kubernetes, Docker, Jenkins, Terraform
Big Data / Hadoop: 2 years
Experience with Spark

Job Responsibilities:
Establishes database management systems, standards, guidelines and quality assurance for database deliverables, such as conceptual design, logical database, capacity planning, external data interface specification, data loading plan, data maintenance plan and security policy.
Documents and communicates database design. Evaluates and installs database management systems.
Codes complex programs and derives logical processes on technical platforms. Builds windows, screens, and reports.
Assists in the design of user interface and business application prototypes.
Participates in quality assurance and develops test application code in client server environment.
Provides expertise in devising, negotiating and defending the tables and fields provided in the database.
Adapts business requirements, developed by modeling/development staff and systems engineers, and develops the data, database specifications, and table and element attributes for an application.
At more experienced levels, helps to develop an understanding of client's original data and storage mechanisms.
Determines appropriateness of data for storage and optimum storage organization.
Determines how tables relate to each other and how fields interact within the tables for a relational model.

Education and Qualifications Required:
Degrees required for this job: A bachelor’s degree in design, UX/UI design, human-computer interaction, or related field is preferred, but not required
Years of experience required for this job: 6+ years of relevant experience with Data Modeling, Python AWS Spark Big Data / Hadoop developer of Machine Learning/Data Science applications; Software Architecture, Cloud Infrastructure - Kubernetes, Docker, Jenkins, Terraform; Agile/Kanban/Scrum

Soft skills for this job:
Communication skills both verbal and written

Email your resume to: usjobs@mavensoft.com
To learn more about Mavensoft visit us online at http://www.mavensoft.com/

 

More Openings

ASP.NET Developers (4-6 yrs)
JAVA DEVELOPERS
Sr.Net Developer

Share This Job

Powered by