Big Data Architect/Engineer | Houston, TX - Job.com

Big Data Architect/Engineer

for Rice University in Houston, TX

Job Description

### Position Information

## Position Summary

The Big Data Architect/Engineer will work with the Machine Learning Research Scientist, contractors, and team developers to design and implement the second version of BigLearn, which provides personalization, recommendations, and performance prediction to students using OpenStax Tutor and CourseWare.

The Architect/Engineer will design big data solutions with heavy realtime usage in a secure manner, preserving privacy of student data.

The architect/engineer will design the data architecture and software components and application programming interfaces (APIs) to ingest learner interaction data, run an ever-expanding suite of cognitive science and machine learning algorithms on it in near-realtime and in batch processes, and return the recommendations and analytics produced by those algorithms to client learning platforms.

## Education Required

Bachelor's Degree

## Concentration / Degree Type

Engineering, computer science, MIS or related discipline.

## Substitution for Education Requirement

May substitute additional related experience, above and beyond what is required, on an equivalent year for year basis in lieu of the education requirement.

## Education Preferred

Masters degree.

## Experience Required

3 years

## Type of Experience

Experience architecting big data solutions with heavy real-time usage.

## Substitution for Experience Requirement

May substitute additional related education, above and beyond what is required, on an equivalent year for year basis in lieu of the experience requirement.

## Experience Preferred

* Experience with/exposure to Lambda Architecture Spark preferred but alternative frameworks are okay if the experience is relevant.

* Experience with repurposing and applying algorithms from data scientists into machine learning applications.

* Ability to work with at least one of the standard tools in statistical data analysis (Python, R, Matlab, etc).

* Experience with one or more of the following models: Latent variable models, natural language processing, low-rank methods, Bayesian inference, data mining, regression analysis.

* Familiarity with Ansible and AWS, python celery, and relational databases.

## License/Certification Required

N/A

## License/Certification Preferred

N/A

## Skills Required

* Ability to work well under pressure, without supervision and as a team member with other staff, faculty or students.

* Ability to create technical documentation and architecture specs.

* Good communication skills.

* Solid work ethic.

* Commitment to creating automated tests and using automated test frameworks.

## Skills Preferred

* Familiarity with property based testing frameworks like QuickCheck would be an added advantage.

## Internal / External Contacts

Daily interaction with OpenStax staff, and all levels of the University community including Rice
faculty, staff, and students. Occasional contact with researchers investigating learning using OpenStax products, and educators and learners using OpenStax products and services.

Regular discussions and collaborations with representatives from partners and other institutions.

Contact with funders and vendors as appropriate.

## Physical Demands

Must be able to move about the campus. Ability to lift computers and monitors.

## Working Conditions

Normal business hours, US Central time. May be required to work weekends or evenings for major deadlines. Occasional travel for conferences and training should be expected.

Non-smoking environment.

## Security Sensitive

Yes

## Quick Link for Posting

http://jobs. rice. edu/postings/5213

## Job Duty Name

Software Architecture and Design

## Description of Job Duty

* Software architecture, design, and research.

* Work with UX team, developers, and stakeholders to establish required features and services.

* Provide deep technical and strategic advice to the team on software architecture, component technologies, and APIs.

* Work with data scientists and cognitive scientists in conceptualizing and designing machine learning algorithms. Help identifying potential bottlenecks and optimization/parallelization opportunities early in the algorithmic design process.

* Document design and APIs.

## Percentage of Time

35

## Job Duty Name

Software Development

## Description of Job Duty

* Development of software components supporting BigLearn.

* Develop APIs for communicating between BigLearn, Tutor components, research infrastructure, and partner technologies.

* Develop distributed, scalable and highly available architecture that hosts the machine learning algorithms created by data scientists.

* Create quick prototypes to demonstrate new features and get early feedback from stakeholders.

* Research and implement industry best practices for versioning algorithms, data and APIs.

## Percentage of Time

35

## Job Duty Name

Management and Team Participation

## Description of Job Duty

* Participate in agile development communications, daily scrum, sprint planning, chat rooms.

* Communicate constantly and effectively with teams that use the BigLearn platform to ensure compatibility and seamless integration.

* Communicate with the devops team to make sure the infrastructure required for the BigLearn platform is addressed in the automated deployment scripts.

* Occasional work with the research team to help setting up and conducting experiments.

* Mentor and train other developers.

* Supervise staff and interns.

## Percentage of Time

10

## Job Duty Name

Testing and Documentation

## Description of Job Duty

* Document architecture and design at a high level.

* Document expected functionality and workflows and error conditions.

* Develop and run unit tests on existing and new features.

* Help maintain development and testing infrastructure.

## Percentage of Time

10

## Job Duty Name

Other

## Description of Job Duty

* Other duties as specified b

Register and find the right job for you.

Register and find the right job for you.

Why Register?
  • Get weekly job alerts
  • Upload your resume
  • Use our career tools

Register now & start applying for jobs.

Why Register?
  • Apply to Matching Jobs
  • Get Weekly Job Alerts
  • Post Your Resume
() -

Register now & start applying for jobs.

Why Register?
  • Apply to Matching Jobs
  • Get Weekly Job Alerts
  • Post Your Resume
() -

Register now & start applying for jobs.

Why Register?
  • Apply to Matching Jobs
  • Get Weekly Job Alerts
  • Post Your Resume
() -

Register now & start applying for jobs.

Why Register?
  • Apply to Matching Jobs
  • Get Weekly Job Alerts
  • Post Your Resume
() -