Data retrieval / Finders

Finder methods are intended to query data from the database. They do not return plain objects but instead return model instances. Because finder methods return model instances you can call any model instance member on the result as described in the documentation for instances.

In this document we'll explore what finder methods can do:

find - Search for one specific element in the database

  1. // search for known ids
  2. Project.findByPk(123).then(project => {
  3. // project will be an instance of Project and stores the content of the table entry
  4. // with id 123. if such an entry is not defined you will get null
  5. })
  6. // search for attributes
  7. Project.findOne({ where: {title: 'aProject'} }).then(project => {
  8. // project will be the first entry of the Projects table with the title 'aProject' || null
  9. })
  10. Project.findOne({
  11. where: {title: 'aProject'},
  12. attributes: ['id', ['name', 'title']]
  13. }).then(project => {
  14. // project will be the first entry of the Projects table with the title 'aProject' || null
  15. // project.get('title') will contain the name of the project
  16. })

findOrCreate - Search for a specific element or create it if not available

The method findOrCreate can be used to check if a certain element already exists in the database. If that is the case the method will result in a respective instance. If the element does not yet exist, it will be created.

Let's assume we have an empty database with a User model which has a username and a job.

where option will be appended to defaults for create case.

  1. User
  2. .findOrCreate({where: {username: 'sdepold'}, defaults: {job: 'Technical Lead JavaScript'}})
  3. .then(([user, created]) => {
  4. console.log(user.get({
  5. plain: true
  6. }))
  7. console.log(created)
  8. /*
  9. findOrCreate returns an array containing the object that was found or created and a boolean that
  10. will be true if a new object was created and false if not, like so:
  11. [ {
  12. username: 'sdepold',
  13. job: 'Technical Lead JavaScript',
  14. id: 1,
  15. createdAt: Fri Mar 22 2013 21: 28: 34 GMT + 0100(CET),
  16. updatedAt: Fri Mar 22 2013 21: 28: 34 GMT + 0100(CET)
  17. },
  18. true ]
  19. In the example above, the array spread on line 3 divides the array into its 2 parts and passes them
  20. as arguments to the callback function defined beginning at line 39, which treats them as "user" and
  21. "created" in this case. (So "user" will be the object from index 0 of the returned array and
  22. "created" will equal "true".)
  23. */
  24. })

The code created a new instance. So when we already have an instance …

  1. User.create({ username: 'fnord', job: 'omnomnom' })
  2. .then(() => User.findOrCreate({where: {username: 'fnord'}, defaults: {job: 'something else'}}))
  3. .then(([user, created]) => {
  4. console.log(user.get({
  5. plain: true
  6. }))
  7. console.log(created)
  8. /*
  9. In this example, findOrCreate returns an array like this:
  10. [ {
  11. username: 'fnord',
  12. job: 'omnomnom',
  13. id: 2,
  14. createdAt: Fri Mar 22 2013 21: 28: 34 GMT + 0100(CET),
  15. updatedAt: Fri Mar 22 2013 21: 28: 34 GMT + 0100(CET)
  16. },
  17. false
  18. ]
  19. The array returned by findOrCreate gets spread into its 2 parts by the array spread on line 3, and
  20. the parts will be passed as 2 arguments to the callback function beginning on line 69, which will
  21. then treat them as "user" and "created" in this case. (So "user" will be the object from index 0
  22. of the returned array and "created" will equal "false".)
  23. */
  24. })

… the existing entry will not be changed. See the job of the second user, and the fact that created was false.

findAndCountAll - Search for multiple elements in the database, returns both data and total count

This is a convenience method that combinesfindAll and count (see below) this is useful when dealing with queries related to pagination where you want to retrieve data with a limit and offset but also need to know the total number of records that match the query:

The success handler will always receive an object with two properties:

  • count - an integer, total number records matching the where clause and other filters due to associations
  • rows - an array of objects, the records matching the where clause and other filters due to associations, within the limit and offset range
  1. Project
  2. .findAndCountAll({
  3. where: {
  4. title: {
  5. [Op.like]: 'foo%'
  6. }
  7. },
  8. offset: 10,
  9. limit: 2
  10. })
  11. .then(result => {
  12. console.log(result.count);
  13. console.log(result.rows);
  14. });

It support includes. Only the includes that are marked as required will be added to the count part:

Suppose you want to find all users who have a profile attached:

  1. User.findAndCountAll({
  2. include: [
  3. { model: Profile, required: true }
  4. ],
  5. limit: 3
  6. });

Because the include for Profile has required set it will result in an inner join, and only the users who have a profile will be counted. If we remove required from the include, both users with and without profiles will be counted. Adding a where clause to the include automatically makes it required:

  1. User.findAndCountAll({
  2. include: [
  3. { model: Profile, where: { active: true }}
  4. ],
  5. limit: 3
  6. });

The query above will only count users who have an active profile, because required is implicitly set to true when you add a where clause to the include.

The options object that you pass to findAndCountAll is the same as for findAll (described below).

findAll - Search for multiple elements in the database

  1. // find multiple entries
  2. Project.findAll().then(projects => {
  3. // projects will be an array of all Project instances
  4. })
  5. // search for specific attributes - hash usage
  6. Project.findAll({ where: { name: 'A Project' } }).then(projects => {
  7. // projects will be an array of Project instances with the specified name
  8. })
  9. // search within a specific range
  10. Project.findAll({ where: { id: [1,2,3] } }).then(projects => {
  11. // projects will be an array of Projects having the id 1, 2 or 3
  12. // this is actually doing an IN query
  13. })
  14. Project.findAll({
  15. where: {
  16. id: {
  17. [Op.and]: {a: 5}, // AND (a = 5)
  18. [Op.or]: [{a: 5}, {a: 6}], // (a = 5 OR a = 6)
  19. [Op.gt]: 6, // id > 6
  20. [Op.gte]: 6, // id >= 6
  21. [Op.lt]: 10, // id < 10
  22. [Op.lte]: 10, // id <= 10
  23. [Op.ne]: 20, // id != 20
  24. [Op.between]: [6, 10], // BETWEEN 6 AND 10
  25. [Op.notBetween]: [11, 15], // NOT BETWEEN 11 AND 15
  26. [Op.in]: [1, 2], // IN [1, 2]
  27. [Op.notIn]: [1, 2], // NOT IN [1, 2]
  28. [Op.like]: '%hat', // LIKE '%hat'
  29. [Op.notLike]: '%hat', // NOT LIKE '%hat'
  30. [Op.iLike]: '%hat', // ILIKE '%hat' (case insensitive) (PG only)
  31. [Op.notILike]: '%hat', // NOT ILIKE '%hat' (PG only)
  32. [Op.overlap]: [1, 2], // && [1, 2] (PG array overlap operator)
  33. [Op.contains]: [1, 2], // @> [1, 2] (PG array contains operator)
  34. [Op.contained]: [1, 2], // <@ [1, 2] (PG array contained by operator)
  35. [Op.any]: [2,3] // ANY ARRAY[2, 3]::INTEGER (PG only)
  36. },
  37. status: {
  38. [Op.not]: false // status NOT FALSE
  39. }
  40. }
  41. })

Complex filtering / OR / NOT queries

It's possible to do complex where queries with multiple levels of nested AND, OR and NOT conditions. In order to do that you can use or, and or not Operators:

  1. Project.findOne({
  2. where: {
  3. name: 'a project',
  4. [Op.or]: [
  5. { id: [1,2,3] },
  6. { id: { [Op.gt]: 10 } }
  7. ]
  8. }
  9. })
  10. Project.findOne({
  11. where: {
  12. name: 'a project',
  13. id: {
  14. [Op.or]: [
  15. [1,2,3],
  16. { [Op.gt]: 10 }
  17. ]
  18. }
  19. }
  20. })

Both pieces of code will generate the following:

  1. SELECT *
  2. FROM `Projects`
  3. WHERE (
  4. `Projects`.`name` = 'a project'
  5. AND (`Projects`.`id` IN (1,2,3) OR `Projects`.`id` > 10)
  6. )
  7. LIMIT 1;

not example:

  1. Project.findOne({
  2. where: {
  3. name: 'a project',
  4. [Op.not]: [
  5. { id: [1,2,3] },
  6. { array: { [Op.contains]: [3,4,5] } }
  7. ]
  8. }
  9. });

Will generate:

  1. SELECT *
  2. FROM `Projects`
  3. WHERE (
  4. `Projects`.`name` = 'a project'
  5. AND NOT (`Projects`.`id` IN (1,2,3) OR `Projects`.`array` @> ARRAY[3,4,5]::INTEGER[])
  6. )
  7. LIMIT 1;

Manipulating the dataset with limit, offset, order and group

To get more relevant data, you can use limit, offset, order and grouping:

  1. // limit the results of the query
  2. Project.findAll({ limit: 10 })
  3. // step over the first 10 elements
  4. Project.findAll({ offset: 10 })
  5. // step over the first 10 elements, and take 2
  6. Project.findAll({ offset: 10, limit: 2 })

The syntax for grouping and ordering are equal, so below it is only explained with a single example for group, and the rest for order. Everything you see below can also be done for group

  1. Project.findAll({order: [['title', 'DESC']]})
  2. // yields ORDER BY title DESC
  3. Project.findAll({group: 'name'})
  4. // yields GROUP BY name

Notice how in the two examples above, the string provided is inserted verbatim into the query, i.e. column names are not escaped. When you provide a string to order/group, this will always be the case. If you want to escape column names, you should provide an array of arguments, even though you only want to order/group by a single column

  1. something.findOne({
  2. order: [
  3. // will return `name`
  4. ['name'],
  5. // will return `username` DESC
  6. ['username', 'DESC'],
  7. // will return max(`age`)
  8. sequelize.fn('max', sequelize.col('age')),
  9. // will return max(`age`) DESC
  10. [sequelize.fn('max', sequelize.col('age')), 'DESC'],
  11. // will return otherfunction(`col1`, 12, 'lalala') DESC
  12. [sequelize.fn('otherfunction', sequelize.col('col1'), 12, 'lalala'), 'DESC'],
  13. // will return otherfunction(awesomefunction(`col`)) DESC, This nesting is potentially infinite!
  14. [sequelize.fn('otherfunction', sequelize.fn('awesomefunction', sequelize.col('col'))), 'DESC']
  15. ]
  16. })

To recap, the elements of the order/group array can be the following:

  • String - will be quoted
  • Array - first element will be quoted, second will be appended verbatim
  • Object -
    • Raw will be added verbatim without quoting
    • Everything else is ignored, and if raw is not set, the query will fail
  • Sequelize.fn and Sequelize.col returns functions and quoted column names

Raw queries

Sometimes you might be expecting a massive dataset that you just want to display, without manipulation. For each row you select, Sequelize creates an instance with functions for update, delete, get associations etc. If you have thousands of rows, this might take some time. If you only need the raw data and don't want to update anything, you can do like this to get the raw data.

  1. // Are you expecting a massive dataset from the DB,
  2. // and don't want to spend the time building DAOs for each entry?
  3. // You can pass an extra query option to get the raw data instead:
  4. Project.findAll({ where: { ... }, raw: true })

count - Count the occurrences of elements in the database

There is also a method for counting database objects:

  1. Project.count().then(c => {
  2. console.log("There are " + c + " projects!")
  3. })
  4. Project.count({ where: {'id': {[Op.gt]: 25}} }).then(c => {
  5. console.log("There are " + c + " projects with an id greater than 25.")
  6. })

max - Get the greatest value of a specific attribute within a specific table

And here is a method for getting the max value of an attribute

  1. /*
  2. Let's assume 3 person objects with an attribute age.
  3. The first one is 10 years old,
  4. the second one is 5 years old,
  5. the third one is 40 years old.
  6. */
  7. Project.max('age').then(max => {
  8. // this will return 40
  9. })
  10. Project.max('age', { where: { age: { [Op.lt]: 20 } } }).then(max => {
  11. // will be 10
  12. })

min - Get the least value of a specific attribute within a specific table

And here is a method for getting the min value of an attribute:

  1. /*
  2. Let's assume 3 person objects with an attribute age.
  3. The first one is 10 years old,
  4. the second one is 5 years old,
  5. the third one is 40 years old.
  6. */
  7. Project.min('age').then(min => {
  8. // this will return 5
  9. })
  10. Project.min('age', { where: { age: { [Op.gt]: 5 } } }).then(min => {
  11. // will be 10
  12. })

sum - Sum the value of specific attributes

In order to calculate the sum over a specific column of a table, you canuse the sum method.

  1. /*
  2. Let's assume 3 person objects with an attribute age.
  3. The first one is 10 years old,
  4. the second one is 5 years old,
  5. the third one is 40 years old.
  6. */
  7. Project.sum('age').then(sum => {
  8. // this will return 55
  9. })
  10. Project.sum('age', { where: { age: { [Op.gt]: 5 } } }).then(sum => {
  11. // will be 50
  12. })