Spring JDBC 批量操作数据

Posted 2021-02-13 哆啦任意门

tags:

篇首语：本文由小常识网(cha138.com)小编为大家整理，主要介绍了Spring JDBC 批量操作数据相关的知识，希望对你有一定的参考价值。

通过JDBC 操作数据库有三种方式第一种是使用 JDBC的JDBC Template ，一种是NamedParameterJdbcTemplate ，一种是使用 Simple JDBC Insert。

具体的例子可以参考下面的几种示例。因为我的类是使用的 Map 进行传参，而且又不想使用占位符，所以变使用了 Simple JDBC Insert

A JDBC batch update is multiple updates using the same database session. That is, we don‘t have to open connections multiple times.

In our previous example, let‘s say we want to insert multiple Person objects in the database. Followings are the various ways to do that in Spring.

Using JdbcTemplate

batchUpdate(String... sql) :

jdbcTemplate.batchUpdate(
"insert into PERSON (FIRST_NAME, LAST_NAME, ADDRESS) values (‘Dana‘, ‘Whitley‘, ‘464 Gorsuch Drive‘)",
"insert into PERSON (FIRST_NAME, LAST_NAME, ADDRESS) values (‘Robin‘, ‘Cash‘, ‘64 Zella Park‘)"
            );

batchUpdate(String sql, List<Object[]> batchArgs) :

jdbcTemplate.batchUpdate(
        "insert into PERSON (FIRST_NAME, LAST_NAME, ADDRESS) values (?, ?, ?)",
        Arrays.asList(new Object[]{"Dana", "Whitley", "464 Gorsuch Drive"},
                      new Object[]{"Robin", "Cash", "64 Zella Park"})
 );

batchUpdate(String sql, List <Object[]> batchArgs, int[] argTypes) :

jdbcTemplate.batchUpdate(
        "insert into PERSON (FIRST_NAME, LAST_NAME, ADDRESS) values (?, ?, ?)",
        Arrays.asList(new Object[]{"Dana", "Whitley", "464 Gorsuch Drive"},
                      new Object[]{"Robin", "Cash", "64 Zella Park"}),
                new int[]{Types.VARCHAR, Types.VARCHAR, Types.VARCHAR}
 );

batchUpdate(String sql, BatchPreparedStatementSetter pss)

final List<Person> persons = Arrays.asList(
        Person.create("Dana", "Whitley", "464 Gorsuch Drive"),
        Person.create("Robin", "Cash", "64 Zella Park")
);

String sql = "insert into Person (first_Name, Last_Name, Address) values (?, ?, ?)";

int[] updateCounts = jdbcTemplate.batchUpdate(sql, new BatchPreparedStatementSetter() {
    @Override
    public void setValues(PreparedStatement ps, int i) throws SQLException {
        ps.setString(1, persons.get(i).getFirstName());
        ps.setString(2, persons.get(i).getLastName());
        ps.setString(3, persons.get(i).getAddress());
    }

    @Override
    public int getBatchSize() {
        return persons.size();
    }
});

batchUpdate(String sql, Collection<T> batchArgs, int batchSize, ParameterizedPreparedStatementSetter <T> pss). This method can break the batch updates into serveral smaller batches specified by batchSize.

final List<Person> persons = Arrays.asList(
        Person.create("Dana", "Whitley", "464 Gorsuch Drive"),
        Person.create("Robin", "Cash", "64 Zella Park")
);

String sql = "insert into Person (first_Name, Last_Name, Address) values (?, ?, ?)";

int[][] updateCounts = jdbcTemplate.batchUpdate(sql, persons, persons.size(),

        new ParameterizedPreparedStatementSetter<Person>() {
            @Override
            public void setValues(PreparedStatement ps, Person person) throws SQLException {
                ps.setString(1, person.getFirstName());
                ps.setString(2, person.getLastName());
                ps.setString(3, person.getAddress());
            }
        });

Using NamedParameterJdbcTemplate

batchUpdate(String sql, Map <String,?>[] batchValues)

List<Person> persons = Arrays.asList(
        Person.create("Dana", "Whitley", "464 Gorsuch Drive"),
        Person.create("Robin", "Cash", "64 Zella Park")
);

String sql = "insert into Person (first_Name, Last_Name, Address) " +
        "values (:firstName, :lastName, :address)";

List<Map<String, Object>> batchValues = new ArrayList<>(persons.size());
for (Person person : persons) {
    batchValues.add(
            new MapSqlParameterSource("firstName", person.getFirstName())
                    .addValue("lastName", person.getLastName())
                    .addValue("address", person.getAddress())
                    .getValues());
}

int[] updateCounts = namedParamJdbcTemplate.batchUpdate(sql,
                           batchValues.toArray(new Map[persons.size()]));

batchUpdate(String sql, SqlParameterSource[] batchArgs)

List<Person> persons = Arrays.asList(
        Person.create("Dana", "Whitley", "464 Gorsuch Drive"),
        Person.create("Robin", "Cash", "64 Zella Park")
);

String sql = "insert into Person (first_Name, Last_Name, Address) " +
        "values (:firstName, :lastName, :address)";

SqlParameterSource[] batch = SqlParameterSourceUtils.createBatch(persons.toArray());
int[] updateCounts = namedParamJdbcTemplate.batchUpdate(sql, batch);

Using SimpleJdbcInsert

executeBatch(Map<String,?>... batch) 对大小写不敏感，只要 Columns 中有数值就可以

List<Map<String, Object>> batchValues = new ArrayList<>(persons.size());
for (Person person : persons) {
 Map<String, Object> map = new HashMap<>();
  map.put("first_Name", person.getFirstName());
  map.put("last_Name", person.getLastName());
  map.put("address", person.getAddress());

 batchValues.add(map);
  }

 SimpleJdbcInsert simpleJdbcInsert = new SimpleJdbcInsert(dataSource).withTableName("PERSON");

 int[] ints = simpleJdbcInsert.executeBatch(batchValues.toArray(new Map[persons.size()]));

public int[] executeBatch(SqlParameterSource... batch). We don‘t have to specify any column to bean field name mapping. It can figure out the differences like underscores in the table column names. For example bean#firstName is automatically mapped to column FIRST_NAME.

List<Person> persons = Arrays.asList(
        Person.create("Dana", "Whitley", "464 Gorsuch Drive"),
        Person.create("Robin", "Cash", "64 Zella Park")
);

SimpleJdbcInsert simpleJdbcInsert = new SimpleJdbcInsert(dataSource)
                                          .withTableName("PERSON")
                                          .usingGeneratedKeyColumns("id");

SqlParameterSource[] batch = SqlParameterSourceUtils.createBatch(persons.toArray());
int[] ints = simpleJdbcInsert.executeBatch(batch);

我自己的示例，首先我需要多批次的操作，其次我已经封装好了一个 Map 使用 Java 8 的流的方式将Map 的list 转换为 Map 数组。

在这里我就碰到了这个坑如果是传统的 list.toArray() , 那么其实转换出来的是一个 Object 数组，这样子使用的方式是 Bean 命名的方式。

for ( int i = 0 ; i < list.size() ; i +=batchSize ) {
    final List<Map<String, Object>> batchList = list.subList(i, i + batchSize > list.size() ? list.size() : i + batchSize);
batchList.stream().forEach(putMapValue(batchId, site));
Map[] maps = batchList.stream().toArray(Map[]::new);
SqlParameterSource[] batch = SqlParameterSourceUtils.createBatch(maps);
jdbcInsert.executeBatch(batch);
}

private Consumer<Map<String, Object>> putMapValue(String batchId, String site) {
    return map -> {
        map.put("UUID", UUID.randomUUID().toString());
map.put("LAST_BATCH_ID",batchId);
map.put("SITE", site);
};
}

for ( int i = 0 ; i < list.size() ; i +=batchSize ) {
    final List<Map<String, Object>> batchList = list.subList(i, i + batchSize > list.size() ? list.size() : i + batchSize);
batchList.stream().forEach(putMapValue(batchId, site));
Map[] maps = batchList.stream().toArray(Map[]::new);
SqlParameterSource[] batch = SqlParameterSourceUtils.createBatch(maps);
jdbcInsert.executeBatch(batch);
}

以上是关于Spring JDBC 批量操作数据的主要内容，如果未能解决你的问题，请参考以下文章

spring3: 对JDBC的支持之 Spring提供的其它帮助 SimpleJdbcInsert/SimpleJdbcCall/SqlUpdate/JdbcTemplate 生成主键/批量处理(

Mybatis批量操作与JDBC批量操作效率测试

肝！Spring JDBC持久化层框架“全家桶”教程！

spring批量更新数据 ---- BatchPreparedStatementSetter

Java批量插入更新操作

Spring JDBC 批量操作 数据

Using JdbcTemplate

Using NamedParameterJdbcTemplate

Using SimpleJdbcInsert

Spring JDBC 批量操作数据