一、fail-fast机制的定义
fail-fast是java集合Collection中的一种错误机制。在多线程环境下,当一个线程正在读取集合数据时,另一个线程对集合数据进行修改(添加、修改、删除、清空等操作),就会抛出ConcurrentModificationException异常,触发fail-fast事件。
二、fail-fast举例
程序员不骗程序员,直接上代码:两个线程类,一个读取ArrayList里面的数据,一个往arrayList里面插入数据。
1、ThreadRead
package multithread.fastfail;
import utils.ThreadUtils;
import java.util.Iterator;
import java.util.List;
public class ThreadRead extends Thread{
List list;
public ThreadRead(List list){
this.list=list;
}
@Override
public void run() {
int i =0;
while (i<20){
String value = null;
Iterator iter = list.iterator();
StringBuffer buffer = new StringBuffer("");
while(iter.hasNext()) {
value = (String)iter.next();
buffer.append("ThreadRead"+"读取元素:"+value+", ");
}
System.out.println(buffer.toString());
i++;
}
}
}
2、ThreadWrite
package multithread.fastfail;
import utils.ThreadUtils;
import java.util.List;
public class ThreadWrite extends Thread{
List list;
public ThreadWrite(List list){
this.list=list;
}
@Override
public void run() {
int i =10;
while (i<20){
list.add(String.valueOf(i));
System.out.println("ThreadWrite"+"插入元素:"+i+", ");
i++;
}
}
}
3、测试类
package multithread.fastfail;
import java.util.ArrayList;
import java.util.List;
public class FastFailTest {
private static List list = new ArrayList();
static{
list.add("1");
list.add("2");
list.add("3");
}
public static void main(String[] args) {
new ThreadRead(list).start();
new ThreadWrite(list).start();
}
}
运行结果:
三、异常分析
上述案例中,我们是利用两个线程分别向ArrayList里面分别读和写数据,所以我们进行异常分析时可以把焦点定位在ArrayList这个类中。
我们发现这个问题主要是在读取数据时抛出,那么俺们从ThreadRead中可以看到涉及到ArrayList类相关的方法就是被红框标记出来的三处。
首先我们看iterator方法,查看源码得知iterator时返回Itr这个对象。
Itr是一个内部类,它初始是有个重要的设定:expectedModCount = modCount。modCount是ArrayList被修改的次数。
private class Itr implements Iterator{ int cursor; // index of next element to return int lastRet = -1; // index of last element returned; -1 if no such int expectedModCount = modCount; public boolean hasNext() { return cursor != size; } @SuppressWarnings("unchecked") public E next() { checkForComodification(); int i = cursor; if (i >= size) throw new NoSuchElementException(); Object[] elementData = ArrayList.this.elementData; if (i >= elementData.length) throw new ConcurrentModificationException(); cursor = i + 1; return (E) elementData[lastRet = i]; } public void remove() { if (lastRet < 0) throw new IllegalStateException(); checkForComodification(); try { ArrayList.this.remove(lastRet); cursor = lastRet; lastRet = -1; expectedModCount = modCount; } catch (IndexOutOfBoundsException ex) { throw new ConcurrentModificationException(); } } @Override @SuppressWarnings("unchecked") public void forEachRemaining(Consumer super E> consumer) { Objects.requireNonNull(consumer); final int size = ArrayList.this.size; int i = cursor; if (i >= size) { return; } final Object[] elementData = ArrayList.this.elementData; if (i >= elementData.length) { throw new ConcurrentModificationException(); } while (i != size && modCount == expectedModCount) { consumer.accept((E) elementData[i++]); } // update once at end of iteration to reduce heap write traffic cursor = i; lastRet = i - 1; checkForComodification(); } final void checkForComodification() { if (modCount != expectedModCount) throw new ConcurrentModificationException(); } }
hasNext方法只是判断下一个元素与游标的关系,异常不会发生在这个方法。
next方法,会调用checkForComodification方法来比较expectedModCount 和 modCount的大小,如果发现不等,则返回ConcurrentModificationException异常。到此为止,我们就找到了抛出异常是因为执行Itr.next()时,发现expectedModCount 和 modCount不一致的情况。而且Itr内remove方法完成操作后也会设置expectedModCount 和 modCount相等。
既然问题不是出现在ThreadRead中,我们再看ThreadWrite。涉及到ArrayList的就是红框所在的add方法。
我们回到ArrayList源码中,涉及到add方法及辅助方法中,ensureExplicitCapacity会进modCount增一的操作。
public boolean add(E e) {
ensureCapacityInternal(size + 1); // Increments modCount!!
elementData[size++] = e;
return true;
}
private void ensureCapacityInternal(int minCapacity) {
if (elementData == DEFAULTCAPACITY_EMPTY_ELEMENTDATA) {
minCapacity = Math.max(DEFAULT_CAPACITY, minCapacity);
}
ensureExplicitCapacity(minCapacity);
}
private void ensureExplicitCapacity(int minCapacity) {
modCount++;
// overflow-conscious code
if (minCapacity - elementData.length > 0)
grow(minCapacity);
}
最终梳理的出抛错的流程:ThreadRead获取ArrayList迭代器Itr时,modCount获取到当前的快照值,并赋值给expectedModCount(假设为10),此时ThreadWrite对ArrayList通过add方法添加元素,并把modCount进行+1操作(这次modCount值为11)。ThreadRead对Itr调用其next方法时,检查发现expectedModCount和modCount不一致,因此抛出了ConcurrentModificationException异常,触发了fail-fast机制。
四、解决方案
1、解决方案
从上面我们从源码层面梳理了fail-fast机制,那么是否有办法解决呢?答案是肯定的,官方建议使用“java.util.concurrent包下的类”去取代“java.util包下的类。
如上述案例中,把ArrayList换成CopyOnWriteArrayList,即可避免fail-fast。
测试类
import java.util.List;
import java.util.concurrent.CopyOnWriteArrayList;
public class FastFailTest {
// private static List list = new ArrayList();
private static List list = new CopyOnWriteArrayList();
static{
list.add("1");
list.add("2");
list.add("3");
}
public static void main(String[] args) {
new ThreadRead(list).start();
new ThreadWrite(list).start();
}
}
运行结果:
"D:Program FilesJavajdk1.8.0_40binjava.exe" "-javaagent:D:Program FilesJetBrainsIntelliJ IDEA 2022.1libidea_rt.jar=53500:D:Program FilesJetBrainsIntelliJ IDEA 2022.1bin" -Dfile.encoding=UTF-8 -classpath "D:Program FilesJavajdk1.8.0_40jrelibcharsets.jar;D:Program FilesJavajdk1.8.0_40jrelibdeploy.jar;D:Program FilesJavajdk1.8.0_40jrelibextaccess-bridge-64.jar;D:Program FilesJavajdk1.8.0_40jrelibextcldrdata.jar;D:Program FilesJavajdk1.8.0_40jrelibextdnsns.jar;D:Program FilesJavajdk1.8.0_40jrelibextjaccess.jar;D:Program FilesJavajdk1.8.0_40jrelibextjfxrt.jar;D:Program FilesJavajdk1.8.0_40jrelibextlocaledata.jar;D:Program FilesJavajdk1.8.0_40jrelibextnashorn.jar;D:Program FilesJavajdk1.8.0_40jrelibextsunec.jar;D:Program FilesJavajdk1.8.0_40jrelibextsunjce_provider.jar;D:Program FilesJavajdk1.8.0_40jrelibextsunmscapi.jar;D:Program FilesJavajdk1.8.0_40jrelibextsunpkcs11.jar;D:Program FilesJavajdk1.8.0_40jrelibextzipfs.jar;D:Program FilesJavajdk1.8.0_40jrelibjavaws.jar;D:Program FilesJavajdk1.8.0_40jrelibjce.jar;D:Program FilesJavajdk1.8.0_40jrelibjfr.jar;D:Program FilesJavajdk1.8.0_40jrelibjfxswt.jar;D:Program FilesJavajdk1.8.0_40jrelibjsse.jar;D:Program FilesJavajdk1.8.0_40jrelibmanagement-agent.jar;D:Program FilesJavajdk1.8.0_40jrelibplugin.jar;D:Program FilesJavajdk1.8.0_40jrelibresources.jar;D:Program FilesJavajdk1.8.0_40jrelibrt.jar;D:programJavaPogramtargetclasses;C:Usersethan.m2repositorycglibcglib3.2.5cglib-3.2.5.jar;C:Usersethan.m2repositoryorgow2asmasm5.2asm-5.2.jar;C:Usersethan.m2repositoryorgapacheantant1.9.6ant-1.9.6.jar;C:Usersethan.m2repositoryorgapacheantant-launcher1.9.6ant-launcher-1.9.6.jar" multithread.fastfail.FastFailTest ThreadRead读取元素:1, ThreadRead读取元素:2, ThreadRead读取元素:3, ThreadRead读取元素:1, ThreadRead读取元素:2, ThreadRead读取元素:3, ThreadRead读取元素:1, ThreadRead读取元素:2, ThreadRead读取元素:3, ThreadRead读取元素:1, ThreadRead读取元素:2, ThreadRead读取元素:3, ThreadRead读取元素:1, ThreadRead读取元素:2, ThreadRead读取元素:3, ThreadWrite插入元素:10, ThreadRead读取元素:1, ThreadRead读取元素:2, ThreadRead读取元素:3, ThreadRead读取元素:10, ThreadWrite插入元素:11, ThreadRead读取元素:1, ThreadRead读取元素:2, ThreadRead读取元素:3, ThreadRead读取元素:10, ThreadRead读取元素:11, ThreadWrite插入元素:12, ThreadRead读取元素:1, ThreadRead读取元素:2, ThreadRead读取元素:3, ThreadRead读取元素:10, ThreadRead读取元素:11, ThreadRead读取元素:12, ThreadWrite插入元素:13, ThreadRead读取元素:1, ThreadRead读取元素:2, ThreadRead读取元素:3, ThreadRead读取元素:10, ThreadRead读取元素:11, ThreadRead读取元素:12, ThreadRead读取元素:13, ThreadWrite插入元素:14, ThreadRead读取元素:1, ThreadRead读取元素:2, ThreadRead读取元素:3, ThreadRead读取元素:10, ThreadRead读取元素:11, ThreadRead读取元素:12, ThreadRead读取元素:13, ThreadRead读取元素:14, ThreadWrite插入元素:15, ThreadRead读取元素:1, ThreadRead读取元素:2, ThreadRead读取元素:3, ThreadRead读取元素:10, ThreadRead读取元素:11, ThreadRead读取元素:12, ThreadRead读取元素:13, ThreadRead读取元素:14, ThreadRead读取元素:15, ThreadWrite插入元素:16, ThreadRead读取元素:1, ThreadRead读取元素:2, ThreadRead读取元素:3, ThreadRead读取元素:10, ThreadRead读取元素:11, ThreadRead读取元素:12, ThreadRead读取元素:13, ThreadRead读取元素:14, ThreadRead读取元素:15, ThreadRead读取元素:16, ThreadWrite插入元素:17, ThreadRead读取元素:1, ThreadRead读取元素:2, ThreadRead读取元素:3, ThreadRead读取元素:10, ThreadRead读取元素:11, ThreadRead读取元素:12, ThreadRead读取元素:13, ThreadRead读取元素:14, ThreadRead读取元素:15, ThreadRead读取元素:16, ThreadRead读取元素:17, ThreadWrite插入元素:18, ThreadRead读取元素:1, ThreadRead读取元素:2, ThreadRead读取元素:3, ThreadRead读取元素:10, ThreadRead读取元素:11, ThreadRead读取元素:12, ThreadRead读取元素:13, ThreadRead读取元素:14, ThreadRead读取元素:15, ThreadRead读取元素:16, ThreadRead读取元素:17, ThreadRead读取元素:18, ThreadWrite插入元素:19, ThreadRead读取元素:1, ThreadRead读取元素:2, ThreadRead读取元素:3, ThreadRead读取元素:10, ThreadRead读取元素:11, ThreadRead读取元素:12, ThreadRead读取元素:13, ThreadRead读取元素:14, ThreadRead读取元素:15, ThreadRead读取元素:16, ThreadRead读取元素:17, ThreadRead读取元素:18, ThreadRead读取元素:19, ThreadRead读取元素:1, ThreadRead读取元素:2, ThreadRead读取元素:3, ThreadRead读取元素:10, ThreadRead读取元素:11, ThreadRead读取元素:12, ThreadRead读取元素:13, ThreadRead读取元素:14, ThreadRead读取元素:15, ThreadRead读取元素:16, ThreadRead读取元素:17, ThreadRead读取元素:18, ThreadRead读取元素:19, ThreadRead读取元素:1, ThreadRead读取元素:2, ThreadRead读取元素:3, ThreadRead读取元素:10, ThreadRead读取元素:11, ThreadRead读取元素:12, ThreadRead读取元素:13, ThreadRead读取元素:14, ThreadRead读取元素:15, ThreadRead读取元素:16, ThreadRead读取元素:17, ThreadRead读取元素:18, ThreadRead读取元素:19, ThreadRead读取元素:1, ThreadRead读取元素:2, ThreadRead读取元素:3, ThreadRead读取元素:10, ThreadRead读取元素:11, ThreadRead读取元素:12, ThreadRead读取元素:13, ThreadRead读取元素:14, ThreadRead读取元素:15, ThreadRead读取元素:16, ThreadRead读取元素:17, ThreadRead读取元素:18, ThreadRead读取元素:19, ThreadRead读取元素:1, ThreadRead读取元素:2, ThreadRead读取元素:3, ThreadRead读取元素:10, ThreadRead读取元素:11, ThreadRead读取元素:12, ThreadRead读取元素:13, ThreadRead读取元素:14, ThreadRead读取元素:15, ThreadRead读取元素:16, ThreadRead读取元素:17, ThreadRead读取元素:18, ThreadRead读取元素:19, ThreadRead读取元素:1, ThreadRead读取元素:2, ThreadRead读取元素:3, ThreadRead读取元素:10, ThreadRead读取元素:11, ThreadRead读取元素:12, ThreadRead读取元素:13, ThreadRead读取元素:14, ThreadRead读取元素:15, ThreadRead读取元素:16, ThreadRead读取元素:17, ThreadRead读取元素:18, ThreadRead读取元素:19, Process finished with exit code 0
2、CopyOnWriteArrayList避免fail-fast的原理
CopyOnWrite**相关类的实现原理,主要是读写分离,最后把引用指向新容器。读的操作是在原容器中进行,但是改的操作则在内存中新建一个副本并在其上面进行。当完成操作后,会把引用从旧的对象中指向新的容器。
CopyOnWrite类容器,并发读不需要加锁,只有写的时候才会进行加锁,提升了效率。



