May 25 12:10:34.451952 ip-10-0-133-4 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 25 12:10:34.451962 ip-10-0-133-4 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 25 12:10:34.451969 ip-10-0-133-4 systemd[1]: kubelet.service: Failed with result 'resources'. May 25 12:10:34.452366 ip-10-0-133-4 systemd[1]: Failed to start Kubernetes Kubelet. May 25 12:10:44.457043 ip-10-0-133-4 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 25 12:10:44.457066 ip-10-0-133-4 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 360b62969ec741f4af9c2d3d09e44bc5 -- May 25 12:13:09.634263 ip-10-0-133-4 systemd[1]: Starting Kubernetes Kubelet... May 25 12:13:10.138532 ip-10-0-133-4 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 25 12:13:10.138532 ip-10-0-133-4 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 25 12:13:10.138532 ip-10-0-133-4 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 25 12:13:10.138532 ip-10-0-133-4 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 25 12:13:10.138532 ip-10-0-133-4 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 25 12:13:10.140539 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.140413 2569 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 25 12:13:10.147324 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147306 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 12:13:10.147324 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147324 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 12:13:10.147324 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147327 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 12:13:10.147434 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147331 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 12:13:10.147434 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147334 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 12:13:10.147434 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147338 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 12:13:10.147434 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147341 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 12:13:10.147434 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147344 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 12:13:10.147434 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147346 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 12:13:10.147434 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147349 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 12:13:10.147434 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147351 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 12:13:10.147434 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147354 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 12:13:10.147434 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147357 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 12:13:10.147434 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147359 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 12:13:10.147434 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147362 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 12:13:10.147434 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147365 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 12:13:10.147434 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147368 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 12:13:10.147434 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147370 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 12:13:10.147434 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147373 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 12:13:10.147434 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147375 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 12:13:10.147434 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147378 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 12:13:10.147434 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147381 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 12:13:10.147434 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147390 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 12:13:10.147899 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147395 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 12:13:10.147899 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147398 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 12:13:10.147899 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147400 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 12:13:10.147899 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147403 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 12:13:10.147899 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147406 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 12:13:10.147899 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147408 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 12:13:10.147899 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147411 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 12:13:10.147899 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147414 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 12:13:10.147899 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147416 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 12:13:10.147899 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147421 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 12:13:10.147899 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147425 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 12:13:10.147899 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147428 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 12:13:10.147899 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147431 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 12:13:10.147899 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147435 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 12:13:10.147899 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147438 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 12:13:10.147899 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147441 2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 12:13:10.147899 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147444 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 12:13:10.147899 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147447 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 12:13:10.147899 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147450 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 12:13:10.148410 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147453 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 12:13:10.148410 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147455 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 12:13:10.148410 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147459 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 12:13:10.148410 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147463 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 12:13:10.148410 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147465 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 12:13:10.148410 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147468 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 12:13:10.148410 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147471 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 12:13:10.148410 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147474 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 12:13:10.148410 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147476 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 12:13:10.148410 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147479 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 12:13:10.148410 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147481 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 12:13:10.148410 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147484 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 12:13:10.148410 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147487 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 12:13:10.148410 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147489 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 12:13:10.148410 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147492 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 12:13:10.148410 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147494 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 12:13:10.148410 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147497 2569 feature_gate.go:328] unrecognized feature gate: Example May 25 12:13:10.148410 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147499 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 12:13:10.148410 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147501 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 12:13:10.148410 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147504 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 12:13:10.149000 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147507 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 12:13:10.149000 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147509 2569 feature_gate.go:328] unrecognized feature gate: Example2 May 25 12:13:10.149000 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147512 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 12:13:10.149000 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147514 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 12:13:10.149000 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147517 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 12:13:10.149000 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147519 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 12:13:10.149000 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147523 2569 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 12:13:10.149000 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147526 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 12:13:10.149000 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147529 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 12:13:10.149000 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147532 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 12:13:10.149000 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147534 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 12:13:10.149000 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147537 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 12:13:10.149000 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147539 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 12:13:10.149000 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147542 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 12:13:10.149000 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147544 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 12:13:10.149000 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147548 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 12:13:10.149000 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147550 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 12:13:10.149000 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147553 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 12:13:10.149000 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147555 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 12:13:10.149000 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147558 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 12:13:10.149486 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147560 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 12:13:10.149486 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147563 2569 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 12:13:10.149486 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147565 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 12:13:10.149486 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.147568 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 12:13:10.149486 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148003 2569 feature_gate.go:328] unrecognized feature gate: Example2 May 25 12:13:10.149486 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148009 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 12:13:10.149486 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148012 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 12:13:10.149486 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148015 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 12:13:10.149486 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148017 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 12:13:10.149486 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148020 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 12:13:10.149486 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148022 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 12:13:10.149486 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148025 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 12:13:10.149486 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148028 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 12:13:10.149486 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148030 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 12:13:10.149486 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148033 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 12:13:10.149486 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148036 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 12:13:10.149486 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148038 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 12:13:10.149486 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148041 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 12:13:10.149486 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148044 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 12:13:10.149486 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148047 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 12:13:10.149989 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148050 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 12:13:10.149989 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148053 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 12:13:10.149989 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148055 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 12:13:10.149989 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148058 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 12:13:10.149989 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148061 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 12:13:10.149989 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148063 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 12:13:10.149989 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148066 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 12:13:10.149989 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148068 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 12:13:10.149989 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148070 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 12:13:10.149989 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148073 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 12:13:10.149989 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148075 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 12:13:10.149989 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148078 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 12:13:10.149989 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148080 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 12:13:10.149989 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148082 2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 12:13:10.149989 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148085 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 12:13:10.149989 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148087 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 12:13:10.149989 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148090 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 12:13:10.149989 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148092 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 12:13:10.149989 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148095 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 12:13:10.149989 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148097 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 12:13:10.150483 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148099 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 12:13:10.150483 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148102 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 12:13:10.150483 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148104 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 12:13:10.150483 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148106 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 12:13:10.150483 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148109 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 12:13:10.150483 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148111 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 12:13:10.150483 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148114 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 12:13:10.150483 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148116 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 12:13:10.150483 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148118 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 12:13:10.150483 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148121 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 12:13:10.150483 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148125 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 12:13:10.150483 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148128 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 12:13:10.150483 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148130 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 12:13:10.150483 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148135 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 12:13:10.150483 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148138 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 12:13:10.150483 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148141 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 12:13:10.150483 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148144 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 12:13:10.150483 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148147 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 12:13:10.150483 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148149 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 12:13:10.150483 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148152 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 12:13:10.150984 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148154 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 12:13:10.150984 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148156 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 12:13:10.150984 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148159 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 12:13:10.150984 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148161 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 12:13:10.150984 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148164 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 12:13:10.150984 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148166 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 12:13:10.150984 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148168 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 12:13:10.150984 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148171 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 12:13:10.150984 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148173 2569 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 12:13:10.150984 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148175 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 12:13:10.150984 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148178 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 12:13:10.150984 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148181 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 12:13:10.150984 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148186 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 12:13:10.150984 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148188 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 12:13:10.150984 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148191 2569 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 12:13:10.150984 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148193 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 12:13:10.150984 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148195 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 12:13:10.150984 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148198 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 12:13:10.150984 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148200 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 12:13:10.150984 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148203 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 12:13:10.151477 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148205 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 12:13:10.151477 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148207 2569 feature_gate.go:328] unrecognized feature gate: Example May 25 12:13:10.151477 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148211 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 12:13:10.151477 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148214 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 12:13:10.151477 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148216 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 12:13:10.151477 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148220 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 12:13:10.151477 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148224 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 12:13:10.151477 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148227 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 12:13:10.151477 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148230 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 12:13:10.151477 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.148233 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 12:13:10.151477 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149023 2569 flags.go:64] FLAG: --address="0.0.0.0" May 25 12:13:10.151477 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149033 2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 25 12:13:10.151477 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149042 2569 flags.go:64] FLAG: --anonymous-auth="true" May 25 12:13:10.151477 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149047 2569 flags.go:64] FLAG: --application-metrics-count-limit="100" May 25 12:13:10.151477 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149051 2569 flags.go:64] FLAG: --authentication-token-webhook="false" May 25 12:13:10.151477 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149055 2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 25 12:13:10.151477 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149059 2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 25 12:13:10.151477 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149064 2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 25 12:13:10.151477 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149067 2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 25 12:13:10.151477 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149070 2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 25 12:13:10.151477 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149074 2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 25 12:13:10.152003 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149077 2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 25 12:13:10.152003 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149080 2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 25 12:13:10.152003 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149083 2569 flags.go:64] FLAG: --cgroup-root="" May 25 12:13:10.152003 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149086 2569 flags.go:64] FLAG: --cgroups-per-qos="true" May 25 12:13:10.152003 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149089 2569 flags.go:64] FLAG: --client-ca-file="" May 25 12:13:10.152003 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149092 2569 flags.go:64] FLAG: --cloud-config="" May 25 12:13:10.152003 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149095 2569 flags.go:64] FLAG: --cloud-provider="external" May 25 12:13:10.152003 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149098 2569 flags.go:64] FLAG: --cluster-dns="[]" May 25 12:13:10.152003 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149102 2569 flags.go:64] FLAG: --cluster-domain="" May 25 12:13:10.152003 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149104 2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 25 12:13:10.152003 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149107 2569 flags.go:64] FLAG: --config-dir="" May 25 12:13:10.152003 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149110 2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 25 12:13:10.152003 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149113 2569 flags.go:64] FLAG: --container-log-max-files="5" May 25 12:13:10.152003 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149118 2569 flags.go:64] FLAG: --container-log-max-size="10Mi" May 25 12:13:10.152003 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149121 2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 25 12:13:10.152003 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149125 2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 25 12:13:10.152003 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149128 2569 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 25 12:13:10.152003 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149131 2569 flags.go:64] FLAG: --contention-profiling="false" May 25 12:13:10.152003 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149135 2569 flags.go:64] FLAG: --cpu-cfs-quota="true" May 25 12:13:10.152003 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149138 2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 25 12:13:10.152003 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149141 2569 flags.go:64] FLAG: --cpu-manager-policy="none" May 25 12:13:10.152003 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149144 2569 flags.go:64] FLAG: --cpu-manager-policy-options="" May 25 12:13:10.152003 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149149 2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 25 12:13:10.152003 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149152 2569 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 25 12:13:10.152003 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149155 2569 flags.go:64] FLAG: --enable-debugging-handlers="true" May 25 12:13:10.152598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149158 2569 flags.go:64] FLAG: --enable-load-reader="false" May 25 12:13:10.152598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149161 2569 flags.go:64] FLAG: --enable-server="true" May 25 12:13:10.152598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149164 2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 25 12:13:10.152598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149169 2569 flags.go:64] FLAG: --event-burst="100" May 25 12:13:10.152598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149172 2569 flags.go:64] FLAG: --event-qps="50" May 25 12:13:10.152598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149175 2569 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 25 12:13:10.152598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149178 2569 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 25 12:13:10.152598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149182 2569 flags.go:64] FLAG: --eviction-hard="" May 25 12:13:10.152598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149185 2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 25 12:13:10.152598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149188 2569 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 25 12:13:10.152598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149191 2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 25 12:13:10.152598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149194 2569 flags.go:64] FLAG: --eviction-soft="" May 25 12:13:10.152598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149197 2569 flags.go:64] FLAG: --eviction-soft-grace-period="" May 25 12:13:10.152598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149200 2569 flags.go:64] FLAG: --exit-on-lock-contention="false" May 25 12:13:10.152598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149203 2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 25 12:13:10.152598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149206 2569 flags.go:64] FLAG: --experimental-mounter-path="" May 25 12:13:10.152598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149208 2569 flags.go:64] FLAG: --fail-cgroupv1="false" May 25 12:13:10.152598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149211 2569 flags.go:64] FLAG: --fail-swap-on="true" May 25 12:13:10.152598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149214 2569 flags.go:64] FLAG: --feature-gates="" May 25 12:13:10.152598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149218 2569 flags.go:64] FLAG: --file-check-frequency="20s" May 25 12:13:10.152598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149221 2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 25 12:13:10.152598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149225 2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 25 12:13:10.152598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149228 2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 25 12:13:10.152598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149231 2569 flags.go:64] FLAG: --healthz-port="10248" May 25 12:13:10.152598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149234 2569 flags.go:64] FLAG: --help="false" May 25 12:13:10.153689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149237 2569 flags.go:64] FLAG: --hostname-override="ip-10-0-133-4.ec2.internal" May 25 12:13:10.153689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149241 2569 flags.go:64] FLAG: --housekeeping-interval="10s" May 25 12:13:10.153689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149244 2569 flags.go:64] FLAG: --http-check-frequency="20s" May 25 12:13:10.153689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149247 2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 25 12:13:10.153689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149250 2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 25 12:13:10.153689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149254 2569 flags.go:64] FLAG: --image-gc-high-threshold="85" May 25 12:13:10.153689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149256 2569 flags.go:64] FLAG: --image-gc-low-threshold="80" May 25 12:13:10.153689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149259 2569 flags.go:64] FLAG: --image-service-endpoint="" May 25 12:13:10.153689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149262 2569 flags.go:64] FLAG: --kernel-memcg-notification="false" May 25 12:13:10.153689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149265 2569 flags.go:64] FLAG: --kube-api-burst="100" May 25 12:13:10.153689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149267 2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 25 12:13:10.153689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149270 2569 flags.go:64] FLAG: --kube-api-qps="50" May 25 12:13:10.153689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149274 2569 flags.go:64] FLAG: --kube-reserved="" May 25 12:13:10.153689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149277 2569 flags.go:64] FLAG: --kube-reserved-cgroup="" May 25 12:13:10.153689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149280 2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 25 12:13:10.153689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149283 2569 flags.go:64] FLAG: --kubelet-cgroups="" May 25 12:13:10.153689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149285 2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 25 12:13:10.153689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149288 2569 flags.go:64] FLAG: --lock-file="" May 25 12:13:10.153689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149291 2569 flags.go:64] FLAG: --log-cadvisor-usage="false" May 25 12:13:10.153689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149294 2569 flags.go:64] FLAG: --log-flush-frequency="5s" May 25 12:13:10.153689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149297 2569 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 25 12:13:10.153689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149303 2569 flags.go:64] FLAG: --log-json-split-stream="false" May 25 12:13:10.153689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149305 2569 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 25 12:13:10.154362 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149308 2569 flags.go:64] FLAG: --log-text-split-stream="false" May 25 12:13:10.154362 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149311 2569 flags.go:64] FLAG: --logging-format="text" May 25 12:13:10.154362 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149314 2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 25 12:13:10.154362 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149318 2569 flags.go:64] FLAG: --make-iptables-util-chains="true" May 25 12:13:10.154362 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149324 2569 flags.go:64] FLAG: --manifest-url="" May 25 12:13:10.154362 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149327 2569 flags.go:64] FLAG: --manifest-url-header="" May 25 12:13:10.154362 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149335 2569 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 25 12:13:10.154362 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149338 2569 flags.go:64] FLAG: --max-open-files="1000000" May 25 12:13:10.154362 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149342 2569 flags.go:64] FLAG: --max-pods="110" May 25 12:13:10.154362 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149345 2569 flags.go:64] FLAG: --maximum-dead-containers="-1" May 25 12:13:10.154362 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149348 2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 25 12:13:10.154362 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149351 2569 flags.go:64] FLAG: --memory-manager-policy="None" May 25 12:13:10.154362 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149354 2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 25 12:13:10.154362 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149358 2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 25 12:13:10.154362 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149361 2569 flags.go:64] FLAG: --node-ip="0.0.0.0" May 25 12:13:10.154362 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149364 2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 25 12:13:10.154362 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149373 2569 flags.go:64] FLAG: --node-status-max-images="50" May 25 12:13:10.154362 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149376 2569 flags.go:64] FLAG: --node-status-update-frequency="10s" May 25 12:13:10.154362 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149379 2569 flags.go:64] FLAG: --oom-score-adj="-999" May 25 12:13:10.154362 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149382 2569 flags.go:64] FLAG: --pod-cidr="" May 25 12:13:10.154362 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149385 2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 25 12:13:10.154362 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149390 2569 flags.go:64] FLAG: --pod-manifest-path="" May 25 12:13:10.154362 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149394 2569 flags.go:64] FLAG: --pod-max-pids="-1" May 25 12:13:10.154362 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149397 2569 flags.go:64] FLAG: --pods-per-core="0" May 25 12:13:10.155017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149400 2569 flags.go:64] FLAG: --port="10250" May 25 12:13:10.155017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149403 2569 flags.go:64] FLAG: --protect-kernel-defaults="false" May 25 12:13:10.155017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149405 2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-090ff760a8cbfad01" May 25 12:13:10.155017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149408 2569 flags.go:64] FLAG: --qos-reserved="" May 25 12:13:10.155017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149411 2569 flags.go:64] FLAG: --read-only-port="10255" May 25 12:13:10.155017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149414 2569 flags.go:64] FLAG: --register-node="true" May 25 12:13:10.155017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149417 2569 flags.go:64] FLAG: --register-schedulable="true" May 25 12:13:10.155017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149420 2569 flags.go:64] FLAG: --register-with-taints="" May 25 12:13:10.155017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149424 2569 flags.go:64] FLAG: --registry-burst="10" May 25 12:13:10.155017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149426 2569 flags.go:64] FLAG: --registry-qps="5" May 25 12:13:10.155017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149429 2569 flags.go:64] FLAG: --reserved-cpus="" May 25 12:13:10.155017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149432 2569 flags.go:64] FLAG: --reserved-memory="" May 25 12:13:10.155017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149438 2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 25 12:13:10.155017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149442 2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 25 12:13:10.155017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149445 2569 flags.go:64] FLAG: --rotate-certificates="false" May 25 12:13:10.155017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149448 2569 flags.go:64] FLAG: --rotate-server-certificates="false" May 25 12:13:10.155017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149450 2569 flags.go:64] FLAG: --runonce="false" May 25 12:13:10.155017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149454 2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 25 12:13:10.155017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149457 2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 25 12:13:10.155017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149460 2569 flags.go:64] FLAG: --seccomp-default="false" May 25 12:13:10.155017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149463 2569 flags.go:64] FLAG: --serialize-image-pulls="true" May 25 12:13:10.155017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149466 2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 25 12:13:10.155017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149469 2569 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 25 12:13:10.155017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149472 2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 25 12:13:10.155017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149475 2569 flags.go:64] FLAG: --storage-driver-password="root" May 25 12:13:10.155017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149478 2569 flags.go:64] FLAG: --storage-driver-secure="false" May 25 12:13:10.155655 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149481 2569 flags.go:64] FLAG: --storage-driver-table="stats" May 25 12:13:10.155655 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149484 2569 flags.go:64] FLAG: --storage-driver-user="root" May 25 12:13:10.155655 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149486 2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 25 12:13:10.155655 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149490 2569 flags.go:64] FLAG: --sync-frequency="1m0s" May 25 12:13:10.155655 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149492 2569 flags.go:64] FLAG: --system-cgroups="" May 25 12:13:10.155655 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149495 2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 25 12:13:10.155655 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149501 2569 flags.go:64] FLAG: --system-reserved-cgroup="" May 25 12:13:10.155655 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149504 2569 flags.go:64] FLAG: --tls-cert-file="" May 25 12:13:10.155655 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149506 2569 flags.go:64] FLAG: --tls-cipher-suites="[]" May 25 12:13:10.155655 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149510 2569 flags.go:64] FLAG: --tls-min-version="" May 25 12:13:10.155655 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149513 2569 flags.go:64] FLAG: --tls-private-key-file="" May 25 12:13:10.155655 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149516 2569 flags.go:64] FLAG: --topology-manager-policy="none" May 25 12:13:10.155655 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149519 2569 flags.go:64] FLAG: --topology-manager-policy-options="" May 25 12:13:10.155655 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149522 2569 flags.go:64] FLAG: --topology-manager-scope="container" May 25 12:13:10.155655 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149525 2569 flags.go:64] FLAG: --v="2" May 25 12:13:10.155655 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149529 2569 flags.go:64] FLAG: --version="false" May 25 12:13:10.155655 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149533 2569 flags.go:64] FLAG: --vmodule="" May 25 12:13:10.155655 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149537 2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 25 12:13:10.155655 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.149542 2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 25 12:13:10.155655 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149644 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 12:13:10.155655 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149648 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 12:13:10.155655 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149650 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 12:13:10.155655 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149653 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 12:13:10.155655 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149656 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 12:13:10.156332 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149658 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 12:13:10.156332 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149661 2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 12:13:10.156332 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149664 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 12:13:10.156332 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149667 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 12:13:10.156332 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149670 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 12:13:10.156332 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149672 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 12:13:10.156332 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149675 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 12:13:10.156332 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149678 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 12:13:10.156332 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149680 2569 feature_gate.go:328] unrecognized feature gate: Example May 25 12:13:10.156332 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149683 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 12:13:10.156332 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149685 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 12:13:10.156332 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149688 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 12:13:10.156332 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149690 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 12:13:10.156332 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149693 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 12:13:10.156332 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149696 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 12:13:10.156332 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149698 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 12:13:10.156332 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149701 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 12:13:10.156332 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149703 2569 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 12:13:10.156332 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149705 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 12:13:10.156332 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149708 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 12:13:10.156877 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149711 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 12:13:10.156877 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149713 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 12:13:10.156877 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149715 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 12:13:10.156877 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149718 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 12:13:10.156877 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149720 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 12:13:10.156877 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149724 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 12:13:10.156877 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149729 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 12:13:10.156877 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149734 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 12:13:10.156877 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149738 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 12:13:10.156877 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149741 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 12:13:10.156877 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149743 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 12:13:10.156877 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149746 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 12:13:10.156877 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149749 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 12:13:10.156877 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149752 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 12:13:10.156877 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149754 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 12:13:10.156877 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149757 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 12:13:10.156877 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149760 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 12:13:10.156877 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149762 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 12:13:10.156877 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149765 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 12:13:10.157374 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149767 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 12:13:10.157374 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149770 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 12:13:10.157374 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149772 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 12:13:10.157374 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149775 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 12:13:10.157374 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149777 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 12:13:10.157374 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149780 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 12:13:10.157374 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149782 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 12:13:10.157374 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149785 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 12:13:10.157374 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149787 2569 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 12:13:10.157374 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149790 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 12:13:10.157374 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149793 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 12:13:10.157374 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149796 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 12:13:10.157374 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149798 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 12:13:10.157374 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149801 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 12:13:10.157374 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149803 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 12:13:10.157374 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149805 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 12:13:10.157374 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149808 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 12:13:10.157374 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149810 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 12:13:10.157374 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149813 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 12:13:10.157374 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149817 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 12:13:10.157890 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149822 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 12:13:10.157890 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149824 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 12:13:10.157890 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149827 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 12:13:10.157890 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149830 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 12:13:10.157890 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149832 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 12:13:10.157890 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149835 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 12:13:10.157890 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149838 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 12:13:10.157890 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149840 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 12:13:10.157890 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149843 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 12:13:10.157890 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149845 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 12:13:10.157890 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149849 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 12:13:10.157890 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149851 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 12:13:10.157890 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149855 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 12:13:10.157890 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149858 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 12:13:10.157890 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149861 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 12:13:10.157890 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149864 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 12:13:10.157890 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149866 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 12:13:10.157890 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149868 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 12:13:10.157890 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149871 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 12:13:10.158380 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149873 2569 feature_gate.go:328] unrecognized feature gate: Example2 May 25 12:13:10.158380 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149876 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 12:13:10.158380 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.149878 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 12:13:10.158380 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.150713 2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 25 12:13:10.158380 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.157788 2569 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 25 12:13:10.158380 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.157804 2569 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 25 12:13:10.158380 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157853 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 12:13:10.158380 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157858 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 12:13:10.158380 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157861 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 12:13:10.158380 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157864 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 12:13:10.158380 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157867 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 12:13:10.158380 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157869 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 12:13:10.158380 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157872 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 12:13:10.158380 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157874 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 12:13:10.158380 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157876 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 12:13:10.158380 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157879 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 12:13:10.158787 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157882 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 12:13:10.158787 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157884 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 12:13:10.158787 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157887 2569 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 12:13:10.158787 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157890 2569 feature_gate.go:328] unrecognized feature gate: Example May 25 12:13:10.158787 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157892 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 12:13:10.158787 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157895 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 12:13:10.158787 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157897 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 12:13:10.158787 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157901 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 12:13:10.158787 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157904 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 12:13:10.158787 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157907 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 12:13:10.158787 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157909 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 12:13:10.158787 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157911 2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 12:13:10.158787 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157914 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 12:13:10.158787 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157916 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 12:13:10.158787 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157919 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 12:13:10.158787 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157922 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 12:13:10.158787 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157924 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 12:13:10.158787 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157926 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 12:13:10.158787 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157947 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 12:13:10.158787 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157952 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 12:13:10.159292 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157955 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 12:13:10.159292 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157958 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 12:13:10.159292 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157961 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 12:13:10.159292 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157964 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 12:13:10.159292 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157967 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 12:13:10.159292 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157969 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 12:13:10.159292 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157972 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 12:13:10.159292 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157975 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 12:13:10.159292 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157977 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 12:13:10.159292 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157980 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 12:13:10.159292 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157982 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 12:13:10.159292 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157985 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 12:13:10.159292 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157989 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 12:13:10.159292 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157993 2569 feature_gate.go:328] unrecognized feature gate: Example2 May 25 12:13:10.159292 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157996 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 12:13:10.159292 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.157999 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 12:13:10.159292 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158001 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 12:13:10.159292 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158004 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 12:13:10.159292 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158006 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 12:13:10.159758 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158009 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 12:13:10.159758 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158015 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 12:13:10.159758 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158017 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 12:13:10.159758 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158020 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 12:13:10.159758 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158022 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 12:13:10.159758 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158025 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 12:13:10.159758 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158027 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 12:13:10.159758 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158030 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 12:13:10.159758 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158032 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 12:13:10.159758 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158035 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 12:13:10.159758 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158037 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 12:13:10.159758 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158040 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 12:13:10.159758 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158042 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 12:13:10.159758 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158045 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 12:13:10.159758 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158048 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 12:13:10.159758 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158050 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 12:13:10.159758 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158053 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 12:13:10.159758 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158055 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 12:13:10.159758 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158058 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 12:13:10.159758 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158060 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 12:13:10.160269 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158062 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 12:13:10.160269 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158064 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 12:13:10.160269 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158067 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 12:13:10.160269 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158069 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 12:13:10.160269 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158072 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 12:13:10.160269 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158074 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 12:13:10.160269 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158078 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 12:13:10.160269 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158081 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 12:13:10.160269 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158084 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 12:13:10.160269 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158086 2569 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 12:13:10.160269 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158089 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 12:13:10.160269 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158091 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 12:13:10.160269 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158094 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 12:13:10.160269 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158098 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 12:13:10.160269 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158101 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 12:13:10.160269 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158103 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 12:13:10.160269 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158106 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 12:13:10.160685 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.158111 2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 25 12:13:10.160685 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158208 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 12:13:10.160685 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158214 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 12:13:10.160685 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158217 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 12:13:10.160685 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158220 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 12:13:10.160685 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158223 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 12:13:10.160685 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158225 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 12:13:10.160685 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158228 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 12:13:10.160685 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158231 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 12:13:10.160685 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158234 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 12:13:10.160685 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158237 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 12:13:10.160685 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158239 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 12:13:10.160685 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158242 2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 12:13:10.160685 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158245 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 12:13:10.160685 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158247 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 12:13:10.161092 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158250 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 12:13:10.161092 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158252 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 12:13:10.161092 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158255 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 12:13:10.161092 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158258 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 12:13:10.161092 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158260 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 12:13:10.161092 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158262 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 12:13:10.161092 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158265 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 12:13:10.161092 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158267 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 12:13:10.161092 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158270 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 12:13:10.161092 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158272 2569 feature_gate.go:328] unrecognized feature gate: Example2 May 25 12:13:10.161092 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158274 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 12:13:10.161092 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158277 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 12:13:10.161092 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158280 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 12:13:10.161092 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158282 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 12:13:10.161092 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158285 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 12:13:10.161092 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158287 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 12:13:10.161092 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158290 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 12:13:10.161092 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158292 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 12:13:10.161092 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158294 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 12:13:10.161092 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158297 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 12:13:10.161578 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158300 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 12:13:10.161578 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158302 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 12:13:10.161578 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158304 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 12:13:10.161578 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158306 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 12:13:10.161578 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158309 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 12:13:10.161578 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158312 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 12:13:10.161578 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158314 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 12:13:10.161578 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158317 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 12:13:10.161578 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158319 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 12:13:10.161578 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158322 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 12:13:10.161578 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158324 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 12:13:10.161578 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158327 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 12:13:10.161578 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158329 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 12:13:10.161578 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158332 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 12:13:10.161578 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158334 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 12:13:10.161578 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158336 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 12:13:10.161578 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158339 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 12:13:10.161578 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158341 2569 feature_gate.go:328] unrecognized feature gate: Example May 25 12:13:10.161578 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158343 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 12:13:10.161578 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158346 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 12:13:10.162075 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158348 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 12:13:10.162075 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158351 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 12:13:10.162075 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158354 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 12:13:10.162075 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158358 2569 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 12:13:10.162075 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158361 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 12:13:10.162075 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158363 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 12:13:10.162075 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158366 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 12:13:10.162075 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158369 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 12:13:10.162075 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158371 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 12:13:10.162075 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158374 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 12:13:10.162075 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158376 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 12:13:10.162075 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158378 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 12:13:10.162075 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158381 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 12:13:10.162075 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158384 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 12:13:10.162075 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158386 2569 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 12:13:10.162075 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158389 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 12:13:10.162075 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158391 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 12:13:10.162075 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158394 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 12:13:10.162075 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158397 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 12:13:10.162522 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158399 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 12:13:10.162522 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158402 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 12:13:10.162522 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158404 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 12:13:10.162522 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158406 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 12:13:10.162522 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158409 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 12:13:10.162522 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158411 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 12:13:10.162522 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158414 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 12:13:10.162522 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158416 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 12:13:10.162522 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158419 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 12:13:10.162522 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158421 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 12:13:10.162522 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158424 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 12:13:10.162522 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158427 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 12:13:10.162522 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:10.158429 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 12:13:10.162522 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.158434 2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 25 12:13:10.162522 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.159234 2569 server.go:962] "Client rotation is on, will bootstrap in background" May 25 12:13:10.162892 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.161646 2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 25 12:13:10.162892 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.162795 2569 server.go:1019] "Starting client certificate rotation" May 25 12:13:10.162970 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.162893 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 25 12:13:10.162970 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.162945 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 25 12:13:10.194410 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.194393 2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 25 12:13:10.196669 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.196615 2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 25 12:13:10.217638 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.217610 2569 log.go:25] "Validated CRI v1 runtime API" May 25 12:13:10.225712 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.225695 2569 log.go:25] "Validated CRI v1 image API" May 25 12:13:10.227370 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.227355 2569 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 25 12:13:10.231454 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.231426 2569 fs.go:135] Filesystem UUIDs: map[02434a9e-e5c8-42ca-a61e-fdf9dfccb320:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c5c3eb48-df93-445b-9cad-b002a8bcf8e3:/dev/nvme0n1p3] May 25 12:13:10.231503 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.231455 2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 25 12:13:10.236032 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.235888 2569 manager.go:217] Machine: {Timestamp:2026-05-25 12:13:10.23540167 +0000 UTC m=+0.462819338 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096788 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b9aee84ebd9bbe86f9219fb6b4db8 SystemUUID:ec2b9aee-84eb-d9bb-e86f-9219fb6b4db8 BootID:360b6296-9ec7-41f4-af9c-2d3d09e44bc5 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ab:ca:eb:22:87 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ab:ca:eb:22:87 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:a5:54:4e:eb:f7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 25 12:13:10.236724 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.236712 2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 25 12:13:10.236866 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.236852 2569 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 25 12:13:10.237780 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.237764 2569 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 25 12:13:10.239754 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.239724 2569 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 25 12:13:10.239903 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.239757 2569 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-4.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 25 12:13:10.239966 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.239913 2569 topology_manager.go:138] "Creating topology manager with none policy" May 25 12:13:10.239966 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.239921 2569 container_manager_linux.go:306] "Creating device plugin manager" May 25 12:13:10.239966 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.239943 2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 25 12:13:10.241519 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.241507 2569 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 25 12:13:10.242826 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.242816 2569 state_mem.go:36] "Initialized new in-memory state store" May 25 12:13:10.242981 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.242972 2569 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 25 12:13:10.245896 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.245887 2569 kubelet.go:491] "Attempting to sync node with API server" May 25 12:13:10.245951 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.245907 2569 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 25 12:13:10.245984 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.245961 2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 25 12:13:10.245984 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.245973 2569 kubelet.go:397] "Adding apiserver pod source" May 25 12:13:10.245984 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.245983 2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 25 12:13:10.247200 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.247187 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 25 12:13:10.247251 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.247206 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 25 12:13:10.252990 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.252970 2569 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 25 12:13:10.255219 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.255206 2569 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 25 12:13:10.257894 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.257876 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7l6gq" May 25 12:13:10.258682 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.258668 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 25 12:13:10.258742 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.258685 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 25 12:13:10.258742 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.258692 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 25 12:13:10.258742 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.258697 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 25 12:13:10.258742 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.258705 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 25 12:13:10.258742 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.258711 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 25 12:13:10.258742 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.258719 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 25 12:13:10.258742 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.258728 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 25 12:13:10.258742 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.258738 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 25 12:13:10.258968 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.258756 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 25 12:13:10.258968 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.258776 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 25 12:13:10.258968 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.258782 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 25 12:13:10.259056 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:10.258968 2569 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-4.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 25 12:13:10.259056 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:10.258968 2569 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 25 12:13:10.259887 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.259875 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 25 12:13:10.259919 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.259887 2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 25 12:13:10.263033 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.263021 2569 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 25 12:13:10.263074 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.263059 2569 server.go:1295] "Started kubelet" May 25 12:13:10.263194 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.263163 2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 25 12:13:10.263251 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.263163 2569 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 25 12:13:10.263251 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.263227 2569 server_v1.go:47] "podresources" method="list" useActivePods=true May 25 12:13:10.263863 ip-10-0-133-4 systemd[1]: Started Kubernetes Kubelet. May 25 12:13:10.267494 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.267469 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7l6gq" May 25 12:13:10.267494 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.267443 2569 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 25 12:13:10.271193 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.271174 2569 server.go:317] "Adding debug handlers to kubelet server" May 25 12:13:10.273157 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.273136 2569 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-4.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 25 12:13:10.274241 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:10.273253 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-4.ec2.internal.18b2cde5f26a6f3b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-4.ec2.internal,UID:ip-10-0-133-4.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-4.ec2.internal,},FirstTimestamp:2026-05-25 12:13:10.263033659 +0000 UTC m=+0.490451327,LastTimestamp:2026-05-25 12:13:10.263033659 +0000 UTC m=+0.490451327,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-4.ec2.internal,}" May 25 12:13:10.277202 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.277171 2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 25 12:13:10.277202 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:10.277172 2569 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 25 12:13:10.277349 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.277225 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 25 12:13:10.277349 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.277322 2569 volume_manager.go:295] "The desired_state_of_world populator starts" May 25 12:13:10.277349 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.277331 2569 volume_manager.go:297] "Starting Kubelet Volume Manager" May 25 12:13:10.277476 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.277375 2569 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 25 12:13:10.277524 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.277482 2569 reconstruct.go:97] "Volume reconstruction finished" May 25 12:13:10.277524 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.277491 2569 reconciler.go:26] "Reconciler: start to sync state" May 25 12:13:10.278148 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.278089 2569 factory.go:55] Registering systemd factory May 25 12:13:10.278148 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.278147 2569 factory.go:223] Registration of the systemd container factory successfully May 25 12:13:10.278532 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:10.278306 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-4.ec2.internal\" not found" May 25 12:13:10.278674 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.278658 2569 factory.go:153] Registering CRI-O factory May 25 12:13:10.278727 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.278676 2569 factory.go:223] Registration of the crio container factory successfully May 25 12:13:10.278775 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.278737 2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 25 12:13:10.278775 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.278756 2569 factory.go:103] Registering Raw factory May 25 12:13:10.278775 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.278775 2569 manager.go:1196] Started watching for new ooms in manager May 25 12:13:10.279239 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.279226 2569 manager.go:319] Starting recovery of all containers May 25 12:13:10.286235 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.286219 2569 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 25 12:13:10.288859 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.288843 2569 manager.go:324] Recovery completed May 25 12:13:10.290985 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:10.290965 2569 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-4.ec2.internal\" not found" node="ip-10-0-133-4.ec2.internal" May 25 12:13:10.292648 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.292636 2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 12:13:10.294901 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.294885 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientMemory" May 25 12:13:10.295024 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.294912 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasNoDiskPressure" May 25 12:13:10.295024 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.294924 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientPID" May 25 12:13:10.295466 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.295452 2569 cpu_manager.go:222] "Starting CPU manager" policy="none" May 25 12:13:10.295524 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.295464 2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 25 12:13:10.295524 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.295487 2569 state_mem.go:36] "Initialized new in-memory state store" May 25 12:13:10.299048 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.299034 2569 policy_none.go:49] "None policy: Start" May 25 12:13:10.299114 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.299053 2569 memory_manager.go:186] "Starting memorymanager" policy="None" May 25 12:13:10.299114 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.299063 2569 state_mem.go:35] "Initializing new in-memory state store" May 25 12:13:10.333560 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.333533 2569 manager.go:341] "Starting Device Plugin manager" May 25 12:13:10.333700 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:10.333571 2569 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 25 12:13:10.333700 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.333581 2569 server.go:85] "Starting device plugin registration server" May 25 12:13:10.333839 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.333827 2569 eviction_manager.go:189] "Eviction manager: starting control loop" May 25 12:13:10.333882 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.333840 2569 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 25 12:13:10.334032 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.334011 2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 25 12:13:10.334147 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.334121 2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 25 12:13:10.334147 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.334130 2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 25 12:13:10.337129 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:10.336981 2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 25 12:13:10.337129 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:10.337023 2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-4.ec2.internal\" not found" May 25 12:13:10.423319 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.423237 2569 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 25 12:13:10.424746 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.424725 2569 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 25 12:13:10.424825 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.424754 2569 status_manager.go:230] "Starting to sync pod status with apiserver" May 25 12:13:10.424825 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.424775 2569 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 25 12:13:10.424825 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.424782 2569 kubelet.go:2451] "Starting kubelet main sync loop" May 25 12:13:10.424963 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:10.424880 2569 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 25 12:13:10.429052 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.429033 2569 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 25 12:13:10.434900 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.434883 2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 12:13:10.435724 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.435709 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientMemory" May 25 12:13:10.435817 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.435737 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasNoDiskPressure" May 25 12:13:10.435817 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.435749 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientPID" May 25 12:13:10.435817 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.435775 2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-4.ec2.internal" May 25 12:13:10.447078 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.447061 2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-4.ec2.internal" May 25 12:13:10.447147 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:10.447086 2569 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-4.ec2.internal\": node \"ip-10-0-133-4.ec2.internal\" not found" May 25 12:13:10.466850 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:10.466827 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-4.ec2.internal\" not found" May 25 12:13:10.525259 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.525225 2569 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-4.ec2.internal"] May 25 12:13:10.525367 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.525316 2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 12:13:10.526883 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.526862 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientMemory" May 25 12:13:10.526996 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.526896 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasNoDiskPressure" May 25 12:13:10.526996 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.526912 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientPID" May 25 12:13:10.528031 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.528018 2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 12:13:10.528191 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.528177 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal" May 25 12:13:10.528234 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.528206 2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 12:13:10.528799 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.528783 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientMemory" May 25 12:13:10.528901 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.528814 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasNoDiskPressure" May 25 12:13:10.528901 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.528826 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientPID" May 25 12:13:10.528901 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.528783 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientMemory" May 25 12:13:10.528901 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.528883 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasNoDiskPressure" May 25 12:13:10.528901 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.528895 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientPID" May 25 12:13:10.530113 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.530099 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-4.ec2.internal" May 25 12:13:10.530167 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.530126 2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 12:13:10.530814 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.530794 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientMemory" May 25 12:13:10.530895 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.530825 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasNoDiskPressure" May 25 12:13:10.530895 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.530836 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeHasSufficientPID" May 25 12:13:10.552548 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:10.552524 2569 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-4.ec2.internal\" not found" node="ip-10-0-133-4.ec2.internal" May 25 12:13:10.556998 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:10.556982 2569 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-4.ec2.internal\" not found" node="ip-10-0-133-4.ec2.internal" May 25 12:13:10.567333 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:10.567314 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-4.ec2.internal\" not found" May 25 12:13:10.667776 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:10.667739 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-4.ec2.internal\" not found" May 25 12:13:10.679149 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.679093 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d5c02dbdb2a105c5821f47c7fe2bbaa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal\" (UID: \"4d5c02dbdb2a105c5821f47c7fe2bbaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal" May 25 12:13:10.679149 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.679134 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d5c02dbdb2a105c5821f47c7fe2bbaa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal\" (UID: \"4d5c02dbdb2a105c5821f47c7fe2bbaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal" May 25 12:13:10.679260 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.679154 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e779f73ef05ca5fe5885eec9de6ce2f6-config\") pod \"kube-apiserver-proxy-ip-10-0-133-4.ec2.internal\" (UID: \"e779f73ef05ca5fe5885eec9de6ce2f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-4.ec2.internal" May 25 12:13:10.768476 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:10.768440 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-4.ec2.internal\" not found" May 25 12:13:10.779809 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.779780 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e779f73ef05ca5fe5885eec9de6ce2f6-config\") pod \"kube-apiserver-proxy-ip-10-0-133-4.ec2.internal\" (UID: \"e779f73ef05ca5fe5885eec9de6ce2f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-4.ec2.internal" May 25 12:13:10.779876 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.779817 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d5c02dbdb2a105c5821f47c7fe2bbaa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal\" (UID: \"4d5c02dbdb2a105c5821f47c7fe2bbaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal" May 25 12:13:10.779876 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.779837 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d5c02dbdb2a105c5821f47c7fe2bbaa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal\" (UID: \"4d5c02dbdb2a105c5821f47c7fe2bbaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal" May 25 12:13:10.779958 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.779897 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d5c02dbdb2a105c5821f47c7fe2bbaa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal\" (UID: \"4d5c02dbdb2a105c5821f47c7fe2bbaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal" May 25 12:13:10.779958 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.779897 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e779f73ef05ca5fe5885eec9de6ce2f6-config\") pod \"kube-apiserver-proxy-ip-10-0-133-4.ec2.internal\" (UID: \"e779f73ef05ca5fe5885eec9de6ce2f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-4.ec2.internal" May 25 12:13:10.779958 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.779897 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d5c02dbdb2a105c5821f47c7fe2bbaa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal\" (UID: \"4d5c02dbdb2a105c5821f47c7fe2bbaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal" May 25 12:13:10.856000 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.855957 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal" May 25 12:13:10.859535 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:10.859519 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-4.ec2.internal" May 25 12:13:10.869225 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:10.869205 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-4.ec2.internal\" not found" May 25 12:13:10.969845 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:10.969734 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-4.ec2.internal\" not found" May 25 12:13:11.070249 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:11.070215 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-4.ec2.internal\" not found" May 25 12:13:11.162755 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:11.162714 2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 25 12:13:11.163427 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:11.162883 2569 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 25 12:13:11.163427 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:11.162919 2569 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 25 12:13:11.170881 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:11.170856 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-4.ec2.internal\" not found" May 25 12:13:11.271918 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:11.271836 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-4.ec2.internal\" not found" May 25 12:13:11.271918 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:11.271810 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-24 12:08:10 +0000 UTC" deadline="2027-12-08 22:27:34.680859093 +0000 UTC" May 25 12:13:11.271918 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:11.271880 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13498h14m23.408983699s" May 25 12:13:11.277333 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:11.277312 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 25 12:13:11.290478 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:11.290456 2569 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 25 12:13:11.339009 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:11.338967 2569 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 25 12:13:11.369232 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:11.369061 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ksv5k" May 25 12:13:11.372156 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:11.372135 2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-4.ec2.internal\" not found" May 25 12:13:11.379136 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:11.379111 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ksv5k" May 25 12:13:11.455569 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:11.455533 2569 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 25 12:13:11.477852 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:11.477819 2569 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal" May 25 12:13:11.490265 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:11.490219 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d5c02dbdb2a105c5821f47c7fe2bbaa.slice/crio-89347933842cff4438ab43d1dce7c3bc058f592694ca7042b3c70d50c054d6db WatchSource:0}: Error finding container 89347933842cff4438ab43d1dce7c3bc058f592694ca7042b3c70d50c054d6db: Status 404 returned error can't find the container with id 89347933842cff4438ab43d1dce7c3bc058f592694ca7042b3c70d50c054d6db May 25 12:13:11.490547 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:11.490527 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode779f73ef05ca5fe5885eec9de6ce2f6.slice/crio-d4a69e83cec555a0b677cb8e24ab6be96b4d52ca4a1f10a0036169a9a2b9e799 WatchSource:0}: Error finding container d4a69e83cec555a0b677cb8e24ab6be96b4d52ca4a1f10a0036169a9a2b9e799: Status 404 returned error can't find the container with id d4a69e83cec555a0b677cb8e24ab6be96b4d52ca4a1f10a0036169a9a2b9e799 May 25 12:13:11.492221 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:11.492203 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 25 12:13:11.493445 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:11.493426 2569 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-4.ec2.internal" May 25 12:13:11.494060 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:11.494035 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 25 12:13:11.502627 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:11.502609 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 25 12:13:12.143758 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.143724 2569 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 25 12:13:12.247336 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.247303 2569 apiserver.go:52] "Watching apiserver" May 25 12:13:12.256845 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.256804 2569 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 25 12:13:12.258721 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.258327 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-2fsnt","kube-system/kube-apiserver-proxy-ip-10-0-133-4.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j","openshift-cluster-node-tuning-operator/tuned-8mgh5","openshift-dns/node-resolver-mjhc6","openshift-image-registry/node-ca-h6vr7","openshift-multus/multus-n66nj","openshift-network-diagnostics/network-check-target-mldgv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal","openshift-multus/multus-additional-cni-plugins-wjdzw","openshift-multus/network-metrics-daemon-xwk2x","openshift-network-operator/iptables-alerter-gp884","openshift-ovn-kubernetes/ovnkube-node-z8r9j"] May 25 12:13:12.261171 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.261147 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n66nj" May 25 12:13:12.263864 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.263840 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 25 12:13:12.263864 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.263852 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 25 12:13:12.263864 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.263850 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 25 12:13:12.264120 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.264004 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jfqq7\"" May 25 12:13:12.264120 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.264032 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 25 12:13:12.266064 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.265581 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" May 25 12:13:12.267111 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.267093 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 25 12:13:12.267509 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.267490 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 25 12:13:12.267599 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.267570 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mllxb\"" May 25 12:13:12.267731 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.267698 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 25 12:13:12.269742 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.269724 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.271316 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.271295 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 25 12:13:12.271651 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.271636 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gxcf7\"" May 25 12:13:12.271810 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.271797 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 25 12:13:12.272013 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.271999 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mjhc6" May 25 12:13:12.273573 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.273555 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 25 12:13:12.273665 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.273656 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2t6cp\"" May 25 12:13:12.273849 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.273832 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 25 12:13:12.274957 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.274803 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h6vr7" May 25 12:13:12.277505 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.277478 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 25 12:13:12.277505 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.277502 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 25 12:13:12.277658 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.277583 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-l54fv\"" May 25 12:13:12.277714 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.277505 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 25 12:13:12.277807 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.277788 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2fsnt" May 25 12:13:12.279677 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.279623 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 25 12:13:12.279677 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.279654 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l9nx4\"" May 25 12:13:12.279857 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.279841 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 25 12:13:12.280178 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.280160 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:13:12.280287 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:12.280225 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldgv" podUID="4709a8d8-46d8-4e6d-8e53-17021b442cc8" May 25 12:13:12.280350 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.280324 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wjdzw" May 25 12:13:12.282211 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.282083 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 25 12:13:12.282316 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.282263 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 25 12:13:12.282477 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.282460 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hqs9h\"" May 25 12:13:12.282563 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.282546 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:12.282635 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:12.282613 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwk2x" podUID="cfe666ec-6ce2-4bfe-9149-8b8a058cd681" May 25 12:13:12.285676 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.285652 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gp884" May 25 12:13:12.287720 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.287699 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.288588 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.288566 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 25 12:13:12.288720 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.288704 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 25 12:13:12.289124 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.289106 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 25 12:13:12.289270 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.289254 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 25 12:13:12.289372 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.289356 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rgsg9\"" May 25 12:13:12.289730 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.289713 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 25 12:13:12.290011 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.289895 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-host-run-multus-certs\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.290102 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.290059 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1954d0fa-a186-4c14-975b-3de4de24bac3-konnectivity-ca\") pod \"konnectivity-agent-2fsnt\" (UID: \"1954d0fa-a186-4c14-975b-3de4de24bac3\") " pod="kube-system/konnectivity-agent-2fsnt" May 25 12:13:12.290160 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.290097 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e5130231-8dd8-4aa5-8f05-6768b03404bf-cni-binary-copy\") pod \"multus-additional-cni-plugins-wjdzw\" (UID: \"e5130231-8dd8-4aa5-8f05-6768b03404bf\") " pod="openshift-multus/multus-additional-cni-plugins-wjdzw" May 25 12:13:12.290160 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.290132 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-cnibin\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.290256 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.290166 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-multus-conf-dir\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.290256 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.290203 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-etc-sysconfig\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.290256 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.290236 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e5130231-8dd8-4aa5-8f05-6768b03404bf-cnibin\") pod \"multus-additional-cni-plugins-wjdzw\" (UID: \"e5130231-8dd8-4aa5-8f05-6768b03404bf\") " pod="openshift-multus/multus-additional-cni-plugins-wjdzw" May 25 12:13:12.290256 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.290246 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 25 12:13:12.290446 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.290267 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-host-run-netns\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.290446 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.290295 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf27j\" (UniqueName: \"kubernetes.io/projected/09ceb244-50a8-477e-8f70-dfa7ab73b894-kube-api-access-lf27j\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.290446 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.290333 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-etc-systemd\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.290446 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.290369 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/343fb19d-f18b-4f2c-9bc7-7810b24743d8-hosts-file\") pod \"node-resolver-mjhc6\" (UID: \"343fb19d-f18b-4f2c-9bc7-7810b24743d8\") " pod="openshift-dns/node-resolver-mjhc6" May 25 12:13:12.290446 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.290401 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-host-var-lib-kubelet\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.290446 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.290431 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-hostroot\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.290712 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.290457 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrrkx\" (UniqueName: \"kubernetes.io/projected/343fb19d-f18b-4f2c-9bc7-7810b24743d8-kube-api-access-qrrkx\") pod \"node-resolver-mjhc6\" (UID: \"343fb19d-f18b-4f2c-9bc7-7810b24743d8\") " pod="openshift-dns/node-resolver-mjhc6" May 25 12:13:12.290712 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.290464 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 25 12:13:12.290712 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.290490 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ee78a86-cc33-496d-a4cf-9c1e6de70f6f-host\") pod \"node-ca-h6vr7\" (UID: \"0ee78a86-cc33-496d-a4cf-9c1e6de70f6f\") " pod="openshift-image-registry/node-ca-h6vr7" May 25 12:13:12.290712 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.290522 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/09ceb244-50a8-477e-8f70-dfa7ab73b894-multus-daemon-config\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.290712 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.290553 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/163fbbca-62cd-46c2-9e52-08212856fcf7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lm24j\" (UID: \"163fbbca-62cd-46c2-9e52-08212856fcf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" May 25 12:13:12.290712 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.290588 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-lib-modules\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.290712 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.290626 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4ksk\" (UniqueName: \"kubernetes.io/projected/e5130231-8dd8-4aa5-8f05-6768b03404bf-kube-api-access-d4ksk\") pod \"multus-additional-cni-plugins-wjdzw\" (UID: \"e5130231-8dd8-4aa5-8f05-6768b03404bf\") " pod="openshift-multus/multus-additional-cni-plugins-wjdzw" May 25 12:13:12.290712 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.290654 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-system-cni-dir\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.290712 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.290698 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05328a04-43ba-472e-aa2b-47a64884c691-tmp\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.291131 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.290745 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e5130231-8dd8-4aa5-8f05-6768b03404bf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wjdzw\" (UID: \"e5130231-8dd8-4aa5-8f05-6768b03404bf\") " pod="openshift-multus/multus-additional-cni-plugins-wjdzw" May 25 12:13:12.291131 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.290899 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-run\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.291131 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.290956 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-var-lib-kubelet\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.291131 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.291000 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-host\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.291131 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.291094 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74zjf\" (UniqueName: \"kubernetes.io/projected/0ee78a86-cc33-496d-a4cf-9c1e6de70f6f-kube-api-access-74zjf\") pod \"node-ca-h6vr7\" (UID: \"0ee78a86-cc33-496d-a4cf-9c1e6de70f6f\") " pod="openshift-image-registry/node-ca-h6vr7" May 25 12:13:12.291349 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.291178 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e5130231-8dd8-4aa5-8f05-6768b03404bf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wjdzw\" (UID: \"e5130231-8dd8-4aa5-8f05-6768b03404bf\") " pod="openshift-multus/multus-additional-cni-plugins-wjdzw" May 25 12:13:12.291349 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.291262 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-host-var-lib-cni-bin\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.291349 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.291299 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-etc-modprobe-d\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.291349 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.291335 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 25 12:13:12.291534 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.291343 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-sys\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.291534 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.291351 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-j48lg\"" May 25 12:13:12.291534 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.291392 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/343fb19d-f18b-4f2c-9bc7-7810b24743d8-tmp-dir\") pod \"node-resolver-mjhc6\" (UID: \"343fb19d-f18b-4f2c-9bc7-7810b24743d8\") " pod="openshift-dns/node-resolver-mjhc6" May 25 12:13:12.291534 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.291419 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e5130231-8dd8-4aa5-8f05-6768b03404bf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wjdzw\" (UID: \"e5130231-8dd8-4aa5-8f05-6768b03404bf\") " pod="openshift-multus/multus-additional-cni-plugins-wjdzw" May 25 12:13:12.291716 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.291545 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 25 12:13:12.291716 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.291592 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/163fbbca-62cd-46c2-9e52-08212856fcf7-device-dir\") pod \"aws-ebs-csi-driver-node-lm24j\" (UID: \"163fbbca-62cd-46c2-9e52-08212856fcf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" May 25 12:13:12.291716 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.291631 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/163fbbca-62cd-46c2-9e52-08212856fcf7-etc-selinux\") pod \"aws-ebs-csi-driver-node-lm24j\" (UID: \"163fbbca-62cd-46c2-9e52-08212856fcf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" May 25 12:13:12.291716 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.291664 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09ceb244-50a8-477e-8f70-dfa7ab73b894-cni-binary-copy\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.291716 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.291696 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/163fbbca-62cd-46c2-9e52-08212856fcf7-sys-fs\") pod \"aws-ebs-csi-driver-node-lm24j\" (UID: \"163fbbca-62cd-46c2-9e52-08212856fcf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" May 25 12:13:12.291974 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.291728 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwcr9\" (UniqueName: \"kubernetes.io/projected/163fbbca-62cd-46c2-9e52-08212856fcf7-kube-api-access-rwcr9\") pod \"aws-ebs-csi-driver-node-lm24j\" (UID: \"163fbbca-62cd-46c2-9e52-08212856fcf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" May 25 12:13:12.291974 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.291782 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/05328a04-43ba-472e-aa2b-47a64884c691-etc-tuned\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.291974 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.291817 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgc84\" (UniqueName: \"kubernetes.io/projected/4709a8d8-46d8-4e6d-8e53-17021b442cc8-kube-api-access-jgc84\") pod \"network-check-target-mldgv\" (UID: \"4709a8d8-46d8-4e6d-8e53-17021b442cc8\") " pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:13:12.291974 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.291863 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-etc-kubernetes\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.291974 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.291918 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/163fbbca-62cd-46c2-9e52-08212856fcf7-socket-dir\") pod \"aws-ebs-csi-driver-node-lm24j\" (UID: \"163fbbca-62cd-46c2-9e52-08212856fcf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" May 25 12:13:12.291974 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.291969 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-etc-sysctl-d\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.292178 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.292022 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1954d0fa-a186-4c14-975b-3de4de24bac3-agent-certs\") pod \"konnectivity-agent-2fsnt\" (UID: \"1954d0fa-a186-4c14-975b-3de4de24bac3\") " pod="kube-system/konnectivity-agent-2fsnt" May 25 12:13:12.292178 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.292052 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0ee78a86-cc33-496d-a4cf-9c1e6de70f6f-serviceca\") pod \"node-ca-h6vr7\" (UID: \"0ee78a86-cc33-496d-a4cf-9c1e6de70f6f\") " pod="openshift-image-registry/node-ca-h6vr7" May 25 12:13:12.292178 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.292080 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e5130231-8dd8-4aa5-8f05-6768b03404bf-os-release\") pod \"multus-additional-cni-plugins-wjdzw\" (UID: \"e5130231-8dd8-4aa5-8f05-6768b03404bf\") " pod="openshift-multus/multus-additional-cni-plugins-wjdzw" May 25 12:13:12.292178 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.292112 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-multus-cni-dir\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.292298 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.292173 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-host-var-lib-cni-multus\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.292298 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.292206 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-etc-sysctl-conf\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.292298 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.292229 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxrk9\" (UniqueName: \"kubernetes.io/projected/05328a04-43ba-472e-aa2b-47a64884c691-kube-api-access-fxrk9\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.292298 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.292248 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5130231-8dd8-4aa5-8f05-6768b03404bf-system-cni-dir\") pod \"multus-additional-cni-plugins-wjdzw\" (UID: \"e5130231-8dd8-4aa5-8f05-6768b03404bf\") " pod="openshift-multus/multus-additional-cni-plugins-wjdzw" May 25 12:13:12.292298 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.292268 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/163fbbca-62cd-46c2-9e52-08212856fcf7-registration-dir\") pod \"aws-ebs-csi-driver-node-lm24j\" (UID: \"163fbbca-62cd-46c2-9e52-08212856fcf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" May 25 12:13:12.292433 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.292311 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-etc-kubernetes\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.292433 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.292340 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-os-release\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.292433 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.292363 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-multus-socket-dir-parent\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.292433 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.292381 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-host-run-k8s-cni-cncf-io\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.379137 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.379103 2569 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 25 12:13:12.380536 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.380496 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 12:08:11 +0000 UTC" deadline="2027-10-30 22:55:07.875232402 +0000 UTC" May 25 12:13:12.380536 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.380530 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12562h41m55.494704944s" May 25 12:13:12.393480 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.393448 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/343fb19d-f18b-4f2c-9bc7-7810b24743d8-hosts-file\") pod \"node-resolver-mjhc6\" (UID: \"343fb19d-f18b-4f2c-9bc7-7810b24743d8\") " pod="openshift-dns/node-resolver-mjhc6" May 25 12:13:12.393633 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.393487 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-host-var-lib-kubelet\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.393633 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.393519 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-hostroot\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.393633 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.393571 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-hostroot\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.393633 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.393571 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-host-var-lib-kubelet\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.393633 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.393593 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-host-run-netns\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.393633 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.393622 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/343fb19d-f18b-4f2c-9bc7-7810b24743d8-hosts-file\") pod \"node-resolver-mjhc6\" (UID: \"343fb19d-f18b-4f2c-9bc7-7810b24743d8\") " pod="openshift-dns/node-resolver-mjhc6" May 25 12:13:12.393924 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.393627 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-env-overrides\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.393924 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.393674 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qrrkx\" (UniqueName: \"kubernetes.io/projected/343fb19d-f18b-4f2c-9bc7-7810b24743d8-kube-api-access-qrrkx\") pod \"node-resolver-mjhc6\" (UID: \"343fb19d-f18b-4f2c-9bc7-7810b24743d8\") " pod="openshift-dns/node-resolver-mjhc6" May 25 12:13:12.393924 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.393709 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ee78a86-cc33-496d-a4cf-9c1e6de70f6f-host\") pod \"node-ca-h6vr7\" (UID: \"0ee78a86-cc33-496d-a4cf-9c1e6de70f6f\") " pod="openshift-image-registry/node-ca-h6vr7" May 25 12:13:12.393924 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.393738 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/09ceb244-50a8-477e-8f70-dfa7ab73b894-multus-daemon-config\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.393924 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.393760 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/163fbbca-62cd-46c2-9e52-08212856fcf7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lm24j\" (UID: \"163fbbca-62cd-46c2-9e52-08212856fcf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" May 25 12:13:12.393924 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.393783 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-lib-modules\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.393924 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.393813 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf8qp\" (UniqueName: \"kubernetes.io/projected/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-kube-api-access-nf8qp\") pod \"network-metrics-daemon-xwk2x\" (UID: \"cfe666ec-6ce2-4bfe-9149-8b8a058cd681\") " pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:12.393924 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.393827 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ee78a86-cc33-496d-a4cf-9c1e6de70f6f-host\") pod \"node-ca-h6vr7\" (UID: \"0ee78a86-cc33-496d-a4cf-9c1e6de70f6f\") " pod="openshift-image-registry/node-ca-h6vr7" May 25 12:13:12.393924 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.393839 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-host-cni-netd\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.393924 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.393875 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/163fbbca-62cd-46c2-9e52-08212856fcf7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lm24j\" (UID: \"163fbbca-62cd-46c2-9e52-08212856fcf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" May 25 12:13:12.393924 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.393878 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-ovn-node-metrics-cert\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.394439 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.393951 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d4ksk\" (UniqueName: \"kubernetes.io/projected/e5130231-8dd8-4aa5-8f05-6768b03404bf-kube-api-access-d4ksk\") pod \"multus-additional-cni-plugins-wjdzw\" (UID: \"e5130231-8dd8-4aa5-8f05-6768b03404bf\") " pod="openshift-multus/multus-additional-cni-plugins-wjdzw" May 25 12:13:12.394439 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.393983 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-system-cni-dir\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.394439 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394007 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05328a04-43ba-472e-aa2b-47a64884c691-tmp\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.394439 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.393953 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-lib-modules\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.394439 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394081 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-system-cni-dir\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.394439 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394123 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9121ba37-984d-4b12-992f-5ab12f57c886-iptables-alerter-script\") pod \"iptables-alerter-gp884\" (UID: \"9121ba37-984d-4b12-992f-5ab12f57c886\") " pod="openshift-network-operator/iptables-alerter-gp884" May 25 12:13:12.394439 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394156 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-systemd-units\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.394439 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394181 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-run-systemd\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.394439 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394208 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-log-socket\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.394439 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394232 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-ovnkube-config\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.394439 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394272 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e5130231-8dd8-4aa5-8f05-6768b03404bf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wjdzw\" (UID: \"e5130231-8dd8-4aa5-8f05-6768b03404bf\") " pod="openshift-multus/multus-additional-cni-plugins-wjdzw" May 25 12:13:12.394439 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394309 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-run\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.394439 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394333 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-var-lib-kubelet\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.394439 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394336 2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 25 12:13:12.394439 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394357 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-host\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.394439 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394382 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-etc-openvswitch\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.394439 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394415 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs\") pod \"network-metrics-daemon-xwk2x\" (UID: \"cfe666ec-6ce2-4bfe-9149-8b8a058cd681\") " pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:12.395271 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394440 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-host-run-ovn-kubernetes\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.395271 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394467 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-74zjf\" (UniqueName: \"kubernetes.io/projected/0ee78a86-cc33-496d-a4cf-9c1e6de70f6f-kube-api-access-74zjf\") pod \"node-ca-h6vr7\" (UID: \"0ee78a86-cc33-496d-a4cf-9c1e6de70f6f\") " pod="openshift-image-registry/node-ca-h6vr7" May 25 12:13:12.395271 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394515 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e5130231-8dd8-4aa5-8f05-6768b03404bf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wjdzw\" (UID: \"e5130231-8dd8-4aa5-8f05-6768b03404bf\") " pod="openshift-multus/multus-additional-cni-plugins-wjdzw" May 25 12:13:12.395271 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394543 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj2l6\" (UniqueName: \"kubernetes.io/projected/9121ba37-984d-4b12-992f-5ab12f57c886-kube-api-access-lj2l6\") pod \"iptables-alerter-gp884\" (UID: \"9121ba37-984d-4b12-992f-5ab12f57c886\") " pod="openshift-network-operator/iptables-alerter-gp884" May 25 12:13:12.395271 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394574 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-host-var-lib-cni-bin\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.395271 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394585 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/09ceb244-50a8-477e-8f70-dfa7ab73b894-multus-daemon-config\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.395271 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394600 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-etc-modprobe-d\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.395271 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394614 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-run\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.395271 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394622 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-sys\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.395271 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394744 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-etc-modprobe-d\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.395271 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394773 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e5130231-8dd8-4aa5-8f05-6768b03404bf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wjdzw\" (UID: \"e5130231-8dd8-4aa5-8f05-6768b03404bf\") " pod="openshift-multus/multus-additional-cni-plugins-wjdzw" May 25 12:13:12.395271 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394795 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-var-lib-kubelet\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.395271 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394853 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-host\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.395271 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394885 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-host-var-lib-cni-bin\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.395271 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.394909 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/343fb19d-f18b-4f2c-9bc7-7810b24743d8-tmp-dir\") pod \"node-resolver-mjhc6\" (UID: \"343fb19d-f18b-4f2c-9bc7-7810b24743d8\") " pod="openshift-dns/node-resolver-mjhc6" May 25 12:13:12.395271 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.395135 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e5130231-8dd8-4aa5-8f05-6768b03404bf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wjdzw\" (UID: \"e5130231-8dd8-4aa5-8f05-6768b03404bf\") " pod="openshift-multus/multus-additional-cni-plugins-wjdzw" May 25 12:13:12.395271 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.395185 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/343fb19d-f18b-4f2c-9bc7-7810b24743d8-tmp-dir\") pod \"node-resolver-mjhc6\" (UID: \"343fb19d-f18b-4f2c-9bc7-7810b24743d8\") " pod="openshift-dns/node-resolver-mjhc6" May 25 12:13:12.396065 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.395251 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-sys\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.396065 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.395277 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e5130231-8dd8-4aa5-8f05-6768b03404bf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wjdzw\" (UID: \"e5130231-8dd8-4aa5-8f05-6768b03404bf\") " pod="openshift-multus/multus-additional-cni-plugins-wjdzw" May 25 12:13:12.396065 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.395304 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/163fbbca-62cd-46c2-9e52-08212856fcf7-device-dir\") pod \"aws-ebs-csi-driver-node-lm24j\" (UID: \"163fbbca-62cd-46c2-9e52-08212856fcf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" May 25 12:13:12.396065 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.395334 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/163fbbca-62cd-46c2-9e52-08212856fcf7-etc-selinux\") pod \"aws-ebs-csi-driver-node-lm24j\" (UID: \"163fbbca-62cd-46c2-9e52-08212856fcf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" May 25 12:13:12.396065 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.395351 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-var-lib-openvswitch\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.396065 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.395399 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-run-ovn\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.396065 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.395414 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-node-log\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.396065 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.395431 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09ceb244-50a8-477e-8f70-dfa7ab73b894-cni-binary-copy\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.396065 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.395447 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e5130231-8dd8-4aa5-8f05-6768b03404bf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wjdzw\" (UID: \"e5130231-8dd8-4aa5-8f05-6768b03404bf\") " pod="openshift-multus/multus-additional-cni-plugins-wjdzw" May 25 12:13:12.396065 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.395450 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/163fbbca-62cd-46c2-9e52-08212856fcf7-sys-fs\") pod \"aws-ebs-csi-driver-node-lm24j\" (UID: \"163fbbca-62cd-46c2-9e52-08212856fcf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" May 25 12:13:12.396065 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.395487 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwcr9\" (UniqueName: \"kubernetes.io/projected/163fbbca-62cd-46c2-9e52-08212856fcf7-kube-api-access-rwcr9\") pod \"aws-ebs-csi-driver-node-lm24j\" (UID: \"163fbbca-62cd-46c2-9e52-08212856fcf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" May 25 12:13:12.396065 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.395496 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/163fbbca-62cd-46c2-9e52-08212856fcf7-sys-fs\") pod \"aws-ebs-csi-driver-node-lm24j\" (UID: \"163fbbca-62cd-46c2-9e52-08212856fcf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" May 25 12:13:12.396065 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.395505 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/05328a04-43ba-472e-aa2b-47a64884c691-etc-tuned\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.396065 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.395535 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6zqp\" (UniqueName: \"kubernetes.io/projected/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-kube-api-access-c6zqp\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.396065 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.395564 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgc84\" (UniqueName: \"kubernetes.io/projected/4709a8d8-46d8-4e6d-8e53-17021b442cc8-kube-api-access-jgc84\") pod \"network-check-target-mldgv\" (UID: \"4709a8d8-46d8-4e6d-8e53-17021b442cc8\") " pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:13:12.396065 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.395579 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/163fbbca-62cd-46c2-9e52-08212856fcf7-etc-selinux\") pod \"aws-ebs-csi-driver-node-lm24j\" (UID: \"163fbbca-62cd-46c2-9e52-08212856fcf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" May 25 12:13:12.396065 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.395616 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-etc-kubernetes\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.396671 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.395848 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/163fbbca-62cd-46c2-9e52-08212856fcf7-device-dir\") pod \"aws-ebs-csi-driver-node-lm24j\" (UID: \"163fbbca-62cd-46c2-9e52-08212856fcf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" May 25 12:13:12.396671 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.395585 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-etc-kubernetes\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.396671 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.395890 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/163fbbca-62cd-46c2-9e52-08212856fcf7-socket-dir\") pod \"aws-ebs-csi-driver-node-lm24j\" (UID: \"163fbbca-62cd-46c2-9e52-08212856fcf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" May 25 12:13:12.396671 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.395920 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-etc-sysctl-d\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.396671 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.395968 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1954d0fa-a186-4c14-975b-3de4de24bac3-agent-certs\") pod \"konnectivity-agent-2fsnt\" (UID: \"1954d0fa-a186-4c14-975b-3de4de24bac3\") " pod="kube-system/konnectivity-agent-2fsnt" May 25 12:13:12.396671 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.395999 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-host-cni-bin\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.396671 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396025 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0ee78a86-cc33-496d-a4cf-9c1e6de70f6f-serviceca\") pod \"node-ca-h6vr7\" (UID: \"0ee78a86-cc33-496d-a4cf-9c1e6de70f6f\") " pod="openshift-image-registry/node-ca-h6vr7" May 25 12:13:12.396671 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396027 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/163fbbca-62cd-46c2-9e52-08212856fcf7-socket-dir\") pod \"aws-ebs-csi-driver-node-lm24j\" (UID: \"163fbbca-62cd-46c2-9e52-08212856fcf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" May 25 12:13:12.396671 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396051 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e5130231-8dd8-4aa5-8f05-6768b03404bf-os-release\") pod \"multus-additional-cni-plugins-wjdzw\" (UID: \"e5130231-8dd8-4aa5-8f05-6768b03404bf\") " pod="openshift-multus/multus-additional-cni-plugins-wjdzw" May 25 12:13:12.396671 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396077 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-multus-cni-dir\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.396671 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396081 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09ceb244-50a8-477e-8f70-dfa7ab73b894-cni-binary-copy\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.396671 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396103 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-host-var-lib-cni-multus\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.396671 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396148 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-etc-sysctl-conf\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.396671 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396168 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxrk9\" (UniqueName: \"kubernetes.io/projected/05328a04-43ba-472e-aa2b-47a64884c691-kube-api-access-fxrk9\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.396671 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396197 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-host-kubelet\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.396671 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396221 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-ovnkube-script-lib\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.396671 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396227 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-etc-sysctl-d\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.397255 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396276 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-host-var-lib-cni-multus\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.397255 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396349 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-etc-sysctl-conf\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.397255 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396442 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5130231-8dd8-4aa5-8f05-6768b03404bf-system-cni-dir\") pod \"multus-additional-cni-plugins-wjdzw\" (UID: \"e5130231-8dd8-4aa5-8f05-6768b03404bf\") " pod="openshift-multus/multus-additional-cni-plugins-wjdzw" May 25 12:13:12.397255 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396480 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/163fbbca-62cd-46c2-9e52-08212856fcf7-registration-dir\") pod \"aws-ebs-csi-driver-node-lm24j\" (UID: \"163fbbca-62cd-46c2-9e52-08212856fcf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" May 25 12:13:12.397255 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396507 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-etc-kubernetes\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.397255 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396538 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-run-openvswitch\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.397255 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396570 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-os-release\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.397255 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396597 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-multus-socket-dir-parent\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.397255 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396624 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-host-run-k8s-cni-cncf-io\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.397255 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396651 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-host-run-multus-certs\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.397255 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396657 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0ee78a86-cc33-496d-a4cf-9c1e6de70f6f-serviceca\") pod \"node-ca-h6vr7\" (UID: \"0ee78a86-cc33-496d-a4cf-9c1e6de70f6f\") " pod="openshift-image-registry/node-ca-h6vr7" May 25 12:13:12.397255 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396676 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1954d0fa-a186-4c14-975b-3de4de24bac3-konnectivity-ca\") pod \"konnectivity-agent-2fsnt\" (UID: \"1954d0fa-a186-4c14-975b-3de4de24bac3\") " pod="kube-system/konnectivity-agent-2fsnt" May 25 12:13:12.397255 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396703 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-host-slash\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.397255 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396714 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/163fbbca-62cd-46c2-9e52-08212856fcf7-registration-dir\") pod \"aws-ebs-csi-driver-node-lm24j\" (UID: \"163fbbca-62cd-46c2-9e52-08212856fcf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" May 25 12:13:12.397255 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396724 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e5130231-8dd8-4aa5-8f05-6768b03404bf-os-release\") pod \"multus-additional-cni-plugins-wjdzw\" (UID: \"e5130231-8dd8-4aa5-8f05-6768b03404bf\") " pod="openshift-multus/multus-additional-cni-plugins-wjdzw" May 25 12:13:12.397255 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396732 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e5130231-8dd8-4aa5-8f05-6768b03404bf-cni-binary-copy\") pod \"multus-additional-cni-plugins-wjdzw\" (UID: \"e5130231-8dd8-4aa5-8f05-6768b03404bf\") " pod="openshift-multus/multus-additional-cni-plugins-wjdzw" May 25 12:13:12.397255 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396784 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-multus-socket-dir-parent\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.398014 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396796 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-cnibin\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.398014 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396824 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-multus-conf-dir\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.398014 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396829 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-etc-kubernetes\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.398014 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396850 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-etc-sysconfig\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.398014 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396879 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e5130231-8dd8-4aa5-8f05-6768b03404bf-cnibin\") pod \"multus-additional-cni-plugins-wjdzw\" (UID: \"e5130231-8dd8-4aa5-8f05-6768b03404bf\") " pod="openshift-multus/multus-additional-cni-plugins-wjdzw" May 25 12:13:12.398014 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396885 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-os-release\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.398014 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396905 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-host-run-netns\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.398014 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396984 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-etc-sysconfig\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.398014 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.397018 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-host-run-k8s-cni-cncf-io\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.398014 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.397024 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-host-run-netns\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.398014 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.397065 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-multus-cni-dir\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.398014 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.397078 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-cnibin\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.398014 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396926 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5130231-8dd8-4aa5-8f05-6768b03404bf-system-cni-dir\") pod \"multus-additional-cni-plugins-wjdzw\" (UID: \"e5130231-8dd8-4aa5-8f05-6768b03404bf\") " pod="openshift-multus/multus-additional-cni-plugins-wjdzw" May 25 12:13:12.398014 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.397113 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e5130231-8dd8-4aa5-8f05-6768b03404bf-cnibin\") pod \"multus-additional-cni-plugins-wjdzw\" (UID: \"e5130231-8dd8-4aa5-8f05-6768b03404bf\") " pod="openshift-multus/multus-additional-cni-plugins-wjdzw" May 25 12:13:12.398014 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.397108 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-multus-conf-dir\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.398014 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.396974 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9121ba37-984d-4b12-992f-5ab12f57c886-host-slash\") pod \"iptables-alerter-gp884\" (UID: \"9121ba37-984d-4b12-992f-5ab12f57c886\") " pod="openshift-network-operator/iptables-alerter-gp884" May 25 12:13:12.398014 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.397220 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/09ceb244-50a8-477e-8f70-dfa7ab73b894-host-run-multus-certs\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.398014 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.397239 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lf27j\" (UniqueName: \"kubernetes.io/projected/09ceb244-50a8-477e-8f70-dfa7ab73b894-kube-api-access-lf27j\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.398844 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.397276 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-etc-systemd\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.398844 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.397307 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.398844 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.397346 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/05328a04-43ba-472e-aa2b-47a64884c691-etc-systemd\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.398844 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.397852 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05328a04-43ba-472e-aa2b-47a64884c691-tmp\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.398844 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.398211 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e5130231-8dd8-4aa5-8f05-6768b03404bf-cni-binary-copy\") pod \"multus-additional-cni-plugins-wjdzw\" (UID: \"e5130231-8dd8-4aa5-8f05-6768b03404bf\") " pod="openshift-multus/multus-additional-cni-plugins-wjdzw" May 25 12:13:12.398844 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.398480 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1954d0fa-a186-4c14-975b-3de4de24bac3-konnectivity-ca\") pod \"konnectivity-agent-2fsnt\" (UID: \"1954d0fa-a186-4c14-975b-3de4de24bac3\") " pod="kube-system/konnectivity-agent-2fsnt" May 25 12:13:12.398844 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.398506 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/05328a04-43ba-472e-aa2b-47a64884c691-etc-tuned\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.399803 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.399781 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1954d0fa-a186-4c14-975b-3de4de24bac3-agent-certs\") pod \"konnectivity-agent-2fsnt\" (UID: \"1954d0fa-a186-4c14-975b-3de4de24bac3\") " pod="kube-system/konnectivity-agent-2fsnt" May 25 12:13:12.402033 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:12.402005 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 12:13:12.402144 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:12.402041 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 12:13:12.402144 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:12.402055 2569 projected.go:194] Error preparing data for projected volume kube-api-access-jgc84 for pod openshift-network-diagnostics/network-check-target-mldgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:13:12.402259 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:12.402152 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4709a8d8-46d8-4e6d-8e53-17021b442cc8-kube-api-access-jgc84 podName:4709a8d8-46d8-4e6d-8e53-17021b442cc8 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:12.902113275 +0000 UTC m=+3.129530947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jgc84" (UniqueName: "kubernetes.io/projected/4709a8d8-46d8-4e6d-8e53-17021b442cc8-kube-api-access-jgc84") pod "network-check-target-mldgv" (UID: "4709a8d8-46d8-4e6d-8e53-17021b442cc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:13:12.404009 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.403908 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4ksk\" (UniqueName: \"kubernetes.io/projected/e5130231-8dd8-4aa5-8f05-6768b03404bf-kube-api-access-d4ksk\") pod \"multus-additional-cni-plugins-wjdzw\" (UID: \"e5130231-8dd8-4aa5-8f05-6768b03404bf\") " pod="openshift-multus/multus-additional-cni-plugins-wjdzw" May 25 12:13:12.404673 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.404635 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74zjf\" (UniqueName: \"kubernetes.io/projected/0ee78a86-cc33-496d-a4cf-9c1e6de70f6f-kube-api-access-74zjf\") pod \"node-ca-h6vr7\" (UID: \"0ee78a86-cc33-496d-a4cf-9c1e6de70f6f\") " pod="openshift-image-registry/node-ca-h6vr7" May 25 12:13:12.406243 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.406212 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxrk9\" (UniqueName: \"kubernetes.io/projected/05328a04-43ba-472e-aa2b-47a64884c691-kube-api-access-fxrk9\") pod \"tuned-8mgh5\" (UID: \"05328a04-43ba-472e-aa2b-47a64884c691\") " pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.406952 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.406848 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf27j\" (UniqueName: \"kubernetes.io/projected/09ceb244-50a8-477e-8f70-dfa7ab73b894-kube-api-access-lf27j\") pod \"multus-n66nj\" (UID: \"09ceb244-50a8-477e-8f70-dfa7ab73b894\") " pod="openshift-multus/multus-n66nj" May 25 12:13:12.407651 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.407312 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrrkx\" (UniqueName: \"kubernetes.io/projected/343fb19d-f18b-4f2c-9bc7-7810b24743d8-kube-api-access-qrrkx\") pod \"node-resolver-mjhc6\" (UID: \"343fb19d-f18b-4f2c-9bc7-7810b24743d8\") " pod="openshift-dns/node-resolver-mjhc6" May 25 12:13:12.407651 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.407392 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwcr9\" (UniqueName: \"kubernetes.io/projected/163fbbca-62cd-46c2-9e52-08212856fcf7-kube-api-access-rwcr9\") pod \"aws-ebs-csi-driver-node-lm24j\" (UID: \"163fbbca-62cd-46c2-9e52-08212856fcf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" May 25 12:13:12.429177 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.429120 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal" event={"ID":"4d5c02dbdb2a105c5821f47c7fe2bbaa","Type":"ContainerStarted","Data":"89347933842cff4438ab43d1dce7c3bc058f592694ca7042b3c70d50c054d6db"} May 25 12:13:12.430288 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.430260 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-4.ec2.internal" event={"ID":"e779f73ef05ca5fe5885eec9de6ce2f6","Type":"ContainerStarted","Data":"d4a69e83cec555a0b677cb8e24ab6be96b4d52ca4a1f10a0036169a9a2b9e799"} May 25 12:13:12.465043 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.465010 2569 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 25 12:13:12.498557 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.498521 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nf8qp\" (UniqueName: \"kubernetes.io/projected/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-kube-api-access-nf8qp\") pod \"network-metrics-daemon-xwk2x\" (UID: \"cfe666ec-6ce2-4bfe-9149-8b8a058cd681\") " pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:12.498747 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.498573 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-host-cni-netd\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.498747 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.498598 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-ovn-node-metrics-cert\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.498747 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.498626 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9121ba37-984d-4b12-992f-5ab12f57c886-iptables-alerter-script\") pod \"iptables-alerter-gp884\" (UID: \"9121ba37-984d-4b12-992f-5ab12f57c886\") " pod="openshift-network-operator/iptables-alerter-gp884" May 25 12:13:12.498747 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.498650 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-systemd-units\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.498747 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.498656 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-host-cni-netd\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.498747 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.498675 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-run-systemd\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.498747 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.498698 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-log-socket\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.498747 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.498722 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-ovnkube-config\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.498747 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.498746 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-etc-openvswitch\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.499154 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.498771 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs\") pod \"network-metrics-daemon-xwk2x\" (UID: \"cfe666ec-6ce2-4bfe-9149-8b8a058cd681\") " pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:12.499154 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.498793 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-host-run-ovn-kubernetes\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.499154 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.498815 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lj2l6\" (UniqueName: \"kubernetes.io/projected/9121ba37-984d-4b12-992f-5ab12f57c886-kube-api-access-lj2l6\") pod \"iptables-alerter-gp884\" (UID: \"9121ba37-984d-4b12-992f-5ab12f57c886\") " pod="openshift-network-operator/iptables-alerter-gp884" May 25 12:13:12.499154 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.498845 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-var-lib-openvswitch\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.499154 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.498869 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-run-ovn\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.499154 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.498894 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-node-log\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.499154 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.498921 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c6zqp\" (UniqueName: \"kubernetes.io/projected/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-kube-api-access-c6zqp\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.499154 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.498986 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-host-cni-bin\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.499154 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.499018 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-host-kubelet\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.499154 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.499042 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-ovnkube-script-lib\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.499154 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.499071 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-run-openvswitch\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.499154 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.499112 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-host-slash\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.499154 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.499144 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9121ba37-984d-4b12-992f-5ab12f57c886-host-slash\") pod \"iptables-alerter-gp884\" (UID: \"9121ba37-984d-4b12-992f-5ab12f57c886\") " pod="openshift-network-operator/iptables-alerter-gp884" May 25 12:13:12.499916 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.499175 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.499916 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.499207 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-host-run-netns\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.499916 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.499223 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9121ba37-984d-4b12-992f-5ab12f57c886-iptables-alerter-script\") pod \"iptables-alerter-gp884\" (UID: \"9121ba37-984d-4b12-992f-5ab12f57c886\") " pod="openshift-network-operator/iptables-alerter-gp884" May 25 12:13:12.499916 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.499233 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-env-overrides\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.499916 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.499236 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-systemd-units\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.499916 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.499317 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-log-socket\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.499916 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.499350 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-run-systemd\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.499916 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.499473 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9121ba37-984d-4b12-992f-5ab12f57c886-host-slash\") pod \"iptables-alerter-gp884\" (UID: \"9121ba37-984d-4b12-992f-5ab12f57c886\") " pod="openshift-network-operator/iptables-alerter-gp884" May 25 12:13:12.499916 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.499518 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-run-openvswitch\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.499916 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.499557 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-host-slash\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.499916 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.499593 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-var-lib-openvswitch\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.499916 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.499635 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.499916 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.499684 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-env-overrides\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.499916 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:12.499723 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:13:12.499916 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.499730 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-host-run-netns\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.499916 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.499771 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-etc-openvswitch\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.499916 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:12.499792 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs podName:cfe666ec-6ce2-4bfe-9149-8b8a058cd681 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:12.99977496 +0000 UTC m=+3.227192635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs") pod "network-metrics-daemon-xwk2x" (UID: "cfe666ec-6ce2-4bfe-9149-8b8a058cd681") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:13:12.500838 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.499870 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-ovnkube-config\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.500838 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.499959 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-node-log\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.500838 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.499955 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-host-run-ovn-kubernetes\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.500838 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.499991 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-run-ovn\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.500838 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.500048 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-host-cni-bin\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.500838 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.500056 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-host-kubelet\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.500838 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.500473 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-ovnkube-script-lib\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.501862 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.501835 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-ovn-node-metrics-cert\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.508811 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.508781 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj2l6\" (UniqueName: \"kubernetes.io/projected/9121ba37-984d-4b12-992f-5ab12f57c886-kube-api-access-lj2l6\") pod \"iptables-alerter-gp884\" (UID: \"9121ba37-984d-4b12-992f-5ab12f57c886\") " pod="openshift-network-operator/iptables-alerter-gp884" May 25 12:13:12.508926 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.508868 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6zqp\" (UniqueName: \"kubernetes.io/projected/b5b21efc-8e4f-43d2-9f26-7a1832e1cee7-kube-api-access-c6zqp\") pod \"ovnkube-node-z8r9j\" (UID: \"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.508993 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.508965 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf8qp\" (UniqueName: \"kubernetes.io/projected/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-kube-api-access-nf8qp\") pod \"network-metrics-daemon-xwk2x\" (UID: \"cfe666ec-6ce2-4bfe-9149-8b8a058cd681\") " pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:12.573951 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.573899 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n66nj" May 25 12:13:12.580909 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.580877 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" May 25 12:13:12.594722 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.594687 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" May 25 12:13:12.600841 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.600803 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mjhc6" May 25 12:13:12.608559 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.608523 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h6vr7" May 25 12:13:12.617278 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.617253 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2fsnt" May 25 12:13:12.623883 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.623860 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wjdzw" May 25 12:13:12.639474 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.639446 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gp884" May 25 12:13:12.645233 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.645168 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:12.902251 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:12.902186 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgc84\" (UniqueName: \"kubernetes.io/projected/4709a8d8-46d8-4e6d-8e53-17021b442cc8-kube-api-access-jgc84\") pod \"network-check-target-mldgv\" (UID: \"4709a8d8-46d8-4e6d-8e53-17021b442cc8\") " pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:13:12.902382 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:12.902300 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 12:13:12.902382 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:12.902315 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 12:13:12.902382 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:12.902324 2569 projected.go:194] Error preparing data for projected volume kube-api-access-jgc84 for pod openshift-network-diagnostics/network-check-target-mldgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:13:12.902382 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:12.902371 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4709a8d8-46d8-4e6d-8e53-17021b442cc8-kube-api-access-jgc84 podName:4709a8d8-46d8-4e6d-8e53-17021b442cc8 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:13.90235694 +0000 UTC m=+4.129774594 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jgc84" (UniqueName: "kubernetes.io/projected/4709a8d8-46d8-4e6d-8e53-17021b442cc8-kube-api-access-jgc84") pod "network-check-target-mldgv" (UID: "4709a8d8-46d8-4e6d-8e53-17021b442cc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:13:13.003182 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:13.003149 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs\") pod \"network-metrics-daemon-xwk2x\" (UID: \"cfe666ec-6ce2-4bfe-9149-8b8a058cd681\") " pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:13.003367 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:13.003264 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:13:13.003367 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:13.003328 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs podName:cfe666ec-6ce2-4bfe-9149-8b8a058cd681 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:14.003307379 +0000 UTC m=+4.230725040 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs") pod "network-metrics-daemon-xwk2x" (UID: "cfe666ec-6ce2-4bfe-9149-8b8a058cd681") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:13:13.117083 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:13.116965 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09ceb244_50a8_477e_8f70_dfa7ab73b894.slice/crio-7d73eaaef4b5fbdb991ccf5bfa2a2c37f9f620eb687a8a738775b316e881674c WatchSource:0}: Error finding container 7d73eaaef4b5fbdb991ccf5bfa2a2c37f9f620eb687a8a738775b316e881674c: Status 404 returned error can't find the container with id 7d73eaaef4b5fbdb991ccf5bfa2a2c37f9f620eb687a8a738775b316e881674c May 25 12:13:13.118263 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:13.118238 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5130231_8dd8_4aa5_8f05_6768b03404bf.slice/crio-c24143b1bdc4f18e50be867f631b4dace9ec4eeb7f7fb870a82afccb2e193182 WatchSource:0}: Error finding container c24143b1bdc4f18e50be867f631b4dace9ec4eeb7f7fb870a82afccb2e193182: Status 404 returned error can't find the container with id c24143b1bdc4f18e50be867f631b4dace9ec4eeb7f7fb870a82afccb2e193182 May 25 12:13:13.119783 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:13.119758 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9121ba37_984d_4b12_992f_5ab12f57c886.slice/crio-e7aa42c63e712c889449ec05b8b8a4e88f353fe1a83f4fe430db8694dcc45ff1 WatchSource:0}: Error finding container e7aa42c63e712c889449ec05b8b8a4e88f353fe1a83f4fe430db8694dcc45ff1: Status 404 returned error can't find the container with id e7aa42c63e712c889449ec05b8b8a4e88f353fe1a83f4fe430db8694dcc45ff1 May 25 12:13:13.120692 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:13.120656 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1954d0fa_a186_4c14_975b_3de4de24bac3.slice/crio-912e646fb66b8f819b1a9323e41c08b5f2d7058cd8b2c90f52b78217a936adda WatchSource:0}: Error finding container 912e646fb66b8f819b1a9323e41c08b5f2d7058cd8b2c90f52b78217a936adda: Status 404 returned error can't find the container with id 912e646fb66b8f819b1a9323e41c08b5f2d7058cd8b2c90f52b78217a936adda May 25 12:13:13.121777 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:13.121758 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod343fb19d_f18b_4f2c_9bc7_7810b24743d8.slice/crio-fff7b8d44d59845199a6ab9fdec31f5916ef1bd041b32cd404b316bfc2aa09f4 WatchSource:0}: Error finding container fff7b8d44d59845199a6ab9fdec31f5916ef1bd041b32cd404b316bfc2aa09f4: Status 404 returned error can't find the container with id fff7b8d44d59845199a6ab9fdec31f5916ef1bd041b32cd404b316bfc2aa09f4 May 25 12:13:13.123000 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:13.122574 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05328a04_43ba_472e_aa2b_47a64884c691.slice/crio-ab0e30b170e8e590d2bf2858951eed22089ee35972d50f11fb91eedd56ababd2 WatchSource:0}: Error finding container ab0e30b170e8e590d2bf2858951eed22089ee35972d50f11fb91eedd56ababd2: Status 404 returned error can't find the container with id ab0e30b170e8e590d2bf2858951eed22089ee35972d50f11fb91eedd56ababd2 May 25 12:13:13.126633 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:13.126613 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ee78a86_cc33_496d_a4cf_9c1e6de70f6f.slice/crio-f1662f9a0b53380b024f92a0acf43c1cc1615ee8d56cf08de00992e313c0cd7d WatchSource:0}: Error finding container f1662f9a0b53380b024f92a0acf43c1cc1615ee8d56cf08de00992e313c0cd7d: Status 404 returned error can't find the container with id f1662f9a0b53380b024f92a0acf43c1cc1615ee8d56cf08de00992e313c0cd7d May 25 12:13:13.148399 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:13.148372 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5b21efc_8e4f_43d2_9f26_7a1832e1cee7.slice/crio-fd6bb274584a8c59924e6d0054a098a0ee1b73aad6c11652ece939c7e68b8ce9 WatchSource:0}: Error finding container fd6bb274584a8c59924e6d0054a098a0ee1b73aad6c11652ece939c7e68b8ce9: Status 404 returned error can't find the container with id fd6bb274584a8c59924e6d0054a098a0ee1b73aad6c11652ece939c7e68b8ce9 May 25 12:13:13.149820 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:13.149800 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod163fbbca_62cd_46c2_9e52_08212856fcf7.slice/crio-f260e8987e1636a98785a2403ef1bb6a5ef8b343ebe624d5cd6b0a6017bd397f WatchSource:0}: Error finding container f260e8987e1636a98785a2403ef1bb6a5ef8b343ebe624d5cd6b0a6017bd397f: Status 404 returned error can't find the container with id f260e8987e1636a98785a2403ef1bb6a5ef8b343ebe624d5cd6b0a6017bd397f May 25 12:13:13.381510 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:13.381473 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 12:08:11 +0000 UTC" deadline="2028-01-23 12:31:19.345131151 +0000 UTC" May 25 12:13:13.381510 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:13.381505 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14592h18m5.963628073s" May 25 12:13:13.425445 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:13.425418 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:13:13.425602 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:13.425541 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldgv" podUID="4709a8d8-46d8-4e6d-8e53-17021b442cc8" May 25 12:13:13.432515 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:13.432475 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" event={"ID":"163fbbca-62cd-46c2-9e52-08212856fcf7","Type":"ContainerStarted","Data":"f260e8987e1636a98785a2403ef1bb6a5ef8b343ebe624d5cd6b0a6017bd397f"} May 25 12:13:13.433593 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:13.433568 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h6vr7" event={"ID":"0ee78a86-cc33-496d-a4cf-9c1e6de70f6f","Type":"ContainerStarted","Data":"f1662f9a0b53380b024f92a0acf43c1cc1615ee8d56cf08de00992e313c0cd7d"} May 25 12:13:13.434583 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:13.434564 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" event={"ID":"05328a04-43ba-472e-aa2b-47a64884c691","Type":"ContainerStarted","Data":"ab0e30b170e8e590d2bf2858951eed22089ee35972d50f11fb91eedd56ababd2"} May 25 12:13:13.435613 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:13.435593 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mjhc6" event={"ID":"343fb19d-f18b-4f2c-9bc7-7810b24743d8","Type":"ContainerStarted","Data":"fff7b8d44d59845199a6ab9fdec31f5916ef1bd041b32cd404b316bfc2aa09f4"} May 25 12:13:13.436551 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:13.436525 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2fsnt" event={"ID":"1954d0fa-a186-4c14-975b-3de4de24bac3","Type":"ContainerStarted","Data":"912e646fb66b8f819b1a9323e41c08b5f2d7058cd8b2c90f52b78217a936adda"} May 25 12:13:13.437505 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:13.437482 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gp884" event={"ID":"9121ba37-984d-4b12-992f-5ab12f57c886","Type":"ContainerStarted","Data":"e7aa42c63e712c889449ec05b8b8a4e88f353fe1a83f4fe430db8694dcc45ff1"} May 25 12:13:13.438384 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:13.438361 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wjdzw" event={"ID":"e5130231-8dd8-4aa5-8f05-6768b03404bf","Type":"ContainerStarted","Data":"c24143b1bdc4f18e50be867f631b4dace9ec4eeb7f7fb870a82afccb2e193182"} May 25 12:13:13.439867 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:13.439844 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-4.ec2.internal" event={"ID":"e779f73ef05ca5fe5885eec9de6ce2f6","Type":"ContainerStarted","Data":"1fdc4b64a5b4193f3f6a216d3ae9ab4c4eec999ff41f8556c1880dd05c2b0399"} May 25 12:13:13.440960 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:13.440915 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" event={"ID":"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7","Type":"ContainerStarted","Data":"fd6bb274584a8c59924e6d0054a098a0ee1b73aad6c11652ece939c7e68b8ce9"} May 25 12:13:13.441745 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:13.441728 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n66nj" event={"ID":"09ceb244-50a8-477e-8f70-dfa7ab73b894","Type":"ContainerStarted","Data":"7d73eaaef4b5fbdb991ccf5bfa2a2c37f9f620eb687a8a738775b316e881674c"} May 25 12:13:13.473811 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:13.473749 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-4.ec2.internal" podStartSLOduration=2.473729723 podStartE2EDuration="2.473729723s" podCreationTimestamp="2026-05-25 12:13:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 12:13:13.473548518 +0000 UTC m=+3.700966198" watchObservedRunningTime="2026-05-25 12:13:13.473729723 +0000 UTC m=+3.701147402" May 25 12:13:13.911361 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:13.911257 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgc84\" (UniqueName: \"kubernetes.io/projected/4709a8d8-46d8-4e6d-8e53-17021b442cc8-kube-api-access-jgc84\") pod \"network-check-target-mldgv\" (UID: \"4709a8d8-46d8-4e6d-8e53-17021b442cc8\") " pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:13:13.911535 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:13.911479 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 12:13:13.911535 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:13.911502 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 12:13:13.911535 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:13.911515 2569 projected.go:194] Error preparing data for projected volume kube-api-access-jgc84 for pod openshift-network-diagnostics/network-check-target-mldgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:13:13.911687 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:13.911620 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4709a8d8-46d8-4e6d-8e53-17021b442cc8-kube-api-access-jgc84 podName:4709a8d8-46d8-4e6d-8e53-17021b442cc8 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:15.911557657 +0000 UTC m=+6.138975319 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jgc84" (UniqueName: "kubernetes.io/projected/4709a8d8-46d8-4e6d-8e53-17021b442cc8-kube-api-access-jgc84") pod "network-check-target-mldgv" (UID: "4709a8d8-46d8-4e6d-8e53-17021b442cc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:13:14.012499 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:14.012459 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs\") pod \"network-metrics-daemon-xwk2x\" (UID: \"cfe666ec-6ce2-4bfe-9149-8b8a058cd681\") " pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:14.012742 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:14.012617 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:13:14.012742 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:14.012697 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs podName:cfe666ec-6ce2-4bfe-9149-8b8a058cd681 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:16.012674951 +0000 UTC m=+6.240092611 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs") pod "network-metrics-daemon-xwk2x" (UID: "cfe666ec-6ce2-4bfe-9149-8b8a058cd681") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:13:14.427991 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:14.427959 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:14.428519 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:14.428098 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwk2x" podUID="cfe666ec-6ce2-4bfe-9149-8b8a058cd681" May 25 12:13:14.464484 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:14.464441 2569 generic.go:358] "Generic (PLEG): container finished" podID="4d5c02dbdb2a105c5821f47c7fe2bbaa" containerID="c5ed82c353965d164c031dc78d0ca5c47570a8d7cedcfb7a45c5ac5f9e7d5c33" exitCode=0 May 25 12:13:14.465755 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:14.465502 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal" event={"ID":"4d5c02dbdb2a105c5821f47c7fe2bbaa","Type":"ContainerDied","Data":"c5ed82c353965d164c031dc78d0ca5c47570a8d7cedcfb7a45c5ac5f9e7d5c33"} May 25 12:13:15.426523 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:15.425714 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:13:15.426523 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:15.426156 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldgv" podUID="4709a8d8-46d8-4e6d-8e53-17021b442cc8" May 25 12:13:15.484286 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:15.484241 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal" event={"ID":"4d5c02dbdb2a105c5821f47c7fe2bbaa","Type":"ContainerStarted","Data":"5ff417ea45b47d52473947c943e3311e0522bf69857a52eb69924ae644796656"} May 25 12:13:15.928199 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:15.928155 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgc84\" (UniqueName: \"kubernetes.io/projected/4709a8d8-46d8-4e6d-8e53-17021b442cc8-kube-api-access-jgc84\") pod \"network-check-target-mldgv\" (UID: \"4709a8d8-46d8-4e6d-8e53-17021b442cc8\") " pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:13:15.928363 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:15.928313 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 12:13:15.928363 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:15.928332 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 12:13:15.928363 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:15.928345 2569 projected.go:194] Error preparing data for projected volume kube-api-access-jgc84 for pod openshift-network-diagnostics/network-check-target-mldgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:13:15.928522 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:15.928416 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4709a8d8-46d8-4e6d-8e53-17021b442cc8-kube-api-access-jgc84 podName:4709a8d8-46d8-4e6d-8e53-17021b442cc8 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:19.928395389 +0000 UTC m=+10.155813047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jgc84" (UniqueName: "kubernetes.io/projected/4709a8d8-46d8-4e6d-8e53-17021b442cc8-kube-api-access-jgc84") pod "network-check-target-mldgv" (UID: "4709a8d8-46d8-4e6d-8e53-17021b442cc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:13:16.028793 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:16.028729 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs\") pod \"network-metrics-daemon-xwk2x\" (UID: \"cfe666ec-6ce2-4bfe-9149-8b8a058cd681\") " pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:16.028999 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:16.028918 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:13:16.029061 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:16.029001 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs podName:cfe666ec-6ce2-4bfe-9149-8b8a058cd681 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:20.028982189 +0000 UTC m=+10.256399858 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs") pod "network-metrics-daemon-xwk2x" (UID: "cfe666ec-6ce2-4bfe-9149-8b8a058cd681") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:13:16.425745 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:16.425669 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:16.425871 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:16.425838 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwk2x" podUID="cfe666ec-6ce2-4bfe-9149-8b8a058cd681" May 25 12:13:17.060881 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:17.060009 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-4.ec2.internal" podStartSLOduration=6.059990391 podStartE2EDuration="6.059990391s" podCreationTimestamp="2026-05-25 12:13:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 12:13:15.501566632 +0000 UTC m=+5.728984310" watchObservedRunningTime="2026-05-25 12:13:17.059990391 +0000 UTC m=+7.287408071" May 25 12:13:17.060881 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:17.060256 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-bxhdm"] May 25 12:13:17.066419 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:17.066053 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:17.066419 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:17.066135 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxhdm" podUID="bf6ee847-4da0-4712-b6cf-1b39e6fb91fb" May 25 12:13:17.137571 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:17.137533 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-dbus\") pod \"global-pull-secret-syncer-bxhdm\" (UID: \"bf6ee847-4da0-4712-b6cf-1b39e6fb91fb\") " pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:17.137748 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:17.137620 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-original-pull-secret\") pod \"global-pull-secret-syncer-bxhdm\" (UID: \"bf6ee847-4da0-4712-b6cf-1b39e6fb91fb\") " pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:17.137748 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:17.137652 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-kubelet-config\") pod \"global-pull-secret-syncer-bxhdm\" (UID: \"bf6ee847-4da0-4712-b6cf-1b39e6fb91fb\") " pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:17.238723 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:17.238681 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-original-pull-secret\") pod \"global-pull-secret-syncer-bxhdm\" (UID: \"bf6ee847-4da0-4712-b6cf-1b39e6fb91fb\") " pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:17.238921 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:17.238747 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-kubelet-config\") pod \"global-pull-secret-syncer-bxhdm\" (UID: \"bf6ee847-4da0-4712-b6cf-1b39e6fb91fb\") " pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:17.238921 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:17.238810 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-dbus\") pod \"global-pull-secret-syncer-bxhdm\" (UID: \"bf6ee847-4da0-4712-b6cf-1b39e6fb91fb\") " pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:17.239077 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:17.239047 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-dbus\") pod \"global-pull-secret-syncer-bxhdm\" (UID: \"bf6ee847-4da0-4712-b6cf-1b39e6fb91fb\") " pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:17.239128 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:17.239081 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 12:13:17.239128 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:17.239117 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-kubelet-config\") pod \"global-pull-secret-syncer-bxhdm\" (UID: \"bf6ee847-4da0-4712-b6cf-1b39e6fb91fb\") " pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:17.239228 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:17.239200 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-original-pull-secret podName:bf6ee847-4da0-4712-b6cf-1b39e6fb91fb nodeName:}" failed. No retries permitted until 2026-05-25 12:13:17.739177876 +0000 UTC m=+7.966595532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-original-pull-secret") pod "global-pull-secret-syncer-bxhdm" (UID: "bf6ee847-4da0-4712-b6cf-1b39e6fb91fb") : object "kube-system"/"original-pull-secret" not registered May 25 12:13:17.425289 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:17.425207 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:13:17.425453 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:17.425318 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldgv" podUID="4709a8d8-46d8-4e6d-8e53-17021b442cc8" May 25 12:13:17.743368 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:17.743270 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-original-pull-secret\") pod \"global-pull-secret-syncer-bxhdm\" (UID: \"bf6ee847-4da0-4712-b6cf-1b39e6fb91fb\") " pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:17.743530 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:17.743430 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 12:13:17.743530 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:17.743512 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-original-pull-secret podName:bf6ee847-4da0-4712-b6cf-1b39e6fb91fb nodeName:}" failed. No retries permitted until 2026-05-25 12:13:18.743489595 +0000 UTC m=+8.970907249 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-original-pull-secret") pod "global-pull-secret-syncer-bxhdm" (UID: "bf6ee847-4da0-4712-b6cf-1b39e6fb91fb") : object "kube-system"/"original-pull-secret" not registered May 25 12:13:18.425183 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:18.425151 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:18.425183 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:18.425189 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:18.425701 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:18.425399 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwk2x" podUID="cfe666ec-6ce2-4bfe-9149-8b8a058cd681" May 25 12:13:18.426333 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:18.426298 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxhdm" podUID="bf6ee847-4da0-4712-b6cf-1b39e6fb91fb" May 25 12:13:18.753841 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:18.753744 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-original-pull-secret\") pod \"global-pull-secret-syncer-bxhdm\" (UID: \"bf6ee847-4da0-4712-b6cf-1b39e6fb91fb\") " pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:18.754096 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:18.753913 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 12:13:18.754096 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:18.754003 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-original-pull-secret podName:bf6ee847-4da0-4712-b6cf-1b39e6fb91fb nodeName:}" failed. No retries permitted until 2026-05-25 12:13:20.753983574 +0000 UTC m=+10.981401246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-original-pull-secret") pod "global-pull-secret-syncer-bxhdm" (UID: "bf6ee847-4da0-4712-b6cf-1b39e6fb91fb") : object "kube-system"/"original-pull-secret" not registered May 25 12:13:19.425297 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:19.425050 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:13:19.425297 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:19.425166 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldgv" podUID="4709a8d8-46d8-4e6d-8e53-17021b442cc8" May 25 12:13:19.964985 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:19.964950 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgc84\" (UniqueName: \"kubernetes.io/projected/4709a8d8-46d8-4e6d-8e53-17021b442cc8-kube-api-access-jgc84\") pod \"network-check-target-mldgv\" (UID: \"4709a8d8-46d8-4e6d-8e53-17021b442cc8\") " pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:13:19.965191 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:19.965156 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 12:13:19.965191 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:19.965176 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 12:13:19.965191 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:19.965188 2569 projected.go:194] Error preparing data for projected volume kube-api-access-jgc84 for pod openshift-network-diagnostics/network-check-target-mldgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:13:19.965338 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:19.965249 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4709a8d8-46d8-4e6d-8e53-17021b442cc8-kube-api-access-jgc84 podName:4709a8d8-46d8-4e6d-8e53-17021b442cc8 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:27.965229908 +0000 UTC m=+18.192647583 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jgc84" (UniqueName: "kubernetes.io/projected/4709a8d8-46d8-4e6d-8e53-17021b442cc8-kube-api-access-jgc84") pod "network-check-target-mldgv" (UID: "4709a8d8-46d8-4e6d-8e53-17021b442cc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:13:20.065770 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:20.065737 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs\") pod \"network-metrics-daemon-xwk2x\" (UID: \"cfe666ec-6ce2-4bfe-9149-8b8a058cd681\") " pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:20.066055 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:20.065899 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:13:20.066055 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:20.065994 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs podName:cfe666ec-6ce2-4bfe-9149-8b8a058cd681 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:28.065970489 +0000 UTC m=+18.293388195 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs") pod "network-metrics-daemon-xwk2x" (UID: "cfe666ec-6ce2-4bfe-9149-8b8a058cd681") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:13:20.426360 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:20.426272 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:20.426793 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:20.426402 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwk2x" podUID="cfe666ec-6ce2-4bfe-9149-8b8a058cd681" May 25 12:13:20.426831 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:20.426793 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:20.426902 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:20.426879 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxhdm" podUID="bf6ee847-4da0-4712-b6cf-1b39e6fb91fb" May 25 12:13:20.772063 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:20.771874 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-original-pull-secret\") pod \"global-pull-secret-syncer-bxhdm\" (UID: \"bf6ee847-4da0-4712-b6cf-1b39e6fb91fb\") " pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:20.772216 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:20.772080 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 12:13:20.772216 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:20.772157 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-original-pull-secret podName:bf6ee847-4da0-4712-b6cf-1b39e6fb91fb nodeName:}" failed. No retries permitted until 2026-05-25 12:13:24.772137039 +0000 UTC m=+14.999554698 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-original-pull-secret") pod "global-pull-secret-syncer-bxhdm" (UID: "bf6ee847-4da0-4712-b6cf-1b39e6fb91fb") : object "kube-system"/"original-pull-secret" not registered May 25 12:13:21.425783 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:21.425703 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:13:21.425946 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:21.425807 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldgv" podUID="4709a8d8-46d8-4e6d-8e53-17021b442cc8" May 25 12:13:22.426573 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:22.426068 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:22.426573 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:22.426087 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:22.426573 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:22.426218 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwk2x" podUID="cfe666ec-6ce2-4bfe-9149-8b8a058cd681" May 25 12:13:22.426573 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:22.426350 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxhdm" podUID="bf6ee847-4da0-4712-b6cf-1b39e6fb91fb" May 25 12:13:23.425241 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:23.425210 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:13:23.425376 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:23.425317 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldgv" podUID="4709a8d8-46d8-4e6d-8e53-17021b442cc8" May 25 12:13:24.426044 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:24.426005 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:24.426585 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:24.426134 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwk2x" podUID="cfe666ec-6ce2-4bfe-9149-8b8a058cd681" May 25 12:13:24.426585 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:24.426489 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:24.426585 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:24.426560 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxhdm" podUID="bf6ee847-4da0-4712-b6cf-1b39e6fb91fb" May 25 12:13:24.799715 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:24.799626 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-original-pull-secret\") pod \"global-pull-secret-syncer-bxhdm\" (UID: \"bf6ee847-4da0-4712-b6cf-1b39e6fb91fb\") " pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:24.799849 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:24.799789 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 12:13:24.799906 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:24.799857 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-original-pull-secret podName:bf6ee847-4da0-4712-b6cf-1b39e6fb91fb nodeName:}" failed. No retries permitted until 2026-05-25 12:13:32.799840579 +0000 UTC m=+23.027258235 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-original-pull-secret") pod "global-pull-secret-syncer-bxhdm" (UID: "bf6ee847-4da0-4712-b6cf-1b39e6fb91fb") : object "kube-system"/"original-pull-secret" not registered May 25 12:13:25.425277 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:25.425241 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:13:25.425475 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:25.425368 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldgv" podUID="4709a8d8-46d8-4e6d-8e53-17021b442cc8" May 25 12:13:26.425626 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:26.425589 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:26.426102 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:26.425644 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:26.426102 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:26.425713 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwk2x" podUID="cfe666ec-6ce2-4bfe-9149-8b8a058cd681" May 25 12:13:26.426102 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:26.425757 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxhdm" podUID="bf6ee847-4da0-4712-b6cf-1b39e6fb91fb" May 25 12:13:27.426013 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:27.425972 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:13:27.426401 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:27.426103 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldgv" podUID="4709a8d8-46d8-4e6d-8e53-17021b442cc8" May 25 12:13:28.023671 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:28.023628 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgc84\" (UniqueName: \"kubernetes.io/projected/4709a8d8-46d8-4e6d-8e53-17021b442cc8-kube-api-access-jgc84\") pod \"network-check-target-mldgv\" (UID: \"4709a8d8-46d8-4e6d-8e53-17021b442cc8\") " pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:13:28.023865 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:28.023807 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 12:13:28.023865 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:28.023834 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 12:13:28.023865 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:28.023848 2569 projected.go:194] Error preparing data for projected volume kube-api-access-jgc84 for pod openshift-network-diagnostics/network-check-target-mldgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:13:28.024007 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:28.023908 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4709a8d8-46d8-4e6d-8e53-17021b442cc8-kube-api-access-jgc84 podName:4709a8d8-46d8-4e6d-8e53-17021b442cc8 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:44.023888716 +0000 UTC m=+34.251306383 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jgc84" (UniqueName: "kubernetes.io/projected/4709a8d8-46d8-4e6d-8e53-17021b442cc8-kube-api-access-jgc84") pod "network-check-target-mldgv" (UID: "4709a8d8-46d8-4e6d-8e53-17021b442cc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:13:28.124688 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:28.124642 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs\") pod \"network-metrics-daemon-xwk2x\" (UID: \"cfe666ec-6ce2-4bfe-9149-8b8a058cd681\") " pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:28.124861 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:28.124814 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:13:28.124917 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:28.124891 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs podName:cfe666ec-6ce2-4bfe-9149-8b8a058cd681 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:44.124873499 +0000 UTC m=+34.352291154 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs") pod "network-metrics-daemon-xwk2x" (UID: "cfe666ec-6ce2-4bfe-9149-8b8a058cd681") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:13:28.426002 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:28.425908 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:28.426002 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:28.425966 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:28.426512 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:28.426050 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwk2x" podUID="cfe666ec-6ce2-4bfe-9149-8b8a058cd681" May 25 12:13:28.426512 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:28.426182 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxhdm" podUID="bf6ee847-4da0-4712-b6cf-1b39e6fb91fb" May 25 12:13:29.425777 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:29.425742 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:13:29.425976 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:29.425867 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldgv" podUID="4709a8d8-46d8-4e6d-8e53-17021b442cc8" May 25 12:13:30.426419 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:30.426337 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:30.426919 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:30.426470 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwk2x" podUID="cfe666ec-6ce2-4bfe-9149-8b8a058cd681" May 25 12:13:30.426919 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:30.426529 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:30.426919 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:30.426636 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxhdm" podUID="bf6ee847-4da0-4712-b6cf-1b39e6fb91fb" May 25 12:13:31.425347 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:31.425315 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:13:31.425464 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:31.425431 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldgv" podUID="4709a8d8-46d8-4e6d-8e53-17021b442cc8" May 25 12:13:32.426048 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:32.426009 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:32.426048 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:32.426040 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:32.426731 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:32.426143 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxhdm" podUID="bf6ee847-4da0-4712-b6cf-1b39e6fb91fb" May 25 12:13:32.428240 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:32.428203 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwk2x" podUID="cfe666ec-6ce2-4bfe-9149-8b8a058cd681" May 25 12:13:32.518848 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:32.518812 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" event={"ID":"163fbbca-62cd-46c2-9e52-08212856fcf7","Type":"ContainerStarted","Data":"4780305bb1798918d912c207e253496be90b6178677267b26e5f9be13518bffc"} May 25 12:13:32.520076 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:32.520046 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h6vr7" event={"ID":"0ee78a86-cc33-496d-a4cf-9c1e6de70f6f","Type":"ContainerStarted","Data":"61cd69749d36acde47f4520833e2a6bc37bf6ee30eb5c7ee0085fac786341252"} May 25 12:13:32.521352 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:32.521321 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" event={"ID":"05328a04-43ba-472e-aa2b-47a64884c691","Type":"ContainerStarted","Data":"b31b7cb435170e56f878c2d4efde8e2a71c1098af4a8539b332e5642fa57b15c"} May 25 12:13:32.522809 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:32.522786 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mjhc6" event={"ID":"343fb19d-f18b-4f2c-9bc7-7810b24743d8","Type":"ContainerStarted","Data":"40f275c435881cc432c09190ee0597fb21df7886f928f03d0b7fd28ff4fd7696"} May 25 12:13:32.524120 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:32.524098 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2fsnt" event={"ID":"1954d0fa-a186-4c14-975b-3de4de24bac3","Type":"ContainerStarted","Data":"69fbf8775d0c6342a3d09e631204436ee0703ddde07551b8273faa2428696d43"} May 25 12:13:32.525579 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:32.525557 2569 generic.go:358] "Generic (PLEG): container finished" podID="e5130231-8dd8-4aa5-8f05-6768b03404bf" containerID="21294c81291824f529ef471ae57ea297bbc16ef74b6e0c228b251887353c9c66" exitCode=0 May 25 12:13:32.525672 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:32.525629 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wjdzw" event={"ID":"e5130231-8dd8-4aa5-8f05-6768b03404bf","Type":"ContainerDied","Data":"21294c81291824f529ef471ae57ea297bbc16ef74b6e0c228b251887353c9c66"} May 25 12:13:32.528676 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:32.528496 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/ovn-acl-logging/0.log" May 25 12:13:32.529062 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:32.529039 2569 generic.go:358] "Generic (PLEG): container finished" podID="b5b21efc-8e4f-43d2-9f26-7a1832e1cee7" containerID="c5a33cd68b3f05a463df9ffa1dad39e241077c86b491caacffab0e8aff5860a0" exitCode=1 May 25 12:13:32.529124 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:32.529105 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" event={"ID":"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7","Type":"ContainerStarted","Data":"9e292dd50dd707e63654bfef27cfc562bc6dcc075d53667ca083f097bec822e8"} May 25 12:13:32.529188 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:32.529127 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" event={"ID":"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7","Type":"ContainerStarted","Data":"17bf59b9798a77b098dd82c47cf1041ace3f146ea65e2f15d94274e7e1c52190"} May 25 12:13:32.529188 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:32.529137 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" event={"ID":"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7","Type":"ContainerStarted","Data":"11bd79cd355b7addf150ed901548dce7a6490084a2a775592b3d7253af18378b"} May 25 12:13:32.529188 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:32.529146 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" event={"ID":"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7","Type":"ContainerStarted","Data":"3fc2946f7480285bad26b71d673b2864a3bc856aae6d363ae6f22e284f8c0526"} May 25 12:13:32.529188 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:32.529154 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" event={"ID":"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7","Type":"ContainerDied","Data":"c5a33cd68b3f05a463df9ffa1dad39e241077c86b491caacffab0e8aff5860a0"} May 25 12:13:32.529188 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:32.529167 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" event={"ID":"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7","Type":"ContainerStarted","Data":"d000fffb2cd7390640982f236e6744222725acc75b0820b113ce9d448cdcaa64"} May 25 12:13:32.530499 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:32.530479 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n66nj" event={"ID":"09ceb244-50a8-477e-8f70-dfa7ab73b894","Type":"ContainerStarted","Data":"8f8445e0fa4d37924f296bdd08172264572b918ec1b0b062d7c25b9e1b097aa4"} May 25 12:13:32.535207 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:32.535170 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h6vr7" podStartSLOduration=4.154118394 podStartE2EDuration="22.535155818s" podCreationTimestamp="2026-05-25 12:13:10 +0000 UTC" firstStartedPulling="2026-05-25 12:13:13.147194136 +0000 UTC m=+3.374611791" lastFinishedPulling="2026-05-25 12:13:31.52823156 +0000 UTC m=+21.755649215" observedRunningTime="2026-05-25 12:13:32.534693138 +0000 UTC m=+22.762110815" watchObservedRunningTime="2026-05-25 12:13:32.535155818 +0000 UTC m=+22.762573498" May 25 12:13:32.549328 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:32.549291 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-mjhc6" podStartSLOduration=4.145489687 podStartE2EDuration="22.549277921s" podCreationTimestamp="2026-05-25 12:13:10 +0000 UTC" firstStartedPulling="2026-05-25 12:13:13.12460231 +0000 UTC m=+3.352019966" lastFinishedPulling="2026-05-25 12:13:31.528390543 +0000 UTC m=+21.755808200" observedRunningTime="2026-05-25 12:13:32.548684379 +0000 UTC m=+22.776102058" watchObservedRunningTime="2026-05-25 12:13:32.549277921 +0000 UTC m=+22.776695598" May 25 12:13:32.585458 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:32.585403 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2fsnt" podStartSLOduration=8.080787528 podStartE2EDuration="22.585383653s" podCreationTimestamp="2026-05-25 12:13:10 +0000 UTC" firstStartedPulling="2026-05-25 12:13:13.124213931 +0000 UTC m=+3.351631586" lastFinishedPulling="2026-05-25 12:13:27.628810053 +0000 UTC m=+17.856227711" observedRunningTime="2026-05-25 12:13:32.56299437 +0000 UTC m=+22.790412046" watchObservedRunningTime="2026-05-25 12:13:32.585383653 +0000 UTC m=+22.812801330" May 25 12:13:32.600961 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:32.600897 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-n66nj" podStartSLOduration=4.122729882 podStartE2EDuration="22.600882214s" podCreationTimestamp="2026-05-25 12:13:10 +0000 UTC" firstStartedPulling="2026-05-25 12:13:13.118730814 +0000 UTC m=+3.346148469" lastFinishedPulling="2026-05-25 12:13:31.596883129 +0000 UTC m=+21.824300801" observedRunningTime="2026-05-25 12:13:32.600558158 +0000 UTC m=+22.827975860" watchObservedRunningTime="2026-05-25 12:13:32.600882214 +0000 UTC m=+22.828299891" May 25 12:13:32.616885 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:32.616835 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8mgh5" podStartSLOduration=4.211439276 podStartE2EDuration="22.616818044s" podCreationTimestamp="2026-05-25 12:13:10 +0000 UTC" firstStartedPulling="2026-05-25 12:13:13.125280616 +0000 UTC m=+3.352698271" lastFinishedPulling="2026-05-25 12:13:31.530659382 +0000 UTC m=+21.758077039" observedRunningTime="2026-05-25 12:13:32.616186378 +0000 UTC m=+22.843604056" watchObservedRunningTime="2026-05-25 12:13:32.616818044 +0000 UTC m=+22.844235750" May 25 12:13:32.863587 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:32.863557 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-original-pull-secret\") pod \"global-pull-secret-syncer-bxhdm\" (UID: \"bf6ee847-4da0-4712-b6cf-1b39e6fb91fb\") " pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:32.863686 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:32.863665 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 12:13:32.863790 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:32.863718 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-original-pull-secret podName:bf6ee847-4da0-4712-b6cf-1b39e6fb91fb nodeName:}" failed. No retries permitted until 2026-05-25 12:13:48.863702742 +0000 UTC m=+39.091120397 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-original-pull-secret") pod "global-pull-secret-syncer-bxhdm" (UID: "bf6ee847-4da0-4712-b6cf-1b39e6fb91fb") : object "kube-system"/"original-pull-secret" not registered May 25 12:13:32.869214 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:32.869188 2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 25 12:13:33.348833 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:33.348646 2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-25T12:13:32.869210343Z","UUID":"cb06056c-01fe-44b2-b7a7-cb801c632eff","Handler":null,"Name":"","Endpoint":""} May 25 12:13:33.351482 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:33.351048 2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 25 12:13:33.351482 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:33.351084 2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 25 12:13:33.425032 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:33.424997 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:13:33.425226 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:33.425120 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldgv" podUID="4709a8d8-46d8-4e6d-8e53-17021b442cc8" May 25 12:13:33.534852 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:33.534810 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" event={"ID":"163fbbca-62cd-46c2-9e52-08212856fcf7","Type":"ContainerStarted","Data":"558140b8cb23c827af16f5c16430cd3a8980e0d1b23b6c45ac937219fe72cc96"} May 25 12:13:33.537049 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:33.537016 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gp884" event={"ID":"9121ba37-984d-4b12-992f-5ab12f57c886","Type":"ContainerStarted","Data":"fd004ea0074ce0db42e560b8010574ac47c8a85899382b93df580a146c9fca6c"} May 25 12:13:34.425543 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:34.425506 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:34.425735 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:34.425506 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:34.425735 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:34.425649 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwk2x" podUID="cfe666ec-6ce2-4bfe-9149-8b8a058cd681" May 25 12:13:34.425821 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:34.425740 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxhdm" podUID="bf6ee847-4da0-4712-b6cf-1b39e6fb91fb" May 25 12:13:34.542408 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:34.542307 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/ovn-acl-logging/0.log" May 25 12:13:34.542925 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:34.542748 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" event={"ID":"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7","Type":"ContainerStarted","Data":"657f0508d7b11fca93d986137a19d2eb35968ec5e040479410a2635047041c9a"} May 25 12:13:34.544740 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:34.544694 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" event={"ID":"163fbbca-62cd-46c2-9e52-08212856fcf7","Type":"ContainerStarted","Data":"db9a2435c760d99fc889b32b3f3af709d53bb118084e336f58041ab84a5f1179"} May 25 12:13:34.564884 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:34.564834 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gp884" podStartSLOduration=6.169333606 podStartE2EDuration="24.564820623s" podCreationTimestamp="2026-05-25 12:13:10 +0000 UTC" firstStartedPulling="2026-05-25 12:13:13.121916761 +0000 UTC m=+3.349334431" lastFinishedPulling="2026-05-25 12:13:31.517403779 +0000 UTC m=+21.744821448" observedRunningTime="2026-05-25 12:13:33.559279114 +0000 UTC m=+23.786696791" watchObservedRunningTime="2026-05-25 12:13:34.564820623 +0000 UTC m=+24.792238300" May 25 12:13:34.565209 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:34.565165 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lm24j" podStartSLOduration=4.061054095 podStartE2EDuration="24.565156219s" podCreationTimestamp="2026-05-25 12:13:10 +0000 UTC" firstStartedPulling="2026-05-25 12:13:13.152092375 +0000 UTC m=+3.379510030" lastFinishedPulling="2026-05-25 12:13:33.656194497 +0000 UTC m=+23.883612154" observedRunningTime="2026-05-25 12:13:34.564817002 +0000 UTC m=+24.792234678" watchObservedRunningTime="2026-05-25 12:13:34.565156219 +0000 UTC m=+24.792573900" May 25 12:13:35.425728 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:35.425691 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:13:35.425921 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:35.425816 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldgv" podUID="4709a8d8-46d8-4e6d-8e53-17021b442cc8" May 25 12:13:36.425460 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:36.425421 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:36.426151 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:36.425561 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwk2x" podUID="cfe666ec-6ce2-4bfe-9149-8b8a058cd681" May 25 12:13:36.426151 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:36.425611 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:36.426151 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:36.425703 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxhdm" podUID="bf6ee847-4da0-4712-b6cf-1b39e6fb91fb" May 25 12:13:36.553563 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:36.552875 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/ovn-acl-logging/0.log" May 25 12:13:36.553563 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:36.553431 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" event={"ID":"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7","Type":"ContainerStarted","Data":"0c36e99505de476e3f25d9d82d3a28bc37cd3d13a51f788759a64998a2124846"} May 25 12:13:36.553856 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:36.553822 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:36.554319 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:36.554294 2569 scope.go:117] "RemoveContainer" containerID="c5a33cd68b3f05a463df9ffa1dad39e241077c86b491caacffab0e8aff5860a0" May 25 12:13:36.574797 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:36.573026 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:37.053197 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:37.053161 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2fsnt" May 25 12:13:37.053764 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:37.053740 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2fsnt" May 25 12:13:37.425032 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:37.425003 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:13:37.425198 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:37.425111 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldgv" podUID="4709a8d8-46d8-4e6d-8e53-17021b442cc8" May 25 12:13:37.558862 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:37.558830 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/ovn-acl-logging/0.log" May 25 12:13:37.559325 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:37.559212 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" event={"ID":"b5b21efc-8e4f-43d2-9f26-7a1832e1cee7","Type":"ContainerStarted","Data":"ad1aaa0d27fe82cb2b7cc52c8cc78714c0ce4fe1c759f7a86acfc1c87a591bbe"} May 25 12:13:37.559555 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:37.559521 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:37.559555 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:37.559553 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:37.561212 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:37.561191 2569 generic.go:358] "Generic (PLEG): container finished" podID="e5130231-8dd8-4aa5-8f05-6768b03404bf" containerID="9f7926ba3842b0a137f84978d77b5928e991c981004c04308273c39ff0fe6df7" exitCode=0 May 25 12:13:37.561329 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:37.561233 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wjdzw" event={"ID":"e5130231-8dd8-4aa5-8f05-6768b03404bf","Type":"ContainerDied","Data":"9f7926ba3842b0a137f84978d77b5928e991c981004c04308273c39ff0fe6df7"} May 25 12:13:37.576372 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:37.576350 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:13:37.587268 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:37.587207 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" podStartSLOduration=9.14970981 podStartE2EDuration="27.587193299s" podCreationTimestamp="2026-05-25 12:13:10 +0000 UTC" firstStartedPulling="2026-05-25 12:13:13.151843835 +0000 UTC m=+3.379261495" lastFinishedPulling="2026-05-25 12:13:31.589327323 +0000 UTC m=+21.816744984" observedRunningTime="2026-05-25 12:13:37.586327908 +0000 UTC m=+27.813745584" watchObservedRunningTime="2026-05-25 12:13:37.587193299 +0000 UTC m=+27.814611010" May 25 12:13:38.425866 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:38.425824 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:38.426034 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:38.425828 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:38.426034 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:38.426010 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwk2x" podUID="cfe666ec-6ce2-4bfe-9149-8b8a058cd681" May 25 12:13:38.426130 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:38.426106 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxhdm" podUID="bf6ee847-4da0-4712-b6cf-1b39e6fb91fb" May 25 12:13:38.750984 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:38.750688 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xwk2x"] May 25 12:13:38.751325 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:38.751045 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:38.751325 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:38.751174 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwk2x" podUID="cfe666ec-6ce2-4bfe-9149-8b8a058cd681" May 25 12:13:38.753271 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:38.753246 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bxhdm"] May 25 12:13:38.753400 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:38.753321 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:38.753456 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:38.753398 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxhdm" podUID="bf6ee847-4da0-4712-b6cf-1b39e6fb91fb" May 25 12:13:38.765889 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:38.765862 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mldgv"] May 25 12:13:38.766086 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:38.766000 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:13:38.766192 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:38.766089 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldgv" podUID="4709a8d8-46d8-4e6d-8e53-17021b442cc8" May 25 12:13:39.566770 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:39.566735 2569 generic.go:358] "Generic (PLEG): container finished" podID="e5130231-8dd8-4aa5-8f05-6768b03404bf" containerID="b41ddadc04d7706b38f3faf355232ba392daa8887815d08160b5092561362e9b" exitCode=0 May 25 12:13:39.566922 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:39.566817 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wjdzw" event={"ID":"e5130231-8dd8-4aa5-8f05-6768b03404bf","Type":"ContainerDied","Data":"b41ddadc04d7706b38f3faf355232ba392daa8887815d08160b5092561362e9b"} May 25 12:13:40.152108 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:40.152065 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2fsnt" May 25 12:13:40.152560 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:40.152229 2569 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 25 12:13:40.152720 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:40.152703 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2fsnt" May 25 12:13:40.426668 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:40.426639 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:13:40.426821 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:40.426730 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldgv" podUID="4709a8d8-46d8-4e6d-8e53-17021b442cc8" May 25 12:13:40.426821 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:40.426799 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:40.426919 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:40.426899 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxhdm" podUID="bf6ee847-4da0-4712-b6cf-1b39e6fb91fb" May 25 12:13:40.426988 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:40.426957 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:40.427048 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:40.427030 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwk2x" podUID="cfe666ec-6ce2-4bfe-9149-8b8a058cd681" May 25 12:13:40.571342 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:40.571309 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wjdzw" event={"ID":"e5130231-8dd8-4aa5-8f05-6768b03404bf","Type":"ContainerStarted","Data":"ae0ac1c85055a52f921ff375d565bbe2ef2fe7da537ed04c8eb37dcfef9f43ac"} May 25 12:13:41.575491 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:41.575453 2569 generic.go:358] "Generic (PLEG): container finished" podID="e5130231-8dd8-4aa5-8f05-6768b03404bf" containerID="ae0ac1c85055a52f921ff375d565bbe2ef2fe7da537ed04c8eb37dcfef9f43ac" exitCode=0 May 25 12:13:41.576328 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:41.575503 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wjdzw" event={"ID":"e5130231-8dd8-4aa5-8f05-6768b03404bf","Type":"ContainerDied","Data":"ae0ac1c85055a52f921ff375d565bbe2ef2fe7da537ed04c8eb37dcfef9f43ac"} May 25 12:13:42.428798 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:42.428765 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:13:42.429064 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:42.428780 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:42.429064 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:42.428882 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldgv" podUID="4709a8d8-46d8-4e6d-8e53-17021b442cc8" May 25 12:13:42.429064 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:42.428780 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:42.429064 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:42.428955 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxhdm" podUID="bf6ee847-4da0-4712-b6cf-1b39e6fb91fb" May 25 12:13:42.429230 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:42.429070 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xwk2x" podUID="cfe666ec-6ce2-4bfe-9149-8b8a058cd681" May 25 12:13:43.623771 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.623744 2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-4.ec2.internal" event="NodeReady" May 25 12:13:43.624288 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.623897 2569 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 25 12:13:43.673875 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.673118 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6284j"] May 25 12:13:43.692617 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.692583 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mpnlz"] May 25 12:13:43.692803 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.692740 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6284j" May 25 12:13:43.694607 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.694580 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 25 12:13:43.695022 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.694591 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 25 12:13:43.695117 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.694902 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c8dc6\"" May 25 12:13:43.710673 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.710645 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6284j"] May 25 12:13:43.710816 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.710682 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mpnlz"] May 25 12:13:43.710816 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.710781 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mpnlz" May 25 12:13:43.712764 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.712735 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 25 12:13:43.713015 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.712994 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-sw9bq\"" May 25 12:13:43.713115 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.713060 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 25 12:13:43.713166 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.712994 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 25 12:13:43.846144 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.846102 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpqj4\" (UniqueName: \"kubernetes.io/projected/27ca0001-404e-4e5f-ba48-1698e3cee67f-kube-api-access-qpqj4\") pod \"dns-default-6284j\" (UID: \"27ca0001-404e-4e5f-ba48-1698e3cee67f\") " pod="openshift-dns/dns-default-6284j" May 25 12:13:43.846348 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.846171 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrr68\" (UniqueName: \"kubernetes.io/projected/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-kube-api-access-mrr68\") pod \"ingress-canary-mpnlz\" (UID: \"fdb1b8ee-d354-463f-89b6-0b8140aa2dd7\") " pod="openshift-ingress-canary/ingress-canary-mpnlz" May 25 12:13:43.846348 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.846213 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27ca0001-404e-4e5f-ba48-1698e3cee67f-tmp-dir\") pod \"dns-default-6284j\" (UID: \"27ca0001-404e-4e5f-ba48-1698e3cee67f\") " pod="openshift-dns/dns-default-6284j" May 25 12:13:43.846348 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.846240 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert\") pod \"ingress-canary-mpnlz\" (UID: \"fdb1b8ee-d354-463f-89b6-0b8140aa2dd7\") " pod="openshift-ingress-canary/ingress-canary-mpnlz" May 25 12:13:43.846348 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.846289 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/27ca0001-404e-4e5f-ba48-1698e3cee67f-config-volume\") pod \"dns-default-6284j\" (UID: \"27ca0001-404e-4e5f-ba48-1698e3cee67f\") " pod="openshift-dns/dns-default-6284j" May 25 12:13:43.846348 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.846315 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls\") pod \"dns-default-6284j\" (UID: \"27ca0001-404e-4e5f-ba48-1698e3cee67f\") " pod="openshift-dns/dns-default-6284j" May 25 12:13:43.947431 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.947399 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qpqj4\" (UniqueName: \"kubernetes.io/projected/27ca0001-404e-4e5f-ba48-1698e3cee67f-kube-api-access-qpqj4\") pod \"dns-default-6284j\" (UID: \"27ca0001-404e-4e5f-ba48-1698e3cee67f\") " pod="openshift-dns/dns-default-6284j" May 25 12:13:43.947622 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.947449 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mrr68\" (UniqueName: \"kubernetes.io/projected/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-kube-api-access-mrr68\") pod \"ingress-canary-mpnlz\" (UID: \"fdb1b8ee-d354-463f-89b6-0b8140aa2dd7\") " pod="openshift-ingress-canary/ingress-canary-mpnlz" May 25 12:13:43.947622 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.947478 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27ca0001-404e-4e5f-ba48-1698e3cee67f-tmp-dir\") pod \"dns-default-6284j\" (UID: \"27ca0001-404e-4e5f-ba48-1698e3cee67f\") " pod="openshift-dns/dns-default-6284j" May 25 12:13:43.947622 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.947502 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert\") pod \"ingress-canary-mpnlz\" (UID: \"fdb1b8ee-d354-463f-89b6-0b8140aa2dd7\") " pod="openshift-ingress-canary/ingress-canary-mpnlz" May 25 12:13:43.947622 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.947544 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/27ca0001-404e-4e5f-ba48-1698e3cee67f-config-volume\") pod \"dns-default-6284j\" (UID: \"27ca0001-404e-4e5f-ba48-1698e3cee67f\") " pod="openshift-dns/dns-default-6284j" May 25 12:13:43.947622 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.947565 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls\") pod \"dns-default-6284j\" (UID: \"27ca0001-404e-4e5f-ba48-1698e3cee67f\") " pod="openshift-dns/dns-default-6284j" May 25 12:13:43.947821 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:43.947670 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 12:13:43.947821 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:43.947728 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls podName:27ca0001-404e-4e5f-ba48-1698e3cee67f nodeName:}" failed. No retries permitted until 2026-05-25 12:13:44.447708976 +0000 UTC m=+34.675126638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls") pod "dns-default-6284j" (UID: "27ca0001-404e-4e5f-ba48-1698e3cee67f") : secret "dns-default-metrics-tls" not found May 25 12:13:43.948292 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.948267 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27ca0001-404e-4e5f-ba48-1698e3cee67f-tmp-dir\") pod \"dns-default-6284j\" (UID: \"27ca0001-404e-4e5f-ba48-1698e3cee67f\") " pod="openshift-dns/dns-default-6284j" May 25 12:13:43.948398 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:43.948385 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 12:13:43.948448 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:43.948437 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert podName:fdb1b8ee-d354-463f-89b6-0b8140aa2dd7 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:44.448419198 +0000 UTC m=+34.675836854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert") pod "ingress-canary-mpnlz" (UID: "fdb1b8ee-d354-463f-89b6-0b8140aa2dd7") : secret "canary-serving-cert" not found May 25 12:13:43.948809 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.948778 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/27ca0001-404e-4e5f-ba48-1698e3cee67f-config-volume\") pod \"dns-default-6284j\" (UID: \"27ca0001-404e-4e5f-ba48-1698e3cee67f\") " pod="openshift-dns/dns-default-6284j" May 25 12:13:43.963213 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.963188 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpqj4\" (UniqueName: \"kubernetes.io/projected/27ca0001-404e-4e5f-ba48-1698e3cee67f-kube-api-access-qpqj4\") pod \"dns-default-6284j\" (UID: \"27ca0001-404e-4e5f-ba48-1698e3cee67f\") " pod="openshift-dns/dns-default-6284j" May 25 12:13:43.963474 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:43.963451 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrr68\" (UniqueName: \"kubernetes.io/projected/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-kube-api-access-mrr68\") pod \"ingress-canary-mpnlz\" (UID: \"fdb1b8ee-d354-463f-89b6-0b8140aa2dd7\") " pod="openshift-ingress-canary/ingress-canary-mpnlz" May 25 12:13:44.048467 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:44.048431 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgc84\" (UniqueName: \"kubernetes.io/projected/4709a8d8-46d8-4e6d-8e53-17021b442cc8-kube-api-access-jgc84\") pod \"network-check-target-mldgv\" (UID: \"4709a8d8-46d8-4e6d-8e53-17021b442cc8\") " pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:13:44.048627 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:44.048572 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 12:13:44.048627 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:44.048589 2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 12:13:44.048627 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:44.048598 2569 projected.go:194] Error preparing data for projected volume kube-api-access-jgc84 for pod openshift-network-diagnostics/network-check-target-mldgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:13:44.048730 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:44.048651 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4709a8d8-46d8-4e6d-8e53-17021b442cc8-kube-api-access-jgc84 podName:4709a8d8-46d8-4e6d-8e53-17021b442cc8 nodeName:}" failed. No retries permitted until 2026-05-25 12:14:16.048634527 +0000 UTC m=+66.276052185 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jgc84" (UniqueName: "kubernetes.io/projected/4709a8d8-46d8-4e6d-8e53-17021b442cc8-kube-api-access-jgc84") pod "network-check-target-mldgv" (UID: "4709a8d8-46d8-4e6d-8e53-17021b442cc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 12:13:44.149289 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:44.149255 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs\") pod \"network-metrics-daemon-xwk2x\" (UID: \"cfe666ec-6ce2-4bfe-9149-8b8a058cd681\") " pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:44.149459 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:44.149420 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:13:44.149502 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:44.149486 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs podName:cfe666ec-6ce2-4bfe-9149-8b8a058cd681 nodeName:}" failed. No retries permitted until 2026-05-25 12:14:16.149469871 +0000 UTC m=+66.376887530 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs") pod "network-metrics-daemon-xwk2x" (UID: "cfe666ec-6ce2-4bfe-9149-8b8a058cd681") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 12:13:44.425294 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:44.425251 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:44.425513 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:44.425253 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:13:44.425513 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:44.425395 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:13:44.427848 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:44.427827 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 25 12:13:44.428958 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:44.428360 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nmk2h\"" May 25 12:13:44.428958 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:44.428374 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 25 12:13:44.428958 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:44.428412 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 25 12:13:44.428958 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:44.428424 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rrs9z\"" May 25 12:13:44.428958 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:44.428365 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 25 12:13:44.451162 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:44.451138 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert\") pod \"ingress-canary-mpnlz\" (UID: \"fdb1b8ee-d354-463f-89b6-0b8140aa2dd7\") " pod="openshift-ingress-canary/ingress-canary-mpnlz" May 25 12:13:44.451296 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:44.451198 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls\") pod \"dns-default-6284j\" (UID: \"27ca0001-404e-4e5f-ba48-1698e3cee67f\") " pod="openshift-dns/dns-default-6284j" May 25 12:13:44.451356 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:44.451294 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 12:13:44.451397 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:44.451369 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls podName:27ca0001-404e-4e5f-ba48-1698e3cee67f nodeName:}" failed. No retries permitted until 2026-05-25 12:13:45.451353047 +0000 UTC m=+35.678770701 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls") pod "dns-default-6284j" (UID: "27ca0001-404e-4e5f-ba48-1698e3cee67f") : secret "dns-default-metrics-tls" not found May 25 12:13:44.451397 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:44.451294 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 12:13:44.451497 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:44.451434 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert podName:fdb1b8ee-d354-463f-89b6-0b8140aa2dd7 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:45.451422611 +0000 UTC m=+35.678840268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert") pod "ingress-canary-mpnlz" (UID: "fdb1b8ee-d354-463f-89b6-0b8140aa2dd7") : secret "canary-serving-cert" not found May 25 12:13:45.459112 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:45.459071 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls\") pod \"dns-default-6284j\" (UID: \"27ca0001-404e-4e5f-ba48-1698e3cee67f\") " pod="openshift-dns/dns-default-6284j" May 25 12:13:45.459560 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:45.459178 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert\") pod \"ingress-canary-mpnlz\" (UID: \"fdb1b8ee-d354-463f-89b6-0b8140aa2dd7\") " pod="openshift-ingress-canary/ingress-canary-mpnlz" May 25 12:13:45.459560 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:45.459255 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 12:13:45.459560 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:45.459280 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 12:13:45.459560 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:45.459340 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls podName:27ca0001-404e-4e5f-ba48-1698e3cee67f nodeName:}" failed. No retries permitted until 2026-05-25 12:13:47.459317311 +0000 UTC m=+37.686734967 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls") pod "dns-default-6284j" (UID: "27ca0001-404e-4e5f-ba48-1698e3cee67f") : secret "dns-default-metrics-tls" not found May 25 12:13:45.459560 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:45.459364 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert podName:fdb1b8ee-d354-463f-89b6-0b8140aa2dd7 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:47.459351783 +0000 UTC m=+37.686769439 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert") pod "ingress-canary-mpnlz" (UID: "fdb1b8ee-d354-463f-89b6-0b8140aa2dd7") : secret "canary-serving-cert" not found May 25 12:13:47.478216 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:47.478175 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls\") pod \"dns-default-6284j\" (UID: \"27ca0001-404e-4e5f-ba48-1698e3cee67f\") " pod="openshift-dns/dns-default-6284j" May 25 12:13:47.478630 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:47.478257 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert\") pod \"ingress-canary-mpnlz\" (UID: \"fdb1b8ee-d354-463f-89b6-0b8140aa2dd7\") " pod="openshift-ingress-canary/ingress-canary-mpnlz" May 25 12:13:47.478630 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:47.478340 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 12:13:47.478630 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:47.478354 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 12:13:47.478630 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:47.478392 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert podName:fdb1b8ee-d354-463f-89b6-0b8140aa2dd7 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:51.478377424 +0000 UTC m=+41.705795080 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert") pod "ingress-canary-mpnlz" (UID: "fdb1b8ee-d354-463f-89b6-0b8140aa2dd7") : secret "canary-serving-cert" not found May 25 12:13:47.478630 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:47.478421 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls podName:27ca0001-404e-4e5f-ba48-1698e3cee67f nodeName:}" failed. No retries permitted until 2026-05-25 12:13:51.47840384 +0000 UTC m=+41.705821499 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls") pod "dns-default-6284j" (UID: "27ca0001-404e-4e5f-ba48-1698e3cee67f") : secret "dns-default-metrics-tls" not found May 25 12:13:48.592054 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:48.591421 2569 generic.go:358] "Generic (PLEG): container finished" podID="e5130231-8dd8-4aa5-8f05-6768b03404bf" containerID="d4ac39bee0184480182b3b5a61cd6d76cd2e0e6b3c758d4da0534f804c3fb13b" exitCode=0 May 25 12:13:48.592054 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:48.591558 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wjdzw" event={"ID":"e5130231-8dd8-4aa5-8f05-6768b03404bf","Type":"ContainerDied","Data":"d4ac39bee0184480182b3b5a61cd6d76cd2e0e6b3c758d4da0534f804c3fb13b"} May 25 12:13:48.886760 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:48.886652 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-original-pull-secret\") pod \"global-pull-secret-syncer-bxhdm\" (UID: \"bf6ee847-4da0-4712-b6cf-1b39e6fb91fb\") " pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:48.889817 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:48.889782 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bf6ee847-4da0-4712-b6cf-1b39e6fb91fb-original-pull-secret\") pod \"global-pull-secret-syncer-bxhdm\" (UID: \"bf6ee847-4da0-4712-b6cf-1b39e6fb91fb\") " pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:48.937772 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:48.937731 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxhdm" May 25 12:13:49.124516 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:49.124325 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bxhdm"] May 25 12:13:49.129768 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:13:49.129727 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf6ee847_4da0_4712_b6cf_1b39e6fb91fb.slice/crio-17ee66e486ce932b4ca964e87dc064456141647e1b9981529afc2db5b3236625 WatchSource:0}: Error finding container 17ee66e486ce932b4ca964e87dc064456141647e1b9981529afc2db5b3236625: Status 404 returned error can't find the container with id 17ee66e486ce932b4ca964e87dc064456141647e1b9981529afc2db5b3236625 May 25 12:13:49.596108 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:49.596068 2569 generic.go:358] "Generic (PLEG): container finished" podID="e5130231-8dd8-4aa5-8f05-6768b03404bf" containerID="244c5e8d7d8c8b54d68b09e3469f2da643f798266c4d05c3d02d74170ac69eb1" exitCode=0 May 25 12:13:49.596673 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:49.596159 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wjdzw" event={"ID":"e5130231-8dd8-4aa5-8f05-6768b03404bf","Type":"ContainerDied","Data":"244c5e8d7d8c8b54d68b09e3469f2da643f798266c4d05c3d02d74170ac69eb1"} May 25 12:13:49.597265 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:49.597239 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bxhdm" event={"ID":"bf6ee847-4da0-4712-b6cf-1b39e6fb91fb","Type":"ContainerStarted","Data":"17ee66e486ce932b4ca964e87dc064456141647e1b9981529afc2db5b3236625"} May 25 12:13:50.603157 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:50.603123 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wjdzw" event={"ID":"e5130231-8dd8-4aa5-8f05-6768b03404bf","Type":"ContainerStarted","Data":"6414ded83d4d3548d6dd2311e2522f88c79cb3464ea1db2d5bab25f53896ac73"} May 25 12:13:50.629395 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:50.627917 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wjdzw" podStartSLOduration=6.076749366 podStartE2EDuration="40.62789853s" podCreationTimestamp="2026-05-25 12:13:10 +0000 UTC" firstStartedPulling="2026-05-25 12:13:13.12008328 +0000 UTC m=+3.347500950" lastFinishedPulling="2026-05-25 12:13:47.671232445 +0000 UTC m=+37.898650114" observedRunningTime="2026-05-25 12:13:50.626562808 +0000 UTC m=+40.853980482" watchObservedRunningTime="2026-05-25 12:13:50.62789853 +0000 UTC m=+40.855316207" May 25 12:13:51.509498 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:51.509458 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert\") pod \"ingress-canary-mpnlz\" (UID: \"fdb1b8ee-d354-463f-89b6-0b8140aa2dd7\") " pod="openshift-ingress-canary/ingress-canary-mpnlz" May 25 12:13:51.509498 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:51.509517 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls\") pod \"dns-default-6284j\" (UID: \"27ca0001-404e-4e5f-ba48-1698e3cee67f\") " pod="openshift-dns/dns-default-6284j" May 25 12:13:51.509760 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:51.509633 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 12:13:51.509760 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:51.509640 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 12:13:51.509760 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:51.509705 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls podName:27ca0001-404e-4e5f-ba48-1698e3cee67f nodeName:}" failed. No retries permitted until 2026-05-25 12:13:59.509687124 +0000 UTC m=+49.737104781 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls") pod "dns-default-6284j" (UID: "27ca0001-404e-4e5f-ba48-1698e3cee67f") : secret "dns-default-metrics-tls" not found May 25 12:13:51.509760 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:51.509721 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert podName:fdb1b8ee-d354-463f-89b6-0b8140aa2dd7 nodeName:}" failed. No retries permitted until 2026-05-25 12:13:59.509715201 +0000 UTC m=+49.737132856 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert") pod "ingress-canary-mpnlz" (UID: "fdb1b8ee-d354-463f-89b6-0b8140aa2dd7") : secret "canary-serving-cert" not found May 25 12:13:53.610406 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:53.610363 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bxhdm" event={"ID":"bf6ee847-4da0-4712-b6cf-1b39e6fb91fb","Type":"ContainerStarted","Data":"da430f935e148cf9b8bdb015679da46872b1c8d01de8039e6d2cb56ad4cf744c"} May 25 12:13:53.627682 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:53.627543 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bxhdm" podStartSLOduration=32.926813051 podStartE2EDuration="36.627523245s" podCreationTimestamp="2026-05-25 12:13:17 +0000 UTC" firstStartedPulling="2026-05-25 12:13:49.131300209 +0000 UTC m=+39.358717866" lastFinishedPulling="2026-05-25 12:13:52.832010401 +0000 UTC m=+43.059428060" observedRunningTime="2026-05-25 12:13:53.627272934 +0000 UTC m=+43.854690612" watchObservedRunningTime="2026-05-25 12:13:53.627523245 +0000 UTC m=+43.854940923" May 25 12:13:59.571574 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:59.571530 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert\") pod \"ingress-canary-mpnlz\" (UID: \"fdb1b8ee-d354-463f-89b6-0b8140aa2dd7\") " pod="openshift-ingress-canary/ingress-canary-mpnlz" May 25 12:13:59.571574 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:13:59.571583 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls\") pod \"dns-default-6284j\" (UID: \"27ca0001-404e-4e5f-ba48-1698e3cee67f\") " pod="openshift-dns/dns-default-6284j" May 25 12:13:59.572031 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:59.571681 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 12:13:59.572031 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:59.571683 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 12:13:59.572031 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:59.571736 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls podName:27ca0001-404e-4e5f-ba48-1698e3cee67f nodeName:}" failed. No retries permitted until 2026-05-25 12:14:15.571720524 +0000 UTC m=+65.799138178 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls") pod "dns-default-6284j" (UID: "27ca0001-404e-4e5f-ba48-1698e3cee67f") : secret "dns-default-metrics-tls" not found May 25 12:13:59.572031 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:13:59.571749 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert podName:fdb1b8ee-d354-463f-89b6-0b8140aa2dd7 nodeName:}" failed. No retries permitted until 2026-05-25 12:14:15.571742853 +0000 UTC m=+65.799160507 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert") pod "ingress-canary-mpnlz" (UID: "fdb1b8ee-d354-463f-89b6-0b8140aa2dd7") : secret "canary-serving-cert" not found May 25 12:14:09.581672 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:09.581641 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z8r9j" May 25 12:14:15.587869 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:15.587810 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert\") pod \"ingress-canary-mpnlz\" (UID: \"fdb1b8ee-d354-463f-89b6-0b8140aa2dd7\") " pod="openshift-ingress-canary/ingress-canary-mpnlz" May 25 12:14:15.587869 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:15.587881 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls\") pod \"dns-default-6284j\" (UID: \"27ca0001-404e-4e5f-ba48-1698e3cee67f\") " pod="openshift-dns/dns-default-6284j" May 25 12:14:15.588554 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:14:15.587991 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 12:14:15.588554 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:14:15.587999 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 12:14:15.588554 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:14:15.588049 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls podName:27ca0001-404e-4e5f-ba48-1698e3cee67f nodeName:}" failed. No retries permitted until 2026-05-25 12:14:47.58803386 +0000 UTC m=+97.815451515 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls") pod "dns-default-6284j" (UID: "27ca0001-404e-4e5f-ba48-1698e3cee67f") : secret "dns-default-metrics-tls" not found May 25 12:14:15.588554 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:14:15.588062 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert podName:fdb1b8ee-d354-463f-89b6-0b8140aa2dd7 nodeName:}" failed. No retries permitted until 2026-05-25 12:14:47.588056719 +0000 UTC m=+97.815474374 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert") pod "ingress-canary-mpnlz" (UID: "fdb1b8ee-d354-463f-89b6-0b8140aa2dd7") : secret "canary-serving-cert" not found May 25 12:14:16.092208 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:16.092175 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgc84\" (UniqueName: \"kubernetes.io/projected/4709a8d8-46d8-4e6d-8e53-17021b442cc8-kube-api-access-jgc84\") pod \"network-check-target-mldgv\" (UID: \"4709a8d8-46d8-4e6d-8e53-17021b442cc8\") " pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:14:16.094677 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:16.094656 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 25 12:14:16.104882 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:16.104851 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 25 12:14:16.115835 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:16.115804 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgc84\" (UniqueName: \"kubernetes.io/projected/4709a8d8-46d8-4e6d-8e53-17021b442cc8-kube-api-access-jgc84\") pod \"network-check-target-mldgv\" (UID: \"4709a8d8-46d8-4e6d-8e53-17021b442cc8\") " pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:14:16.193066 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:16.193027 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs\") pod \"network-metrics-daemon-xwk2x\" (UID: \"cfe666ec-6ce2-4bfe-9149-8b8a058cd681\") " pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:14:16.195465 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:16.195446 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 25 12:14:16.203701 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:14:16.203683 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 25 12:14:16.203760 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:14:16.203751 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs podName:cfe666ec-6ce2-4bfe-9149-8b8a058cd681 nodeName:}" failed. No retries permitted until 2026-05-25 12:15:20.203733187 +0000 UTC m=+130.431150844 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs") pod "network-metrics-daemon-xwk2x" (UID: "cfe666ec-6ce2-4bfe-9149-8b8a058cd681") : secret "metrics-daemon-secret" not found May 25 12:14:16.246450 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:16.246422 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nmk2h\"" May 25 12:14:16.254747 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:16.254727 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:14:16.394483 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:16.394398 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mldgv"] May 25 12:14:16.398468 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:14:16.398429 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4709a8d8_46d8_4e6d_8e53_17021b442cc8.slice/crio-f7fd7776a8eefb9390e26d3e5740fb9f172ab0b7287310f7c4c3e00a78155c37 WatchSource:0}: Error finding container f7fd7776a8eefb9390e26d3e5740fb9f172ab0b7287310f7c4c3e00a78155c37: Status 404 returned error can't find the container with id f7fd7776a8eefb9390e26d3e5740fb9f172ab0b7287310f7c4c3e00a78155c37 May 25 12:14:16.655724 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:16.655632 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mldgv" event={"ID":"4709a8d8-46d8-4e6d-8e53-17021b442cc8","Type":"ContainerStarted","Data":"f7fd7776a8eefb9390e26d3e5740fb9f172ab0b7287310f7c4c3e00a78155c37"} May 25 12:14:19.663127 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:19.663083 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mldgv" event={"ID":"4709a8d8-46d8-4e6d-8e53-17021b442cc8","Type":"ContainerStarted","Data":"c83905bda31f50b32d8eec641f89eee7f31d8106eae25c5c94dcdd4af4391faf"} May 25 12:14:19.663506 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:19.663330 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:14:19.681408 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:19.681362 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mldgv" podStartSLOduration=67.189613874 podStartE2EDuration="1m9.681348914s" podCreationTimestamp="2026-05-25 12:13:10 +0000 UTC" firstStartedPulling="2026-05-25 12:14:16.400473451 +0000 UTC m=+66.627891106" lastFinishedPulling="2026-05-25 12:14:18.892208489 +0000 UTC m=+69.119626146" observedRunningTime="2026-05-25 12:14:19.680532179 +0000 UTC m=+69.907949859" watchObservedRunningTime="2026-05-25 12:14:19.681348914 +0000 UTC m=+69.908766591" May 25 12:14:46.253998 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.253960 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-z9fqm"] May 25 12:14:46.256333 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.256314 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-z9fqm" May 25 12:14:46.258544 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.258514 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 25 12:14:46.258757 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.258735 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-n7kjp\"" May 25 12:14:46.258825 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.258747 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 25 12:14:46.264544 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.264511 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-z9fqm"] May 25 12:14:46.287252 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.287215 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbbw2\" (UniqueName: \"kubernetes.io/projected/bc86fe4f-52b8-468e-99dc-5b34bd09dd6d-kube-api-access-vbbw2\") pod \"volume-data-source-validator-5cf8c89d64-z9fqm\" (UID: \"bc86fe4f-52b8-468e-99dc-5b34bd09dd6d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-z9fqm" May 25 12:14:46.359073 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.359040 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-wtzrg"] May 25 12:14:46.360826 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.360810 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-wtzrg" May 25 12:14:46.365090 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.365068 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 25 12:14:46.365413 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.365398 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 25 12:14:46.365413 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.365404 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 25 12:14:46.365640 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.365628 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 25 12:14:46.365691 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.365659 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-9n8cw\"" May 25 12:14:46.371663 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.371637 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 25 12:14:46.373793 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.373768 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-wtzrg"] May 25 12:14:46.387786 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.387751 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1bbf38fe-0f28-4fa3-8e04-4d0520f30c14-serving-cert\") pod \"console-operator-76dff48d59-wtzrg\" (UID: \"1bbf38fe-0f28-4fa3-8e04-4d0520f30c14\") " pod="openshift-console-operator/console-operator-76dff48d59-wtzrg" May 25 12:14:46.387972 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.387795 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vbbw2\" (UniqueName: \"kubernetes.io/projected/bc86fe4f-52b8-468e-99dc-5b34bd09dd6d-kube-api-access-vbbw2\") pod \"volume-data-source-validator-5cf8c89d64-z9fqm\" (UID: \"bc86fe4f-52b8-468e-99dc-5b34bd09dd6d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-z9fqm" May 25 12:14:46.387972 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.387816 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqb86\" (UniqueName: \"kubernetes.io/projected/1bbf38fe-0f28-4fa3-8e04-4d0520f30c14-kube-api-access-pqb86\") pod \"console-operator-76dff48d59-wtzrg\" (UID: \"1bbf38fe-0f28-4fa3-8e04-4d0520f30c14\") " pod="openshift-console-operator/console-operator-76dff48d59-wtzrg" May 25 12:14:46.387972 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.387852 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1bbf38fe-0f28-4fa3-8e04-4d0520f30c14-config\") pod \"console-operator-76dff48d59-wtzrg\" (UID: \"1bbf38fe-0f28-4fa3-8e04-4d0520f30c14\") " pod="openshift-console-operator/console-operator-76dff48d59-wtzrg" May 25 12:14:46.387972 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.387886 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1bbf38fe-0f28-4fa3-8e04-4d0520f30c14-trusted-ca\") pod \"console-operator-76dff48d59-wtzrg\" (UID: \"1bbf38fe-0f28-4fa3-8e04-4d0520f30c14\") " pod="openshift-console-operator/console-operator-76dff48d59-wtzrg" May 25 12:14:46.401611 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.401573 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbbw2\" (UniqueName: \"kubernetes.io/projected/bc86fe4f-52b8-468e-99dc-5b34bd09dd6d-kube-api-access-vbbw2\") pod \"volume-data-source-validator-5cf8c89d64-z9fqm\" (UID: \"bc86fe4f-52b8-468e-99dc-5b34bd09dd6d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-z9fqm" May 25 12:14:46.451192 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.451162 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-5jcxl"] May 25 12:14:46.452868 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.452850 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5jcxl" May 25 12:14:46.456348 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.455543 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vmkc2\"" May 25 12:14:46.456348 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.455643 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 25 12:14:46.456348 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.456059 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 25 12:14:46.456348 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.456153 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 25 12:14:46.456348 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.456344 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 25 12:14:46.456698 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.456375 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-vxntb"] May 25 12:14:46.459971 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.459950 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-bnkc2"] May 25 12:14:46.460081 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.460026 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vxntb" May 25 12:14:46.461434 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.461415 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bnkc2" May 25 12:14:46.462004 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.461982 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-2hz5p\"" May 25 12:14:46.463036 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.463014 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-5jcxl"] May 25 12:14:46.463319 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.463253 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 25 12:14:46.463966 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.463916 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 25 12:14:46.464351 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.464335 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 25 12:14:46.464463 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.464367 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bm2m9\"" May 25 12:14:46.464463 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.464456 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 25 12:14:46.466722 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.466703 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-vxntb"] May 25 12:14:46.467519 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.467499 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-bnkc2"] May 25 12:14:46.488773 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.488747 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1bbf38fe-0f28-4fa3-8e04-4d0520f30c14-trusted-ca\") pod \"console-operator-76dff48d59-wtzrg\" (UID: \"1bbf38fe-0f28-4fa3-8e04-4d0520f30c14\") " pod="openshift-console-operator/console-operator-76dff48d59-wtzrg" May 25 12:14:46.488903 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.488788 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1bbf38fe-0f28-4fa3-8e04-4d0520f30c14-serving-cert\") pod \"console-operator-76dff48d59-wtzrg\" (UID: \"1bbf38fe-0f28-4fa3-8e04-4d0520f30c14\") " pod="openshift-console-operator/console-operator-76dff48d59-wtzrg" May 25 12:14:46.488903 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.488820 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6wbm\" (UniqueName: \"kubernetes.io/projected/0398fbca-aafe-47ca-bc5e-7bfeda763426-kube-api-access-k6wbm\") pod \"network-check-source-7f44b6dd87-vxntb\" (UID: \"0398fbca-aafe-47ca-bc5e-7bfeda763426\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vxntb" May 25 12:14:46.488903 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.488853 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c15556-618a-4ad2-9f3a-44ce817b0d48-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-bnkc2\" (UID: \"c0c15556-618a-4ad2-9f3a-44ce817b0d48\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bnkc2" May 25 12:14:46.488903 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.488899 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqb86\" (UniqueName: \"kubernetes.io/projected/1bbf38fe-0f28-4fa3-8e04-4d0520f30c14-kube-api-access-pqb86\") pod \"console-operator-76dff48d59-wtzrg\" (UID: \"1bbf38fe-0f28-4fa3-8e04-4d0520f30c14\") " pod="openshift-console-operator/console-operator-76dff48d59-wtzrg" May 25 12:14:46.489129 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.489049 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9zc6\" (UniqueName: \"kubernetes.io/projected/7665986d-fe60-463b-becc-f2595787ce65-kube-api-access-n9zc6\") pod \"service-ca-operator-57b5b68b8-5jcxl\" (UID: \"7665986d-fe60-463b-becc-f2595787ce65\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5jcxl" May 25 12:14:46.489129 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.489112 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7665986d-fe60-463b-becc-f2595787ce65-config\") pod \"service-ca-operator-57b5b68b8-5jcxl\" (UID: \"7665986d-fe60-463b-becc-f2595787ce65\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5jcxl" May 25 12:14:46.489232 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.489138 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5jxc\" (UniqueName: \"kubernetes.io/projected/c0c15556-618a-4ad2-9f3a-44ce817b0d48-kube-api-access-b5jxc\") pod \"cluster-monitoring-operator-6c75959455-bnkc2\" (UID: \"c0c15556-618a-4ad2-9f3a-44ce817b0d48\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bnkc2" May 25 12:14:46.489232 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.489165 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1bbf38fe-0f28-4fa3-8e04-4d0520f30c14-config\") pod \"console-operator-76dff48d59-wtzrg\" (UID: \"1bbf38fe-0f28-4fa3-8e04-4d0520f30c14\") " pod="openshift-console-operator/console-operator-76dff48d59-wtzrg" May 25 12:14:46.489232 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.489210 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7665986d-fe60-463b-becc-f2595787ce65-serving-cert\") pod \"service-ca-operator-57b5b68b8-5jcxl\" (UID: \"7665986d-fe60-463b-becc-f2595787ce65\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5jcxl" May 25 12:14:46.489338 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.489238 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c0c15556-618a-4ad2-9f3a-44ce817b0d48-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-bnkc2\" (UID: \"c0c15556-618a-4ad2-9f3a-44ce817b0d48\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bnkc2" May 25 12:14:46.489680 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.489648 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1bbf38fe-0f28-4fa3-8e04-4d0520f30c14-config\") pod \"console-operator-76dff48d59-wtzrg\" (UID: \"1bbf38fe-0f28-4fa3-8e04-4d0520f30c14\") " pod="openshift-console-operator/console-operator-76dff48d59-wtzrg" May 25 12:14:46.489783 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.489713 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1bbf38fe-0f28-4fa3-8e04-4d0520f30c14-trusted-ca\") pod \"console-operator-76dff48d59-wtzrg\" (UID: \"1bbf38fe-0f28-4fa3-8e04-4d0520f30c14\") " pod="openshift-console-operator/console-operator-76dff48d59-wtzrg" May 25 12:14:46.491375 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.491358 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1bbf38fe-0f28-4fa3-8e04-4d0520f30c14-serving-cert\") pod \"console-operator-76dff48d59-wtzrg\" (UID: \"1bbf38fe-0f28-4fa3-8e04-4d0520f30c14\") " pod="openshift-console-operator/console-operator-76dff48d59-wtzrg" May 25 12:14:46.500385 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.500350 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqb86\" (UniqueName: \"kubernetes.io/projected/1bbf38fe-0f28-4fa3-8e04-4d0520f30c14-kube-api-access-pqb86\") pod \"console-operator-76dff48d59-wtzrg\" (UID: \"1bbf38fe-0f28-4fa3-8e04-4d0520f30c14\") " pod="openshift-console-operator/console-operator-76dff48d59-wtzrg" May 25 12:14:46.566067 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.565975 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-z9fqm" May 25 12:14:46.590493 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.590463 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k6wbm\" (UniqueName: \"kubernetes.io/projected/0398fbca-aafe-47ca-bc5e-7bfeda763426-kube-api-access-k6wbm\") pod \"network-check-source-7f44b6dd87-vxntb\" (UID: \"0398fbca-aafe-47ca-bc5e-7bfeda763426\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vxntb" May 25 12:14:46.590664 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.590505 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c15556-618a-4ad2-9f3a-44ce817b0d48-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-bnkc2\" (UID: \"c0c15556-618a-4ad2-9f3a-44ce817b0d48\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bnkc2" May 25 12:14:46.590664 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.590543 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n9zc6\" (UniqueName: \"kubernetes.io/projected/7665986d-fe60-463b-becc-f2595787ce65-kube-api-access-n9zc6\") pod \"service-ca-operator-57b5b68b8-5jcxl\" (UID: \"7665986d-fe60-463b-becc-f2595787ce65\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5jcxl" May 25 12:14:46.590664 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.590587 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7665986d-fe60-463b-becc-f2595787ce65-config\") pod \"service-ca-operator-57b5b68b8-5jcxl\" (UID: \"7665986d-fe60-463b-becc-f2595787ce65\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5jcxl" May 25 12:14:46.590820 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:14:46.590686 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 25 12:14:46.590820 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:14:46.590781 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c15556-618a-4ad2-9f3a-44ce817b0d48-cluster-monitoring-operator-tls podName:c0c15556-618a-4ad2-9f3a-44ce817b0d48 nodeName:}" failed. No retries permitted until 2026-05-25 12:14:47.09075755 +0000 UTC m=+97.318175215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c0c15556-618a-4ad2-9f3a-44ce817b0d48-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-bnkc2" (UID: "c0c15556-618a-4ad2-9f3a-44ce817b0d48") : secret "cluster-monitoring-operator-tls" not found May 25 12:14:46.590820 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.590809 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b5jxc\" (UniqueName: \"kubernetes.io/projected/c0c15556-618a-4ad2-9f3a-44ce817b0d48-kube-api-access-b5jxc\") pod \"cluster-monitoring-operator-6c75959455-bnkc2\" (UID: \"c0c15556-618a-4ad2-9f3a-44ce817b0d48\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bnkc2" May 25 12:14:46.591002 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.590858 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7665986d-fe60-463b-becc-f2595787ce65-serving-cert\") pod \"service-ca-operator-57b5b68b8-5jcxl\" (UID: \"7665986d-fe60-463b-becc-f2595787ce65\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5jcxl" May 25 12:14:46.591002 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.590894 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c0c15556-618a-4ad2-9f3a-44ce817b0d48-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-bnkc2\" (UID: \"c0c15556-618a-4ad2-9f3a-44ce817b0d48\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bnkc2" May 25 12:14:46.591213 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.591188 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7665986d-fe60-463b-becc-f2595787ce65-config\") pod \"service-ca-operator-57b5b68b8-5jcxl\" (UID: \"7665986d-fe60-463b-becc-f2595787ce65\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5jcxl" May 25 12:14:46.591530 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.591505 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c0c15556-618a-4ad2-9f3a-44ce817b0d48-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-bnkc2\" (UID: \"c0c15556-618a-4ad2-9f3a-44ce817b0d48\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bnkc2" May 25 12:14:46.593245 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.593227 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7665986d-fe60-463b-becc-f2595787ce65-serving-cert\") pod \"service-ca-operator-57b5b68b8-5jcxl\" (UID: \"7665986d-fe60-463b-becc-f2595787ce65\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5jcxl" May 25 12:14:46.600078 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.600044 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9zc6\" (UniqueName: \"kubernetes.io/projected/7665986d-fe60-463b-becc-f2595787ce65-kube-api-access-n9zc6\") pod \"service-ca-operator-57b5b68b8-5jcxl\" (UID: \"7665986d-fe60-463b-becc-f2595787ce65\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5jcxl" May 25 12:14:46.600195 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.600116 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5jxc\" (UniqueName: \"kubernetes.io/projected/c0c15556-618a-4ad2-9f3a-44ce817b0d48-kube-api-access-b5jxc\") pod \"cluster-monitoring-operator-6c75959455-bnkc2\" (UID: \"c0c15556-618a-4ad2-9f3a-44ce817b0d48\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bnkc2" May 25 12:14:46.600195 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.600185 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6wbm\" (UniqueName: \"kubernetes.io/projected/0398fbca-aafe-47ca-bc5e-7bfeda763426-kube-api-access-k6wbm\") pod \"network-check-source-7f44b6dd87-vxntb\" (UID: \"0398fbca-aafe-47ca-bc5e-7bfeda763426\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vxntb" May 25 12:14:46.670252 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.670223 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-wtzrg" May 25 12:14:46.693639 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.693564 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-z9fqm"] May 25 12:14:46.699202 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:14:46.699172 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc86fe4f_52b8_468e_99dc_5b34bd09dd6d.slice/crio-cb3e3ad525a8d1cc3ea9af8502a41717c76e1f5e0a59c66590906cfd4edf4892 WatchSource:0}: Error finding container cb3e3ad525a8d1cc3ea9af8502a41717c76e1f5e0a59c66590906cfd4edf4892: Status 404 returned error can't find the container with id cb3e3ad525a8d1cc3ea9af8502a41717c76e1f5e0a59c66590906cfd4edf4892 May 25 12:14:46.715109 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.715069 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-z9fqm" event={"ID":"bc86fe4f-52b8-468e-99dc-5b34bd09dd6d","Type":"ContainerStarted","Data":"cb3e3ad525a8d1cc3ea9af8502a41717c76e1f5e0a59c66590906cfd4edf4892"} May 25 12:14:46.767301 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.767256 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5jcxl" May 25 12:14:46.774118 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.774089 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vxntb" May 25 12:14:46.804871 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.804813 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-wtzrg"] May 25 12:14:46.809013 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:14:46.808983 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bbf38fe_0f28_4fa3_8e04_4d0520f30c14.slice/crio-064b206e091b11cdd82f988faef5a529d4ccc05ba1fc4e27c5dfae98430d4007 WatchSource:0}: Error finding container 064b206e091b11cdd82f988faef5a529d4ccc05ba1fc4e27c5dfae98430d4007: Status 404 returned error can't find the container with id 064b206e091b11cdd82f988faef5a529d4ccc05ba1fc4e27c5dfae98430d4007 May 25 12:14:46.898341 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.898311 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-5jcxl"] May 25 12:14:46.901992 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:14:46.901950 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7665986d_fe60_463b_becc_f2595787ce65.slice/crio-dde0ab295c1faaac40c62f8880fb14e2588fd1e9f5a7072dd72e001ee10db02a WatchSource:0}: Error finding container dde0ab295c1faaac40c62f8880fb14e2588fd1e9f5a7072dd72e001ee10db02a: Status 404 returned error can't find the container with id dde0ab295c1faaac40c62f8880fb14e2588fd1e9f5a7072dd72e001ee10db02a May 25 12:14:46.920815 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:46.920784 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-vxntb"] May 25 12:14:46.924575 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:14:46.924551 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0398fbca_aafe_47ca_bc5e_7bfeda763426.slice/crio-3ca19d7bc1325150994f003cabbf62a9b03e2a500375610e9da8eee799ef2688 WatchSource:0}: Error finding container 3ca19d7bc1325150994f003cabbf62a9b03e2a500375610e9da8eee799ef2688: Status 404 returned error can't find the container with id 3ca19d7bc1325150994f003cabbf62a9b03e2a500375610e9da8eee799ef2688 May 25 12:14:47.095477 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:47.095443 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c15556-618a-4ad2-9f3a-44ce817b0d48-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-bnkc2\" (UID: \"c0c15556-618a-4ad2-9f3a-44ce817b0d48\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bnkc2" May 25 12:14:47.095619 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:14:47.095586 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 25 12:14:47.095656 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:14:47.095645 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c15556-618a-4ad2-9f3a-44ce817b0d48-cluster-monitoring-operator-tls podName:c0c15556-618a-4ad2-9f3a-44ce817b0d48 nodeName:}" failed. No retries permitted until 2026-05-25 12:14:48.095630216 +0000 UTC m=+98.323047870 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c0c15556-618a-4ad2-9f3a-44ce817b0d48-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-bnkc2" (UID: "c0c15556-618a-4ad2-9f3a-44ce817b0d48") : secret "cluster-monitoring-operator-tls" not found May 25 12:14:47.598382 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:47.598339 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert\") pod \"ingress-canary-mpnlz\" (UID: \"fdb1b8ee-d354-463f-89b6-0b8140aa2dd7\") " pod="openshift-ingress-canary/ingress-canary-mpnlz" May 25 12:14:47.598862 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:47.598419 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls\") pod \"dns-default-6284j\" (UID: \"27ca0001-404e-4e5f-ba48-1698e3cee67f\") " pod="openshift-dns/dns-default-6284j" May 25 12:14:47.598862 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:14:47.598545 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 12:14:47.598862 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:14:47.598609 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls podName:27ca0001-404e-4e5f-ba48-1698e3cee67f nodeName:}" failed. No retries permitted until 2026-05-25 12:15:51.598589056 +0000 UTC m=+161.826006715 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls") pod "dns-default-6284j" (UID: "27ca0001-404e-4e5f-ba48-1698e3cee67f") : secret "dns-default-metrics-tls" not found May 25 12:14:47.599074 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:14:47.599063 2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 12:14:47.599129 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:14:47.599121 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert podName:fdb1b8ee-d354-463f-89b6-0b8140aa2dd7 nodeName:}" failed. No retries permitted until 2026-05-25 12:15:51.599102962 +0000 UTC m=+161.826520623 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert") pod "ingress-canary-mpnlz" (UID: "fdb1b8ee-d354-463f-89b6-0b8140aa2dd7") : secret "canary-serving-cert" not found May 25 12:14:47.719135 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:47.719094 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-wtzrg" event={"ID":"1bbf38fe-0f28-4fa3-8e04-4d0520f30c14","Type":"ContainerStarted","Data":"064b206e091b11cdd82f988faef5a529d4ccc05ba1fc4e27c5dfae98430d4007"} May 25 12:14:47.721430 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:47.721386 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vxntb" event={"ID":"0398fbca-aafe-47ca-bc5e-7bfeda763426","Type":"ContainerStarted","Data":"3452e1a7567f36e381fa872fcf8294604c3bd16451d30c2743743e3264116ab5"} May 25 12:14:47.721587 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:47.721432 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vxntb" event={"ID":"0398fbca-aafe-47ca-bc5e-7bfeda763426","Type":"ContainerStarted","Data":"3ca19d7bc1325150994f003cabbf62a9b03e2a500375610e9da8eee799ef2688"} May 25 12:14:47.723300 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:47.723256 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5jcxl" event={"ID":"7665986d-fe60-463b-becc-f2595787ce65","Type":"ContainerStarted","Data":"dde0ab295c1faaac40c62f8880fb14e2588fd1e9f5a7072dd72e001ee10db02a"} May 25 12:14:47.738524 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:47.738469 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-vxntb" podStartSLOduration=1.738453061 podStartE2EDuration="1.738453061s" podCreationTimestamp="2026-05-25 12:14:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 12:14:47.738285312 +0000 UTC m=+97.965703042" watchObservedRunningTime="2026-05-25 12:14:47.738453061 +0000 UTC m=+97.965870737" May 25 12:14:48.103815 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:48.103177 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c15556-618a-4ad2-9f3a-44ce817b0d48-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-bnkc2\" (UID: \"c0c15556-618a-4ad2-9f3a-44ce817b0d48\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bnkc2" May 25 12:14:48.103815 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:14:48.103359 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 25 12:14:48.103815 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:14:48.103423 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c15556-618a-4ad2-9f3a-44ce817b0d48-cluster-monitoring-operator-tls podName:c0c15556-618a-4ad2-9f3a-44ce817b0d48 nodeName:}" failed. No retries permitted until 2026-05-25 12:14:50.103405333 +0000 UTC m=+100.330822991 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c0c15556-618a-4ad2-9f3a-44ce817b0d48-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-bnkc2" (UID: "c0c15556-618a-4ad2-9f3a-44ce817b0d48") : secret "cluster-monitoring-operator-tls" not found May 25 12:14:49.734261 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:49.734220 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-z9fqm" event={"ID":"bc86fe4f-52b8-468e-99dc-5b34bd09dd6d","Type":"ContainerStarted","Data":"365af2a89784f87b3d85d9939162b50f7b283f3312e61a125d203cfe50b7a39e"} May 25 12:14:49.735642 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:49.735618 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5jcxl" event={"ID":"7665986d-fe60-463b-becc-f2595787ce65","Type":"ContainerStarted","Data":"03e65c226de3767490702f9ddd48637b4ee028ace40103231db8e52dc1fe44c5"} May 25 12:14:49.737068 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:49.737051 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wtzrg_1bbf38fe-0f28-4fa3-8e04-4d0520f30c14/console-operator/0.log" May 25 12:14:49.737175 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:49.737086 2569 generic.go:358] "Generic (PLEG): container finished" podID="1bbf38fe-0f28-4fa3-8e04-4d0520f30c14" containerID="1eb4bd73cf68d479323ba009005e38612d25cf6328c2e6762ad1f254537a6314" exitCode=255 May 25 12:14:49.737175 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:49.737121 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-wtzrg" event={"ID":"1bbf38fe-0f28-4fa3-8e04-4d0520f30c14","Type":"ContainerDied","Data":"1eb4bd73cf68d479323ba009005e38612d25cf6328c2e6762ad1f254537a6314"} May 25 12:14:49.737387 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:49.737298 2569 scope.go:117] "RemoveContainer" containerID="1eb4bd73cf68d479323ba009005e38612d25cf6328c2e6762ad1f254537a6314" May 25 12:14:49.751795 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:49.751739 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-z9fqm" podStartSLOduration=0.88875342 podStartE2EDuration="3.751719321s" podCreationTimestamp="2026-05-25 12:14:46 +0000 UTC" firstStartedPulling="2026-05-25 12:14:46.701440182 +0000 UTC m=+96.928857840" lastFinishedPulling="2026-05-25 12:14:49.564406074 +0000 UTC m=+99.791823741" observedRunningTime="2026-05-25 12:14:49.750892736 +0000 UTC m=+99.978310414" watchObservedRunningTime="2026-05-25 12:14:49.751719321 +0000 UTC m=+99.979136999" May 25 12:14:49.786747 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:49.786696 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5jcxl" podStartSLOduration=1.120311543 podStartE2EDuration="3.786680929s" podCreationTimestamp="2026-05-25 12:14:46 +0000 UTC" firstStartedPulling="2026-05-25 12:14:46.903913861 +0000 UTC m=+97.131331517" lastFinishedPulling="2026-05-25 12:14:49.570283247 +0000 UTC m=+99.797700903" observedRunningTime="2026-05-25 12:14:49.78601467 +0000 UTC m=+100.013432346" watchObservedRunningTime="2026-05-25 12:14:49.786680929 +0000 UTC m=+100.014098603" May 25 12:14:50.121380 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:50.121330 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c15556-618a-4ad2-9f3a-44ce817b0d48-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-bnkc2\" (UID: \"c0c15556-618a-4ad2-9f3a-44ce817b0d48\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bnkc2" May 25 12:14:50.121535 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:14:50.121480 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 25 12:14:50.121594 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:14:50.121549 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c15556-618a-4ad2-9f3a-44ce817b0d48-cluster-monitoring-operator-tls podName:c0c15556-618a-4ad2-9f3a-44ce817b0d48 nodeName:}" failed. No retries permitted until 2026-05-25 12:14:54.121532092 +0000 UTC m=+104.348949747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c0c15556-618a-4ad2-9f3a-44ce817b0d48-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-bnkc2" (UID: "c0c15556-618a-4ad2-9f3a-44ce817b0d48") : secret "cluster-monitoring-operator-tls" not found May 25 12:14:50.667631 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:50.667597 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mldgv" May 25 12:14:50.741839 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:50.741812 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wtzrg_1bbf38fe-0f28-4fa3-8e04-4d0520f30c14/console-operator/1.log" May 25 12:14:50.742244 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:50.742228 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wtzrg_1bbf38fe-0f28-4fa3-8e04-4d0520f30c14/console-operator/0.log" May 25 12:14:50.742298 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:50.742264 2569 generic.go:358] "Generic (PLEG): container finished" podID="1bbf38fe-0f28-4fa3-8e04-4d0520f30c14" containerID="faafbed04f4b33fc23d731070719fab27d7f92c930f555628a7dbd213526e328" exitCode=255 May 25 12:14:50.742383 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:50.742358 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-wtzrg" event={"ID":"1bbf38fe-0f28-4fa3-8e04-4d0520f30c14","Type":"ContainerDied","Data":"faafbed04f4b33fc23d731070719fab27d7f92c930f555628a7dbd213526e328"} May 25 12:14:50.742437 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:50.742407 2569 scope.go:117] "RemoveContainer" containerID="1eb4bd73cf68d479323ba009005e38612d25cf6328c2e6762ad1f254537a6314" May 25 12:14:50.742635 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:50.742613 2569 scope.go:117] "RemoveContainer" containerID="faafbed04f4b33fc23d731070719fab27d7f92c930f555628a7dbd213526e328" May 25 12:14:50.742832 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:14:50.742813 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-wtzrg_openshift-console-operator(1bbf38fe-0f28-4fa3-8e04-4d0520f30c14)\"" pod="openshift-console-operator/console-operator-76dff48d59-wtzrg" podUID="1bbf38fe-0f28-4fa3-8e04-4d0520f30c14" May 25 12:14:51.032610 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:51.032524 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-7v9wx"] May 25 12:14:51.035510 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:51.035493 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7v9wx" May 25 12:14:51.038117 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:51.038095 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 25 12:14:51.038117 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:51.038106 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-hhnsq\"" May 25 12:14:51.038251 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:51.038218 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 25 12:14:51.045116 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:51.045094 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-7v9wx"] May 25 12:14:51.130132 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:51.130098 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvlvc\" (UniqueName: \"kubernetes.io/projected/cc65ed34-59e1-4c38-94d9-5b66a31b3a46-kube-api-access-nvlvc\") pod \"migrator-b985f5d89-7v9wx\" (UID: \"cc65ed34-59e1-4c38-94d9-5b66a31b3a46\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7v9wx" May 25 12:14:51.230903 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:51.230844 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nvlvc\" (UniqueName: \"kubernetes.io/projected/cc65ed34-59e1-4c38-94d9-5b66a31b3a46-kube-api-access-nvlvc\") pod \"migrator-b985f5d89-7v9wx\" (UID: \"cc65ed34-59e1-4c38-94d9-5b66a31b3a46\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7v9wx" May 25 12:14:51.240586 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:51.240552 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvlvc\" (UniqueName: \"kubernetes.io/projected/cc65ed34-59e1-4c38-94d9-5b66a31b3a46-kube-api-access-nvlvc\") pod \"migrator-b985f5d89-7v9wx\" (UID: \"cc65ed34-59e1-4c38-94d9-5b66a31b3a46\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7v9wx" May 25 12:14:51.344611 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:51.344573 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7v9wx" May 25 12:14:51.472032 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:51.472000 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-7v9wx"] May 25 12:14:51.475245 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:14:51.475215 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc65ed34_59e1_4c38_94d9_5b66a31b3a46.slice/crio-ddf117fb341201adea525d513c18cf335b839bcaabe75b76f4d9e4627c6ee283 WatchSource:0}: Error finding container ddf117fb341201adea525d513c18cf335b839bcaabe75b76f4d9e4627c6ee283: Status 404 returned error can't find the container with id ddf117fb341201adea525d513c18cf335b839bcaabe75b76f4d9e4627c6ee283 May 25 12:14:51.745560 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:51.745464 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7v9wx" event={"ID":"cc65ed34-59e1-4c38-94d9-5b66a31b3a46","Type":"ContainerStarted","Data":"ddf117fb341201adea525d513c18cf335b839bcaabe75b76f4d9e4627c6ee283"} May 25 12:14:51.746838 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:51.746820 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wtzrg_1bbf38fe-0f28-4fa3-8e04-4d0520f30c14/console-operator/1.log" May 25 12:14:51.747184 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:51.747167 2569 scope.go:117] "RemoveContainer" containerID="faafbed04f4b33fc23d731070719fab27d7f92c930f555628a7dbd213526e328" May 25 12:14:51.747358 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:14:51.747342 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-wtzrg_openshift-console-operator(1bbf38fe-0f28-4fa3-8e04-4d0520f30c14)\"" pod="openshift-console-operator/console-operator-76dff48d59-wtzrg" podUID="1bbf38fe-0f28-4fa3-8e04-4d0520f30c14" May 25 12:14:52.750188 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:52.750162 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7v9wx" event={"ID":"cc65ed34-59e1-4c38-94d9-5b66a31b3a46","Type":"ContainerStarted","Data":"892e6c1ee1526ada2e00ef828de4106972694ce3ce815c72297b319109bfe908"} May 25 12:14:52.750518 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:52.750194 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7v9wx" event={"ID":"cc65ed34-59e1-4c38-94d9-5b66a31b3a46","Type":"ContainerStarted","Data":"d5fd1dcf78617298791ae37c0ba3d7a3abc0a888c54decd1dd93e7edf9a4199d"} May 25 12:14:52.767701 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:52.767652 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7v9wx" podStartSLOduration=0.628779747 podStartE2EDuration="1.767633508s" podCreationTimestamp="2026-05-25 12:14:51 +0000 UTC" firstStartedPulling="2026-05-25 12:14:51.477047108 +0000 UTC m=+101.704464763" lastFinishedPulling="2026-05-25 12:14:52.615900866 +0000 UTC m=+102.843318524" observedRunningTime="2026-05-25 12:14:52.767002077 +0000 UTC m=+102.994419754" watchObservedRunningTime="2026-05-25 12:14:52.767633508 +0000 UTC m=+102.995051185" May 25 12:14:52.802241 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:52.802218 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mjhc6_343fb19d-f18b-4f2c-9bc7-7810b24743d8/dns-node-resolver/0.log" May 25 12:14:53.601307 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:53.601272 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h6vr7_0ee78a86-cc33-496d-a4cf-9c1e6de70f6f/node-ca/0.log" May 25 12:14:54.152395 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:54.152357 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c15556-618a-4ad2-9f3a-44ce817b0d48-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-bnkc2\" (UID: \"c0c15556-618a-4ad2-9f3a-44ce817b0d48\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bnkc2" May 25 12:14:54.152793 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:14:54.152510 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 25 12:14:54.152793 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:14:54.152580 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c15556-618a-4ad2-9f3a-44ce817b0d48-cluster-monitoring-operator-tls podName:c0c15556-618a-4ad2-9f3a-44ce817b0d48 nodeName:}" failed. No retries permitted until 2026-05-25 12:15:02.15256391 +0000 UTC m=+112.379981581 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c0c15556-618a-4ad2-9f3a-44ce817b0d48-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-bnkc2" (UID: "c0c15556-618a-4ad2-9f3a-44ce817b0d48") : secret "cluster-monitoring-operator-tls" not found May 25 12:14:56.670785 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:56.670747 2569 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-wtzrg" May 25 12:14:56.671188 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:56.670796 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-wtzrg" May 25 12:14:56.671228 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:14:56.671213 2569 scope.go:117] "RemoveContainer" containerID="faafbed04f4b33fc23d731070719fab27d7f92c930f555628a7dbd213526e328" May 25 12:14:56.671400 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:14:56.671380 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-wtzrg_openshift-console-operator(1bbf38fe-0f28-4fa3-8e04-4d0520f30c14)\"" pod="openshift-console-operator/console-operator-76dff48d59-wtzrg" podUID="1bbf38fe-0f28-4fa3-8e04-4d0520f30c14" May 25 12:15:02.216518 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:02.216476 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c15556-618a-4ad2-9f3a-44ce817b0d48-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-bnkc2\" (UID: \"c0c15556-618a-4ad2-9f3a-44ce817b0d48\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bnkc2" May 25 12:15:02.216907 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:15:02.216626 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 25 12:15:02.216907 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:15:02.216693 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c15556-618a-4ad2-9f3a-44ce817b0d48-cluster-monitoring-operator-tls podName:c0c15556-618a-4ad2-9f3a-44ce817b0d48 nodeName:}" failed. No retries permitted until 2026-05-25 12:15:18.21667587 +0000 UTC m=+128.444093526 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c0c15556-618a-4ad2-9f3a-44ce817b0d48-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-bnkc2" (UID: "c0c15556-618a-4ad2-9f3a-44ce817b0d48") : secret "cluster-monitoring-operator-tls" not found May 25 12:15:12.425709 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:12.425672 2569 scope.go:117] "RemoveContainer" containerID="faafbed04f4b33fc23d731070719fab27d7f92c930f555628a7dbd213526e328" May 25 12:15:12.800525 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:12.800447 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wtzrg_1bbf38fe-0f28-4fa3-8e04-4d0520f30c14/console-operator/1.log" May 25 12:15:12.800525 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:12.800500 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-wtzrg" event={"ID":"1bbf38fe-0f28-4fa3-8e04-4d0520f30c14","Type":"ContainerStarted","Data":"26a1941439f92e9bbe563f95edff9f052fe608d26e67802e6d82c412155c9b91"} May 25 12:15:12.800812 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:12.800788 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-wtzrg" May 25 12:15:12.820116 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:12.820058 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-wtzrg" podStartSLOduration=24.064254451 podStartE2EDuration="26.820043655s" podCreationTimestamp="2026-05-25 12:14:46 +0000 UTC" firstStartedPulling="2026-05-25 12:14:46.810955338 +0000 UTC m=+97.038373001" lastFinishedPulling="2026-05-25 12:14:49.566744534 +0000 UTC m=+99.794162205" observedRunningTime="2026-05-25 12:15:12.820026854 +0000 UTC m=+123.047444531" watchObservedRunningTime="2026-05-25 12:15:12.820043655 +0000 UTC m=+123.047461331" May 25 12:15:13.247060 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:13.247029 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-wtzrg" May 25 12:15:13.949838 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:13.949800 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-c8wsw"] May 25 12:15:13.952086 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:13.952062 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c8wsw" May 25 12:15:13.955074 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:13.955048 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-82qnj\"" May 25 12:15:13.955074 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:13.955074 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 25 12:15:13.955257 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:13.955126 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 25 12:15:13.955257 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:13.955191 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 25 12:15:13.955364 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:13.955347 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 25 12:15:13.963992 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:13.963972 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c8wsw"] May 25 12:15:14.019914 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.019881 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-86zz8"] May 25 12:15:14.021727 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.021710 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-86zz8" May 25 12:15:14.024524 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.024502 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 25 12:15:14.025298 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.025270 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 25 12:15:14.026573 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.026540 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-86b49f8787-r57k6"] May 25 12:15:14.027223 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.027197 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-wlrwb\"" May 25 12:15:14.030179 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.030162 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.032490 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.032471 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 25 12:15:14.033274 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.033259 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s7xbv\"" May 25 12:15:14.033558 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.033544 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 25 12:15:14.034723 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.034702 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 25 12:15:14.035899 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.035877 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-86zz8"] May 25 12:15:14.038697 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.038678 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 25 12:15:14.061533 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.061511 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86b49f8787-r57k6"] May 25 12:15:14.110825 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.110795 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/369e0283-53e0-4f9c-98b7-3f3b7bb86304-data-volume\") pod \"insights-runtime-extractor-c8wsw\" (UID: \"369e0283-53e0-4f9c-98b7-3f3b7bb86304\") " pod="openshift-insights/insights-runtime-extractor-c8wsw" May 25 12:15:14.111028 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.110834 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/79bc0bd5-7639-4903-a23f-06cb3105e83d-registry-certificates\") pod \"image-registry-86b49f8787-r57k6\" (UID: \"79bc0bd5-7639-4903-a23f-06cb3105e83d\") " pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.111028 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.110871 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/369e0283-53e0-4f9c-98b7-3f3b7bb86304-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c8wsw\" (UID: \"369e0283-53e0-4f9c-98b7-3f3b7bb86304\") " pod="openshift-insights/insights-runtime-extractor-c8wsw" May 25 12:15:14.111028 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.110999 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79bc0bd5-7639-4903-a23f-06cb3105e83d-registry-tls\") pod \"image-registry-86b49f8787-r57k6\" (UID: \"79bc0bd5-7639-4903-a23f-06cb3105e83d\") " pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.111197 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.111058 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/369e0283-53e0-4f9c-98b7-3f3b7bb86304-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c8wsw\" (UID: \"369e0283-53e0-4f9c-98b7-3f3b7bb86304\") " pod="openshift-insights/insights-runtime-extractor-c8wsw" May 25 12:15:14.111197 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.111090 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/79bc0bd5-7639-4903-a23f-06cb3105e83d-installation-pull-secrets\") pod \"image-registry-86b49f8787-r57k6\" (UID: \"79bc0bd5-7639-4903-a23f-06cb3105e83d\") " pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.111197 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.111130 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/79bc0bd5-7639-4903-a23f-06cb3105e83d-image-registry-private-configuration\") pod \"image-registry-86b49f8787-r57k6\" (UID: \"79bc0bd5-7639-4903-a23f-06cb3105e83d\") " pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.111197 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.111158 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/79bc0bd5-7639-4903-a23f-06cb3105e83d-ca-trust-extracted\") pod \"image-registry-86b49f8787-r57k6\" (UID: \"79bc0bd5-7639-4903-a23f-06cb3105e83d\") " pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.111197 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.111190 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q78v4\" (UniqueName: \"kubernetes.io/projected/df6be786-2eb9-461a-a9f6-4f9fa19ccaa1-kube-api-access-q78v4\") pod \"downloads-57bd96b888-86zz8\" (UID: \"df6be786-2eb9-461a-a9f6-4f9fa19ccaa1\") " pod="openshift-console/downloads-57bd96b888-86zz8" May 25 12:15:14.111394 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.111269 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfcjl\" (UniqueName: \"kubernetes.io/projected/369e0283-53e0-4f9c-98b7-3f3b7bb86304-kube-api-access-hfcjl\") pod \"insights-runtime-extractor-c8wsw\" (UID: \"369e0283-53e0-4f9c-98b7-3f3b7bb86304\") " pod="openshift-insights/insights-runtime-extractor-c8wsw" May 25 12:15:14.111394 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.111328 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79bc0bd5-7639-4903-a23f-06cb3105e83d-bound-sa-token\") pod \"image-registry-86b49f8787-r57k6\" (UID: \"79bc0bd5-7639-4903-a23f-06cb3105e83d\") " pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.111394 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.111358 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/369e0283-53e0-4f9c-98b7-3f3b7bb86304-crio-socket\") pod \"insights-runtime-extractor-c8wsw\" (UID: \"369e0283-53e0-4f9c-98b7-3f3b7bb86304\") " pod="openshift-insights/insights-runtime-extractor-c8wsw" May 25 12:15:14.111394 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.111374 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/79bc0bd5-7639-4903-a23f-06cb3105e83d-trusted-ca\") pod \"image-registry-86b49f8787-r57k6\" (UID: \"79bc0bd5-7639-4903-a23f-06cb3105e83d\") " pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.111394 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.111395 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5286\" (UniqueName: \"kubernetes.io/projected/79bc0bd5-7639-4903-a23f-06cb3105e83d-kube-api-access-w5286\") pod \"image-registry-86b49f8787-r57k6\" (UID: \"79bc0bd5-7639-4903-a23f-06cb3105e83d\") " pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.211823 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.211742 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/369e0283-53e0-4f9c-98b7-3f3b7bb86304-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c8wsw\" (UID: \"369e0283-53e0-4f9c-98b7-3f3b7bb86304\") " pod="openshift-insights/insights-runtime-extractor-c8wsw" May 25 12:15:14.211823 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.211774 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/79bc0bd5-7639-4903-a23f-06cb3105e83d-installation-pull-secrets\") pod \"image-registry-86b49f8787-r57k6\" (UID: \"79bc0bd5-7639-4903-a23f-06cb3105e83d\") " pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.211823 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.211802 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/79bc0bd5-7639-4903-a23f-06cb3105e83d-image-registry-private-configuration\") pod \"image-registry-86b49f8787-r57k6\" (UID: \"79bc0bd5-7639-4903-a23f-06cb3105e83d\") " pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.211823 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.211820 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/79bc0bd5-7639-4903-a23f-06cb3105e83d-ca-trust-extracted\") pod \"image-registry-86b49f8787-r57k6\" (UID: \"79bc0bd5-7639-4903-a23f-06cb3105e83d\") " pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.212172 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.211840 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q78v4\" (UniqueName: \"kubernetes.io/projected/df6be786-2eb9-461a-a9f6-4f9fa19ccaa1-kube-api-access-q78v4\") pod \"downloads-57bd96b888-86zz8\" (UID: \"df6be786-2eb9-461a-a9f6-4f9fa19ccaa1\") " pod="openshift-console/downloads-57bd96b888-86zz8" May 25 12:15:14.212172 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.211866 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hfcjl\" (UniqueName: \"kubernetes.io/projected/369e0283-53e0-4f9c-98b7-3f3b7bb86304-kube-api-access-hfcjl\") pod \"insights-runtime-extractor-c8wsw\" (UID: \"369e0283-53e0-4f9c-98b7-3f3b7bb86304\") " pod="openshift-insights/insights-runtime-extractor-c8wsw" May 25 12:15:14.212172 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.211896 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79bc0bd5-7639-4903-a23f-06cb3105e83d-bound-sa-token\") pod \"image-registry-86b49f8787-r57k6\" (UID: \"79bc0bd5-7639-4903-a23f-06cb3105e83d\") " pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.212172 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.212035 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/369e0283-53e0-4f9c-98b7-3f3b7bb86304-crio-socket\") pod \"insights-runtime-extractor-c8wsw\" (UID: \"369e0283-53e0-4f9c-98b7-3f3b7bb86304\") " pod="openshift-insights/insights-runtime-extractor-c8wsw" May 25 12:15:14.212172 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.212066 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/79bc0bd5-7639-4903-a23f-06cb3105e83d-trusted-ca\") pod \"image-registry-86b49f8787-r57k6\" (UID: \"79bc0bd5-7639-4903-a23f-06cb3105e83d\") " pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.212172 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.212097 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5286\" (UniqueName: \"kubernetes.io/projected/79bc0bd5-7639-4903-a23f-06cb3105e83d-kube-api-access-w5286\") pod \"image-registry-86b49f8787-r57k6\" (UID: \"79bc0bd5-7639-4903-a23f-06cb3105e83d\") " pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.212172 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.212154 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/369e0283-53e0-4f9c-98b7-3f3b7bb86304-data-volume\") pod \"insights-runtime-extractor-c8wsw\" (UID: \"369e0283-53e0-4f9c-98b7-3f3b7bb86304\") " pod="openshift-insights/insights-runtime-extractor-c8wsw" May 25 12:15:14.212541 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.212173 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/369e0283-53e0-4f9c-98b7-3f3b7bb86304-crio-socket\") pod \"insights-runtime-extractor-c8wsw\" (UID: \"369e0283-53e0-4f9c-98b7-3f3b7bb86304\") " pod="openshift-insights/insights-runtime-extractor-c8wsw" May 25 12:15:14.212541 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.212180 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/79bc0bd5-7639-4903-a23f-06cb3105e83d-registry-certificates\") pod \"image-registry-86b49f8787-r57k6\" (UID: \"79bc0bd5-7639-4903-a23f-06cb3105e83d\") " pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.212541 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.212247 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/369e0283-53e0-4f9c-98b7-3f3b7bb86304-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c8wsw\" (UID: \"369e0283-53e0-4f9c-98b7-3f3b7bb86304\") " pod="openshift-insights/insights-runtime-extractor-c8wsw" May 25 12:15:14.212541 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.212288 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/79bc0bd5-7639-4903-a23f-06cb3105e83d-ca-trust-extracted\") pod \"image-registry-86b49f8787-r57k6\" (UID: \"79bc0bd5-7639-4903-a23f-06cb3105e83d\") " pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.212541 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.212305 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79bc0bd5-7639-4903-a23f-06cb3105e83d-registry-tls\") pod \"image-registry-86b49f8787-r57k6\" (UID: \"79bc0bd5-7639-4903-a23f-06cb3105e83d\") " pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.212979 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.212928 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/369e0283-53e0-4f9c-98b7-3f3b7bb86304-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c8wsw\" (UID: \"369e0283-53e0-4f9c-98b7-3f3b7bb86304\") " pod="openshift-insights/insights-runtime-extractor-c8wsw" May 25 12:15:14.212979 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.212962 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/369e0283-53e0-4f9c-98b7-3f3b7bb86304-data-volume\") pod \"insights-runtime-extractor-c8wsw\" (UID: \"369e0283-53e0-4f9c-98b7-3f3b7bb86304\") " pod="openshift-insights/insights-runtime-extractor-c8wsw" May 25 12:15:14.213116 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.213094 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/79bc0bd5-7639-4903-a23f-06cb3105e83d-registry-certificates\") pod \"image-registry-86b49f8787-r57k6\" (UID: \"79bc0bd5-7639-4903-a23f-06cb3105e83d\") " pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.213765 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.213737 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/79bc0bd5-7639-4903-a23f-06cb3105e83d-trusted-ca\") pod \"image-registry-86b49f8787-r57k6\" (UID: \"79bc0bd5-7639-4903-a23f-06cb3105e83d\") " pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.214621 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.214602 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/369e0283-53e0-4f9c-98b7-3f3b7bb86304-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c8wsw\" (UID: \"369e0283-53e0-4f9c-98b7-3f3b7bb86304\") " pod="openshift-insights/insights-runtime-extractor-c8wsw" May 25 12:15:14.214743 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.214721 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/79bc0bd5-7639-4903-a23f-06cb3105e83d-installation-pull-secrets\") pod \"image-registry-86b49f8787-r57k6\" (UID: \"79bc0bd5-7639-4903-a23f-06cb3105e83d\") " pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.215012 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.214994 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/79bc0bd5-7639-4903-a23f-06cb3105e83d-image-registry-private-configuration\") pod \"image-registry-86b49f8787-r57k6\" (UID: \"79bc0bd5-7639-4903-a23f-06cb3105e83d\") " pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.215176 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.215161 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79bc0bd5-7639-4903-a23f-06cb3105e83d-registry-tls\") pod \"image-registry-86b49f8787-r57k6\" (UID: \"79bc0bd5-7639-4903-a23f-06cb3105e83d\") " pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.224146 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.224115 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfcjl\" (UniqueName: \"kubernetes.io/projected/369e0283-53e0-4f9c-98b7-3f3b7bb86304-kube-api-access-hfcjl\") pod \"insights-runtime-extractor-c8wsw\" (UID: \"369e0283-53e0-4f9c-98b7-3f3b7bb86304\") " pod="openshift-insights/insights-runtime-extractor-c8wsw" May 25 12:15:14.224373 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.224355 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5286\" (UniqueName: \"kubernetes.io/projected/79bc0bd5-7639-4903-a23f-06cb3105e83d-kube-api-access-w5286\") pod \"image-registry-86b49f8787-r57k6\" (UID: \"79bc0bd5-7639-4903-a23f-06cb3105e83d\") " pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.224561 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.224538 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79bc0bd5-7639-4903-a23f-06cb3105e83d-bound-sa-token\") pod \"image-registry-86b49f8787-r57k6\" (UID: \"79bc0bd5-7639-4903-a23f-06cb3105e83d\") " pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.225332 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.225311 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q78v4\" (UniqueName: \"kubernetes.io/projected/df6be786-2eb9-461a-a9f6-4f9fa19ccaa1-kube-api-access-q78v4\") pod \"downloads-57bd96b888-86zz8\" (UID: \"df6be786-2eb9-461a-a9f6-4f9fa19ccaa1\") " pod="openshift-console/downloads-57bd96b888-86zz8" May 25 12:15:14.261423 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.261396 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c8wsw" May 25 12:15:14.333468 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.333441 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-86zz8" May 25 12:15:14.341385 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.341365 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.403305 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.403148 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c8wsw"] May 25 12:15:14.406624 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:15:14.406589 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod369e0283_53e0_4f9c_98b7_3f3b7bb86304.slice/crio-cbb8d1b1e65db42de7b020c3b7bc5c4fddf906c4635a8e616e4ea8d4b6990336 WatchSource:0}: Error finding container cbb8d1b1e65db42de7b020c3b7bc5c4fddf906c4635a8e616e4ea8d4b6990336: Status 404 returned error can't find the container with id cbb8d1b1e65db42de7b020c3b7bc5c4fddf906c4635a8e616e4ea8d4b6990336 May 25 12:15:14.481271 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.481174 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-86zz8"] May 25 12:15:14.483766 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:15:14.483736 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf6be786_2eb9_461a_a9f6_4f9fa19ccaa1.slice/crio-ece4c5f0dfb9e6398fd79d7cd2fd37d5b6720cb20e3e69d4a8b6f14ece1c58ee WatchSource:0}: Error finding container ece4c5f0dfb9e6398fd79d7cd2fd37d5b6720cb20e3e69d4a8b6f14ece1c58ee: Status 404 returned error can't find the container with id ece4c5f0dfb9e6398fd79d7cd2fd37d5b6720cb20e3e69d4a8b6f14ece1c58ee May 25 12:15:14.496496 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.496460 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86b49f8787-r57k6"] May 25 12:15:14.500216 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:15:14.500185 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79bc0bd5_7639_4903_a23f_06cb3105e83d.slice/crio-fd145a3c4bb562ba6867ed30c75b97a9c5fe2b2faeae4ee14e5dd77439502338 WatchSource:0}: Error finding container fd145a3c4bb562ba6867ed30c75b97a9c5fe2b2faeae4ee14e5dd77439502338: Status 404 returned error can't find the container with id fd145a3c4bb562ba6867ed30c75b97a9c5fe2b2faeae4ee14e5dd77439502338 May 25 12:15:14.806541 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.806450 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-86zz8" event={"ID":"df6be786-2eb9-461a-a9f6-4f9fa19ccaa1","Type":"ContainerStarted","Data":"ece4c5f0dfb9e6398fd79d7cd2fd37d5b6720cb20e3e69d4a8b6f14ece1c58ee"} May 25 12:15:14.807839 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.807810 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86b49f8787-r57k6" event={"ID":"79bc0bd5-7639-4903-a23f-06cb3105e83d","Type":"ContainerStarted","Data":"eed604f04d10815fc90748fbfeaf953847eabea6ca7df4dfafa97a5243d5b77f"} May 25 12:15:14.808012 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.807844 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86b49f8787-r57k6" event={"ID":"79bc0bd5-7639-4903-a23f-06cb3105e83d","Type":"ContainerStarted","Data":"fd145a3c4bb562ba6867ed30c75b97a9c5fe2b2faeae4ee14e5dd77439502338"} May 25 12:15:14.808012 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.807886 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:14.809262 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.809239 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c8wsw" event={"ID":"369e0283-53e0-4f9c-98b7-3f3b7bb86304","Type":"ContainerStarted","Data":"a9df2c979606d3a4e4f205599b6ca8f90c2d5bb1aa8f3edd9eb542885fbe9812"} May 25 12:15:14.809364 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.809268 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c8wsw" event={"ID":"369e0283-53e0-4f9c-98b7-3f3b7bb86304","Type":"ContainerStarted","Data":"cbb8d1b1e65db42de7b020c3b7bc5c4fddf906c4635a8e616e4ea8d4b6990336"} May 25 12:15:14.830343 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:14.830294 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-86b49f8787-r57k6" podStartSLOduration=0.830277586 podStartE2EDuration="830.277586ms" podCreationTimestamp="2026-05-25 12:15:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 12:15:14.829108599 +0000 UTC m=+125.056526277" watchObservedRunningTime="2026-05-25 12:15:14.830277586 +0000 UTC m=+125.057695267" May 25 12:15:15.813277 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:15.813231 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c8wsw" event={"ID":"369e0283-53e0-4f9c-98b7-3f3b7bb86304","Type":"ContainerStarted","Data":"0d24f9a11ce39cdfd82f9eb799480b8799cf1d454364dd37ee117c6f69e4455d"} May 25 12:15:17.821485 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:17.821444 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c8wsw" event={"ID":"369e0283-53e0-4f9c-98b7-3f3b7bb86304","Type":"ContainerStarted","Data":"f0ba423d07e842b025073d72300152b3af47ffde042698555ef7ce17511135d0"} May 25 12:15:17.840567 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:17.840521 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-c8wsw" podStartSLOduration=2.514526906 podStartE2EDuration="4.840507854s" podCreationTimestamp="2026-05-25 12:15:13 +0000 UTC" firstStartedPulling="2026-05-25 12:15:14.479030789 +0000 UTC m=+124.706448443" lastFinishedPulling="2026-05-25 12:15:16.805011732 +0000 UTC m=+127.032429391" observedRunningTime="2026-05-25 12:15:17.839633737 +0000 UTC m=+128.067051418" watchObservedRunningTime="2026-05-25 12:15:17.840507854 +0000 UTC m=+128.067925590" May 25 12:15:18.244643 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:18.244599 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c15556-618a-4ad2-9f3a-44ce817b0d48-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-bnkc2\" (UID: \"c0c15556-618a-4ad2-9f3a-44ce817b0d48\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bnkc2" May 25 12:15:18.247617 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:18.247588 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c0c15556-618a-4ad2-9f3a-44ce817b0d48-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-bnkc2\" (UID: \"c0c15556-618a-4ad2-9f3a-44ce817b0d48\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bnkc2" May 25 12:15:18.281815 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:18.281784 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bm2m9\"" May 25 12:15:18.290433 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:18.290408 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bnkc2" May 25 12:15:18.455083 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:18.454885 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-bnkc2"] May 25 12:15:18.457926 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:15:18.457899 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0c15556_618a_4ad2_9f3a_44ce817b0d48.slice/crio-c93e489c6423b04b71e104c1d07b3984671b813908f5200664169d9673dc2fc1 WatchSource:0}: Error finding container c93e489c6423b04b71e104c1d07b3984671b813908f5200664169d9673dc2fc1: Status 404 returned error can't find the container with id c93e489c6423b04b71e104c1d07b3984671b813908f5200664169d9673dc2fc1 May 25 12:15:18.825500 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:18.825457 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bnkc2" event={"ID":"c0c15556-618a-4ad2-9f3a-44ce817b0d48","Type":"ContainerStarted","Data":"c93e489c6423b04b71e104c1d07b3984671b813908f5200664169d9673dc2fc1"} May 25 12:15:20.263845 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:20.263800 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs\") pod \"network-metrics-daemon-xwk2x\" (UID: \"cfe666ec-6ce2-4bfe-9149-8b8a058cd681\") " pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:15:20.267722 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:20.267686 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cfe666ec-6ce2-4bfe-9149-8b8a058cd681-metrics-certs\") pod \"network-metrics-daemon-xwk2x\" (UID: \"cfe666ec-6ce2-4bfe-9149-8b8a058cd681\") " pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:15:20.453024 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:20.452993 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rrs9z\"" May 25 12:15:20.461312 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:20.461280 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xwk2x" May 25 12:15:20.870799 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:20.870769 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xwk2x"] May 25 12:15:20.874363 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:15:20.874328 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfe666ec_6ce2_4bfe_9149_8b8a058cd681.slice/crio-a27ca57a015281f7fa4dea6108d902a69db8e142cd494b4705c874d7c597803d WatchSource:0}: Error finding container a27ca57a015281f7fa4dea6108d902a69db8e142cd494b4705c874d7c597803d: Status 404 returned error can't find the container with id a27ca57a015281f7fa4dea6108d902a69db8e142cd494b4705c874d7c597803d May 25 12:15:21.836560 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:21.836497 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bnkc2" event={"ID":"c0c15556-618a-4ad2-9f3a-44ce817b0d48","Type":"ContainerStarted","Data":"424e1cd5830d3ade4b6e0a9b9a1d154baa8ea6ceefaaa61af83a2a64e4818e01"} May 25 12:15:21.838599 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:21.838569 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xwk2x" event={"ID":"cfe666ec-6ce2-4bfe-9149-8b8a058cd681","Type":"ContainerStarted","Data":"a27ca57a015281f7fa4dea6108d902a69db8e142cd494b4705c874d7c597803d"} May 25 12:15:21.854857 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:21.854751 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-bnkc2" podStartSLOduration=33.292557518 podStartE2EDuration="35.854730208s" podCreationTimestamp="2026-05-25 12:14:46 +0000 UTC" firstStartedPulling="2026-05-25 12:15:18.460378961 +0000 UTC m=+128.687796617" lastFinishedPulling="2026-05-25 12:15:21.022551645 +0000 UTC m=+131.249969307" observedRunningTime="2026-05-25 12:15:21.853517846 +0000 UTC m=+132.080935523" watchObservedRunningTime="2026-05-25 12:15:21.854730208 +0000 UTC m=+132.082147886" May 25 12:15:22.842866 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:22.842829 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xwk2x" event={"ID":"cfe666ec-6ce2-4bfe-9149-8b8a058cd681","Type":"ContainerStarted","Data":"18372e90bee7793f1ed67722fb393d3486fe044937e5c6a2f2dba183ebc5645b"} May 25 12:15:22.842866 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:22.842870 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xwk2x" event={"ID":"cfe666ec-6ce2-4bfe-9149-8b8a058cd681","Type":"ContainerStarted","Data":"fe9cdc0a0aa34c90db3e6fe8a7fea5d6eb6e8314d8a2e44ec4c6722b53f150fb"} May 25 12:15:22.860090 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:22.860050 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xwk2x" podStartSLOduration=131.686816306 podStartE2EDuration="2m12.860037183s" podCreationTimestamp="2026-05-25 12:13:10 +0000 UTC" firstStartedPulling="2026-05-25 12:15:20.878154227 +0000 UTC m=+131.105571890" lastFinishedPulling="2026-05-25 12:15:22.051375112 +0000 UTC m=+132.278792767" observedRunningTime="2026-05-25 12:15:22.859866575 +0000 UTC m=+133.087284252" watchObservedRunningTime="2026-05-25 12:15:22.860037183 +0000 UTC m=+133.087454860" May 25 12:15:28.030078 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.030045 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pt6fc"] May 25 12:15:28.034874 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.034722 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.036647 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.036624 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 25 12:15:28.037074 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.037059 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 25 12:15:28.037144 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.037075 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 25 12:15:28.037144 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.037088 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-85pp4\"" May 25 12:15:28.037252 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.037147 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 25 12:15:28.130912 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.130881 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/154574d3-a885-4e8d-b14f-de3aba1010f8-node-exporter-tls\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.131094 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.130922 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/154574d3-a885-4e8d-b14f-de3aba1010f8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.131094 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.130986 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/154574d3-a885-4e8d-b14f-de3aba1010f8-metrics-client-ca\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.131094 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.131039 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z69n\" (UniqueName: \"kubernetes.io/projected/154574d3-a885-4e8d-b14f-de3aba1010f8-kube-api-access-5z69n\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.131094 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.131071 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/154574d3-a885-4e8d-b14f-de3aba1010f8-node-exporter-wtmp\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.131305 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.131100 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/154574d3-a885-4e8d-b14f-de3aba1010f8-root\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.131305 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.131120 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/154574d3-a885-4e8d-b14f-de3aba1010f8-sys\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.131305 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.131153 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/154574d3-a885-4e8d-b14f-de3aba1010f8-node-exporter-textfile\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.131305 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.131184 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/154574d3-a885-4e8d-b14f-de3aba1010f8-node-exporter-accelerators-collector-config\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.232048 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.232012 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/154574d3-a885-4e8d-b14f-de3aba1010f8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.232216 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.232060 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/154574d3-a885-4e8d-b14f-de3aba1010f8-metrics-client-ca\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.232216 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.232085 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5z69n\" (UniqueName: \"kubernetes.io/projected/154574d3-a885-4e8d-b14f-de3aba1010f8-kube-api-access-5z69n\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.232216 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.232163 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/154574d3-a885-4e8d-b14f-de3aba1010f8-node-exporter-wtmp\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.232382 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.232221 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/154574d3-a885-4e8d-b14f-de3aba1010f8-root\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.232382 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.232253 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/154574d3-a885-4e8d-b14f-de3aba1010f8-sys\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.232382 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.232281 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/154574d3-a885-4e8d-b14f-de3aba1010f8-node-exporter-textfile\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.232382 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.232286 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/154574d3-a885-4e8d-b14f-de3aba1010f8-node-exporter-wtmp\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.232382 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.232329 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/154574d3-a885-4e8d-b14f-de3aba1010f8-root\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.232382 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.232331 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/154574d3-a885-4e8d-b14f-de3aba1010f8-node-exporter-accelerators-collector-config\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.232382 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.232357 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/154574d3-a885-4e8d-b14f-de3aba1010f8-sys\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.232719 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.232393 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/154574d3-a885-4e8d-b14f-de3aba1010f8-node-exporter-tls\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.232719 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.232631 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/154574d3-a885-4e8d-b14f-de3aba1010f8-node-exporter-textfile\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.232719 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.232698 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/154574d3-a885-4e8d-b14f-de3aba1010f8-metrics-client-ca\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.232871 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.232842 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/154574d3-a885-4e8d-b14f-de3aba1010f8-node-exporter-accelerators-collector-config\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.234566 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.234539 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/154574d3-a885-4e8d-b14f-de3aba1010f8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.234988 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.234969 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/154574d3-a885-4e8d-b14f-de3aba1010f8-node-exporter-tls\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.240853 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.240832 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z69n\" (UniqueName: \"kubernetes.io/projected/154574d3-a885-4e8d-b14f-de3aba1010f8-kube-api-access-5z69n\") pod \"node-exporter-pt6fc\" (UID: \"154574d3-a885-4e8d-b14f-de3aba1010f8\") " pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.344302 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.344268 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pt6fc" May 25 12:15:28.352907 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:15:28.352863 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod154574d3_a885_4e8d_b14f_de3aba1010f8.slice/crio-9ac4054c597fa5e273a25ef4ac252dc4c6483c2bd6c2795b60c3e7c4098ea610 WatchSource:0}: Error finding container 9ac4054c597fa5e273a25ef4ac252dc4c6483c2bd6c2795b60c3e7c4098ea610: Status 404 returned error can't find the container with id 9ac4054c597fa5e273a25ef4ac252dc4c6483c2bd6c2795b60c3e7c4098ea610 May 25 12:15:28.864085 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:28.864047 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pt6fc" event={"ID":"154574d3-a885-4e8d-b14f-de3aba1010f8","Type":"ContainerStarted","Data":"9ac4054c597fa5e273a25ef4ac252dc4c6483c2bd6c2795b60c3e7c4098ea610"} May 25 12:15:29.130449 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.130348 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 25 12:15:29.134955 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.134910 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.138201 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.137478 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" May 25 12:15:29.138201 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.137685 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8lp65\"" May 25 12:15:29.138201 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.137750 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" May 25 12:15:29.138201 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.137811 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" May 25 12:15:29.138201 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.137892 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" May 25 12:15:29.138201 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.138011 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" May 25 12:15:29.138201 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.137690 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" May 25 12:15:29.138201 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.138144 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" May 25 12:15:29.141955 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.138632 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" May 25 12:15:29.141955 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.139018 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" May 25 12:15:29.150906 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.150881 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 25 12:15:29.242165 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.242114 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a1e65f9-6d7d-4964-987e-2f241f71ada4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.242165 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.242168 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-config-volume\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.242369 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.242209 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a1e65f9-6d7d-4964-987e-2f241f71ada4-config-out\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.242369 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.242229 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a1e65f9-6d7d-4964-987e-2f241f71ada4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.242369 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.242246 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a1e65f9-6d7d-4964-987e-2f241f71ada4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.242369 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.242301 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a1e65f9-6d7d-4964-987e-2f241f71ada4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.242369 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.242325 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.242369 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.242352 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.242631 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.242377 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.242631 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.242411 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdfrz\" (UniqueName: \"kubernetes.io/projected/3a1e65f9-6d7d-4964-987e-2f241f71ada4-kube-api-access-fdfrz\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.242631 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.242446 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.242631 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.242483 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-web-config\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.242631 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.242510 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.344114 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.343978 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.344114 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.344034 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-web-config\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.344114 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.344063 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.344347 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.344117 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a1e65f9-6d7d-4964-987e-2f241f71ada4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.344347 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.344150 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-config-volume\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.344598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.344520 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a1e65f9-6d7d-4964-987e-2f241f71ada4-config-out\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.344598 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.344567 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a1e65f9-6d7d-4964-987e-2f241f71ada4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.344733 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.344600 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a1e65f9-6d7d-4964-987e-2f241f71ada4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.344733 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.344663 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a1e65f9-6d7d-4964-987e-2f241f71ada4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.344733 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.344688 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.344733 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.344716 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.344918 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.344743 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.344918 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.344778 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdfrz\" (UniqueName: \"kubernetes.io/projected/3a1e65f9-6d7d-4964-987e-2f241f71ada4-kube-api-access-fdfrz\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.345622 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.345285 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a1e65f9-6d7d-4964-987e-2f241f71ada4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.345622 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.345582 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a1e65f9-6d7d-4964-987e-2f241f71ada4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.346031 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.345967 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a1e65f9-6d7d-4964-987e-2f241f71ada4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.347698 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.347672 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.348579 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.348556 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.349094 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.349060 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-config-volume\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.349280 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.349235 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a1e65f9-6d7d-4964-987e-2f241f71ada4-config-out\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.349434 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.349389 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.350022 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.349994 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.350112 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.350084 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a1e65f9-6d7d-4964-987e-2f241f71ada4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.351442 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.351420 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.351654 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.351634 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-web-config\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.358754 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.358731 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdfrz\" (UniqueName: \"kubernetes.io/projected/3a1e65f9-6d7d-4964-987e-2f241f71ada4-kube-api-access-fdfrz\") pod \"alertmanager-main-0\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.451854 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.451824 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 25 12:15:29.608476 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.608445 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 25 12:15:29.611989 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:15:29.611961 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a1e65f9_6d7d_4964_987e_2f241f71ada4.slice/crio-70f8b7acfb8d22946c6c856eef1fc0f4470bae459bca0c3a84cd22cad213b44f WatchSource:0}: Error finding container 70f8b7acfb8d22946c6c856eef1fc0f4470bae459bca0c3a84cd22cad213b44f: Status 404 returned error can't find the container with id 70f8b7acfb8d22946c6c856eef1fc0f4470bae459bca0c3a84cd22cad213b44f May 25 12:15:29.867455 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.867421 2569 generic.go:358] "Generic (PLEG): container finished" podID="154574d3-a885-4e8d-b14f-de3aba1010f8" containerID="073aa6bd5f69be1b87873b91f293ef68089657ee6d124d81a16c67290953018f" exitCode=0 May 25 12:15:29.867630 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.867492 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pt6fc" event={"ID":"154574d3-a885-4e8d-b14f-de3aba1010f8","Type":"ContainerDied","Data":"073aa6bd5f69be1b87873b91f293ef68089657ee6d124d81a16c67290953018f"} May 25 12:15:29.868501 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:29.868465 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a1e65f9-6d7d-4964-987e-2f241f71ada4","Type":"ContainerStarted","Data":"70f8b7acfb8d22946c6c856eef1fc0f4470bae459bca0c3a84cd22cad213b44f"} May 25 12:15:30.873251 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:30.873163 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pt6fc" event={"ID":"154574d3-a885-4e8d-b14f-de3aba1010f8","Type":"ContainerStarted","Data":"7da3d5ca1209d6ac8936e892acca6368e9efa9db2a77afc4dc3257ba7a327cc5"} May 25 12:15:30.873251 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:30.873198 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pt6fc" event={"ID":"154574d3-a885-4e8d-b14f-de3aba1010f8","Type":"ContainerStarted","Data":"16e0568c3733a8cb0f17927bb8ac65347ad2047dbdf20999a935c6b7d3074767"} May 25 12:15:30.874458 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:30.874433 2569 generic.go:358] "Generic (PLEG): container finished" podID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerID="15acf2d77c73079d8be6b2203b730e868505c711959cf27ed029f40ea065028d" exitCode=0 May 25 12:15:30.874545 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:30.874484 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a1e65f9-6d7d-4964-987e-2f241f71ada4","Type":"ContainerDied","Data":"15acf2d77c73079d8be6b2203b730e868505c711959cf27ed029f40ea065028d"} May 25 12:15:30.893819 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:30.893771 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pt6fc" podStartSLOduration=1.918423767 podStartE2EDuration="2.893754223s" podCreationTimestamp="2026-05-25 12:15:28 +0000 UTC" firstStartedPulling="2026-05-25 12:15:28.356260644 +0000 UTC m=+138.583678315" lastFinishedPulling="2026-05-25 12:15:29.331591104 +0000 UTC m=+139.559008771" observedRunningTime="2026-05-25 12:15:30.892511633 +0000 UTC m=+141.119929375" watchObservedRunningTime="2026-05-25 12:15:30.893754223 +0000 UTC m=+141.121171902" May 25 12:15:31.340966 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.340913 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b8c9dcc95-xnwcv"] May 25 12:15:31.344305 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.344282 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:15:31.346772 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.346513 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 25 12:15:31.346772 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.346532 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 25 12:15:31.346919 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.346805 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 25 12:15:31.346919 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.346825 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 25 12:15:31.346919 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.346865 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 25 12:15:31.346919 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.346895 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vwn8c\"" May 25 12:15:31.352249 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.352208 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 25 12:15:31.355897 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.355872 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b8c9dcc95-xnwcv"] May 25 12:15:31.465040 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.464998 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29b9bc46-3412-4402-b77c-5d9d9f71e56e-console-serving-cert\") pod \"console-7b8c9dcc95-xnwcv\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:15:31.465040 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.465046 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29b9bc46-3412-4402-b77c-5d9d9f71e56e-console-oauth-config\") pod \"console-7b8c9dcc95-xnwcv\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:15:31.465259 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.465109 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xjvc\" (UniqueName: \"kubernetes.io/projected/29b9bc46-3412-4402-b77c-5d9d9f71e56e-kube-api-access-9xjvc\") pod \"console-7b8c9dcc95-xnwcv\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:15:31.465259 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.465146 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29b9bc46-3412-4402-b77c-5d9d9f71e56e-oauth-serving-cert\") pod \"console-7b8c9dcc95-xnwcv\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:15:31.465259 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.465170 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29b9bc46-3412-4402-b77c-5d9d9f71e56e-service-ca\") pod \"console-7b8c9dcc95-xnwcv\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:15:31.465259 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.465197 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29b9bc46-3412-4402-b77c-5d9d9f71e56e-trusted-ca-bundle\") pod \"console-7b8c9dcc95-xnwcv\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:15:31.465408 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.465284 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29b9bc46-3412-4402-b77c-5d9d9f71e56e-console-config\") pod \"console-7b8c9dcc95-xnwcv\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:15:31.565885 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.565848 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29b9bc46-3412-4402-b77c-5d9d9f71e56e-console-config\") pod \"console-7b8c9dcc95-xnwcv\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:15:31.566078 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.565979 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29b9bc46-3412-4402-b77c-5d9d9f71e56e-console-serving-cert\") pod \"console-7b8c9dcc95-xnwcv\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:15:31.566078 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.566010 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29b9bc46-3412-4402-b77c-5d9d9f71e56e-console-oauth-config\") pod \"console-7b8c9dcc95-xnwcv\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:15:31.566078 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.566038 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9xjvc\" (UniqueName: \"kubernetes.io/projected/29b9bc46-3412-4402-b77c-5d9d9f71e56e-kube-api-access-9xjvc\") pod \"console-7b8c9dcc95-xnwcv\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:15:31.566078 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.566067 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29b9bc46-3412-4402-b77c-5d9d9f71e56e-oauth-serving-cert\") pod \"console-7b8c9dcc95-xnwcv\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:15:31.566327 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.566095 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29b9bc46-3412-4402-b77c-5d9d9f71e56e-service-ca\") pod \"console-7b8c9dcc95-xnwcv\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:15:31.566327 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.566122 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29b9bc46-3412-4402-b77c-5d9d9f71e56e-trusted-ca-bundle\") pod \"console-7b8c9dcc95-xnwcv\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:15:31.566702 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.566650 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29b9bc46-3412-4402-b77c-5d9d9f71e56e-console-config\") pod \"console-7b8c9dcc95-xnwcv\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:15:31.567002 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.566720 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29b9bc46-3412-4402-b77c-5d9d9f71e56e-oauth-serving-cert\") pod \"console-7b8c9dcc95-xnwcv\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:15:31.567078 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.567005 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29b9bc46-3412-4402-b77c-5d9d9f71e56e-service-ca\") pod \"console-7b8c9dcc95-xnwcv\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:15:31.567228 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.567201 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29b9bc46-3412-4402-b77c-5d9d9f71e56e-trusted-ca-bundle\") pod \"console-7b8c9dcc95-xnwcv\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:15:31.568916 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.568893 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29b9bc46-3412-4402-b77c-5d9d9f71e56e-console-oauth-config\") pod \"console-7b8c9dcc95-xnwcv\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:15:31.569034 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.568900 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29b9bc46-3412-4402-b77c-5d9d9f71e56e-console-serving-cert\") pod \"console-7b8c9dcc95-xnwcv\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:15:31.575893 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.575872 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xjvc\" (UniqueName: \"kubernetes.io/projected/29b9bc46-3412-4402-b77c-5d9d9f71e56e-kube-api-access-9xjvc\") pod \"console-7b8c9dcc95-xnwcv\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:15:31.657007 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:31.656905 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:15:32.455176 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.455142 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6fb8796695-fbm56"] May 25 12:15:32.458431 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.458409 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:15:32.461026 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.460992 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 25 12:15:32.461273 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.461248 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 25 12:15:32.461387 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.461283 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 25 12:15:32.461387 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.461313 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-7xpnp\"" May 25 12:15:32.461387 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.461325 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7o0f73mk4dt\"" May 25 12:15:32.461387 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.461254 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 25 12:15:32.470553 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.470533 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6fb8796695-fbm56"] May 25 12:15:32.474972 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.474948 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9c06f548-6ef2-43e9-a132-0d2baf9565b3-audit-log\") pod \"metrics-server-6fb8796695-fbm56\" (UID: \"9c06f548-6ef2-43e9-a132-0d2baf9565b3\") " pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:15:32.475057 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.475021 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9c06f548-6ef2-43e9-a132-0d2baf9565b3-secret-metrics-server-tls\") pod \"metrics-server-6fb8796695-fbm56\" (UID: \"9c06f548-6ef2-43e9-a132-0d2baf9565b3\") " pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:15:32.475099 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.475049 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c06f548-6ef2-43e9-a132-0d2baf9565b3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fb8796695-fbm56\" (UID: \"9c06f548-6ef2-43e9-a132-0d2baf9565b3\") " pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:15:32.475133 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.475121 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c06f548-6ef2-43e9-a132-0d2baf9565b3-client-ca-bundle\") pod \"metrics-server-6fb8796695-fbm56\" (UID: \"9c06f548-6ef2-43e9-a132-0d2baf9565b3\") " pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:15:32.475227 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.475205 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9c06f548-6ef2-43e9-a132-0d2baf9565b3-secret-metrics-server-client-certs\") pod \"metrics-server-6fb8796695-fbm56\" (UID: \"9c06f548-6ef2-43e9-a132-0d2baf9565b3\") " pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:15:32.475299 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.475256 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9c06f548-6ef2-43e9-a132-0d2baf9565b3-metrics-server-audit-profiles\") pod \"metrics-server-6fb8796695-fbm56\" (UID: \"9c06f548-6ef2-43e9-a132-0d2baf9565b3\") " pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:15:32.475341 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.475315 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52sk6\" (UniqueName: \"kubernetes.io/projected/9c06f548-6ef2-43e9-a132-0d2baf9565b3-kube-api-access-52sk6\") pod \"metrics-server-6fb8796695-fbm56\" (UID: \"9c06f548-6ef2-43e9-a132-0d2baf9565b3\") " pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:15:32.575958 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.575903 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c06f548-6ef2-43e9-a132-0d2baf9565b3-client-ca-bundle\") pod \"metrics-server-6fb8796695-fbm56\" (UID: \"9c06f548-6ef2-43e9-a132-0d2baf9565b3\") " pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:15:32.576138 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.575985 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9c06f548-6ef2-43e9-a132-0d2baf9565b3-secret-metrics-server-client-certs\") pod \"metrics-server-6fb8796695-fbm56\" (UID: \"9c06f548-6ef2-43e9-a132-0d2baf9565b3\") " pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:15:32.576138 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.576024 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9c06f548-6ef2-43e9-a132-0d2baf9565b3-metrics-server-audit-profiles\") pod \"metrics-server-6fb8796695-fbm56\" (UID: \"9c06f548-6ef2-43e9-a132-0d2baf9565b3\") " pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:15:32.576138 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.576057 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-52sk6\" (UniqueName: \"kubernetes.io/projected/9c06f548-6ef2-43e9-a132-0d2baf9565b3-kube-api-access-52sk6\") pod \"metrics-server-6fb8796695-fbm56\" (UID: \"9c06f548-6ef2-43e9-a132-0d2baf9565b3\") " pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:15:32.576138 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.576097 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9c06f548-6ef2-43e9-a132-0d2baf9565b3-audit-log\") pod \"metrics-server-6fb8796695-fbm56\" (UID: \"9c06f548-6ef2-43e9-a132-0d2baf9565b3\") " pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:15:32.576330 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.576146 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9c06f548-6ef2-43e9-a132-0d2baf9565b3-secret-metrics-server-tls\") pod \"metrics-server-6fb8796695-fbm56\" (UID: \"9c06f548-6ef2-43e9-a132-0d2baf9565b3\") " pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:15:32.576330 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.576174 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c06f548-6ef2-43e9-a132-0d2baf9565b3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fb8796695-fbm56\" (UID: \"9c06f548-6ef2-43e9-a132-0d2baf9565b3\") " pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:15:32.576956 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.576904 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c06f548-6ef2-43e9-a132-0d2baf9565b3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fb8796695-fbm56\" (UID: \"9c06f548-6ef2-43e9-a132-0d2baf9565b3\") " pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:15:32.577603 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.577494 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9c06f548-6ef2-43e9-a132-0d2baf9565b3-audit-log\") pod \"metrics-server-6fb8796695-fbm56\" (UID: \"9c06f548-6ef2-43e9-a132-0d2baf9565b3\") " pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:15:32.578000 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.577978 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9c06f548-6ef2-43e9-a132-0d2baf9565b3-metrics-server-audit-profiles\") pod \"metrics-server-6fb8796695-fbm56\" (UID: \"9c06f548-6ef2-43e9-a132-0d2baf9565b3\") " pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:15:32.579466 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.579447 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9c06f548-6ef2-43e9-a132-0d2baf9565b3-client-ca-bundle\") pod \"metrics-server-6fb8796695-fbm56\" (UID: \"9c06f548-6ef2-43e9-a132-0d2baf9565b3\") " pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:15:32.579681 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.579657 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9c06f548-6ef2-43e9-a132-0d2baf9565b3-secret-metrics-server-tls\") pod \"metrics-server-6fb8796695-fbm56\" (UID: \"9c06f548-6ef2-43e9-a132-0d2baf9565b3\") " pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:15:32.579727 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.579691 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9c06f548-6ef2-43e9-a132-0d2baf9565b3-secret-metrics-server-client-certs\") pod \"metrics-server-6fb8796695-fbm56\" (UID: \"9c06f548-6ef2-43e9-a132-0d2baf9565b3\") " pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:15:32.585916 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.585895 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52sk6\" (UniqueName: \"kubernetes.io/projected/9c06f548-6ef2-43e9-a132-0d2baf9565b3-kube-api-access-52sk6\") pod \"metrics-server-6fb8796695-fbm56\" (UID: \"9c06f548-6ef2-43e9-a132-0d2baf9565b3\") " pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:15:32.769944 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:32.769847 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:15:34.319737 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.319706 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 12:15:34.325142 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.325123 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.328375 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.328311 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 25 12:15:34.332240 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.328908 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 25 12:15:34.332240 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.329425 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 25 12:15:34.332240 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.329463 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 25 12:15:34.332240 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.329564 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gktdf\"" May 25 12:15:34.332240 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.330028 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 25 12:15:34.332240 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.330825 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 25 12:15:34.332240 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.331390 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 25 12:15:34.332240 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.331491 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 25 12:15:34.332240 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.331818 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 25 12:15:34.332240 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.332049 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 25 12:15:34.333566 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.333533 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1k1dsic18bj8m\"" May 25 12:15:34.339285 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.339247 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 25 12:15:34.341110 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.341091 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 12:15:34.341544 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.341518 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 25 12:15:34.347219 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.347193 2569 patch_prober.go:28] interesting pod/image-registry-86b49f8787-r57k6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 25 12:15:34.347318 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.347253 2569 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-86b49f8787-r57k6" podUID="79bc0bd5-7639-4903-a23f-06cb3105e83d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 25 12:15:34.389008 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.388976 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/252710ed-53f8-48f8-b184-105903901a7c-config-out\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.389134 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.389019 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/252710ed-53f8-48f8-b184-105903901a7c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.389134 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.389052 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.389134 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.389118 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.389307 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.389151 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.389307 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.389173 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.389307 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.389202 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.389307 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.389227 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.389307 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.389242 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.389307 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.389260 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.389307 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.389286 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.389660 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.389420 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.389660 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.389446 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-config\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.389660 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.389466 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-web-config\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.389660 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.389489 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.389660 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.389536 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5qg7\" (UniqueName: \"kubernetes.io/projected/252710ed-53f8-48f8-b184-105903901a7c-kube-api-access-g5qg7\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.389660 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.389568 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/252710ed-53f8-48f8-b184-105903901a7c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.389660 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.389617 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.490372 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.490336 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.490576 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.490405 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/252710ed-53f8-48f8-b184-105903901a7c-config-out\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.490576 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.490445 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/252710ed-53f8-48f8-b184-105903901a7c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.490576 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.490473 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.490576 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.490502 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.490576 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.490530 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.490576 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.490562 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.490953 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.490911 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.491031 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.490973 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.491031 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.490999 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.491134 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.491041 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.491134 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.491065 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.491134 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.491099 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.491134 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.491128 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-config\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.491344 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.491158 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-web-config\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.491344 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.491186 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.491344 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.491234 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5qg7\" (UniqueName: \"kubernetes.io/projected/252710ed-53f8-48f8-b184-105903901a7c-kube-api-access-g5qg7\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.491487 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.491311 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/252710ed-53f8-48f8-b184-105903901a7c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.491877 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.491849 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/252710ed-53f8-48f8-b184-105903901a7c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.493846 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.493818 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.493994 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.493878 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.493994 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.493979 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.494386 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.494237 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.494386 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.494310 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/252710ed-53f8-48f8-b184-105903901a7c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.494767 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.494584 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.494767 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.494737 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.495333 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.495310 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.496126 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.495664 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.496306 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.496265 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/252710ed-53f8-48f8-b184-105903901a7c-config-out\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.497519 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.497492 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.497998 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.497926 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-web-config\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.498389 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.498369 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-config\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.498545 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.498520 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.498609 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.498587 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.499482 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.499457 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.506066 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.506045 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5qg7\" (UniqueName: \"kubernetes.io/projected/252710ed-53f8-48f8-b184-105903901a7c-kube-api-access-g5qg7\") pod \"prometheus-k8s-0\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:34.639182 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:34.639140 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:35.817910 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:35.817863 2569 patch_prober.go:28] interesting pod/image-registry-86b49f8787-r57k6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 25 12:15:35.818387 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:35.817946 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-86b49f8787-r57k6" podUID="79bc0bd5-7639-4903-a23f-06cb3105e83d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 25 12:15:39.067563 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:39.067536 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 12:15:39.069487 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:15:39.069464 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod252710ed_53f8_48f8_b184_105903901a7c.slice/crio-43c2fdd808c06baaf8a4fe00a3866f435f9b9e804b1bdc80cf560905c6057004 WatchSource:0}: Error finding container 43c2fdd808c06baaf8a4fe00a3866f435f9b9e804b1bdc80cf560905c6057004: Status 404 returned error can't find the container with id 43c2fdd808c06baaf8a4fe00a3866f435f9b9e804b1bdc80cf560905c6057004 May 25 12:15:39.081048 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:39.080995 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6fb8796695-fbm56"] May 25 12:15:39.084188 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:15:39.084154 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c06f548_6ef2_43e9_a132_0d2baf9565b3.slice/crio-75ebcab4f5d3e3a6d9618824d71b7cf077b456189932fc1348a1e41a1591e0df WatchSource:0}: Error finding container 75ebcab4f5d3e3a6d9618824d71b7cf077b456189932fc1348a1e41a1591e0df: Status 404 returned error can't find the container with id 75ebcab4f5d3e3a6d9618824d71b7cf077b456189932fc1348a1e41a1591e0df May 25 12:15:39.084515 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:39.084492 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b8c9dcc95-xnwcv"] May 25 12:15:39.088107 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:15:39.088079 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29b9bc46_3412_4402_b77c_5d9d9f71e56e.slice/crio-56e99467712d207243aa9e6eb75c965cbf01068f536c09c95dd464d45d1dbf96 WatchSource:0}: Error finding container 56e99467712d207243aa9e6eb75c965cbf01068f536c09c95dd464d45d1dbf96: Status 404 returned error can't find the container with id 56e99467712d207243aa9e6eb75c965cbf01068f536c09c95dd464d45d1dbf96 May 25 12:15:39.906314 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:39.906262 2569 generic.go:358] "Generic (PLEG): container finished" podID="252710ed-53f8-48f8-b184-105903901a7c" containerID="ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d" exitCode=0 May 25 12:15:39.906482 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:39.906364 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"252710ed-53f8-48f8-b184-105903901a7c","Type":"ContainerDied","Data":"ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d"} May 25 12:15:39.906482 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:39.906394 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"252710ed-53f8-48f8-b184-105903901a7c","Type":"ContainerStarted","Data":"43c2fdd808c06baaf8a4fe00a3866f435f9b9e804b1bdc80cf560905c6057004"} May 25 12:15:39.909269 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:39.909241 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b8c9dcc95-xnwcv" event={"ID":"29b9bc46-3412-4402-b77c-5d9d9f71e56e","Type":"ContainerStarted","Data":"56e99467712d207243aa9e6eb75c965cbf01068f536c09c95dd464d45d1dbf96"} May 25 12:15:39.911232 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:39.910836 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-86zz8" event={"ID":"df6be786-2eb9-461a-a9f6-4f9fa19ccaa1","Type":"ContainerStarted","Data":"61ef727c46890e3f1a7b287c7fc4797fa18f7ef11ccd9f2bfd1af1f1552927a6"} May 25 12:15:39.921997 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:39.918147 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-86zz8" May 25 12:15:39.928660 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:39.928630 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a1e65f9-6d7d-4964-987e-2f241f71ada4","Type":"ContainerStarted","Data":"4236a66071b63c0db352b5b96de075f29d7bdab6a6d9489272e9cf69f331844e"} May 25 12:15:39.928943 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:39.928854 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a1e65f9-6d7d-4964-987e-2f241f71ada4","Type":"ContainerStarted","Data":"e0e3b17f71359a53fc442b7ca6771a6ce376190a073c4e442b1b08e47a702eb9"} May 25 12:15:39.928943 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:39.928882 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a1e65f9-6d7d-4964-987e-2f241f71ada4","Type":"ContainerStarted","Data":"1b9636228bfd4000704086c15dab448a74f00be1ead55573657717be7a9a35a8"} May 25 12:15:39.928943 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:39.928895 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a1e65f9-6d7d-4964-987e-2f241f71ada4","Type":"ContainerStarted","Data":"6700746ec90ffd6e65a718d2f4f0e4db6553e7571b77d9703db6e3294e7d249e"} May 25 12:15:39.928943 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:39.928908 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a1e65f9-6d7d-4964-987e-2f241f71ada4","Type":"ContainerStarted","Data":"58c9fb93ce947fbfbbcd2e14c79a1ef8fb74fcdc0b07911aa5baf662db8e396d"} May 25 12:15:39.930498 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:39.930475 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" event={"ID":"9c06f548-6ef2-43e9-a132-0d2baf9565b3","Type":"ContainerStarted","Data":"75ebcab4f5d3e3a6d9618824d71b7cf077b456189932fc1348a1e41a1591e0df"} May 25 12:15:39.932246 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:39.932229 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-86zz8" May 25 12:15:40.461206 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:40.461146 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-86zz8" podStartSLOduration=3.006201515 podStartE2EDuration="27.461126062s" podCreationTimestamp="2026-05-25 12:15:13 +0000 UTC" firstStartedPulling="2026-05-25 12:15:14.485528884 +0000 UTC m=+124.712946540" lastFinishedPulling="2026-05-25 12:15:38.940453417 +0000 UTC m=+149.167871087" observedRunningTime="2026-05-25 12:15:39.974345421 +0000 UTC m=+150.201763100" watchObservedRunningTime="2026-05-25 12:15:40.461126062 +0000 UTC m=+150.688543739" May 25 12:15:40.949802 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:40.949765 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a1e65f9-6d7d-4964-987e-2f241f71ada4","Type":"ContainerStarted","Data":"49c0d75aa7e3a05f7be2d80aae272b2c6c0d2151e4ae7232d0faf5ef02f32465"} May 25 12:15:40.978907 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:40.978834 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.134477342 podStartE2EDuration="11.97881308s" podCreationTimestamp="2026-05-25 12:15:29 +0000 UTC" firstStartedPulling="2026-05-25 12:15:29.614500099 +0000 UTC m=+139.841917759" lastFinishedPulling="2026-05-25 12:15:40.458835842 +0000 UTC m=+150.686253497" observedRunningTime="2026-05-25 12:15:40.9772066 +0000 UTC m=+151.204624277" watchObservedRunningTime="2026-05-25 12:15:40.97881308 +0000 UTC m=+151.206230757" May 25 12:15:44.346734 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:44.346690 2569 patch_prober.go:28] interesting pod/image-registry-86b49f8787-r57k6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 25 12:15:44.347234 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:44.346754 2569 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-86b49f8787-r57k6" podUID="79bc0bd5-7639-4903-a23f-06cb3105e83d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 25 12:15:45.818886 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:45.818791 2569 patch_prober.go:28] interesting pod/image-registry-86b49f8787-r57k6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 25 12:15:45.818886 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:45.818870 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-86b49f8787-r57k6" podUID="79bc0bd5-7639-4903-a23f-06cb3105e83d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 25 12:15:45.968080 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:45.968033 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" event={"ID":"9c06f548-6ef2-43e9-a132-0d2baf9565b3","Type":"ContainerStarted","Data":"f6de2c22abccd8730a44bb09a7f24ed79943d2ff912f740e52cc747d5b8faf30"} May 25 12:15:45.970790 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:45.970761 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"252710ed-53f8-48f8-b184-105903901a7c","Type":"ContainerStarted","Data":"abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67"} May 25 12:15:45.970949 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:45.970798 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"252710ed-53f8-48f8-b184-105903901a7c","Type":"ContainerStarted","Data":"a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6"} May 25 12:15:45.972236 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:45.972204 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b8c9dcc95-xnwcv" event={"ID":"29b9bc46-3412-4402-b77c-5d9d9f71e56e","Type":"ContainerStarted","Data":"50fa7f2e530807879b11e68bdfdb63e30809bb9dfc4fa86d762165de7e162d35"} May 25 12:15:45.989279 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:45.989213 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" podStartSLOduration=7.957350816 podStartE2EDuration="13.989195092s" podCreationTimestamp="2026-05-25 12:15:32 +0000 UTC" firstStartedPulling="2026-05-25 12:15:39.086571949 +0000 UTC m=+149.313989619" lastFinishedPulling="2026-05-25 12:15:45.118416225 +0000 UTC m=+155.345833895" observedRunningTime="2026-05-25 12:15:45.988453813 +0000 UTC m=+156.215871489" watchObservedRunningTime="2026-05-25 12:15:45.989195092 +0000 UTC m=+156.216612771" May 25 12:15:46.008550 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:46.008479 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7b8c9dcc95-xnwcv" podStartSLOduration=8.956073716 podStartE2EDuration="15.008462524s" podCreationTimestamp="2026-05-25 12:15:31 +0000 UTC" firstStartedPulling="2026-05-25 12:15:39.092215782 +0000 UTC m=+149.319633439" lastFinishedPulling="2026-05-25 12:15:45.144604582 +0000 UTC m=+155.372022247" observedRunningTime="2026-05-25 12:15:46.00696917 +0000 UTC m=+156.234386848" watchObservedRunningTime="2026-05-25 12:15:46.008462524 +0000 UTC m=+156.235880208" May 25 12:15:46.706315 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:15:46.706257 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6284j" podUID="27ca0001-404e-4e5f-ba48-1698e3cee67f" May 25 12:15:46.721534 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:15:46.721483 2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-mpnlz" podUID="fdb1b8ee-d354-463f-89b6-0b8140aa2dd7" May 25 12:15:46.976760 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:46.976680 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6284j" May 25 12:15:46.977308 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:46.977286 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mpnlz" May 25 12:15:48.986252 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:48.986215 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"252710ed-53f8-48f8-b184-105903901a7c","Type":"ContainerStarted","Data":"7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699"} May 25 12:15:48.986252 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:48.986251 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"252710ed-53f8-48f8-b184-105903901a7c","Type":"ContainerStarted","Data":"49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f"} May 25 12:15:48.986789 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:48.986264 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"252710ed-53f8-48f8-b184-105903901a7c","Type":"ContainerStarted","Data":"c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245"} May 25 12:15:48.986789 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:48.986274 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"252710ed-53f8-48f8-b184-105903901a7c","Type":"ContainerStarted","Data":"1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347"} May 25 12:15:49.015264 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:49.015213 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.875582868 podStartE2EDuration="15.015197377s" podCreationTimestamp="2026-05-25 12:15:34 +0000 UTC" firstStartedPulling="2026-05-25 12:15:39.908796658 +0000 UTC m=+150.136214315" lastFinishedPulling="2026-05-25 12:15:48.04841116 +0000 UTC m=+158.275828824" observedRunningTime="2026-05-25 12:15:49.013823058 +0000 UTC m=+159.241240735" watchObservedRunningTime="2026-05-25 12:15:49.015197377 +0000 UTC m=+159.242615054" May 25 12:15:49.640211 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:49.640166 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:15:51.657756 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:51.657712 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:15:51.658209 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:51.657771 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:15:51.659373 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:51.659340 2569 patch_prober.go:28] interesting pod/console-7b8c9dcc95-xnwcv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= May 25 12:15:51.659481 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:51.659398 2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7b8c9dcc95-xnwcv" podUID="29b9bc46-3412-4402-b77c-5d9d9f71e56e" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" May 25 12:15:51.691155 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:51.691117 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls\") pod \"dns-default-6284j\" (UID: \"27ca0001-404e-4e5f-ba48-1698e3cee67f\") " pod="openshift-dns/dns-default-6284j" May 25 12:15:51.691278 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:51.691177 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert\") pod \"ingress-canary-mpnlz\" (UID: \"fdb1b8ee-d354-463f-89b6-0b8140aa2dd7\") " pod="openshift-ingress-canary/ingress-canary-mpnlz" May 25 12:15:51.693792 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:51.693766 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdb1b8ee-d354-463f-89b6-0b8140aa2dd7-cert\") pod \"ingress-canary-mpnlz\" (UID: \"fdb1b8ee-d354-463f-89b6-0b8140aa2dd7\") " pod="openshift-ingress-canary/ingress-canary-mpnlz" May 25 12:15:51.693893 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:51.693771 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/27ca0001-404e-4e5f-ba48-1698e3cee67f-metrics-tls\") pod \"dns-default-6284j\" (UID: \"27ca0001-404e-4e5f-ba48-1698e3cee67f\") " pod="openshift-dns/dns-default-6284j" May 25 12:15:51.780104 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:51.780070 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c8dc6\"" May 25 12:15:51.780454 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:51.780436 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-sw9bq\"" May 25 12:15:51.788997 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:51.788970 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6284j" May 25 12:15:51.789107 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:51.789040 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mpnlz" May 25 12:15:51.946712 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:51.946675 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mpnlz"] May 25 12:15:51.950229 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:15:51.950199 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdb1b8ee_d354_463f_89b6_0b8140aa2dd7.slice/crio-cf25bf1b1e70f6fad71204479969a315806073c37e7db0d8b49da808af1c6259 WatchSource:0}: Error finding container cf25bf1b1e70f6fad71204479969a315806073c37e7db0d8b49da808af1c6259: Status 404 returned error can't find the container with id cf25bf1b1e70f6fad71204479969a315806073c37e7db0d8b49da808af1c6259 May 25 12:15:51.964288 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:51.964255 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6284j"] May 25 12:15:51.967320 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:15:51.967286 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27ca0001_404e_4e5f_ba48_1698e3cee67f.slice/crio-ddc8c008813d0e06459fd67087a14641c8322ee90b74c4f00bdff8d8842a93e5 WatchSource:0}: Error finding container ddc8c008813d0e06459fd67087a14641c8322ee90b74c4f00bdff8d8842a93e5: Status 404 returned error can't find the container with id ddc8c008813d0e06459fd67087a14641c8322ee90b74c4f00bdff8d8842a93e5 May 25 12:15:51.996005 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:51.995961 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mpnlz" event={"ID":"fdb1b8ee-d354-463f-89b6-0b8140aa2dd7","Type":"ContainerStarted","Data":"cf25bf1b1e70f6fad71204479969a315806073c37e7db0d8b49da808af1c6259"} May 25 12:15:51.997009 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:51.996981 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6284j" event={"ID":"27ca0001-404e-4e5f-ba48-1698e3cee67f","Type":"ContainerStarted","Data":"ddc8c008813d0e06459fd67087a14641c8322ee90b74c4f00bdff8d8842a93e5"} May 25 12:15:52.770795 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:52.770703 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:15:52.770795 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:52.770755 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:15:54.345784 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:54.345752 2569 patch_prober.go:28] interesting pod/image-registry-86b49f8787-r57k6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 25 12:15:54.346174 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:54.345803 2569 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-86b49f8787-r57k6" podUID="79bc0bd5-7639-4903-a23f-06cb3105e83d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 25 12:15:54.346174 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:54.345848 2569 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:15:54.346375 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:54.346344 2569 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"eed604f04d10815fc90748fbfeaf953847eabea6ca7df4dfafa97a5243d5b77f"} pod="openshift-image-registry/image-registry-86b49f8787-r57k6" containerMessage="Container registry failed liveness probe, will be restarted" May 25 12:15:54.349620 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:54.349593 2569 patch_prober.go:28] interesting pod/image-registry-86b49f8787-r57k6 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 25 12:15:54.349771 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:54.349633 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-86b49f8787-r57k6" podUID="79bc0bd5-7639-4903-a23f-06cb3105e83d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 25 12:15:55.009613 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:55.009579 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6284j" event={"ID":"27ca0001-404e-4e5f-ba48-1698e3cee67f","Type":"ContainerStarted","Data":"60da481bd6f0ff95abbd8c700756fb055084baee505e9bd2996ed00141e87609"} May 25 12:15:55.009811 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:55.009623 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6284j" event={"ID":"27ca0001-404e-4e5f-ba48-1698e3cee67f","Type":"ContainerStarted","Data":"f5b41d04ba032f9463402e382cf741cf8972014f41d9f589e2dd39538f21792f"} May 25 12:15:55.009811 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:55.009754 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6284j" May 25 12:15:55.010969 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:55.010925 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mpnlz" event={"ID":"fdb1b8ee-d354-463f-89b6-0b8140aa2dd7","Type":"ContainerStarted","Data":"00b5a35fee832d38ec3197e78a0a9f2884943fb8b8eb226d4db42a0c64759a22"} May 25 12:15:55.026839 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:55.026782 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-6284j" podStartSLOduration=129.515278682 podStartE2EDuration="2m12.026765538s" podCreationTimestamp="2026-05-25 12:13:43 +0000 UTC" firstStartedPulling="2026-05-25 12:15:51.969297689 +0000 UTC m=+162.196715345" lastFinishedPulling="2026-05-25 12:15:54.480784546 +0000 UTC m=+164.708202201" observedRunningTime="2026-05-25 12:15:55.026550365 +0000 UTC m=+165.253968043" watchObservedRunningTime="2026-05-25 12:15:55.026765538 +0000 UTC m=+165.254183216" May 25 12:15:55.042607 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:15:55.042547 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mpnlz" podStartSLOduration=129.510149598 podStartE2EDuration="2m12.04253409s" podCreationTimestamp="2026-05-25 12:13:43 +0000 UTC" firstStartedPulling="2026-05-25 12:15:51.952606479 +0000 UTC m=+162.180024138" lastFinishedPulling="2026-05-25 12:15:54.484990975 +0000 UTC m=+164.712408630" observedRunningTime="2026-05-25 12:15:55.041208454 +0000 UTC m=+165.268626131" watchObservedRunningTime="2026-05-25 12:15:55.04253409 +0000 UTC m=+165.269951770" May 25 12:16:01.662008 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:01.661976 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:16:01.666020 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:01.665984 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:16:04.350049 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:04.350018 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:16:05.015549 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:05.015516 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6284j" May 25 12:16:08.190150 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:08.190116 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b8c9dcc95-xnwcv"] May 25 12:16:10.055390 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:10.055350 2569 generic.go:358] "Generic (PLEG): container finished" podID="7665986d-fe60-463b-becc-f2595787ce65" containerID="03e65c226de3767490702f9ddd48637b4ee028ace40103231db8e52dc1fe44c5" exitCode=0 May 25 12:16:10.055855 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:10.055404 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5jcxl" event={"ID":"7665986d-fe60-463b-becc-f2595787ce65","Type":"ContainerDied","Data":"03e65c226de3767490702f9ddd48637b4ee028ace40103231db8e52dc1fe44c5"} May 25 12:16:10.055855 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:10.055800 2569 scope.go:117] "RemoveContainer" containerID="03e65c226de3767490702f9ddd48637b4ee028ace40103231db8e52dc1fe44c5" May 25 12:16:11.060329 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:11.060289 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-5jcxl" event={"ID":"7665986d-fe60-463b-becc-f2595787ce65","Type":"ContainerStarted","Data":"b254c7cddaf3a0c5b35d968b22e8a84acad171312a0ba14435b89046713b29f2"} May 25 12:16:12.780215 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:12.780182 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:16:12.783963 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:12.783923 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6fb8796695-fbm56" May 25 12:16:19.365398 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:19.365353 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-86b49f8787-r57k6" podUID="79bc0bd5-7639-4903-a23f-06cb3105e83d" containerName="registry" containerID="cri-o://eed604f04d10815fc90748fbfeaf953847eabea6ca7df4dfafa97a5243d5b77f" gracePeriod=30 May 25 12:16:21.092475 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:21.092443 2569 generic.go:358] "Generic (PLEG): container finished" podID="79bc0bd5-7639-4903-a23f-06cb3105e83d" containerID="eed604f04d10815fc90748fbfeaf953847eabea6ca7df4dfafa97a5243d5b77f" exitCode=0 May 25 12:16:21.092788 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:21.092523 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86b49f8787-r57k6" event={"ID":"79bc0bd5-7639-4903-a23f-06cb3105e83d","Type":"ContainerDied","Data":"eed604f04d10815fc90748fbfeaf953847eabea6ca7df4dfafa97a5243d5b77f"} May 25 12:16:21.092788 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:21.092557 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86b49f8787-r57k6" event={"ID":"79bc0bd5-7639-4903-a23f-06cb3105e83d","Type":"ContainerStarted","Data":"8271512156a6b8d058e2d965aff82b68247b6fb90494a7135ff23e39fabbfc9b"} May 25 12:16:22.096246 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:22.096213 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:16:33.210719 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:33.210659 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7b8c9dcc95-xnwcv" podUID="29b9bc46-3412-4402-b77c-5d9d9f71e56e" containerName="console" containerID="cri-o://50fa7f2e530807879b11e68bdfdb63e30809bb9dfc4fa86d762165de7e162d35" gracePeriod=15 May 25 12:16:33.458297 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:33.458275 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b8c9dcc95-xnwcv_29b9bc46-3412-4402-b77c-5d9d9f71e56e/console/0.log" May 25 12:16:33.458406 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:33.458348 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:16:33.537728 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:33.537666 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29b9bc46-3412-4402-b77c-5d9d9f71e56e-console-oauth-config\") pod \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " May 25 12:16:33.537728 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:33.537708 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29b9bc46-3412-4402-b77c-5d9d9f71e56e-console-serving-cert\") pod \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " May 25 12:16:33.537907 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:33.537751 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29b9bc46-3412-4402-b77c-5d9d9f71e56e-oauth-serving-cert\") pod \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " May 25 12:16:33.537907 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:33.537783 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29b9bc46-3412-4402-b77c-5d9d9f71e56e-trusted-ca-bundle\") pod \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " May 25 12:16:33.537907 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:33.537836 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29b9bc46-3412-4402-b77c-5d9d9f71e56e-console-config\") pod \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " May 25 12:16:33.537907 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:33.537878 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29b9bc46-3412-4402-b77c-5d9d9f71e56e-service-ca\") pod \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " May 25 12:16:33.538123 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:33.537908 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xjvc\" (UniqueName: \"kubernetes.io/projected/29b9bc46-3412-4402-b77c-5d9d9f71e56e-kube-api-access-9xjvc\") pod \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\" (UID: \"29b9bc46-3412-4402-b77c-5d9d9f71e56e\") " May 25 12:16:33.538376 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:33.538277 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29b9bc46-3412-4402-b77c-5d9d9f71e56e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "29b9bc46-3412-4402-b77c-5d9d9f71e56e" (UID: "29b9bc46-3412-4402-b77c-5d9d9f71e56e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 12:16:33.538513 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:33.538398 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29b9bc46-3412-4402-b77c-5d9d9f71e56e-console-config" (OuterVolumeSpecName: "console-config") pod "29b9bc46-3412-4402-b77c-5d9d9f71e56e" (UID: "29b9bc46-3412-4402-b77c-5d9d9f71e56e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 12:16:33.538599 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:33.538566 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29b9bc46-3412-4402-b77c-5d9d9f71e56e-service-ca" (OuterVolumeSpecName: "service-ca") pod "29b9bc46-3412-4402-b77c-5d9d9f71e56e" (UID: "29b9bc46-3412-4402-b77c-5d9d9f71e56e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 12:16:33.538860 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:33.538763 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29b9bc46-3412-4402-b77c-5d9d9f71e56e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "29b9bc46-3412-4402-b77c-5d9d9f71e56e" (UID: "29b9bc46-3412-4402-b77c-5d9d9f71e56e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 12:16:33.540194 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:33.540164 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29b9bc46-3412-4402-b77c-5d9d9f71e56e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "29b9bc46-3412-4402-b77c-5d9d9f71e56e" (UID: "29b9bc46-3412-4402-b77c-5d9d9f71e56e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:16:33.540283 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:33.540191 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29b9bc46-3412-4402-b77c-5d9d9f71e56e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "29b9bc46-3412-4402-b77c-5d9d9f71e56e" (UID: "29b9bc46-3412-4402-b77c-5d9d9f71e56e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:16:33.540283 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:33.540247 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29b9bc46-3412-4402-b77c-5d9d9f71e56e-kube-api-access-9xjvc" (OuterVolumeSpecName: "kube-api-access-9xjvc") pod "29b9bc46-3412-4402-b77c-5d9d9f71e56e" (UID: "29b9bc46-3412-4402-b77c-5d9d9f71e56e"). InnerVolumeSpecName "kube-api-access-9xjvc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 12:16:33.639260 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:33.639235 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29b9bc46-3412-4402-b77c-5d9d9f71e56e-oauth-serving-cert\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:33.639260 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:33.639262 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29b9bc46-3412-4402-b77c-5d9d9f71e56e-trusted-ca-bundle\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:33.639384 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:33.639273 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29b9bc46-3412-4402-b77c-5d9d9f71e56e-console-config\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:33.639384 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:33.639282 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29b9bc46-3412-4402-b77c-5d9d9f71e56e-service-ca\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:33.639384 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:33.639291 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xjvc\" (UniqueName: \"kubernetes.io/projected/29b9bc46-3412-4402-b77c-5d9d9f71e56e-kube-api-access-9xjvc\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:33.639384 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:33.639301 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29b9bc46-3412-4402-b77c-5d9d9f71e56e-console-oauth-config\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:33.639384 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:33.639309 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29b9bc46-3412-4402-b77c-5d9d9f71e56e-console-serving-cert\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:34.129734 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:34.129708 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b8c9dcc95-xnwcv_29b9bc46-3412-4402-b77c-5d9d9f71e56e/console/0.log" May 25 12:16:34.129886 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:34.129746 2569 generic.go:358] "Generic (PLEG): container finished" podID="29b9bc46-3412-4402-b77c-5d9d9f71e56e" containerID="50fa7f2e530807879b11e68bdfdb63e30809bb9dfc4fa86d762165de7e162d35" exitCode=2 May 25 12:16:34.129886 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:34.129799 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b8c9dcc95-xnwcv" event={"ID":"29b9bc46-3412-4402-b77c-5d9d9f71e56e","Type":"ContainerDied","Data":"50fa7f2e530807879b11e68bdfdb63e30809bb9dfc4fa86d762165de7e162d35"} May 25 12:16:34.129886 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:34.129817 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b8c9dcc95-xnwcv" May 25 12:16:34.129886 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:34.129831 2569 scope.go:117] "RemoveContainer" containerID="50fa7f2e530807879b11e68bdfdb63e30809bb9dfc4fa86d762165de7e162d35" May 25 12:16:34.130056 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:34.129821 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b8c9dcc95-xnwcv" event={"ID":"29b9bc46-3412-4402-b77c-5d9d9f71e56e","Type":"ContainerDied","Data":"56e99467712d207243aa9e6eb75c965cbf01068f536c09c95dd464d45d1dbf96"} May 25 12:16:34.138842 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:34.138823 2569 scope.go:117] "RemoveContainer" containerID="50fa7f2e530807879b11e68bdfdb63e30809bb9dfc4fa86d762165de7e162d35" May 25 12:16:34.139106 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:16:34.139078 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50fa7f2e530807879b11e68bdfdb63e30809bb9dfc4fa86d762165de7e162d35\": container with ID starting with 50fa7f2e530807879b11e68bdfdb63e30809bb9dfc4fa86d762165de7e162d35 not found: ID does not exist" containerID="50fa7f2e530807879b11e68bdfdb63e30809bb9dfc4fa86d762165de7e162d35" May 25 12:16:34.139196 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:34.139109 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50fa7f2e530807879b11e68bdfdb63e30809bb9dfc4fa86d762165de7e162d35"} err="failed to get container status \"50fa7f2e530807879b11e68bdfdb63e30809bb9dfc4fa86d762165de7e162d35\": rpc error: code = NotFound desc = could not find container \"50fa7f2e530807879b11e68bdfdb63e30809bb9dfc4fa86d762165de7e162d35\": container with ID starting with 50fa7f2e530807879b11e68bdfdb63e30809bb9dfc4fa86d762165de7e162d35 not found: ID does not exist" May 25 12:16:34.151425 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:34.151386 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b8c9dcc95-xnwcv"] May 25 12:16:34.155967 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:34.155926 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b8c9dcc95-xnwcv"] May 25 12:16:34.429181 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:34.429111 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29b9bc46-3412-4402-b77c-5d9d9f71e56e" path="/var/lib/kubelet/pods/29b9bc46-3412-4402-b77c-5d9d9f71e56e/volumes" May 25 12:16:34.640006 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:34.639965 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:34.659801 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:34.659769 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:35.149819 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:35.149792 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:43.102855 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:43.102819 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-86b49f8787-r57k6" May 25 12:16:48.545753 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:48.545722 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 25 12:16:48.546225 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:48.546168 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerName="alertmanager" containerID="cri-o://58c9fb93ce947fbfbbcd2e14c79a1ef8fb74fcdc0b07911aa5baf662db8e396d" gracePeriod=120 May 25 12:16:48.546382 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:48.546227 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerName="kube-rbac-proxy-metric" containerID="cri-o://4236a66071b63c0db352b5b96de075f29d7bdab6a6d9489272e9cf69f331844e" gracePeriod=120 May 25 12:16:48.546382 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:48.546273 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerName="prom-label-proxy" containerID="cri-o://49c0d75aa7e3a05f7be2d80aae272b2c6c0d2151e4ae7232d0faf5ef02f32465" gracePeriod=120 May 25 12:16:48.546382 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:48.546301 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerName="config-reloader" containerID="cri-o://6700746ec90ffd6e65a718d2f4f0e4db6553e7571b77d9703db6e3294e7d249e" gracePeriod=120 May 25 12:16:48.546382 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:48.546293 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerName="kube-rbac-proxy-web" containerID="cri-o://1b9636228bfd4000704086c15dab448a74f00be1ead55573657717be7a9a35a8" gracePeriod=120 May 25 12:16:48.546382 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:48.546313 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerName="kube-rbac-proxy" containerID="cri-o://e0e3b17f71359a53fc442b7ca6771a6ce376190a073c4e442b1b08e47a702eb9" gracePeriod=120 May 25 12:16:49.179536 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.179498 2569 generic.go:358] "Generic (PLEG): container finished" podID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerID="49c0d75aa7e3a05f7be2d80aae272b2c6c0d2151e4ae7232d0faf5ef02f32465" exitCode=0 May 25 12:16:49.179536 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.179524 2569 generic.go:358] "Generic (PLEG): container finished" podID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerID="e0e3b17f71359a53fc442b7ca6771a6ce376190a073c4e442b1b08e47a702eb9" exitCode=0 May 25 12:16:49.179536 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.179534 2569 generic.go:358] "Generic (PLEG): container finished" podID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerID="6700746ec90ffd6e65a718d2f4f0e4db6553e7571b77d9703db6e3294e7d249e" exitCode=0 May 25 12:16:49.179536 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.179543 2569 generic.go:358] "Generic (PLEG): container finished" podID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerID="58c9fb93ce947fbfbbcd2e14c79a1ef8fb74fcdc0b07911aa5baf662db8e396d" exitCode=0 May 25 12:16:49.179798 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.179571 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a1e65f9-6d7d-4964-987e-2f241f71ada4","Type":"ContainerDied","Data":"49c0d75aa7e3a05f7be2d80aae272b2c6c0d2151e4ae7232d0faf5ef02f32465"} May 25 12:16:49.179798 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.179603 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a1e65f9-6d7d-4964-987e-2f241f71ada4","Type":"ContainerDied","Data":"e0e3b17f71359a53fc442b7ca6771a6ce376190a073c4e442b1b08e47a702eb9"} May 25 12:16:49.179798 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.179614 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a1e65f9-6d7d-4964-987e-2f241f71ada4","Type":"ContainerDied","Data":"6700746ec90ffd6e65a718d2f4f0e4db6553e7571b77d9703db6e3294e7d249e"} May 25 12:16:49.179798 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.179629 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a1e65f9-6d7d-4964-987e-2f241f71ada4","Type":"ContainerDied","Data":"58c9fb93ce947fbfbbcd2e14c79a1ef8fb74fcdc0b07911aa5baf662db8e396d"} May 25 12:16:49.783470 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.783444 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 25 12:16:49.868981 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.868884 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-web-config\") pod \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " May 25 12:16:49.868981 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.868944 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-secret-alertmanager-main-tls\") pod \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " May 25 12:16:49.868981 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.868970 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-cluster-tls-config\") pod \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " May 25 12:16:49.869251 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.868997 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-config-volume\") pod \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " May 25 12:16:49.869251 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.869123 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a1e65f9-6d7d-4964-987e-2f241f71ada4-config-out\") pod \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " May 25 12:16:49.869251 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.869168 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a1e65f9-6d7d-4964-987e-2f241f71ada4-tls-assets\") pod \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " May 25 12:16:49.869251 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.869210 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-secret-alertmanager-kube-rbac-proxy-web\") pod \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " May 25 12:16:49.869460 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.869269 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a1e65f9-6d7d-4964-987e-2f241f71ada4-alertmanager-main-db\") pod \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " May 25 12:16:49.869460 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.869337 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a1e65f9-6d7d-4964-987e-2f241f71ada4-metrics-client-ca\") pod \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " May 25 12:16:49.869460 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.869365 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " May 25 12:16:49.869460 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.869405 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a1e65f9-6d7d-4964-987e-2f241f71ada4-alertmanager-trusted-ca-bundle\") pod \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " May 25 12:16:49.869460 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.869450 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-secret-alertmanager-kube-rbac-proxy\") pod \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " May 25 12:16:49.869730 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.869518 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdfrz\" (UniqueName: \"kubernetes.io/projected/3a1e65f9-6d7d-4964-987e-2f241f71ada4-kube-api-access-fdfrz\") pod \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\" (UID: \"3a1e65f9-6d7d-4964-987e-2f241f71ada4\") " May 25 12:16:49.870628 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.870593 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a1e65f9-6d7d-4964-987e-2f241f71ada4-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "3a1e65f9-6d7d-4964-987e-2f241f71ada4" (UID: "3a1e65f9-6d7d-4964-987e-2f241f71ada4"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 12:16:49.870804 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.870778 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a1e65f9-6d7d-4964-987e-2f241f71ada4-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "3a1e65f9-6d7d-4964-987e-2f241f71ada4" (UID: "3a1e65f9-6d7d-4964-987e-2f241f71ada4"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 12:16:49.870972 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.870924 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a1e65f9-6d7d-4964-987e-2f241f71ada4-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "3a1e65f9-6d7d-4964-987e-2f241f71ada4" (UID: "3a1e65f9-6d7d-4964-987e-2f241f71ada4"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 12:16:49.872442 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.872395 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "3a1e65f9-6d7d-4964-987e-2f241f71ada4" (UID: "3a1e65f9-6d7d-4964-987e-2f241f71ada4"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:16:49.872603 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.872576 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-config-volume" (OuterVolumeSpecName: "config-volume") pod "3a1e65f9-6d7d-4964-987e-2f241f71ada4" (UID: "3a1e65f9-6d7d-4964-987e-2f241f71ada4"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:16:49.872689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.872600 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "3a1e65f9-6d7d-4964-987e-2f241f71ada4" (UID: "3a1e65f9-6d7d-4964-987e-2f241f71ada4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:16:49.872889 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.872842 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a1e65f9-6d7d-4964-987e-2f241f71ada4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3a1e65f9-6d7d-4964-987e-2f241f71ada4" (UID: "3a1e65f9-6d7d-4964-987e-2f241f71ada4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 12:16:49.872889 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.872857 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a1e65f9-6d7d-4964-987e-2f241f71ada4-config-out" (OuterVolumeSpecName: "config-out") pod "3a1e65f9-6d7d-4964-987e-2f241f71ada4" (UID: "3a1e65f9-6d7d-4964-987e-2f241f71ada4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 12:16:49.873052 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.872921 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a1e65f9-6d7d-4964-987e-2f241f71ada4-kube-api-access-fdfrz" (OuterVolumeSpecName: "kube-api-access-fdfrz") pod "3a1e65f9-6d7d-4964-987e-2f241f71ada4" (UID: "3a1e65f9-6d7d-4964-987e-2f241f71ada4"). InnerVolumeSpecName "kube-api-access-fdfrz". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 12:16:49.873620 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.873599 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "3a1e65f9-6d7d-4964-987e-2f241f71ada4" (UID: "3a1e65f9-6d7d-4964-987e-2f241f71ada4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:16:49.874589 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.874565 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "3a1e65f9-6d7d-4964-987e-2f241f71ada4" (UID: "3a1e65f9-6d7d-4964-987e-2f241f71ada4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:16:49.876600 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.876574 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "3a1e65f9-6d7d-4964-987e-2f241f71ada4" (UID: "3a1e65f9-6d7d-4964-987e-2f241f71ada4"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:16:49.883670 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.883651 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-web-config" (OuterVolumeSpecName: "web-config") pod "3a1e65f9-6d7d-4964-987e-2f241f71ada4" (UID: "3a1e65f9-6d7d-4964-987e-2f241f71ada4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:16:49.970286 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.970263 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdfrz\" (UniqueName: \"kubernetes.io/projected/3a1e65f9-6d7d-4964-987e-2f241f71ada4-kube-api-access-fdfrz\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:49.970286 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.970286 2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-web-config\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:49.970410 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.970296 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-secret-alertmanager-main-tls\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:49.970410 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.970305 2569 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-cluster-tls-config\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:49.970410 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.970314 2569 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-config-volume\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:49.970410 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.970323 2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a1e65f9-6d7d-4964-987e-2f241f71ada4-config-out\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:49.970410 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.970331 2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a1e65f9-6d7d-4964-987e-2f241f71ada4-tls-assets\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:49.970410 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.970341 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:49.970410 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.970349 2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a1e65f9-6d7d-4964-987e-2f241f71ada4-alertmanager-main-db\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:49.970410 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.970358 2569 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a1e65f9-6d7d-4964-987e-2f241f71ada4-metrics-client-ca\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:49.970410 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.970367 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:49.970410 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.970375 2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a1e65f9-6d7d-4964-987e-2f241f71ada4-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:49.970410 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:49.970384 2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a1e65f9-6d7d-4964-987e-2f241f71ada4-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:50.189427 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.189346 2569 generic.go:358] "Generic (PLEG): container finished" podID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerID="4236a66071b63c0db352b5b96de075f29d7bdab6a6d9489272e9cf69f331844e" exitCode=0 May 25 12:16:50.189427 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.189372 2569 generic.go:358] "Generic (PLEG): container finished" podID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerID="1b9636228bfd4000704086c15dab448a74f00be1ead55573657717be7a9a35a8" exitCode=0 May 25 12:16:50.189577 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.189454 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" May 25 12:16:50.189577 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.189472 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a1e65f9-6d7d-4964-987e-2f241f71ada4","Type":"ContainerDied","Data":"4236a66071b63c0db352b5b96de075f29d7bdab6a6d9489272e9cf69f331844e"} May 25 12:16:50.189577 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.189514 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a1e65f9-6d7d-4964-987e-2f241f71ada4","Type":"ContainerDied","Data":"1b9636228bfd4000704086c15dab448a74f00be1ead55573657717be7a9a35a8"} May 25 12:16:50.189577 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.189526 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a1e65f9-6d7d-4964-987e-2f241f71ada4","Type":"ContainerDied","Data":"70f8b7acfb8d22946c6c856eef1fc0f4470bae459bca0c3a84cd22cad213b44f"} May 25 12:16:50.189577 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.189542 2569 scope.go:117] "RemoveContainer" containerID="49c0d75aa7e3a05f7be2d80aae272b2c6c0d2151e4ae7232d0faf5ef02f32465" May 25 12:16:50.197058 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.197039 2569 scope.go:117] "RemoveContainer" containerID="4236a66071b63c0db352b5b96de075f29d7bdab6a6d9489272e9cf69f331844e" May 25 12:16:50.203756 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.203740 2569 scope.go:117] "RemoveContainer" containerID="e0e3b17f71359a53fc442b7ca6771a6ce376190a073c4e442b1b08e47a702eb9" May 25 12:16:50.210083 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.210066 2569 scope.go:117] "RemoveContainer" containerID="1b9636228bfd4000704086c15dab448a74f00be1ead55573657717be7a9a35a8" May 25 12:16:50.214714 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.214693 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 25 12:16:50.217845 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.217829 2569 scope.go:117] "RemoveContainer" containerID="6700746ec90ffd6e65a718d2f4f0e4db6553e7571b77d9703db6e3294e7d249e" May 25 12:16:50.224306 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.224281 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] May 25 12:16:50.225276 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.225261 2569 scope.go:117] "RemoveContainer" containerID="58c9fb93ce947fbfbbcd2e14c79a1ef8fb74fcdc0b07911aa5baf662db8e396d" May 25 12:16:50.232079 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.232064 2569 scope.go:117] "RemoveContainer" containerID="15acf2d77c73079d8be6b2203b730e868505c711959cf27ed029f40ea065028d" May 25 12:16:50.238286 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.238269 2569 scope.go:117] "RemoveContainer" containerID="49c0d75aa7e3a05f7be2d80aae272b2c6c0d2151e4ae7232d0faf5ef02f32465" May 25 12:16:50.238505 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:16:50.238489 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49c0d75aa7e3a05f7be2d80aae272b2c6c0d2151e4ae7232d0faf5ef02f32465\": container with ID starting with 49c0d75aa7e3a05f7be2d80aae272b2c6c0d2151e4ae7232d0faf5ef02f32465 not found: ID does not exist" containerID="49c0d75aa7e3a05f7be2d80aae272b2c6c0d2151e4ae7232d0faf5ef02f32465" May 25 12:16:50.238550 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.238511 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49c0d75aa7e3a05f7be2d80aae272b2c6c0d2151e4ae7232d0faf5ef02f32465"} err="failed to get container status \"49c0d75aa7e3a05f7be2d80aae272b2c6c0d2151e4ae7232d0faf5ef02f32465\": rpc error: code = NotFound desc = could not find container \"49c0d75aa7e3a05f7be2d80aae272b2c6c0d2151e4ae7232d0faf5ef02f32465\": container with ID starting with 49c0d75aa7e3a05f7be2d80aae272b2c6c0d2151e4ae7232d0faf5ef02f32465 not found: ID does not exist" May 25 12:16:50.238550 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.238528 2569 scope.go:117] "RemoveContainer" containerID="4236a66071b63c0db352b5b96de075f29d7bdab6a6d9489272e9cf69f331844e" May 25 12:16:50.238722 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:16:50.238705 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4236a66071b63c0db352b5b96de075f29d7bdab6a6d9489272e9cf69f331844e\": container with ID starting with 4236a66071b63c0db352b5b96de075f29d7bdab6a6d9489272e9cf69f331844e not found: ID does not exist" containerID="4236a66071b63c0db352b5b96de075f29d7bdab6a6d9489272e9cf69f331844e" May 25 12:16:50.238757 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.238729 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4236a66071b63c0db352b5b96de075f29d7bdab6a6d9489272e9cf69f331844e"} err="failed to get container status \"4236a66071b63c0db352b5b96de075f29d7bdab6a6d9489272e9cf69f331844e\": rpc error: code = NotFound desc = could not find container \"4236a66071b63c0db352b5b96de075f29d7bdab6a6d9489272e9cf69f331844e\": container with ID starting with 4236a66071b63c0db352b5b96de075f29d7bdab6a6d9489272e9cf69f331844e not found: ID does not exist" May 25 12:16:50.238757 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.238746 2569 scope.go:117] "RemoveContainer" containerID="e0e3b17f71359a53fc442b7ca6771a6ce376190a073c4e442b1b08e47a702eb9" May 25 12:16:50.238968 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:16:50.238950 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0e3b17f71359a53fc442b7ca6771a6ce376190a073c4e442b1b08e47a702eb9\": container with ID starting with e0e3b17f71359a53fc442b7ca6771a6ce376190a073c4e442b1b08e47a702eb9 not found: ID does not exist" containerID="e0e3b17f71359a53fc442b7ca6771a6ce376190a073c4e442b1b08e47a702eb9" May 25 12:16:50.239034 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.238971 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0e3b17f71359a53fc442b7ca6771a6ce376190a073c4e442b1b08e47a702eb9"} err="failed to get container status \"e0e3b17f71359a53fc442b7ca6771a6ce376190a073c4e442b1b08e47a702eb9\": rpc error: code = NotFound desc = could not find container \"e0e3b17f71359a53fc442b7ca6771a6ce376190a073c4e442b1b08e47a702eb9\": container with ID starting with e0e3b17f71359a53fc442b7ca6771a6ce376190a073c4e442b1b08e47a702eb9 not found: ID does not exist" May 25 12:16:50.239034 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.238985 2569 scope.go:117] "RemoveContainer" containerID="1b9636228bfd4000704086c15dab448a74f00be1ead55573657717be7a9a35a8" May 25 12:16:50.239161 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:16:50.239142 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b9636228bfd4000704086c15dab448a74f00be1ead55573657717be7a9a35a8\": container with ID starting with 1b9636228bfd4000704086c15dab448a74f00be1ead55573657717be7a9a35a8 not found: ID does not exist" containerID="1b9636228bfd4000704086c15dab448a74f00be1ead55573657717be7a9a35a8" May 25 12:16:50.239210 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.239164 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b9636228bfd4000704086c15dab448a74f00be1ead55573657717be7a9a35a8"} err="failed to get container status \"1b9636228bfd4000704086c15dab448a74f00be1ead55573657717be7a9a35a8\": rpc error: code = NotFound desc = could not find container \"1b9636228bfd4000704086c15dab448a74f00be1ead55573657717be7a9a35a8\": container with ID starting with 1b9636228bfd4000704086c15dab448a74f00be1ead55573657717be7a9a35a8 not found: ID does not exist" May 25 12:16:50.239210 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.239176 2569 scope.go:117] "RemoveContainer" containerID="6700746ec90ffd6e65a718d2f4f0e4db6553e7571b77d9703db6e3294e7d249e" May 25 12:16:50.239391 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:16:50.239373 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6700746ec90ffd6e65a718d2f4f0e4db6553e7571b77d9703db6e3294e7d249e\": container with ID starting with 6700746ec90ffd6e65a718d2f4f0e4db6553e7571b77d9703db6e3294e7d249e not found: ID does not exist" containerID="6700746ec90ffd6e65a718d2f4f0e4db6553e7571b77d9703db6e3294e7d249e" May 25 12:16:50.239452 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.239401 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6700746ec90ffd6e65a718d2f4f0e4db6553e7571b77d9703db6e3294e7d249e"} err="failed to get container status \"6700746ec90ffd6e65a718d2f4f0e4db6553e7571b77d9703db6e3294e7d249e\": rpc error: code = NotFound desc = could not find container \"6700746ec90ffd6e65a718d2f4f0e4db6553e7571b77d9703db6e3294e7d249e\": container with ID starting with 6700746ec90ffd6e65a718d2f4f0e4db6553e7571b77d9703db6e3294e7d249e not found: ID does not exist" May 25 12:16:50.239452 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.239421 2569 scope.go:117] "RemoveContainer" containerID="58c9fb93ce947fbfbbcd2e14c79a1ef8fb74fcdc0b07911aa5baf662db8e396d" May 25 12:16:50.239667 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:16:50.239651 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58c9fb93ce947fbfbbcd2e14c79a1ef8fb74fcdc0b07911aa5baf662db8e396d\": container with ID starting with 58c9fb93ce947fbfbbcd2e14c79a1ef8fb74fcdc0b07911aa5baf662db8e396d not found: ID does not exist" containerID="58c9fb93ce947fbfbbcd2e14c79a1ef8fb74fcdc0b07911aa5baf662db8e396d" May 25 12:16:50.239703 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.239673 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58c9fb93ce947fbfbbcd2e14c79a1ef8fb74fcdc0b07911aa5baf662db8e396d"} err="failed to get container status \"58c9fb93ce947fbfbbcd2e14c79a1ef8fb74fcdc0b07911aa5baf662db8e396d\": rpc error: code = NotFound desc = could not find container \"58c9fb93ce947fbfbbcd2e14c79a1ef8fb74fcdc0b07911aa5baf662db8e396d\": container with ID starting with 58c9fb93ce947fbfbbcd2e14c79a1ef8fb74fcdc0b07911aa5baf662db8e396d not found: ID does not exist" May 25 12:16:50.239703 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.239688 2569 scope.go:117] "RemoveContainer" containerID="15acf2d77c73079d8be6b2203b730e868505c711959cf27ed029f40ea065028d" May 25 12:16:50.239920 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:16:50.239905 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15acf2d77c73079d8be6b2203b730e868505c711959cf27ed029f40ea065028d\": container with ID starting with 15acf2d77c73079d8be6b2203b730e868505c711959cf27ed029f40ea065028d not found: ID does not exist" containerID="15acf2d77c73079d8be6b2203b730e868505c711959cf27ed029f40ea065028d" May 25 12:16:50.240047 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.239924 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15acf2d77c73079d8be6b2203b730e868505c711959cf27ed029f40ea065028d"} err="failed to get container status \"15acf2d77c73079d8be6b2203b730e868505c711959cf27ed029f40ea065028d\": rpc error: code = NotFound desc = could not find container \"15acf2d77c73079d8be6b2203b730e868505c711959cf27ed029f40ea065028d\": container with ID starting with 15acf2d77c73079d8be6b2203b730e868505c711959cf27ed029f40ea065028d not found: ID does not exist" May 25 12:16:50.240047 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.239959 2569 scope.go:117] "RemoveContainer" containerID="49c0d75aa7e3a05f7be2d80aae272b2c6c0d2151e4ae7232d0faf5ef02f32465" May 25 12:16:50.240175 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.240159 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49c0d75aa7e3a05f7be2d80aae272b2c6c0d2151e4ae7232d0faf5ef02f32465"} err="failed to get container status \"49c0d75aa7e3a05f7be2d80aae272b2c6c0d2151e4ae7232d0faf5ef02f32465\": rpc error: code = NotFound desc = could not find container \"49c0d75aa7e3a05f7be2d80aae272b2c6c0d2151e4ae7232d0faf5ef02f32465\": container with ID starting with 49c0d75aa7e3a05f7be2d80aae272b2c6c0d2151e4ae7232d0faf5ef02f32465 not found: ID does not exist" May 25 12:16:50.240219 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.240177 2569 scope.go:117] "RemoveContainer" containerID="4236a66071b63c0db352b5b96de075f29d7bdab6a6d9489272e9cf69f331844e" May 25 12:16:50.240369 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.240351 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4236a66071b63c0db352b5b96de075f29d7bdab6a6d9489272e9cf69f331844e"} err="failed to get container status \"4236a66071b63c0db352b5b96de075f29d7bdab6a6d9489272e9cf69f331844e\": rpc error: code = NotFound desc = could not find container \"4236a66071b63c0db352b5b96de075f29d7bdab6a6d9489272e9cf69f331844e\": container with ID starting with 4236a66071b63c0db352b5b96de075f29d7bdab6a6d9489272e9cf69f331844e not found: ID does not exist" May 25 12:16:50.240412 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.240371 2569 scope.go:117] "RemoveContainer" containerID="e0e3b17f71359a53fc442b7ca6771a6ce376190a073c4e442b1b08e47a702eb9" May 25 12:16:50.240557 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.240542 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0e3b17f71359a53fc442b7ca6771a6ce376190a073c4e442b1b08e47a702eb9"} err="failed to get container status \"e0e3b17f71359a53fc442b7ca6771a6ce376190a073c4e442b1b08e47a702eb9\": rpc error: code = NotFound desc = could not find container \"e0e3b17f71359a53fc442b7ca6771a6ce376190a073c4e442b1b08e47a702eb9\": container with ID starting with e0e3b17f71359a53fc442b7ca6771a6ce376190a073c4e442b1b08e47a702eb9 not found: ID does not exist" May 25 12:16:50.240605 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.240557 2569 scope.go:117] "RemoveContainer" containerID="1b9636228bfd4000704086c15dab448a74f00be1ead55573657717be7a9a35a8" May 25 12:16:50.240754 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.240736 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b9636228bfd4000704086c15dab448a74f00be1ead55573657717be7a9a35a8"} err="failed to get container status \"1b9636228bfd4000704086c15dab448a74f00be1ead55573657717be7a9a35a8\": rpc error: code = NotFound desc = could not find container \"1b9636228bfd4000704086c15dab448a74f00be1ead55573657717be7a9a35a8\": container with ID starting with 1b9636228bfd4000704086c15dab448a74f00be1ead55573657717be7a9a35a8 not found: ID does not exist" May 25 12:16:50.240754 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.240753 2569 scope.go:117] "RemoveContainer" containerID="6700746ec90ffd6e65a718d2f4f0e4db6553e7571b77d9703db6e3294e7d249e" May 25 12:16:50.240924 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.240908 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6700746ec90ffd6e65a718d2f4f0e4db6553e7571b77d9703db6e3294e7d249e"} err="failed to get container status \"6700746ec90ffd6e65a718d2f4f0e4db6553e7571b77d9703db6e3294e7d249e\": rpc error: code = NotFound desc = could not find container \"6700746ec90ffd6e65a718d2f4f0e4db6553e7571b77d9703db6e3294e7d249e\": container with ID starting with 6700746ec90ffd6e65a718d2f4f0e4db6553e7571b77d9703db6e3294e7d249e not found: ID does not exist" May 25 12:16:50.240993 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.240924 2569 scope.go:117] "RemoveContainer" containerID="58c9fb93ce947fbfbbcd2e14c79a1ef8fb74fcdc0b07911aa5baf662db8e396d" May 25 12:16:50.241149 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.241132 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58c9fb93ce947fbfbbcd2e14c79a1ef8fb74fcdc0b07911aa5baf662db8e396d"} err="failed to get container status \"58c9fb93ce947fbfbbcd2e14c79a1ef8fb74fcdc0b07911aa5baf662db8e396d\": rpc error: code = NotFound desc = could not find container \"58c9fb93ce947fbfbbcd2e14c79a1ef8fb74fcdc0b07911aa5baf662db8e396d\": container with ID starting with 58c9fb93ce947fbfbbcd2e14c79a1ef8fb74fcdc0b07911aa5baf662db8e396d not found: ID does not exist" May 25 12:16:50.241189 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.241149 2569 scope.go:117] "RemoveContainer" containerID="15acf2d77c73079d8be6b2203b730e868505c711959cf27ed029f40ea065028d" May 25 12:16:50.241342 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.241316 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15acf2d77c73079d8be6b2203b730e868505c711959cf27ed029f40ea065028d"} err="failed to get container status \"15acf2d77c73079d8be6b2203b730e868505c711959cf27ed029f40ea065028d\": rpc error: code = NotFound desc = could not find container \"15acf2d77c73079d8be6b2203b730e868505c711959cf27ed029f40ea065028d\": container with ID starting with 15acf2d77c73079d8be6b2203b730e868505c711959cf27ed029f40ea065028d not found: ID does not exist" May 25 12:16:50.429311 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:50.429281 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" path="/var/lib/kubelet/pods/3a1e65f9-6d7d-4964-987e-2f241f71ada4/volumes" May 25 12:16:52.836575 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:52.836545 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 12:16:52.837078 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:52.837050 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="252710ed-53f8-48f8-b184-105903901a7c" containerName="kube-rbac-proxy-web" containerID="cri-o://c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245" gracePeriod=600 May 25 12:16:52.837140 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:52.837088 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="252710ed-53f8-48f8-b184-105903901a7c" containerName="kube-rbac-proxy-thanos" containerID="cri-o://7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699" gracePeriod=600 May 25 12:16:52.837192 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:52.837124 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="252710ed-53f8-48f8-b184-105903901a7c" containerName="thanos-sidecar" containerID="cri-o://1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347" gracePeriod=600 May 25 12:16:52.837192 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:52.837044 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="252710ed-53f8-48f8-b184-105903901a7c" containerName="prometheus" containerID="cri-o://a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6" gracePeriod=600 May 25 12:16:52.837293 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:52.837080 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="252710ed-53f8-48f8-b184-105903901a7c" containerName="config-reloader" containerID="cri-o://abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67" gracePeriod=600 May 25 12:16:52.837293 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:52.837204 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="252710ed-53f8-48f8-b184-105903901a7c" containerName="kube-rbac-proxy" containerID="cri-o://49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f" gracePeriod=600 May 25 12:16:53.074393 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.074370 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.195105 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.195020 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-configmap-kubelet-serving-ca-bundle\") pod \"252710ed-53f8-48f8-b184-105903901a7c\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " May 25 12:16:53.195105 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.195066 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-prometheus-k8s-rulefiles-0\") pod \"252710ed-53f8-48f8-b184-105903901a7c\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " May 25 12:16:53.195105 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.195091 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-metrics-client-certs\") pod \"252710ed-53f8-48f8-b184-105903901a7c\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " May 25 12:16:53.195351 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.195133 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/252710ed-53f8-48f8-b184-105903901a7c-tls-assets\") pod \"252710ed-53f8-48f8-b184-105903901a7c\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " May 25 12:16:53.195351 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.195268 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-prometheus-k8s-tls\") pod \"252710ed-53f8-48f8-b184-105903901a7c\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " May 25 12:16:53.195351 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.195320 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/252710ed-53f8-48f8-b184-105903901a7c-prometheus-k8s-db\") pod \"252710ed-53f8-48f8-b184-105903901a7c\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " May 25 12:16:53.195498 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.195359 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-grpc-tls\") pod \"252710ed-53f8-48f8-b184-105903901a7c\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " May 25 12:16:53.195498 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.195391 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-prometheus-trusted-ca-bundle\") pod \"252710ed-53f8-48f8-b184-105903901a7c\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " May 25 12:16:53.195498 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.195430 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"252710ed-53f8-48f8-b184-105903901a7c\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " May 25 12:16:53.195498 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.195465 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-config\") pod \"252710ed-53f8-48f8-b184-105903901a7c\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " May 25 12:16:53.195698 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.195509 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-web-config\") pod \"252710ed-53f8-48f8-b184-105903901a7c\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " May 25 12:16:53.195698 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.195547 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"252710ed-53f8-48f8-b184-105903901a7c\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " May 25 12:16:53.195698 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.195578 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-thanos-prometheus-http-client-file\") pod \"252710ed-53f8-48f8-b184-105903901a7c\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " May 25 12:16:53.195698 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.195607 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5qg7\" (UniqueName: \"kubernetes.io/projected/252710ed-53f8-48f8-b184-105903901a7c-kube-api-access-g5qg7\") pod \"252710ed-53f8-48f8-b184-105903901a7c\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " May 25 12:16:53.195698 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.195643 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/252710ed-53f8-48f8-b184-105903901a7c-config-out\") pod \"252710ed-53f8-48f8-b184-105903901a7c\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " May 25 12:16:53.195698 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.195640 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "252710ed-53f8-48f8-b184-105903901a7c" (UID: "252710ed-53f8-48f8-b184-105903901a7c"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 12:16:53.195698 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.195672 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-kube-rbac-proxy\") pod \"252710ed-53f8-48f8-b184-105903901a7c\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " May 25 12:16:53.196210 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.195707 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-configmap-serving-certs-ca-bundle\") pod \"252710ed-53f8-48f8-b184-105903901a7c\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " May 25 12:16:53.196210 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.195741 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-configmap-metrics-client-ca\") pod \"252710ed-53f8-48f8-b184-105903901a7c\" (UID: \"252710ed-53f8-48f8-b184-105903901a7c\") " May 25 12:16:53.196210 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.195994 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:53.196363 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.196309 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "252710ed-53f8-48f8-b184-105903901a7c" (UID: "252710ed-53f8-48f8-b184-105903901a7c"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 12:16:53.197176 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.197068 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "252710ed-53f8-48f8-b184-105903901a7c" (UID: "252710ed-53f8-48f8-b184-105903901a7c"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 12:16:53.197402 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.197346 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/252710ed-53f8-48f8-b184-105903901a7c-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "252710ed-53f8-48f8-b184-105903901a7c" (UID: "252710ed-53f8-48f8-b184-105903901a7c"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 12:16:53.197507 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.197480 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "252710ed-53f8-48f8-b184-105903901a7c" (UID: "252710ed-53f8-48f8-b184-105903901a7c"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 12:16:53.198560 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.198532 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/252710ed-53f8-48f8-b184-105903901a7c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "252710ed-53f8-48f8-b184-105903901a7c" (UID: "252710ed-53f8-48f8-b184-105903901a7c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 12:16:53.199176 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.199141 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "252710ed-53f8-48f8-b184-105903901a7c" (UID: "252710ed-53f8-48f8-b184-105903901a7c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 12:16:53.200006 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.199774 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "252710ed-53f8-48f8-b184-105903901a7c" (UID: "252710ed-53f8-48f8-b184-105903901a7c"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:16:53.200006 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.199997 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "252710ed-53f8-48f8-b184-105903901a7c" (UID: "252710ed-53f8-48f8-b184-105903901a7c"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:16:53.200157 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.200070 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "252710ed-53f8-48f8-b184-105903901a7c" (UID: "252710ed-53f8-48f8-b184-105903901a7c"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:16:53.200157 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.200147 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "252710ed-53f8-48f8-b184-105903901a7c" (UID: "252710ed-53f8-48f8-b184-105903901a7c"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:16:53.200314 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.200290 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "252710ed-53f8-48f8-b184-105903901a7c" (UID: "252710ed-53f8-48f8-b184-105903901a7c"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:16:53.201563 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.200695 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "252710ed-53f8-48f8-b184-105903901a7c" (UID: "252710ed-53f8-48f8-b184-105903901a7c"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:16:53.201563 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.200778 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "252710ed-53f8-48f8-b184-105903901a7c" (UID: "252710ed-53f8-48f8-b184-105903901a7c"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:16:53.201563 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.200809 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-config" (OuterVolumeSpecName: "config") pod "252710ed-53f8-48f8-b184-105903901a7c" (UID: "252710ed-53f8-48f8-b184-105903901a7c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:16:53.202634 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.202608 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/252710ed-53f8-48f8-b184-105903901a7c-kube-api-access-g5qg7" (OuterVolumeSpecName: "kube-api-access-g5qg7") pod "252710ed-53f8-48f8-b184-105903901a7c" (UID: "252710ed-53f8-48f8-b184-105903901a7c"). InnerVolumeSpecName "kube-api-access-g5qg7". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 12:16:53.203515 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.203487 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/252710ed-53f8-48f8-b184-105903901a7c-config-out" (OuterVolumeSpecName: "config-out") pod "252710ed-53f8-48f8-b184-105903901a7c" (UID: "252710ed-53f8-48f8-b184-105903901a7c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 12:16:53.210337 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.210310 2569 generic.go:358] "Generic (PLEG): container finished" podID="252710ed-53f8-48f8-b184-105903901a7c" containerID="7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699" exitCode=0 May 25 12:16:53.210337 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.210337 2569 generic.go:358] "Generic (PLEG): container finished" podID="252710ed-53f8-48f8-b184-105903901a7c" containerID="49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f" exitCode=0 May 25 12:16:53.210455 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.210347 2569 generic.go:358] "Generic (PLEG): container finished" podID="252710ed-53f8-48f8-b184-105903901a7c" containerID="c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245" exitCode=0 May 25 12:16:53.210455 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.210356 2569 generic.go:358] "Generic (PLEG): container finished" podID="252710ed-53f8-48f8-b184-105903901a7c" containerID="1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347" exitCode=0 May 25 12:16:53.210455 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.210364 2569 generic.go:358] "Generic (PLEG): container finished" podID="252710ed-53f8-48f8-b184-105903901a7c" containerID="abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67" exitCode=0 May 25 12:16:53.210455 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.210372 2569 generic.go:358] "Generic (PLEG): container finished" podID="252710ed-53f8-48f8-b184-105903901a7c" containerID="a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6" exitCode=0 May 25 12:16:53.210455 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.210391 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"252710ed-53f8-48f8-b184-105903901a7c","Type":"ContainerDied","Data":"7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699"} May 25 12:16:53.210455 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.210416 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.210455 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.210433 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"252710ed-53f8-48f8-b184-105903901a7c","Type":"ContainerDied","Data":"49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f"} May 25 12:16:53.210455 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.210446 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"252710ed-53f8-48f8-b184-105903901a7c","Type":"ContainerDied","Data":"c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245"} May 25 12:16:53.210455 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.210455 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"252710ed-53f8-48f8-b184-105903901a7c","Type":"ContainerDied","Data":"1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347"} May 25 12:16:53.210754 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.210465 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"252710ed-53f8-48f8-b184-105903901a7c","Type":"ContainerDied","Data":"abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67"} May 25 12:16:53.210754 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.210473 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"252710ed-53f8-48f8-b184-105903901a7c","Type":"ContainerDied","Data":"a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6"} May 25 12:16:53.210754 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.210486 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"252710ed-53f8-48f8-b184-105903901a7c","Type":"ContainerDied","Data":"43c2fdd808c06baaf8a4fe00a3866f435f9b9e804b1bdc80cf560905c6057004"} May 25 12:16:53.210754 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.210498 2569 scope.go:117] "RemoveContainer" containerID="7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699" May 25 12:16:53.212739 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.212720 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-web-config" (OuterVolumeSpecName: "web-config") pod "252710ed-53f8-48f8-b184-105903901a7c" (UID: "252710ed-53f8-48f8-b184-105903901a7c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:16:53.218017 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.217996 2569 scope.go:117] "RemoveContainer" containerID="49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f" May 25 12:16:53.224507 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.224493 2569 scope.go:117] "RemoveContainer" containerID="c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245" May 25 12:16:53.230996 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.230975 2569 scope.go:117] "RemoveContainer" containerID="1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347" May 25 12:16:53.237079 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.237064 2569 scope.go:117] "RemoveContainer" containerID="abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67" May 25 12:16:53.243360 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.243345 2569 scope.go:117] "RemoveContainer" containerID="a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6" May 25 12:16:53.249719 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.249705 2569 scope.go:117] "RemoveContainer" containerID="ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d" May 25 12:16:53.255848 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.255821 2569 scope.go:117] "RemoveContainer" containerID="7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699" May 25 12:16:53.256094 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:16:53.256078 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699\": container with ID starting with 7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699 not found: ID does not exist" containerID="7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699" May 25 12:16:53.256148 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.256100 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699"} err="failed to get container status \"7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699\": rpc error: code = NotFound desc = could not find container \"7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699\": container with ID starting with 7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699 not found: ID does not exist" May 25 12:16:53.256148 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.256116 2569 scope.go:117] "RemoveContainer" containerID="49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f" May 25 12:16:53.256336 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:16:53.256318 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f\": container with ID starting with 49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f not found: ID does not exist" containerID="49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f" May 25 12:16:53.256396 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.256346 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f"} err="failed to get container status \"49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f\": rpc error: code = NotFound desc = could not find container \"49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f\": container with ID starting with 49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f not found: ID does not exist" May 25 12:16:53.256396 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.256371 2569 scope.go:117] "RemoveContainer" containerID="c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245" May 25 12:16:53.256597 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:16:53.256581 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245\": container with ID starting with c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245 not found: ID does not exist" containerID="c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245" May 25 12:16:53.256650 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.256605 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245"} err="failed to get container status \"c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245\": rpc error: code = NotFound desc = could not find container \"c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245\": container with ID starting with c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245 not found: ID does not exist" May 25 12:16:53.256650 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.256624 2569 scope.go:117] "RemoveContainer" containerID="1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347" May 25 12:16:53.256848 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:16:53.256827 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347\": container with ID starting with 1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347 not found: ID does not exist" containerID="1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347" May 25 12:16:53.256886 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.256858 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347"} err="failed to get container status \"1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347\": rpc error: code = NotFound desc = could not find container \"1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347\": container with ID starting with 1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347 not found: ID does not exist" May 25 12:16:53.256886 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.256879 2569 scope.go:117] "RemoveContainer" containerID="abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67" May 25 12:16:53.257359 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:16:53.257342 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67\": container with ID starting with abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67 not found: ID does not exist" containerID="abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67" May 25 12:16:53.257410 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.257362 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67"} err="failed to get container status \"abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67\": rpc error: code = NotFound desc = could not find container \"abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67\": container with ID starting with abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67 not found: ID does not exist" May 25 12:16:53.257410 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.257376 2569 scope.go:117] "RemoveContainer" containerID="a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6" May 25 12:16:53.257625 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:16:53.257608 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6\": container with ID starting with a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6 not found: ID does not exist" containerID="a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6" May 25 12:16:53.257665 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.257631 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6"} err="failed to get container status \"a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6\": rpc error: code = NotFound desc = could not find container \"a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6\": container with ID starting with a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6 not found: ID does not exist" May 25 12:16:53.257665 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.257645 2569 scope.go:117] "RemoveContainer" containerID="ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d" May 25 12:16:53.257866 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:16:53.257852 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d\": container with ID starting with ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d not found: ID does not exist" containerID="ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d" May 25 12:16:53.257905 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.257869 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d"} err="failed to get container status \"ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d\": rpc error: code = NotFound desc = could not find container \"ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d\": container with ID starting with ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d not found: ID does not exist" May 25 12:16:53.257905 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.257882 2569 scope.go:117] "RemoveContainer" containerID="7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699" May 25 12:16:53.258121 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.258103 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699"} err="failed to get container status \"7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699\": rpc error: code = NotFound desc = could not find container \"7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699\": container with ID starting with 7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699 not found: ID does not exist" May 25 12:16:53.258158 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.258123 2569 scope.go:117] "RemoveContainer" containerID="49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f" May 25 12:16:53.258332 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.258311 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f"} err="failed to get container status \"49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f\": rpc error: code = NotFound desc = could not find container \"49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f\": container with ID starting with 49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f not found: ID does not exist" May 25 12:16:53.258376 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.258333 2569 scope.go:117] "RemoveContainer" containerID="c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245" May 25 12:16:53.258519 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.258503 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245"} err="failed to get container status \"c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245\": rpc error: code = NotFound desc = could not find container \"c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245\": container with ID starting with c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245 not found: ID does not exist" May 25 12:16:53.258569 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.258521 2569 scope.go:117] "RemoveContainer" containerID="1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347" May 25 12:16:53.258686 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.258670 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347"} err="failed to get container status \"1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347\": rpc error: code = NotFound desc = could not find container \"1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347\": container with ID starting with 1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347 not found: ID does not exist" May 25 12:16:53.258735 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.258686 2569 scope.go:117] "RemoveContainer" containerID="abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67" May 25 12:16:53.258869 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.258850 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67"} err="failed to get container status \"abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67\": rpc error: code = NotFound desc = could not find container \"abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67\": container with ID starting with abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67 not found: ID does not exist" May 25 12:16:53.258913 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.258869 2569 scope.go:117] "RemoveContainer" containerID="a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6" May 25 12:16:53.259075 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.259056 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6"} err="failed to get container status \"a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6\": rpc error: code = NotFound desc = could not find container \"a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6\": container with ID starting with a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6 not found: ID does not exist" May 25 12:16:53.259123 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.259077 2569 scope.go:117] "RemoveContainer" containerID="ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d" May 25 12:16:53.259298 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.259280 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d"} err="failed to get container status \"ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d\": rpc error: code = NotFound desc = could not find container \"ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d\": container with ID starting with ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d not found: ID does not exist" May 25 12:16:53.259349 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.259298 2569 scope.go:117] "RemoveContainer" containerID="7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699" May 25 12:16:53.259512 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.259496 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699"} err="failed to get container status \"7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699\": rpc error: code = NotFound desc = could not find container \"7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699\": container with ID starting with 7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699 not found: ID does not exist" May 25 12:16:53.259554 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.259514 2569 scope.go:117] "RemoveContainer" containerID="49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f" May 25 12:16:53.259736 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.259716 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f"} err="failed to get container status \"49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f\": rpc error: code = NotFound desc = could not find container \"49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f\": container with ID starting with 49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f not found: ID does not exist" May 25 12:16:53.259777 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.259736 2569 scope.go:117] "RemoveContainer" containerID="c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245" May 25 12:16:53.259927 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.259913 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245"} err="failed to get container status \"c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245\": rpc error: code = NotFound desc = could not find container \"c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245\": container with ID starting with c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245 not found: ID does not exist" May 25 12:16:53.259927 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.259926 2569 scope.go:117] "RemoveContainer" containerID="1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347" May 25 12:16:53.260150 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.260131 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347"} err="failed to get container status \"1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347\": rpc error: code = NotFound desc = could not find container \"1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347\": container with ID starting with 1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347 not found: ID does not exist" May 25 12:16:53.260184 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.260153 2569 scope.go:117] "RemoveContainer" containerID="abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67" May 25 12:16:53.260378 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.260358 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67"} err="failed to get container status \"abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67\": rpc error: code = NotFound desc = could not find container \"abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67\": container with ID starting with abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67 not found: ID does not exist" May 25 12:16:53.260378 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.260377 2569 scope.go:117] "RemoveContainer" containerID="a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6" May 25 12:16:53.260600 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.260585 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6"} err="failed to get container status \"a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6\": rpc error: code = NotFound desc = could not find container \"a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6\": container with ID starting with a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6 not found: ID does not exist" May 25 12:16:53.260649 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.260600 2569 scope.go:117] "RemoveContainer" containerID="ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d" May 25 12:16:53.260786 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.260771 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d"} err="failed to get container status \"ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d\": rpc error: code = NotFound desc = could not find container \"ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d\": container with ID starting with ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d not found: ID does not exist" May 25 12:16:53.260826 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.260786 2569 scope.go:117] "RemoveContainer" containerID="7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699" May 25 12:16:53.260994 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.260974 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699"} err="failed to get container status \"7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699\": rpc error: code = NotFound desc = could not find container \"7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699\": container with ID starting with 7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699 not found: ID does not exist" May 25 12:16:53.261042 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.260996 2569 scope.go:117] "RemoveContainer" containerID="49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f" May 25 12:16:53.261170 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.261155 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f"} err="failed to get container status \"49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f\": rpc error: code = NotFound desc = could not find container \"49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f\": container with ID starting with 49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f not found: ID does not exist" May 25 12:16:53.261212 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.261169 2569 scope.go:117] "RemoveContainer" containerID="c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245" May 25 12:16:53.261359 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.261336 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245"} err="failed to get container status \"c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245\": rpc error: code = NotFound desc = could not find container \"c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245\": container with ID starting with c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245 not found: ID does not exist" May 25 12:16:53.261400 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.261361 2569 scope.go:117] "RemoveContainer" containerID="1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347" May 25 12:16:53.261549 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.261535 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347"} err="failed to get container status \"1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347\": rpc error: code = NotFound desc = could not find container \"1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347\": container with ID starting with 1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347 not found: ID does not exist" May 25 12:16:53.261588 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.261549 2569 scope.go:117] "RemoveContainer" containerID="abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67" May 25 12:16:53.261733 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.261719 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67"} err="failed to get container status \"abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67\": rpc error: code = NotFound desc = could not find container \"abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67\": container with ID starting with abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67 not found: ID does not exist" May 25 12:16:53.261779 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.261733 2569 scope.go:117] "RemoveContainer" containerID="a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6" May 25 12:16:53.261909 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.261890 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6"} err="failed to get container status \"a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6\": rpc error: code = NotFound desc = could not find container \"a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6\": container with ID starting with a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6 not found: ID does not exist" May 25 12:16:53.261970 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.261911 2569 scope.go:117] "RemoveContainer" containerID="ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d" May 25 12:16:53.262086 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.262072 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d"} err="failed to get container status \"ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d\": rpc error: code = NotFound desc = could not find container \"ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d\": container with ID starting with ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d not found: ID does not exist" May 25 12:16:53.262124 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.262086 2569 scope.go:117] "RemoveContainer" containerID="7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699" May 25 12:16:53.262245 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.262231 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699"} err="failed to get container status \"7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699\": rpc error: code = NotFound desc = could not find container \"7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699\": container with ID starting with 7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699 not found: ID does not exist" May 25 12:16:53.262283 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.262246 2569 scope.go:117] "RemoveContainer" containerID="49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f" May 25 12:16:53.262417 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.262403 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f"} err="failed to get container status \"49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f\": rpc error: code = NotFound desc = could not find container \"49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f\": container with ID starting with 49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f not found: ID does not exist" May 25 12:16:53.262456 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.262417 2569 scope.go:117] "RemoveContainer" containerID="c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245" May 25 12:16:53.262609 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.262594 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245"} err="failed to get container status \"c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245\": rpc error: code = NotFound desc = could not find container \"c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245\": container with ID starting with c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245 not found: ID does not exist" May 25 12:16:53.262647 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.262609 2569 scope.go:117] "RemoveContainer" containerID="1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347" May 25 12:16:53.262788 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.262771 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347"} err="failed to get container status \"1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347\": rpc error: code = NotFound desc = could not find container \"1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347\": container with ID starting with 1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347 not found: ID does not exist" May 25 12:16:53.262825 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.262788 2569 scope.go:117] "RemoveContainer" containerID="abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67" May 25 12:16:53.262981 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.262967 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67"} err="failed to get container status \"abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67\": rpc error: code = NotFound desc = could not find container \"abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67\": container with ID starting with abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67 not found: ID does not exist" May 25 12:16:53.263026 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.262981 2569 scope.go:117] "RemoveContainer" containerID="a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6" May 25 12:16:53.263139 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.263125 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6"} err="failed to get container status \"a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6\": rpc error: code = NotFound desc = could not find container \"a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6\": container with ID starting with a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6 not found: ID does not exist" May 25 12:16:53.263139 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.263138 2569 scope.go:117] "RemoveContainer" containerID="ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d" May 25 12:16:53.263311 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.263296 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d"} err="failed to get container status \"ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d\": rpc error: code = NotFound desc = could not find container \"ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d\": container with ID starting with ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d not found: ID does not exist" May 25 12:16:53.263398 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.263312 2569 scope.go:117] "RemoveContainer" containerID="7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699" May 25 12:16:53.263514 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.263493 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699"} err="failed to get container status \"7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699\": rpc error: code = NotFound desc = could not find container \"7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699\": container with ID starting with 7a47ec206bba72a2b47714b376463fd8744be47a923ea157e7819cea8b1c0699 not found: ID does not exist" May 25 12:16:53.263551 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.263518 2569 scope.go:117] "RemoveContainer" containerID="49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f" May 25 12:16:53.263732 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.263715 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f"} err="failed to get container status \"49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f\": rpc error: code = NotFound desc = could not find container \"49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f\": container with ID starting with 49699093a9da792d832f80e1f1fbb576a2be375ec36afac72401ca3a5771c70f not found: ID does not exist" May 25 12:16:53.263781 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.263732 2569 scope.go:117] "RemoveContainer" containerID="c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245" May 25 12:16:53.263987 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.263969 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245"} err="failed to get container status \"c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245\": rpc error: code = NotFound desc = could not find container \"c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245\": container with ID starting with c2d92e8cfac221f5e83bb677b6f57a0c5208825a433c15c53c906549ea56f245 not found: ID does not exist" May 25 12:16:53.264045 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.263989 2569 scope.go:117] "RemoveContainer" containerID="1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347" May 25 12:16:53.264198 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.264183 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347"} err="failed to get container status \"1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347\": rpc error: code = NotFound desc = could not find container \"1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347\": container with ID starting with 1042b8491dca7b14ad64da1d1e15bd369bf6785c704ee6b788f4682eb972a347 not found: ID does not exist" May 25 12:16:53.264237 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.264198 2569 scope.go:117] "RemoveContainer" containerID="abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67" May 25 12:16:53.264413 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.264397 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67"} err="failed to get container status \"abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67\": rpc error: code = NotFound desc = could not find container \"abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67\": container with ID starting with abdbd2a39f85c814cde15c116fb8ebeae0cf2086f515279c200f11acc0687c67 not found: ID does not exist" May 25 12:16:53.264460 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.264415 2569 scope.go:117] "RemoveContainer" containerID="a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6" May 25 12:16:53.264618 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.264602 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6"} err="failed to get container status \"a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6\": rpc error: code = NotFound desc = could not find container \"a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6\": container with ID starting with a256053fb302d1804490dd56c7bf04d20bddbefacd2a400fbe3832b77d70f5e6 not found: ID does not exist" May 25 12:16:53.264661 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.264619 2569 scope.go:117] "RemoveContainer" containerID="ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d" May 25 12:16:53.264833 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.264815 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d"} err="failed to get container status \"ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d\": rpc error: code = NotFound desc = could not find container \"ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d\": container with ID starting with ecfbbf62bc43540b47a92f970f191527655fbd0c252f3bc848702b68efe38d8d not found: ID does not exist" May 25 12:16:53.297193 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.297170 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:53.297193 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.297192 2569 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-config\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:53.297294 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.297202 2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-web-config\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:53.297294 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.297211 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:53.297294 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.297220 2569 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:53.297294 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.297229 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5qg7\" (UniqueName: \"kubernetes.io/projected/252710ed-53f8-48f8-b184-105903901a7c-kube-api-access-g5qg7\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:53.297294 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.297237 2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/252710ed-53f8-48f8-b184-105903901a7c-config-out\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:53.297294 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.297246 2569 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-kube-rbac-proxy\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:53.297294 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.297255 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:53.297294 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.297264 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-configmap-metrics-client-ca\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:53.297294 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.297272 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:53.297294 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.297281 2569 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-metrics-client-certs\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:53.297294 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.297290 2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/252710ed-53f8-48f8-b184-105903901a7c-tls-assets\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:53.297294 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.297298 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:53.297637 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.297306 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/252710ed-53f8-48f8-b184-105903901a7c-prometheus-k8s-db\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:53.297637 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.297314 2569 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/252710ed-53f8-48f8-b184-105903901a7c-secret-grpc-tls\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:53.297637 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.297322 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/252710ed-53f8-48f8-b184-105903901a7c-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:16:53.536336 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.536314 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 12:16:53.549029 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.549003 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 12:16:53.579024 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.578997 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 12:16:53.579280 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579268 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="252710ed-53f8-48f8-b184-105903901a7c" containerName="init-config-reloader" May 25 12:16:53.579330 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579284 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="252710ed-53f8-48f8-b184-105903901a7c" containerName="init-config-reloader" May 25 12:16:53.579330 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579292 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerName="config-reloader" May 25 12:16:53.579330 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579298 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerName="config-reloader" May 25 12:16:53.579330 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579309 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerName="kube-rbac-proxy-web" May 25 12:16:53.579330 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579315 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerName="kube-rbac-proxy-web" May 25 12:16:53.579330 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579327 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerName="kube-rbac-proxy" May 25 12:16:53.579495 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579336 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerName="kube-rbac-proxy" May 25 12:16:53.579495 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579343 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerName="kube-rbac-proxy-metric" May 25 12:16:53.579495 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579348 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerName="kube-rbac-proxy-metric" May 25 12:16:53.579495 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579357 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="252710ed-53f8-48f8-b184-105903901a7c" containerName="prometheus" May 25 12:16:53.579495 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579362 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="252710ed-53f8-48f8-b184-105903901a7c" containerName="prometheus" May 25 12:16:53.579495 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579368 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="252710ed-53f8-48f8-b184-105903901a7c" containerName="kube-rbac-proxy-web" May 25 12:16:53.579495 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579373 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="252710ed-53f8-48f8-b184-105903901a7c" containerName="kube-rbac-proxy-web" May 25 12:16:53.579495 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579380 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="252710ed-53f8-48f8-b184-105903901a7c" containerName="config-reloader" May 25 12:16:53.579495 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579384 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="252710ed-53f8-48f8-b184-105903901a7c" containerName="config-reloader" May 25 12:16:53.579495 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579392 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="252710ed-53f8-48f8-b184-105903901a7c" containerName="kube-rbac-proxy-thanos" May 25 12:16:53.579495 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579397 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="252710ed-53f8-48f8-b184-105903901a7c" containerName="kube-rbac-proxy-thanos" May 25 12:16:53.579495 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579408 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="252710ed-53f8-48f8-b184-105903901a7c" containerName="kube-rbac-proxy" May 25 12:16:53.579495 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579416 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="252710ed-53f8-48f8-b184-105903901a7c" containerName="kube-rbac-proxy" May 25 12:16:53.579495 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579423 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerName="init-config-reloader" May 25 12:16:53.579495 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579428 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerName="init-config-reloader" May 25 12:16:53.579495 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579434 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerName="alertmanager" May 25 12:16:53.579495 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579439 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerName="alertmanager" May 25 12:16:53.579495 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579447 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerName="prom-label-proxy" May 25 12:16:53.579495 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579451 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerName="prom-label-proxy" May 25 12:16:53.579495 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579457 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29b9bc46-3412-4402-b77c-5d9d9f71e56e" containerName="console" May 25 12:16:53.579495 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579461 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="29b9bc46-3412-4402-b77c-5d9d9f71e56e" containerName="console" May 25 12:16:53.579495 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579468 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="252710ed-53f8-48f8-b184-105903901a7c" containerName="thanos-sidecar" May 25 12:16:53.579495 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579473 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="252710ed-53f8-48f8-b184-105903901a7c" containerName="thanos-sidecar" May 25 12:16:53.580163 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579540 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerName="kube-rbac-proxy-metric" May 25 12:16:53.580163 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579549 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="252710ed-53f8-48f8-b184-105903901a7c" containerName="thanos-sidecar" May 25 12:16:53.580163 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579556 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="252710ed-53f8-48f8-b184-105903901a7c" containerName="kube-rbac-proxy-web" May 25 12:16:53.580163 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579564 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerName="alertmanager" May 25 12:16:53.580163 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579573 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerName="kube-rbac-proxy-web" May 25 12:16:53.580163 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579581 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerName="kube-rbac-proxy" May 25 12:16:53.580163 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579589 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="252710ed-53f8-48f8-b184-105903901a7c" containerName="prometheus" May 25 12:16:53.580163 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579595 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="252710ed-53f8-48f8-b184-105903901a7c" containerName="kube-rbac-proxy-thanos" May 25 12:16:53.580163 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579600 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="252710ed-53f8-48f8-b184-105903901a7c" containerName="config-reloader" May 25 12:16:53.580163 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579606 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerName="config-reloader" May 25 12:16:53.580163 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579611 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="29b9bc46-3412-4402-b77c-5d9d9f71e56e" containerName="console" May 25 12:16:53.580163 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579617 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="252710ed-53f8-48f8-b184-105903901a7c" containerName="kube-rbac-proxy" May 25 12:16:53.580163 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.579623 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a1e65f9-6d7d-4964-987e-2f241f71ada4" containerName="prom-label-proxy" May 25 12:16:53.583051 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.583036 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.585252 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.585224 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" May 25 12:16:53.585391 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.585371 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" May 25 12:16:53.585483 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.585390 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" May 25 12:16:53.585483 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.585373 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" May 25 12:16:53.585483 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.585423 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" May 25 12:16:53.585483 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.585431 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1k1dsic18bj8m\"" May 25 12:16:53.585809 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.585795 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" May 25 12:16:53.585973 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.585957 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" May 25 12:16:53.586119 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.586103 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gktdf\"" May 25 12:16:53.586320 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.586306 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" May 25 12:16:53.586393 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.586309 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" May 25 12:16:53.587622 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.587604 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" May 25 12:16:53.589378 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.589360 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" May 25 12:16:53.592427 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.592408 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" May 25 12:16:53.598071 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.598048 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 12:16:53.700590 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.700567 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.700682 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.700595 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.700682 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.700615 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-config\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.700682 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.700632 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.700682 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.700679 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.700811 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.700696 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.700811 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.700710 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.700811 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.700726 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.700811 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.700743 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.700811 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.700772 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.700811 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.700789 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.701008 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.700805 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.701008 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.700854 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.701008 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.700878 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.701008 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.700914 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.701008 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.700963 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.701008 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.700993 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.701190 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.701028 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wkx9\" (UniqueName: \"kubernetes.io/projected/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-kube-api-access-8wkx9\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.801869 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.801816 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.801869 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.801844 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.802047 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.801873 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-config\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.802047 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.801888 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.802047 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.801910 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.802047 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.801956 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.802047 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.802005 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.802047 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.802030 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.802316 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.802054 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.802316 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.802114 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.802316 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.802140 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.802316 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.802159 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.802316 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.802181 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.802316 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.802219 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.802316 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.802245 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.802316 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.802276 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.802316 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.802305 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.802821 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.802345 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8wkx9\" (UniqueName: \"kubernetes.io/projected/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-kube-api-access-8wkx9\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.802821 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.802615 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.803523 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.803494 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.804821 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.804791 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-config-out\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.805092 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.805062 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-config\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.805173 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.805124 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-web-config\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.805410 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.805380 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.805516 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.805469 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.805770 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.805750 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.805851 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.805795 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.806342 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.806269 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.806469 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.806444 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.806539 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.806515 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.806634 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.806610 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.807701 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.807677 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.807916 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.807895 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.808029 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.808012 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.808169 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.808152 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.813041 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.813020 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wkx9\" (UniqueName: \"kubernetes.io/projected/0e18c7b7-ba0c-43d6-9e97-32a77622a1ad-kube-api-access-8wkx9\") pod \"prometheus-k8s-0\" (UID: \"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad\") " pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:53.893528 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:53.893505 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:16:54.034308 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:54.034277 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] May 25 12:16:54.036840 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:16:54.036810 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e18c7b7_ba0c_43d6_9e97_32a77622a1ad.slice/crio-cc60e92ddbb73933b4112aeecd6ad6d79fe90c028e446ec4e6174b7e149f8fcf WatchSource:0}: Error finding container cc60e92ddbb73933b4112aeecd6ad6d79fe90c028e446ec4e6174b7e149f8fcf: Status 404 returned error can't find the container with id cc60e92ddbb73933b4112aeecd6ad6d79fe90c028e446ec4e6174b7e149f8fcf May 25 12:16:54.214700 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:54.214666 2569 generic.go:358] "Generic (PLEG): container finished" podID="0e18c7b7-ba0c-43d6-9e97-32a77622a1ad" containerID="f7dc30f1562b32ac543256a7010015901c44f50377d299cc951d49b22cb3c7bd" exitCode=0 May 25 12:16:54.214797 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:54.214749 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad","Type":"ContainerDied","Data":"f7dc30f1562b32ac543256a7010015901c44f50377d299cc951d49b22cb3c7bd"} May 25 12:16:54.214797 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:54.214784 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad","Type":"ContainerStarted","Data":"cc60e92ddbb73933b4112aeecd6ad6d79fe90c028e446ec4e6174b7e149f8fcf"} May 25 12:16:54.432170 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:54.432128 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="252710ed-53f8-48f8-b184-105903901a7c" path="/var/lib/kubelet/pods/252710ed-53f8-48f8-b184-105903901a7c/volumes" May 25 12:16:55.221007 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:55.220971 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad","Type":"ContainerStarted","Data":"f68251829cee6bddf127751e4ec03acff9ab4fc78074d939dacdd90c107e065b"} May 25 12:16:55.221007 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:55.221004 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad","Type":"ContainerStarted","Data":"bf2efe0d579c699944b4f3d7fe5ff70ea75e29358ecbcc6461db473fb9640c16"} May 25 12:16:55.221007 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:55.221015 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad","Type":"ContainerStarted","Data":"bdaf4922c1d10010ffa19c0507a8df68556ee907b53f19db99a88c22e323ef30"} May 25 12:16:55.221442 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:55.221024 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad","Type":"ContainerStarted","Data":"e517542ba09e4cbad0bc46d9c37eef69813de19be2fc38d47e5542c6cf791b2a"} May 25 12:16:55.221442 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:55.221033 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad","Type":"ContainerStarted","Data":"8d60255d2b3318474d567f0484c2ae5f3e821ad97a3e544141585a5861b0a2dc"} May 25 12:16:55.221442 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:55.221041 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0e18c7b7-ba0c-43d6-9e97-32a77622a1ad","Type":"ContainerStarted","Data":"9a774031d17cedf2a20e61c88d14f8ddc477da22ac5be6a1941e2250ae4d201f"} May 25 12:16:55.253689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:55.253646 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.253633653 podStartE2EDuration="2.253633653s" podCreationTimestamp="2026-05-25 12:16:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 12:16:55.251904168 +0000 UTC m=+225.479321858" watchObservedRunningTime="2026-05-25 12:16:55.253633653 +0000 UTC m=+225.481051348" May 25 12:16:58.894576 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:16:58.894548 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:53.894445 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:17:53.894408 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:53.910278 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:17:53.910252 2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:17:54.396238 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:17:54.396208 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" May 25 12:18:10.288552 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:18:10.288518 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wtzrg_1bbf38fe-0f28-4fa3-8e04-4d0520f30c14/console-operator/1.log" May 25 12:18:10.289150 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:18:10.289131 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wtzrg_1bbf38fe-0f28-4fa3-8e04-4d0520f30c14/console-operator/1.log" May 25 12:18:10.291917 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:18:10.291894 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/ovn-acl-logging/0.log" May 25 12:18:10.292420 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:18:10.292384 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/ovn-acl-logging/0.log" May 25 12:18:10.297819 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:18:10.297803 2569 kubelet.go:1628] "Image garbage collection succeeded" May 25 12:19:15.937405 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:19:15.937331 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-79f457656b-8wnjx"] May 25 12:19:15.939239 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:19:15.939223 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-79f457656b-8wnjx" May 25 12:19:15.942347 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:19:15.942323 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" May 25 12:19:15.942479 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:19:15.942375 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" May 25 12:19:15.942479 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:19:15.942397 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-6hhc8\"" May 25 12:19:15.942479 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:19:15.942376 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" May 25 12:19:15.957742 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:19:15.957721 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-79f457656b-8wnjx"] May 25 12:19:16.004401 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:19:16.004375 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f5481953-0346-4fd8-8737-9cadc36fd8f7-data\") pod \"seaweedfs-79f457656b-8wnjx\" (UID: \"f5481953-0346-4fd8-8737-9cadc36fd8f7\") " pod="kserve/seaweedfs-79f457656b-8wnjx" May 25 12:19:16.004492 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:19:16.004443 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdt2s\" (UniqueName: \"kubernetes.io/projected/f5481953-0346-4fd8-8737-9cadc36fd8f7-kube-api-access-mdt2s\") pod \"seaweedfs-79f457656b-8wnjx\" (UID: \"f5481953-0346-4fd8-8737-9cadc36fd8f7\") " pod="kserve/seaweedfs-79f457656b-8wnjx" May 25 12:19:16.104954 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:19:16.104901 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mdt2s\" (UniqueName: \"kubernetes.io/projected/f5481953-0346-4fd8-8737-9cadc36fd8f7-kube-api-access-mdt2s\") pod \"seaweedfs-79f457656b-8wnjx\" (UID: \"f5481953-0346-4fd8-8737-9cadc36fd8f7\") " pod="kserve/seaweedfs-79f457656b-8wnjx" May 25 12:19:16.105075 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:19:16.104982 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f5481953-0346-4fd8-8737-9cadc36fd8f7-data\") pod \"seaweedfs-79f457656b-8wnjx\" (UID: \"f5481953-0346-4fd8-8737-9cadc36fd8f7\") " pod="kserve/seaweedfs-79f457656b-8wnjx" May 25 12:19:16.105295 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:19:16.105278 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f5481953-0346-4fd8-8737-9cadc36fd8f7-data\") pod \"seaweedfs-79f457656b-8wnjx\" (UID: \"f5481953-0346-4fd8-8737-9cadc36fd8f7\") " pod="kserve/seaweedfs-79f457656b-8wnjx" May 25 12:19:16.118464 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:19:16.118440 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdt2s\" (UniqueName: \"kubernetes.io/projected/f5481953-0346-4fd8-8737-9cadc36fd8f7-kube-api-access-mdt2s\") pod \"seaweedfs-79f457656b-8wnjx\" (UID: \"f5481953-0346-4fd8-8737-9cadc36fd8f7\") " pod="kserve/seaweedfs-79f457656b-8wnjx" May 25 12:19:16.248207 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:19:16.248150 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-79f457656b-8wnjx" May 25 12:19:16.374280 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:19:16.374245 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-79f457656b-8wnjx"] May 25 12:19:16.377156 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:19:16.377128 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5481953_0346_4fd8_8737_9cadc36fd8f7.slice/crio-14e2b5a25a884a59828679d7c74dfb0a1362a4205dd4ace35ed0ea4c1fb3da70 WatchSource:0}: Error finding container 14e2b5a25a884a59828679d7c74dfb0a1362a4205dd4ace35ed0ea4c1fb3da70: Status 404 returned error can't find the container with id 14e2b5a25a884a59828679d7c74dfb0a1362a4205dd4ace35ed0ea4c1fb3da70 May 25 12:19:16.378326 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:19:16.378309 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 25 12:19:16.591616 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:19:16.591582 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-79f457656b-8wnjx" event={"ID":"f5481953-0346-4fd8-8737-9cadc36fd8f7","Type":"ContainerStarted","Data":"14e2b5a25a884a59828679d7c74dfb0a1362a4205dd4ace35ed0ea4c1fb3da70"} May 25 12:19:20.604264 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:19:20.604225 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-79f457656b-8wnjx" event={"ID":"f5481953-0346-4fd8-8737-9cadc36fd8f7","Type":"ContainerStarted","Data":"981abb26082b57340dc744aed766b5bfba75e431b30e2bb9f6efa9281c489a42"} May 25 12:19:20.604631 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:19:20.604287 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-79f457656b-8wnjx" May 25 12:19:20.627057 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:19:20.627015 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/seaweedfs-79f457656b-8wnjx" podStartSLOduration=2.06713054 podStartE2EDuration="5.627001862s" podCreationTimestamp="2026-05-25 12:19:15 +0000 UTC" firstStartedPulling="2026-05-25 12:19:16.378456275 +0000 UTC m=+366.605873929" lastFinishedPulling="2026-05-25 12:19:19.938327595 +0000 UTC m=+370.165745251" observedRunningTime="2026-05-25 12:19:20.626034807 +0000 UTC m=+370.853452473" watchObservedRunningTime="2026-05-25 12:19:20.627001862 +0000 UTC m=+370.854419537" May 25 12:19:26.609987 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:19:26.609959 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-79f457656b-8wnjx" May 25 12:20:40.214975 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:20:40.214925 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/s3-init-pfmmj"] May 25 12:20:40.217998 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:20:40.217982 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-pfmmj" May 25 12:20:40.228653 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:20:40.228634 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-pfmmj"] May 25 12:20:40.318453 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:20:40.318430 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rrln\" (UniqueName: \"kubernetes.io/projected/f9e60eac-21f3-4c31-9dd1-a39f2cf8f313-kube-api-access-4rrln\") pod \"s3-init-pfmmj\" (UID: \"f9e60eac-21f3-4c31-9dd1-a39f2cf8f313\") " pod="kserve/s3-init-pfmmj" May 25 12:20:40.419207 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:20:40.419175 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4rrln\" (UniqueName: \"kubernetes.io/projected/f9e60eac-21f3-4c31-9dd1-a39f2cf8f313-kube-api-access-4rrln\") pod \"s3-init-pfmmj\" (UID: \"f9e60eac-21f3-4c31-9dd1-a39f2cf8f313\") " pod="kserve/s3-init-pfmmj" May 25 12:20:40.432044 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:20:40.431991 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rrln\" (UniqueName: \"kubernetes.io/projected/f9e60eac-21f3-4c31-9dd1-a39f2cf8f313-kube-api-access-4rrln\") pod \"s3-init-pfmmj\" (UID: \"f9e60eac-21f3-4c31-9dd1-a39f2cf8f313\") " pod="kserve/s3-init-pfmmj" May 25 12:20:40.536631 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:20:40.536544 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-pfmmj" May 25 12:20:40.662405 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:20:40.662371 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-pfmmj"] May 25 12:20:40.665515 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:20:40.665482 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9e60eac_21f3_4c31_9dd1_a39f2cf8f313.slice/crio-8202c0b48b9331354900b78b7252772161a64e250eb2e339774235bfbc9009aa WatchSource:0}: Error finding container 8202c0b48b9331354900b78b7252772161a64e250eb2e339774235bfbc9009aa: Status 404 returned error can't find the container with id 8202c0b48b9331354900b78b7252772161a64e250eb2e339774235bfbc9009aa May 25 12:20:40.814646 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:20:40.814572 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-pfmmj" event={"ID":"f9e60eac-21f3-4c31-9dd1-a39f2cf8f313","Type":"ContainerStarted","Data":"8202c0b48b9331354900b78b7252772161a64e250eb2e339774235bfbc9009aa"} May 25 12:20:45.831336 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:20:45.831299 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-pfmmj" event={"ID":"f9e60eac-21f3-4c31-9dd1-a39f2cf8f313","Type":"ContainerStarted","Data":"16dbbf59f6099c625efbec7f4876cddca0d5116b650e7578ba59f8a3e766fcfd"} May 25 12:20:45.851159 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:20:45.851100 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/s3-init-pfmmj" podStartSLOduration=1.49928452 podStartE2EDuration="5.85108389s" podCreationTimestamp="2026-05-25 12:20:40 +0000 UTC" firstStartedPulling="2026-05-25 12:20:40.667232266 +0000 UTC m=+450.894649924" lastFinishedPulling="2026-05-25 12:20:45.019031625 +0000 UTC m=+455.246449294" observedRunningTime="2026-05-25 12:20:45.850721001 +0000 UTC m=+456.078138679" watchObservedRunningTime="2026-05-25 12:20:45.85108389 +0000 UTC m=+456.078501564" May 25 12:20:48.842210 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:20:48.842176 2569 generic.go:358] "Generic (PLEG): container finished" podID="f9e60eac-21f3-4c31-9dd1-a39f2cf8f313" containerID="16dbbf59f6099c625efbec7f4876cddca0d5116b650e7578ba59f8a3e766fcfd" exitCode=0 May 25 12:20:48.842556 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:20:48.842222 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-pfmmj" event={"ID":"f9e60eac-21f3-4c31-9dd1-a39f2cf8f313","Type":"ContainerDied","Data":"16dbbf59f6099c625efbec7f4876cddca0d5116b650e7578ba59f8a3e766fcfd"} May 25 12:20:49.963599 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:20:49.963577 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-pfmmj" May 25 12:20:49.995092 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:20:49.995073 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rrln\" (UniqueName: \"kubernetes.io/projected/f9e60eac-21f3-4c31-9dd1-a39f2cf8f313-kube-api-access-4rrln\") pod \"f9e60eac-21f3-4c31-9dd1-a39f2cf8f313\" (UID: \"f9e60eac-21f3-4c31-9dd1-a39f2cf8f313\") " May 25 12:20:49.997274 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:20:49.997251 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9e60eac-21f3-4c31-9dd1-a39f2cf8f313-kube-api-access-4rrln" (OuterVolumeSpecName: "kube-api-access-4rrln") pod "f9e60eac-21f3-4c31-9dd1-a39f2cf8f313" (UID: "f9e60eac-21f3-4c31-9dd1-a39f2cf8f313"). InnerVolumeSpecName "kube-api-access-4rrln". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 12:20:50.096313 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:20:50.096266 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rrln\" (UniqueName: \"kubernetes.io/projected/f9e60eac-21f3-4c31-9dd1-a39f2cf8f313-kube-api-access-4rrln\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:20:50.848759 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:20:50.848725 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-pfmmj" event={"ID":"f9e60eac-21f3-4c31-9dd1-a39f2cf8f313","Type":"ContainerDied","Data":"8202c0b48b9331354900b78b7252772161a64e250eb2e339774235bfbc9009aa"} May 25 12:20:50.848759 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:20:50.848757 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-pfmmj" May 25 12:20:50.848989 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:20:50.848759 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8202c0b48b9331354900b78b7252772161a64e250eb2e339774235bfbc9009aa" May 25 12:21:00.883264 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:00.883232 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb"] May 25 12:21:00.883619 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:00.883523 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9e60eac-21f3-4c31-9dd1-a39f2cf8f313" containerName="s3-init" May 25 12:21:00.883619 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:00.883534 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9e60eac-21f3-4c31-9dd1-a39f2cf8f313" containerName="s3-init" May 25 12:21:00.883619 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:00.883585 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="f9e60eac-21f3-4c31-9dd1-a39f2cf8f313" containerName="s3-init" May 25 12:21:00.886416 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:00.886399 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" May 25 12:21:00.888709 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:00.888687 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" May 25 12:21:00.888862 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:00.888846 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\"" May 25 12:21:00.888944 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:00.888897 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-v7cv4\"" May 25 12:21:00.889228 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:00.889216 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\"" May 25 12:21:00.889277 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:00.889262 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" May 25 12:21:00.897596 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:00.897576 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb"] May 25 12:21:00.978512 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:00.978480 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmbgm\" (UniqueName: \"kubernetes.io/projected/2640504a-5b87-49a4-97b7-0e46974ca1ac-kube-api-access-tmbgm\") pod \"isvc-sklearn-graph-1-predictor-678784f46b-b29kb\" (UID: \"2640504a-5b87-49a4-97b7-0e46974ca1ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" May 25 12:21:00.978648 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:00.978524 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2640504a-5b87-49a4-97b7-0e46974ca1ac-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-678784f46b-b29kb\" (UID: \"2640504a-5b87-49a4-97b7-0e46974ca1ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" May 25 12:21:00.978648 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:00.978631 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2640504a-5b87-49a4-97b7-0e46974ca1ac-isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-678784f46b-b29kb\" (UID: \"2640504a-5b87-49a4-97b7-0e46974ca1ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" May 25 12:21:00.978736 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:00.978662 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2640504a-5b87-49a4-97b7-0e46974ca1ac-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-678784f46b-b29kb\" (UID: \"2640504a-5b87-49a4-97b7-0e46974ca1ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" May 25 12:21:01.079388 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:01.079357 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tmbgm\" (UniqueName: \"kubernetes.io/projected/2640504a-5b87-49a4-97b7-0e46974ca1ac-kube-api-access-tmbgm\") pod \"isvc-sklearn-graph-1-predictor-678784f46b-b29kb\" (UID: \"2640504a-5b87-49a4-97b7-0e46974ca1ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" May 25 12:21:01.079551 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:01.079403 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2640504a-5b87-49a4-97b7-0e46974ca1ac-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-678784f46b-b29kb\" (UID: \"2640504a-5b87-49a4-97b7-0e46974ca1ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" May 25 12:21:01.079551 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:01.079472 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2640504a-5b87-49a4-97b7-0e46974ca1ac-isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-678784f46b-b29kb\" (UID: \"2640504a-5b87-49a4-97b7-0e46974ca1ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" May 25 12:21:01.079551 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:01.079512 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2640504a-5b87-49a4-97b7-0e46974ca1ac-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-678784f46b-b29kb\" (UID: \"2640504a-5b87-49a4-97b7-0e46974ca1ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" May 25 12:21:01.081538 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:21:01.079631 2569 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-serving-cert: secret "isvc-sklearn-graph-1-predictor-serving-cert" not found May 25 12:21:01.081538 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:21:01.079700 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2640504a-5b87-49a4-97b7-0e46974ca1ac-proxy-tls podName:2640504a-5b87-49a4-97b7-0e46974ca1ac nodeName:}" failed. No retries permitted until 2026-05-25 12:21:01.579679131 +0000 UTC m=+471.807096787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/2640504a-5b87-49a4-97b7-0e46974ca1ac-proxy-tls") pod "isvc-sklearn-graph-1-predictor-678784f46b-b29kb" (UID: "2640504a-5b87-49a4-97b7-0e46974ca1ac") : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found May 25 12:21:01.081538 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:01.080284 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2640504a-5b87-49a4-97b7-0e46974ca1ac-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-678784f46b-b29kb\" (UID: \"2640504a-5b87-49a4-97b7-0e46974ca1ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" May 25 12:21:01.081538 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:01.080899 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2640504a-5b87-49a4-97b7-0e46974ca1ac-isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-678784f46b-b29kb\" (UID: \"2640504a-5b87-49a4-97b7-0e46974ca1ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" May 25 12:21:01.097823 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:01.097792 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmbgm\" (UniqueName: \"kubernetes.io/projected/2640504a-5b87-49a4-97b7-0e46974ca1ac-kube-api-access-tmbgm\") pod \"isvc-sklearn-graph-1-predictor-678784f46b-b29kb\" (UID: \"2640504a-5b87-49a4-97b7-0e46974ca1ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" May 25 12:21:01.583236 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:01.583202 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2640504a-5b87-49a4-97b7-0e46974ca1ac-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-678784f46b-b29kb\" (UID: \"2640504a-5b87-49a4-97b7-0e46974ca1ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" May 25 12:21:01.583385 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:21:01.583348 2569 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-serving-cert: secret "isvc-sklearn-graph-1-predictor-serving-cert" not found May 25 12:21:01.583433 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:21:01.583422 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2640504a-5b87-49a4-97b7-0e46974ca1ac-proxy-tls podName:2640504a-5b87-49a4-97b7-0e46974ca1ac nodeName:}" failed. No retries permitted until 2026-05-25 12:21:02.583406982 +0000 UTC m=+472.810824636 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/2640504a-5b87-49a4-97b7-0e46974ca1ac-proxy-tls") pod "isvc-sklearn-graph-1-predictor-678784f46b-b29kb" (UID: "2640504a-5b87-49a4-97b7-0e46974ca1ac") : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found May 25 12:21:01.941993 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:01.941907 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj"] May 25 12:21:01.945427 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:01.945410 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" May 25 12:21:01.947578 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:01.947562 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\"" May 25 12:21:01.947799 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:01.947786 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\"" May 25 12:21:01.954713 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:01.954688 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj"] May 25 12:21:01.986353 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:01.986320 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj\" (UID: \"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" May 25 12:21:01.986519 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:01.986368 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2qfd\" (UniqueName: \"kubernetes.io/projected/bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4-kube-api-access-g2qfd\") pod \"isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj\" (UID: \"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" May 25 12:21:01.986519 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:01.986481 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj\" (UID: \"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" May 25 12:21:01.986519 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:01.986512 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4-isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj\" (UID: \"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" May 25 12:21:02.087516 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:02.087465 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj\" (UID: \"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" May 25 12:21:02.087516 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:02.087524 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2qfd\" (UniqueName: \"kubernetes.io/projected/bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4-kube-api-access-g2qfd\") pod \"isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj\" (UID: \"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" May 25 12:21:02.087758 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:02.087577 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj\" (UID: \"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" May 25 12:21:02.087758 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:02.087597 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4-isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj\" (UID: \"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" May 25 12:21:02.087882 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:02.087859 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj\" (UID: \"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" May 25 12:21:02.088167 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:02.088147 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4-isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj\" (UID: \"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" May 25 12:21:02.090118 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:02.090097 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj\" (UID: \"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" May 25 12:21:02.097556 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:02.097534 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2qfd\" (UniqueName: \"kubernetes.io/projected/bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4-kube-api-access-g2qfd\") pod \"isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj\" (UID: \"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" May 25 12:21:02.256248 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:02.256165 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" May 25 12:21:02.389623 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:02.389596 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj"] May 25 12:21:02.393418 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:21:02.393386 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb8be00d_f8e0_4263_afc5_8d62a7ecd0e4.slice/crio-edd46faf2989239837d3f82afa7972f2133763a3bffb4d70fa8b471f5eac31e7 WatchSource:0}: Error finding container edd46faf2989239837d3f82afa7972f2133763a3bffb4d70fa8b471f5eac31e7: Status 404 returned error can't find the container with id edd46faf2989239837d3f82afa7972f2133763a3bffb4d70fa8b471f5eac31e7 May 25 12:21:02.591550 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:02.591507 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2640504a-5b87-49a4-97b7-0e46974ca1ac-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-678784f46b-b29kb\" (UID: \"2640504a-5b87-49a4-97b7-0e46974ca1ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" May 25 12:21:02.594050 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:02.594020 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2640504a-5b87-49a4-97b7-0e46974ca1ac-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-678784f46b-b29kb\" (UID: \"2640504a-5b87-49a4-97b7-0e46974ca1ac\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" May 25 12:21:02.696178 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:02.696131 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" May 25 12:21:02.831665 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:02.831641 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb"] May 25 12:21:02.834196 ip-10-0-133-4 kubenswrapper[2569]: W0525 12:21:02.834149 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2640504a_5b87_49a4_97b7_0e46974ca1ac.slice/crio-2c91ec517148179ca226aefe97240bf5147430b41e7fd6ef2845d656dff60f94 WatchSource:0}: Error finding container 2c91ec517148179ca226aefe97240bf5147430b41e7fd6ef2845d656dff60f94: Status 404 returned error can't find the container with id 2c91ec517148179ca226aefe97240bf5147430b41e7fd6ef2845d656dff60f94 May 25 12:21:02.882304 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:02.882236 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" event={"ID":"2640504a-5b87-49a4-97b7-0e46974ca1ac","Type":"ContainerStarted","Data":"2c91ec517148179ca226aefe97240bf5147430b41e7fd6ef2845d656dff60f94"} May 25 12:21:02.883210 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:02.883188 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" event={"ID":"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4","Type":"ContainerStarted","Data":"edd46faf2989239837d3f82afa7972f2133763a3bffb4d70fa8b471f5eac31e7"} May 25 12:21:06.897536 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:06.897495 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" event={"ID":"2640504a-5b87-49a4-97b7-0e46974ca1ac","Type":"ContainerStarted","Data":"cdbfa62e7e09f1381b6d01278e63ce7c371b564fbc7f144ab9931a4db491b993"} May 25 12:21:06.898788 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:06.898764 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" event={"ID":"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4","Type":"ContainerStarted","Data":"27d44b94e9bea621540291eb3b5db46acf8dd6ac655ea03fc5ecf69b45e453a0"} May 25 12:21:09.908032 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:09.907948 2569 generic.go:358] "Generic (PLEG): container finished" podID="2640504a-5b87-49a4-97b7-0e46974ca1ac" containerID="cdbfa62e7e09f1381b6d01278e63ce7c371b564fbc7f144ab9931a4db491b993" exitCode=0 May 25 12:21:09.908032 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:09.908014 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" event={"ID":"2640504a-5b87-49a4-97b7-0e46974ca1ac","Type":"ContainerDied","Data":"cdbfa62e7e09f1381b6d01278e63ce7c371b564fbc7f144ab9931a4db491b993"} May 25 12:21:09.909372 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:09.909346 2569 generic.go:358] "Generic (PLEG): container finished" podID="bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" containerID="27d44b94e9bea621540291eb3b5db46acf8dd6ac655ea03fc5ecf69b45e453a0" exitCode=0 May 25 12:21:09.909525 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:09.909378 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" event={"ID":"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4","Type":"ContainerDied","Data":"27d44b94e9bea621540291eb3b5db46acf8dd6ac655ea03fc5ecf69b45e453a0"} May 25 12:21:23.958333 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:23.958299 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" event={"ID":"2640504a-5b87-49a4-97b7-0e46974ca1ac","Type":"ContainerStarted","Data":"2af33d992be57c6b31cc6015a3229bafa718a08f2283d5096e57522543414999"} May 25 12:21:23.959858 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:23.959838 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" event={"ID":"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4","Type":"ContainerStarted","Data":"d3ba5e0fe3c7737e3466e4ebe4b1ca79c1b4179154596eafc8a32912de166613"} May 25 12:21:26.971674 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:26.971640 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" event={"ID":"2640504a-5b87-49a4-97b7-0e46974ca1ac","Type":"ContainerStarted","Data":"e1cddf5f934309a136460ae0bc2343b8be5312431ae81afde1e4cc00f45b9d1a"} May 25 12:21:26.972143 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:26.971907 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" May 25 12:21:26.973467 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:26.973446 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" event={"ID":"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4","Type":"ContainerStarted","Data":"15cfbeec122f1936ff66bbc6cb1a98eba1ff0c2a31ea8118cfd7e53b1631df24"} May 25 12:21:26.973560 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:26.973548 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" May 25 12:21:26.973618 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:26.973565 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" May 25 12:21:26.974919 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:26.974889 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" podUID="bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" May 25 12:21:26.992790 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:26.992744 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" podStartSLOduration=3.503581426 podStartE2EDuration="26.99273363s" podCreationTimestamp="2026-05-25 12:21:00 +0000 UTC" firstStartedPulling="2026-05-25 12:21:02.836228131 +0000 UTC m=+473.063645786" lastFinishedPulling="2026-05-25 12:21:26.325380336 +0000 UTC m=+496.552797990" observedRunningTime="2026-05-25 12:21:26.990925872 +0000 UTC m=+497.218343549" watchObservedRunningTime="2026-05-25 12:21:26.99273363 +0000 UTC m=+497.220151306" May 25 12:21:27.011053 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:27.011015 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" podStartSLOduration=2.078748764 podStartE2EDuration="26.011003335s" podCreationTimestamp="2026-05-25 12:21:01 +0000 UTC" firstStartedPulling="2026-05-25 12:21:02.395343446 +0000 UTC m=+472.622761100" lastFinishedPulling="2026-05-25 12:21:26.327598007 +0000 UTC m=+496.555015671" observedRunningTime="2026-05-25 12:21:27.009145897 +0000 UTC m=+497.236563572" watchObservedRunningTime="2026-05-25 12:21:27.011003335 +0000 UTC m=+497.238421010" May 25 12:21:27.976679 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:27.976636 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" podUID="bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" May 25 12:21:27.977126 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:27.976762 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" May 25 12:21:27.977765 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:27.977740 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" podUID="2640504a-5b87-49a4-97b7-0e46974ca1ac" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" May 25 12:21:28.979633 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:28.979589 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" podUID="2640504a-5b87-49a4-97b7-0e46974ca1ac" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" May 25 12:21:32.982245 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:32.982217 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" May 25 12:21:32.982797 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:32.982771 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" podUID="bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" May 25 12:21:33.984368 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:33.984341 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" May 25 12:21:33.984964 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:33.984915 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" podUID="2640504a-5b87-49a4-97b7-0e46974ca1ac" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" May 25 12:21:42.982884 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:42.982849 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" podUID="bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" May 25 12:21:43.985547 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:43.985508 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" podUID="2640504a-5b87-49a4-97b7-0e46974ca1ac" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" May 25 12:21:52.983421 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:52.983345 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" podUID="bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" May 25 12:21:53.985348 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:21:53.985306 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" podUID="2640504a-5b87-49a4-97b7-0e46974ca1ac" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" May 25 12:22:02.983018 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:22:02.982981 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" podUID="bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" May 25 12:22:03.985284 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:22:03.985245 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" podUID="2640504a-5b87-49a4-97b7-0e46974ca1ac" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" May 25 12:22:12.983720 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:22:12.983682 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" podUID="bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" May 25 12:22:13.985834 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:22:13.985792 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" podUID="2640504a-5b87-49a4-97b7-0e46974ca1ac" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" May 25 12:22:22.983665 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:22:22.983625 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" podUID="bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" May 25 12:22:23.986013 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:22:23.985984 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" May 25 12:22:32.983746 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:22:32.983715 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" May 25 12:23:01.004437 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:01.004391 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj"] May 25 12:23:01.004908 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:01.004843 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" podUID="bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" containerName="kserve-container" containerID="cri-o://d3ba5e0fe3c7737e3466e4ebe4b1ca79c1b4179154596eafc8a32912de166613" gracePeriod=30 May 25 12:23:01.005023 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:01.004915 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" podUID="bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" containerName="kube-rbac-proxy" containerID="cri-o://15cfbeec122f1936ff66bbc6cb1a98eba1ff0c2a31ea8118cfd7e53b1631df24" gracePeriod=30 May 25 12:23:01.084295 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:01.084262 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb"] May 25 12:23:01.084629 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:01.084604 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" podUID="2640504a-5b87-49a4-97b7-0e46974ca1ac" containerName="kserve-container" containerID="cri-o://2af33d992be57c6b31cc6015a3229bafa718a08f2283d5096e57522543414999" gracePeriod=30 May 25 12:23:01.084725 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:01.084663 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" podUID="2640504a-5b87-49a4-97b7-0e46974ca1ac" containerName="kube-rbac-proxy" containerID="cri-o://e1cddf5f934309a136460ae0bc2343b8be5312431ae81afde1e4cc00f45b9d1a" gracePeriod=30 May 25 12:23:01.241458 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:01.241432 2569 generic.go:358] "Generic (PLEG): container finished" podID="2640504a-5b87-49a4-97b7-0e46974ca1ac" containerID="e1cddf5f934309a136460ae0bc2343b8be5312431ae81afde1e4cc00f45b9d1a" exitCode=2 May 25 12:23:01.241589 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:01.241505 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" event={"ID":"2640504a-5b87-49a4-97b7-0e46974ca1ac","Type":"ContainerDied","Data":"e1cddf5f934309a136460ae0bc2343b8be5312431ae81afde1e4cc00f45b9d1a"} May 25 12:23:01.243082 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:01.243063 2569 generic.go:358] "Generic (PLEG): container finished" podID="bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" containerID="15cfbeec122f1936ff66bbc6cb1a98eba1ff0c2a31ea8118cfd7e53b1631df24" exitCode=2 May 25 12:23:01.243171 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:01.243124 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" event={"ID":"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4","Type":"ContainerDied","Data":"15cfbeec122f1936ff66bbc6cb1a98eba1ff0c2a31ea8118cfd7e53b1631df24"} May 25 12:23:02.977574 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:02.977534 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" podUID="bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.25:8643/healthz\": dial tcp 10.133.0.25:8643: connect: connection refused" May 25 12:23:02.982951 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:02.982910 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" podUID="bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" May 25 12:23:03.980099 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:03.980059 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" podUID="2640504a-5b87-49a4-97b7-0e46974ca1ac" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.24:8643/healthz\": dial tcp 10.133.0.24:8643: connect: connection refused" May 25 12:23:03.985237 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:03.985212 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" podUID="2640504a-5b87-49a4-97b7-0e46974ca1ac" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" May 25 12:23:05.147353 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.147331 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" May 25 12:23:05.214389 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.214369 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" May 25 12:23:05.232674 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.232651 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2640504a-5b87-49a4-97b7-0e46974ca1ac-proxy-tls\") pod \"2640504a-5b87-49a4-97b7-0e46974ca1ac\" (UID: \"2640504a-5b87-49a4-97b7-0e46974ca1ac\") " May 25 12:23:05.232781 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.232714 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2qfd\" (UniqueName: \"kubernetes.io/projected/bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4-kube-api-access-g2qfd\") pod \"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4\" (UID: \"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4\") " May 25 12:23:05.232849 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.232794 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2640504a-5b87-49a4-97b7-0e46974ca1ac-isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\") pod \"2640504a-5b87-49a4-97b7-0e46974ca1ac\" (UID: \"2640504a-5b87-49a4-97b7-0e46974ca1ac\") " May 25 12:23:05.232849 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.232838 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4-proxy-tls\") pod \"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4\" (UID: \"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4\") " May 25 12:23:05.232975 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.232865 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2640504a-5b87-49a4-97b7-0e46974ca1ac-kserve-provision-location\") pod \"2640504a-5b87-49a4-97b7-0e46974ca1ac\" (UID: \"2640504a-5b87-49a4-97b7-0e46974ca1ac\") " May 25 12:23:05.232975 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.232902 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4-kserve-provision-location\") pod \"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4\" (UID: \"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4\") " May 25 12:23:05.232975 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.232928 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4-isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\") pod \"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4\" (UID: \"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4\") " May 25 12:23:05.233128 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.232977 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmbgm\" (UniqueName: \"kubernetes.io/projected/2640504a-5b87-49a4-97b7-0e46974ca1ac-kube-api-access-tmbgm\") pod \"2640504a-5b87-49a4-97b7-0e46974ca1ac\" (UID: \"2640504a-5b87-49a4-97b7-0e46974ca1ac\") " May 25 12:23:05.233182 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.233165 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2640504a-5b87-49a4-97b7-0e46974ca1ac-isvc-sklearn-graph-1-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "isvc-sklearn-graph-1-kube-rbac-proxy-sar-config") pod "2640504a-5b87-49a4-97b7-0e46974ca1ac" (UID: "2640504a-5b87-49a4-97b7-0e46974ca1ac"). InnerVolumeSpecName "isvc-sklearn-graph-1-kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 12:23:05.233237 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.233198 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2640504a-5b87-49a4-97b7-0e46974ca1ac-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "2640504a-5b87-49a4-97b7-0e46974ca1ac" (UID: "2640504a-5b87-49a4-97b7-0e46974ca1ac"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 12:23:05.233538 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.233481 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4-isvc-sklearn-graph-2-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "isvc-sklearn-graph-2-kube-rbac-proxy-sar-config") pod "bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" (UID: "bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4"). InnerVolumeSpecName "isvc-sklearn-graph-2-kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 12:23:05.233660 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.233625 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" (UID: "bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 12:23:05.236064 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.235862 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2640504a-5b87-49a4-97b7-0e46974ca1ac-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "2640504a-5b87-49a4-97b7-0e46974ca1ac" (UID: "2640504a-5b87-49a4-97b7-0e46974ca1ac"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:23:05.236064 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.235993 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4-kube-api-access-g2qfd" (OuterVolumeSpecName: "kube-api-access-g2qfd") pod "bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" (UID: "bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4"). InnerVolumeSpecName "kube-api-access-g2qfd". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 12:23:05.236064 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.235982 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" (UID: "bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 12:23:05.236064 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.236003 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2640504a-5b87-49a4-97b7-0e46974ca1ac-kube-api-access-tmbgm" (OuterVolumeSpecName: "kube-api-access-tmbgm") pod "2640504a-5b87-49a4-97b7-0e46974ca1ac" (UID: "2640504a-5b87-49a4-97b7-0e46974ca1ac"). InnerVolumeSpecName "kube-api-access-tmbgm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 12:23:05.255871 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.255839 2569 generic.go:358] "Generic (PLEG): container finished" podID="2640504a-5b87-49a4-97b7-0e46974ca1ac" containerID="2af33d992be57c6b31cc6015a3229bafa718a08f2283d5096e57522543414999" exitCode=0 May 25 12:23:05.255988 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.255907 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" event={"ID":"2640504a-5b87-49a4-97b7-0e46974ca1ac","Type":"ContainerDied","Data":"2af33d992be57c6b31cc6015a3229bafa718a08f2283d5096e57522543414999"} May 25 12:23:05.255988 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.255955 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" May 25 12:23:05.255988 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.255963 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb" event={"ID":"2640504a-5b87-49a4-97b7-0e46974ca1ac","Type":"ContainerDied","Data":"2c91ec517148179ca226aefe97240bf5147430b41e7fd6ef2845d656dff60f94"} May 25 12:23:05.256147 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.255987 2569 scope.go:117] "RemoveContainer" containerID="e1cddf5f934309a136460ae0bc2343b8be5312431ae81afde1e4cc00f45b9d1a" May 25 12:23:05.258066 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.258046 2569 generic.go:358] "Generic (PLEG): container finished" podID="bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" containerID="d3ba5e0fe3c7737e3466e4ebe4b1ca79c1b4179154596eafc8a32912de166613" exitCode=0 May 25 12:23:05.258158 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.258118 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" event={"ID":"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4","Type":"ContainerDied","Data":"d3ba5e0fe3c7737e3466e4ebe4b1ca79c1b4179154596eafc8a32912de166613"} May 25 12:23:05.258158 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.258142 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" event={"ID":"bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4","Type":"ContainerDied","Data":"edd46faf2989239837d3f82afa7972f2133763a3bffb4d70fa8b471f5eac31e7"} May 25 12:23:05.258588 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.258560 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj" May 25 12:23:05.268510 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.268491 2569 scope.go:117] "RemoveContainer" containerID="2af33d992be57c6b31cc6015a3229bafa718a08f2283d5096e57522543414999" May 25 12:23:05.275948 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.275910 2569 scope.go:117] "RemoveContainer" containerID="cdbfa62e7e09f1381b6d01278e63ce7c371b564fbc7f144ab9931a4db491b993" May 25 12:23:05.282224 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.282206 2569 scope.go:117] "RemoveContainer" containerID="e1cddf5f934309a136460ae0bc2343b8be5312431ae81afde1e4cc00f45b9d1a" May 25 12:23:05.282447 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:23:05.282430 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1cddf5f934309a136460ae0bc2343b8be5312431ae81afde1e4cc00f45b9d1a\": container with ID starting with e1cddf5f934309a136460ae0bc2343b8be5312431ae81afde1e4cc00f45b9d1a not found: ID does not exist" containerID="e1cddf5f934309a136460ae0bc2343b8be5312431ae81afde1e4cc00f45b9d1a" May 25 12:23:05.282492 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.282453 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1cddf5f934309a136460ae0bc2343b8be5312431ae81afde1e4cc00f45b9d1a"} err="failed to get container status \"e1cddf5f934309a136460ae0bc2343b8be5312431ae81afde1e4cc00f45b9d1a\": rpc error: code = NotFound desc = could not find container \"e1cddf5f934309a136460ae0bc2343b8be5312431ae81afde1e4cc00f45b9d1a\": container with ID starting with e1cddf5f934309a136460ae0bc2343b8be5312431ae81afde1e4cc00f45b9d1a not found: ID does not exist" May 25 12:23:05.282492 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.282469 2569 scope.go:117] "RemoveContainer" containerID="2af33d992be57c6b31cc6015a3229bafa718a08f2283d5096e57522543414999" May 25 12:23:05.282651 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:23:05.282637 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2af33d992be57c6b31cc6015a3229bafa718a08f2283d5096e57522543414999\": container with ID starting with 2af33d992be57c6b31cc6015a3229bafa718a08f2283d5096e57522543414999 not found: ID does not exist" containerID="2af33d992be57c6b31cc6015a3229bafa718a08f2283d5096e57522543414999" May 25 12:23:05.282689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.282654 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2af33d992be57c6b31cc6015a3229bafa718a08f2283d5096e57522543414999"} err="failed to get container status \"2af33d992be57c6b31cc6015a3229bafa718a08f2283d5096e57522543414999\": rpc error: code = NotFound desc = could not find container \"2af33d992be57c6b31cc6015a3229bafa718a08f2283d5096e57522543414999\": container with ID starting with 2af33d992be57c6b31cc6015a3229bafa718a08f2283d5096e57522543414999 not found: ID does not exist" May 25 12:23:05.282689 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.282667 2569 scope.go:117] "RemoveContainer" containerID="cdbfa62e7e09f1381b6d01278e63ce7c371b564fbc7f144ab9931a4db491b993" May 25 12:23:05.282847 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:23:05.282830 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdbfa62e7e09f1381b6d01278e63ce7c371b564fbc7f144ab9931a4db491b993\": container with ID starting with cdbfa62e7e09f1381b6d01278e63ce7c371b564fbc7f144ab9931a4db491b993 not found: ID does not exist" containerID="cdbfa62e7e09f1381b6d01278e63ce7c371b564fbc7f144ab9931a4db491b993" May 25 12:23:05.282885 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.282853 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdbfa62e7e09f1381b6d01278e63ce7c371b564fbc7f144ab9931a4db491b993"} err="failed to get container status \"cdbfa62e7e09f1381b6d01278e63ce7c371b564fbc7f144ab9931a4db491b993\": rpc error: code = NotFound desc = could not find container \"cdbfa62e7e09f1381b6d01278e63ce7c371b564fbc7f144ab9931a4db491b993\": container with ID starting with cdbfa62e7e09f1381b6d01278e63ce7c371b564fbc7f144ab9931a4db491b993 not found: ID does not exist" May 25 12:23:05.282885 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.282869 2569 scope.go:117] "RemoveContainer" containerID="15cfbeec122f1936ff66bbc6cb1a98eba1ff0c2a31ea8118cfd7e53b1631df24" May 25 12:23:05.288423 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.288403 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj"] May 25 12:23:05.289525 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.289515 2569 scope.go:117] "RemoveContainer" containerID="d3ba5e0fe3c7737e3466e4ebe4b1ca79c1b4179154596eafc8a32912de166613" May 25 12:23:05.294128 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.294105 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-v6cdj"] May 25 12:23:05.296568 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.296553 2569 scope.go:117] "RemoveContainer" containerID="27d44b94e9bea621540291eb3b5db46acf8dd6ac655ea03fc5ecf69b45e453a0" May 25 12:23:05.303105 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.303090 2569 scope.go:117] "RemoveContainer" containerID="15cfbeec122f1936ff66bbc6cb1a98eba1ff0c2a31ea8118cfd7e53b1631df24" May 25 12:23:05.303322 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:23:05.303307 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15cfbeec122f1936ff66bbc6cb1a98eba1ff0c2a31ea8118cfd7e53b1631df24\": container with ID starting with 15cfbeec122f1936ff66bbc6cb1a98eba1ff0c2a31ea8118cfd7e53b1631df24 not found: ID does not exist" containerID="15cfbeec122f1936ff66bbc6cb1a98eba1ff0c2a31ea8118cfd7e53b1631df24" May 25 12:23:05.303365 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.303328 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15cfbeec122f1936ff66bbc6cb1a98eba1ff0c2a31ea8118cfd7e53b1631df24"} err="failed to get container status \"15cfbeec122f1936ff66bbc6cb1a98eba1ff0c2a31ea8118cfd7e53b1631df24\": rpc error: code = NotFound desc = could not find container \"15cfbeec122f1936ff66bbc6cb1a98eba1ff0c2a31ea8118cfd7e53b1631df24\": container with ID starting with 15cfbeec122f1936ff66bbc6cb1a98eba1ff0c2a31ea8118cfd7e53b1631df24 not found: ID does not exist" May 25 12:23:05.303365 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.303341 2569 scope.go:117] "RemoveContainer" containerID="d3ba5e0fe3c7737e3466e4ebe4b1ca79c1b4179154596eafc8a32912de166613" May 25 12:23:05.303572 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:23:05.303557 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3ba5e0fe3c7737e3466e4ebe4b1ca79c1b4179154596eafc8a32912de166613\": container with ID starting with d3ba5e0fe3c7737e3466e4ebe4b1ca79c1b4179154596eafc8a32912de166613 not found: ID does not exist" containerID="d3ba5e0fe3c7737e3466e4ebe4b1ca79c1b4179154596eafc8a32912de166613" May 25 12:23:05.303616 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.303575 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3ba5e0fe3c7737e3466e4ebe4b1ca79c1b4179154596eafc8a32912de166613"} err="failed to get container status \"d3ba5e0fe3c7737e3466e4ebe4b1ca79c1b4179154596eafc8a32912de166613\": rpc error: code = NotFound desc = could not find container \"d3ba5e0fe3c7737e3466e4ebe4b1ca79c1b4179154596eafc8a32912de166613\": container with ID starting with d3ba5e0fe3c7737e3466e4ebe4b1ca79c1b4179154596eafc8a32912de166613 not found: ID does not exist" May 25 12:23:05.303616 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.303587 2569 scope.go:117] "RemoveContainer" containerID="27d44b94e9bea621540291eb3b5db46acf8dd6ac655ea03fc5ecf69b45e453a0" May 25 12:23:05.303813 ip-10-0-133-4 kubenswrapper[2569]: E0525 12:23:05.303796 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27d44b94e9bea621540291eb3b5db46acf8dd6ac655ea03fc5ecf69b45e453a0\": container with ID starting with 27d44b94e9bea621540291eb3b5db46acf8dd6ac655ea03fc5ecf69b45e453a0 not found: ID does not exist" containerID="27d44b94e9bea621540291eb3b5db46acf8dd6ac655ea03fc5ecf69b45e453a0" May 25 12:23:05.303859 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.303827 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27d44b94e9bea621540291eb3b5db46acf8dd6ac655ea03fc5ecf69b45e453a0"} err="failed to get container status \"27d44b94e9bea621540291eb3b5db46acf8dd6ac655ea03fc5ecf69b45e453a0\": rpc error: code = NotFound desc = could not find container \"27d44b94e9bea621540291eb3b5db46acf8dd6ac655ea03fc5ecf69b45e453a0\": container with ID starting with 27d44b94e9bea621540291eb3b5db46acf8dd6ac655ea03fc5ecf69b45e453a0 not found: ID does not exist" May 25 12:23:05.307448 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.307417 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb"] May 25 12:23:05.312560 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.312532 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-b29kb"] May 25 12:23:05.333484 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.333462 2569 reconciler_common.go:299] "Volume detached for volume \"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/2640504a-5b87-49a4-97b7-0e46974ca1ac-isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:23:05.333542 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.333484 2569 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4-proxy-tls\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:23:05.333542 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.333495 2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2640504a-5b87-49a4-97b7-0e46974ca1ac-kserve-provision-location\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:23:05.333542 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.333505 2569 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4-kserve-provision-location\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:23:05.333542 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.333515 2569 reconciler_common.go:299] "Volume detached for volume \"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4-isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:23:05.333542 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.333523 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmbgm\" (UniqueName: \"kubernetes.io/projected/2640504a-5b87-49a4-97b7-0e46974ca1ac-kube-api-access-tmbgm\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:23:05.333542 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.333532 2569 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2640504a-5b87-49a4-97b7-0e46974ca1ac-proxy-tls\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:23:05.333542 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:05.333539 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2qfd\" (UniqueName: \"kubernetes.io/projected/bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4-kube-api-access-g2qfd\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 12:23:06.429283 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:06.429247 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2640504a-5b87-49a4-97b7-0e46974ca1ac" path="/var/lib/kubelet/pods/2640504a-5b87-49a4-97b7-0e46974ca1ac/volumes" May 25 12:23:06.429723 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:06.429710 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" path="/var/lib/kubelet/pods/bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4/volumes" May 25 12:23:10.311840 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:10.311813 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wtzrg_1bbf38fe-0f28-4fa3-8e04-4d0520f30c14/console-operator/1.log" May 25 12:23:10.312651 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:10.312630 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wtzrg_1bbf38fe-0f28-4fa3-8e04-4d0520f30c14/console-operator/1.log" May 25 12:23:10.314846 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:10.314829 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/ovn-acl-logging/0.log" May 25 12:23:10.315649 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:23:10.315632 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/ovn-acl-logging/0.log" May 25 12:28:10.330411 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:28:10.330336 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wtzrg_1bbf38fe-0f28-4fa3-8e04-4d0520f30c14/console-operator/1.log" May 25 12:28:10.332617 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:28:10.332592 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wtzrg_1bbf38fe-0f28-4fa3-8e04-4d0520f30c14/console-operator/1.log" May 25 12:28:10.333989 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:28:10.333970 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/ovn-acl-logging/0.log" May 25 12:28:10.335783 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:28:10.335764 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/ovn-acl-logging/0.log" May 25 12:33:10.351144 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:33:10.351114 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wtzrg_1bbf38fe-0f28-4fa3-8e04-4d0520f30c14/console-operator/1.log" May 25 12:33:10.354696 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:33:10.354673 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wtzrg_1bbf38fe-0f28-4fa3-8e04-4d0520f30c14/console-operator/1.log" May 25 12:33:10.354847 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:33:10.354759 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/ovn-acl-logging/0.log" May 25 12:33:10.358387 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:33:10.358365 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/ovn-acl-logging/0.log" May 25 12:38:10.370681 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:38:10.370654 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wtzrg_1bbf38fe-0f28-4fa3-8e04-4d0520f30c14/console-operator/1.log" May 25 12:38:10.373634 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:38:10.373612 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/ovn-acl-logging/0.log" May 25 12:38:10.375353 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:38:10.375333 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wtzrg_1bbf38fe-0f28-4fa3-8e04-4d0520f30c14/console-operator/1.log" May 25 12:38:10.378199 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:38:10.378179 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/ovn-acl-logging/0.log" May 25 12:43:10.389883 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:43:10.389846 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wtzrg_1bbf38fe-0f28-4fa3-8e04-4d0520f30c14/console-operator/1.log" May 25 12:43:10.393082 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:43:10.393057 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/ovn-acl-logging/0.log" May 25 12:43:10.395272 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:43:10.395253 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wtzrg_1bbf38fe-0f28-4fa3-8e04-4d0520f30c14/console-operator/1.log" May 25 12:43:10.398181 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:43:10.398165 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/ovn-acl-logging/0.log" May 25 12:48:10.411053 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:48:10.411012 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wtzrg_1bbf38fe-0f28-4fa3-8e04-4d0520f30c14/console-operator/1.log" May 25 12:48:10.414543 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:48:10.414519 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/ovn-acl-logging/0.log" May 25 12:48:10.419002 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:48:10.418981 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wtzrg_1bbf38fe-0f28-4fa3-8e04-4d0520f30c14/console-operator/1.log" May 25 12:48:10.422154 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:48:10.422135 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/ovn-acl-logging/0.log" May 25 12:53:10.431525 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:53:10.431429 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wtzrg_1bbf38fe-0f28-4fa3-8e04-4d0520f30c14/console-operator/1.log" May 25 12:53:10.435529 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:53:10.434461 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/ovn-acl-logging/0.log" May 25 12:53:10.447094 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:53:10.447074 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wtzrg_1bbf38fe-0f28-4fa3-8e04-4d0520f30c14/console-operator/1.log" May 25 12:53:10.449797 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:53:10.449781 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/ovn-acl-logging/0.log" May 25 12:58:10.453489 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:58:10.453395 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wtzrg_1bbf38fe-0f28-4fa3-8e04-4d0520f30c14/console-operator/1.log" May 25 12:58:10.458702 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:58:10.457106 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/ovn-acl-logging/0.log" May 25 12:58:10.469135 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:58:10.469118 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wtzrg_1bbf38fe-0f28-4fa3-8e04-4d0520f30c14/console-operator/1.log" May 25 12:58:10.472217 ip-10-0-133-4 kubenswrapper[2569]: I0525 12:58:10.472200 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/ovn-acl-logging/0.log" May 25 13:00:21.837505 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:21.837469 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f4qkq/must-gather-qq45b"] May 25 13:00:21.837989 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:21.837772 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2640504a-5b87-49a4-97b7-0e46974ca1ac" containerName="storage-initializer" May 25 13:00:21.837989 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:21.837783 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2640504a-5b87-49a4-97b7-0e46974ca1ac" containerName="storage-initializer" May 25 13:00:21.837989 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:21.837791 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" containerName="storage-initializer" May 25 13:00:21.837989 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:21.837797 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" containerName="storage-initializer" May 25 13:00:21.837989 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:21.837804 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" containerName="kube-rbac-proxy" May 25 13:00:21.837989 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:21.837813 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" containerName="kube-rbac-proxy" May 25 13:00:21.837989 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:21.837827 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2640504a-5b87-49a4-97b7-0e46974ca1ac" containerName="kserve-container" May 25 13:00:21.837989 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:21.837832 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2640504a-5b87-49a4-97b7-0e46974ca1ac" containerName="kserve-container" May 25 13:00:21.837989 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:21.837840 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2640504a-5b87-49a4-97b7-0e46974ca1ac" containerName="kube-rbac-proxy" May 25 13:00:21.837989 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:21.837845 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2640504a-5b87-49a4-97b7-0e46974ca1ac" containerName="kube-rbac-proxy" May 25 13:00:21.837989 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:21.837851 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" containerName="kserve-container" May 25 13:00:21.837989 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:21.837855 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" containerName="kserve-container" May 25 13:00:21.837989 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:21.837916 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="2640504a-5b87-49a4-97b7-0e46974ca1ac" containerName="kserve-container" May 25 13:00:21.837989 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:21.837926 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" containerName="kserve-container" May 25 13:00:21.837989 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:21.837947 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="bb8be00d-f8e0-4263-afc5-8d62a7ecd0e4" containerName="kube-rbac-proxy" May 25 13:00:21.837989 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:21.837954 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="2640504a-5b87-49a4-97b7-0e46974ca1ac" containerName="kube-rbac-proxy" May 25 13:00:21.840771 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:21.840756 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f4qkq/must-gather-qq45b" May 25 13:00:21.842919 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:21.842898 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f4qkq\"/\"openshift-service-ca.crt\"" May 25 13:00:21.843278 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:21.843262 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-f4qkq\"/\"default-dockercfg-mzb5s\"" May 25 13:00:21.843347 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:21.843264 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f4qkq\"/\"kube-root-ca.crt\"" May 25 13:00:21.858013 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:21.857987 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f4qkq/must-gather-qq45b"] May 25 13:00:21.983527 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:21.983497 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d4b84c46-6bb2-474d-84d5-ff10a63f40f5-must-gather-output\") pod \"must-gather-qq45b\" (UID: \"d4b84c46-6bb2-474d-84d5-ff10a63f40f5\") " pod="openshift-must-gather-f4qkq/must-gather-qq45b" May 25 13:00:21.983661 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:21.983551 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkv8t\" (UniqueName: \"kubernetes.io/projected/d4b84c46-6bb2-474d-84d5-ff10a63f40f5-kube-api-access-mkv8t\") pod \"must-gather-qq45b\" (UID: \"d4b84c46-6bb2-474d-84d5-ff10a63f40f5\") " pod="openshift-must-gather-f4qkq/must-gather-qq45b" May 25 13:00:22.084042 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:22.084016 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d4b84c46-6bb2-474d-84d5-ff10a63f40f5-must-gather-output\") pod \"must-gather-qq45b\" (UID: \"d4b84c46-6bb2-474d-84d5-ff10a63f40f5\") " pod="openshift-must-gather-f4qkq/must-gather-qq45b" May 25 13:00:22.084160 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:22.084065 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mkv8t\" (UniqueName: \"kubernetes.io/projected/d4b84c46-6bb2-474d-84d5-ff10a63f40f5-kube-api-access-mkv8t\") pod \"must-gather-qq45b\" (UID: \"d4b84c46-6bb2-474d-84d5-ff10a63f40f5\") " pod="openshift-must-gather-f4qkq/must-gather-qq45b" May 25 13:00:22.084357 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:22.084335 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d4b84c46-6bb2-474d-84d5-ff10a63f40f5-must-gather-output\") pod \"must-gather-qq45b\" (UID: \"d4b84c46-6bb2-474d-84d5-ff10a63f40f5\") " pod="openshift-must-gather-f4qkq/must-gather-qq45b" May 25 13:00:22.092984 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:22.092911 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkv8t\" (UniqueName: \"kubernetes.io/projected/d4b84c46-6bb2-474d-84d5-ff10a63f40f5-kube-api-access-mkv8t\") pod \"must-gather-qq45b\" (UID: \"d4b84c46-6bb2-474d-84d5-ff10a63f40f5\") " pod="openshift-must-gather-f4qkq/must-gather-qq45b" May 25 13:00:22.155873 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:22.155852 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f4qkq/must-gather-qq45b" May 25 13:00:22.280174 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:22.280144 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f4qkq/must-gather-qq45b"] May 25 13:00:22.286221 ip-10-0-133-4 kubenswrapper[2569]: W0525 13:00:22.286196 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4b84c46_6bb2_474d_84d5_ff10a63f40f5.slice/crio-b6f860695be9306a18df7d1d12c321eeae32ab353aa3cd7213766883974d8028 WatchSource:0}: Error finding container b6f860695be9306a18df7d1d12c321eeae32ab353aa3cd7213766883974d8028: Status 404 returned error can't find the container with id b6f860695be9306a18df7d1d12c321eeae32ab353aa3cd7213766883974d8028 May 25 13:00:22.288273 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:22.288258 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 25 13:00:22.318615 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:22.318589 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f4qkq/must-gather-qq45b" event={"ID":"d4b84c46-6bb2-474d-84d5-ff10a63f40f5","Type":"ContainerStarted","Data":"b6f860695be9306a18df7d1d12c321eeae32ab353aa3cd7213766883974d8028"} May 25 13:00:29.345558 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:29.344755 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f4qkq/must-gather-qq45b" event={"ID":"d4b84c46-6bb2-474d-84d5-ff10a63f40f5","Type":"ContainerStarted","Data":"2856f1d9d6208ac873a782d279d3f421e21b4e4a8a2af6c32c9267bfcd27be23"} May 25 13:00:29.345558 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:29.344806 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f4qkq/must-gather-qq45b" event={"ID":"d4b84c46-6bb2-474d-84d5-ff10a63f40f5","Type":"ContainerStarted","Data":"892fcbf393a74b1b0eaefde9e0343f2f1dc14cc518c13e7b025cd375eb64a9ee"} May 25 13:00:29.361191 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:29.361136 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-f4qkq/must-gather-qq45b" podStartSLOduration=2.373780418 podStartE2EDuration="8.361117263s" podCreationTimestamp="2026-05-25 13:00:21 +0000 UTC" firstStartedPulling="2026-05-25 13:00:22.288381806 +0000 UTC m=+2832.515799462" lastFinishedPulling="2026-05-25 13:00:28.275718651 +0000 UTC m=+2838.503136307" observedRunningTime="2026-05-25 13:00:29.359851669 +0000 UTC m=+2839.587269346" watchObservedRunningTime="2026-05-25 13:00:29.361117263 +0000 UTC m=+2839.588534941" May 25 13:00:51.411709 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:51.411649 2569 generic.go:358] "Generic (PLEG): container finished" podID="d4b84c46-6bb2-474d-84d5-ff10a63f40f5" containerID="892fcbf393a74b1b0eaefde9e0343f2f1dc14cc518c13e7b025cd375eb64a9ee" exitCode=0 May 25 13:00:51.412115 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:51.411723 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f4qkq/must-gather-qq45b" event={"ID":"d4b84c46-6bb2-474d-84d5-ff10a63f40f5","Type":"ContainerDied","Data":"892fcbf393a74b1b0eaefde9e0343f2f1dc14cc518c13e7b025cd375eb64a9ee"} May 25 13:00:51.412115 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:51.412029 2569 scope.go:117] "RemoveContainer" containerID="892fcbf393a74b1b0eaefde9e0343f2f1dc14cc518c13e7b025cd375eb64a9ee" May 25 13:00:51.560426 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:51.560394 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-f4qkq_must-gather-qq45b_d4b84c46-6bb2-474d-84d5-ff10a63f40f5/gather/0.log" May 25 13:00:54.933288 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:54.933203 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bxhdm_bf6ee847-4da0-4712-b6cf-1b39e6fb91fb/global-pull-secret-syncer/0.log" May 25 13:00:55.065553 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:55.065520 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2fsnt_1954d0fa-a186-4c14-975b-3de4de24bac3/konnectivity-agent/0.log" May 25 13:00:55.131688 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:55.131663 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-4.ec2.internal_e779f73ef05ca5fe5885eec9de6ce2f6/haproxy/0.log" May 25 13:00:56.994386 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:56.994352 2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-f4qkq/must-gather-qq45b"] May 25 13:00:56.994843 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:56.994559 2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-f4qkq/must-gather-qq45b" podUID="d4b84c46-6bb2-474d-84d5-ff10a63f40f5" containerName="copy" containerID="cri-o://2856f1d9d6208ac873a782d279d3f421e21b4e4a8a2af6c32c9267bfcd27be23" gracePeriod=2 May 25 13:00:57.000907 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:57.000878 2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-f4qkq/must-gather-qq45b"] May 25 13:00:57.222026 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:57.222005 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-f4qkq_must-gather-qq45b_d4b84c46-6bb2-474d-84d5-ff10a63f40f5/copy/0.log" May 25 13:00:57.222363 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:57.222340 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f4qkq/must-gather-qq45b" May 25 13:00:57.224043 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:57.224017 2569 status_manager.go:895] "Failed to get status for pod" podUID="d4b84c46-6bb2-474d-84d5-ff10a63f40f5" pod="openshift-must-gather-f4qkq/must-gather-qq45b" err="pods \"must-gather-qq45b\" is forbidden: User \"system:node:ip-10-0-133-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-f4qkq\": no relationship found between node 'ip-10-0-133-4.ec2.internal' and this object" May 25 13:00:57.376012 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:57.375987 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkv8t\" (UniqueName: \"kubernetes.io/projected/d4b84c46-6bb2-474d-84d5-ff10a63f40f5-kube-api-access-mkv8t\") pod \"d4b84c46-6bb2-474d-84d5-ff10a63f40f5\" (UID: \"d4b84c46-6bb2-474d-84d5-ff10a63f40f5\") " May 25 13:00:57.376141 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:57.376045 2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d4b84c46-6bb2-474d-84d5-ff10a63f40f5-must-gather-output\") pod \"d4b84c46-6bb2-474d-84d5-ff10a63f40f5\" (UID: \"d4b84c46-6bb2-474d-84d5-ff10a63f40f5\") " May 25 13:00:57.377387 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:57.377361 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4b84c46-6bb2-474d-84d5-ff10a63f40f5-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "d4b84c46-6bb2-474d-84d5-ff10a63f40f5" (UID: "d4b84c46-6bb2-474d-84d5-ff10a63f40f5"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 13:00:57.378259 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:57.378241 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4b84c46-6bb2-474d-84d5-ff10a63f40f5-kube-api-access-mkv8t" (OuterVolumeSpecName: "kube-api-access-mkv8t") pod "d4b84c46-6bb2-474d-84d5-ff10a63f40f5" (UID: "d4b84c46-6bb2-474d-84d5-ff10a63f40f5"). InnerVolumeSpecName "kube-api-access-mkv8t". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 13:00:57.431179 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:57.431157 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-f4qkq_must-gather-qq45b_d4b84c46-6bb2-474d-84d5-ff10a63f40f5/copy/0.log" May 25 13:00:57.431480 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:57.431455 2569 generic.go:358] "Generic (PLEG): container finished" podID="d4b84c46-6bb2-474d-84d5-ff10a63f40f5" containerID="2856f1d9d6208ac873a782d279d3f421e21b4e4a8a2af6c32c9267bfcd27be23" exitCode=143 May 25 13:00:57.431560 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:57.431493 2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f4qkq/must-gather-qq45b" May 25 13:00:57.431560 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:57.431549 2569 scope.go:117] "RemoveContainer" containerID="2856f1d9d6208ac873a782d279d3f421e21b4e4a8a2af6c32c9267bfcd27be23" May 25 13:00:57.433419 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:57.433398 2569 status_manager.go:895] "Failed to get status for pod" podUID="d4b84c46-6bb2-474d-84d5-ff10a63f40f5" pod="openshift-must-gather-f4qkq/must-gather-qq45b" err="pods \"must-gather-qq45b\" is forbidden: User \"system:node:ip-10-0-133-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-f4qkq\": no relationship found between node 'ip-10-0-133-4.ec2.internal' and this object" May 25 13:00:57.439100 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:57.438924 2569 scope.go:117] "RemoveContainer" containerID="892fcbf393a74b1b0eaefde9e0343f2f1dc14cc518c13e7b025cd375eb64a9ee" May 25 13:00:57.441059 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:57.441038 2569 status_manager.go:895] "Failed to get status for pod" podUID="d4b84c46-6bb2-474d-84d5-ff10a63f40f5" pod="openshift-must-gather-f4qkq/must-gather-qq45b" err="pods \"must-gather-qq45b\" is forbidden: User \"system:node:ip-10-0-133-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-f4qkq\": no relationship found between node 'ip-10-0-133-4.ec2.internal' and this object" May 25 13:00:57.450854 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:57.450838 2569 scope.go:117] "RemoveContainer" containerID="2856f1d9d6208ac873a782d279d3f421e21b4e4a8a2af6c32c9267bfcd27be23" May 25 13:00:57.451146 ip-10-0-133-4 kubenswrapper[2569]: E0525 13:00:57.451122 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2856f1d9d6208ac873a782d279d3f421e21b4e4a8a2af6c32c9267bfcd27be23\": container with ID starting with 2856f1d9d6208ac873a782d279d3f421e21b4e4a8a2af6c32c9267bfcd27be23 not found: ID does not exist" containerID="2856f1d9d6208ac873a782d279d3f421e21b4e4a8a2af6c32c9267bfcd27be23" May 25 13:00:57.451223 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:57.451151 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2856f1d9d6208ac873a782d279d3f421e21b4e4a8a2af6c32c9267bfcd27be23"} err="failed to get container status \"2856f1d9d6208ac873a782d279d3f421e21b4e4a8a2af6c32c9267bfcd27be23\": rpc error: code = NotFound desc = could not find container \"2856f1d9d6208ac873a782d279d3f421e21b4e4a8a2af6c32c9267bfcd27be23\": container with ID starting with 2856f1d9d6208ac873a782d279d3f421e21b4e4a8a2af6c32c9267bfcd27be23 not found: ID does not exist" May 25 13:00:57.451223 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:57.451169 2569 scope.go:117] "RemoveContainer" containerID="892fcbf393a74b1b0eaefde9e0343f2f1dc14cc518c13e7b025cd375eb64a9ee" May 25 13:00:57.451407 ip-10-0-133-4 kubenswrapper[2569]: E0525 13:00:57.451389 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"892fcbf393a74b1b0eaefde9e0343f2f1dc14cc518c13e7b025cd375eb64a9ee\": container with ID starting with 892fcbf393a74b1b0eaefde9e0343f2f1dc14cc518c13e7b025cd375eb64a9ee not found: ID does not exist" containerID="892fcbf393a74b1b0eaefde9e0343f2f1dc14cc518c13e7b025cd375eb64a9ee" May 25 13:00:57.451448 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:57.451413 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"892fcbf393a74b1b0eaefde9e0343f2f1dc14cc518c13e7b025cd375eb64a9ee"} err="failed to get container status \"892fcbf393a74b1b0eaefde9e0343f2f1dc14cc518c13e7b025cd375eb64a9ee\": rpc error: code = NotFound desc = could not find container \"892fcbf393a74b1b0eaefde9e0343f2f1dc14cc518c13e7b025cd375eb64a9ee\": container with ID starting with 892fcbf393a74b1b0eaefde9e0343f2f1dc14cc518c13e7b025cd375eb64a9ee not found: ID does not exist" May 25 13:00:57.476803 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:57.476781 2569 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d4b84c46-6bb2-474d-84d5-ff10a63f40f5-must-gather-output\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 13:00:57.476803 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:57.476799 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkv8t\" (UniqueName: \"kubernetes.io/projected/d4b84c46-6bb2-474d-84d5-ff10a63f40f5-kube-api-access-mkv8t\") on node \"ip-10-0-133-4.ec2.internal\" DevicePath \"\"" May 25 13:00:58.429484 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:58.429445 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4b84c46-6bb2-474d-84d5-ff10a63f40f5" path="/var/lib/kubelet/pods/d4b84c46-6bb2-474d-84d5-ff10a63f40f5/volumes" May 25 13:00:58.639161 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:58.639134 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-bnkc2_c0c15556-618a-4ad2-9f3a-44ce817b0d48/cluster-monitoring-operator/0.log" May 25 13:00:58.745983 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:58.745898 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6fb8796695-fbm56_9c06f548-6ef2-43e9-a132-0d2baf9565b3/metrics-server/0.log" May 25 13:00:58.812943 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:58.812914 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pt6fc_154574d3-a885-4e8d-b14f-de3aba1010f8/node-exporter/0.log" May 25 13:00:58.839068 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:58.839045 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pt6fc_154574d3-a885-4e8d-b14f-de3aba1010f8/kube-rbac-proxy/0.log" May 25 13:00:58.861730 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:58.861714 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pt6fc_154574d3-a885-4e8d-b14f-de3aba1010f8/init-textfile/0.log" May 25 13:00:59.125695 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:59.125672 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e18c7b7-ba0c-43d6-9e97-32a77622a1ad/prometheus/0.log" May 25 13:00:59.144000 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:59.143973 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e18c7b7-ba0c-43d6-9e97-32a77622a1ad/config-reloader/0.log" May 25 13:00:59.169143 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:59.169116 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e18c7b7-ba0c-43d6-9e97-32a77622a1ad/thanos-sidecar/0.log" May 25 13:00:59.191714 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:59.191694 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e18c7b7-ba0c-43d6-9e97-32a77622a1ad/kube-rbac-proxy-web/0.log" May 25 13:00:59.215706 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:59.215689 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e18c7b7-ba0c-43d6-9e97-32a77622a1ad/kube-rbac-proxy/0.log" May 25 13:00:59.238964 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:59.238917 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e18c7b7-ba0c-43d6-9e97-32a77622a1ad/kube-rbac-proxy-thanos/0.log" May 25 13:00:59.261601 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:00:59.261579 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0e18c7b7-ba0c-43d6-9e97-32a77622a1ad/init-config-reloader/0.log" May 25 13:01:01.189825 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:01.189800 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wtzrg_1bbf38fe-0f28-4fa3-8e04-4d0520f30c14/console-operator/1.log" May 25 13:01:01.194419 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:01.194397 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-wtzrg_1bbf38fe-0f28-4fa3-8e04-4d0520f30c14/console-operator/2.log" May 25 13:01:01.623314 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:01.623287 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-86zz8_df6be786-2eb9-461a-a9f6-4f9fa19ccaa1/download-server/0.log" May 25 13:01:02.025595 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.025521 2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9vddf/perf-node-gather-daemonset-r2b9w"] May 25 13:01:02.025819 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.025807 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4b84c46-6bb2-474d-84d5-ff10a63f40f5" containerName="gather" May 25 13:01:02.025864 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.025820 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4b84c46-6bb2-474d-84d5-ff10a63f40f5" containerName="gather" May 25 13:01:02.025864 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.025831 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4b84c46-6bb2-474d-84d5-ff10a63f40f5" containerName="copy" May 25 13:01:02.025864 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.025836 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4b84c46-6bb2-474d-84d5-ff10a63f40f5" containerName="copy" May 25 13:01:02.025975 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.025896 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4b84c46-6bb2-474d-84d5-ff10a63f40f5" containerName="gather" May 25 13:01:02.025975 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.025903 2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4b84c46-6bb2-474d-84d5-ff10a63f40f5" containerName="copy" May 25 13:01:02.029859 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.029838 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9vddf/perf-node-gather-daemonset-r2b9w" May 25 13:01:02.031847 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.031822 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9vddf\"/\"kube-root-ca.crt\"" May 25 13:01:02.032365 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.032342 2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9vddf\"/\"default-dockercfg-cdbvg\"" May 25 13:01:02.032466 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.032351 2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9vddf\"/\"openshift-service-ca.crt\"" May 25 13:01:02.038688 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.038668 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9vddf/perf-node-gather-daemonset-r2b9w"] May 25 13:01:02.066642 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.066618 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-z9fqm_bc86fe4f-52b8-468e-99dc-5b34bd09dd6d/volume-data-source-validator/0.log" May 25 13:01:02.111059 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.111036 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ec9867b1-e917-474a-a2e5-0bbbccb4127f-podres\") pod \"perf-node-gather-daemonset-r2b9w\" (UID: \"ec9867b1-e917-474a-a2e5-0bbbccb4127f\") " pod="openshift-must-gather-9vddf/perf-node-gather-daemonset-r2b9w" May 25 13:01:02.111147 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.111072 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec9867b1-e917-474a-a2e5-0bbbccb4127f-sys\") pod \"perf-node-gather-daemonset-r2b9w\" (UID: \"ec9867b1-e917-474a-a2e5-0bbbccb4127f\") " pod="openshift-must-gather-9vddf/perf-node-gather-daemonset-r2b9w" May 25 13:01:02.111147 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.111101 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z7lq\" (UniqueName: \"kubernetes.io/projected/ec9867b1-e917-474a-a2e5-0bbbccb4127f-kube-api-access-9z7lq\") pod \"perf-node-gather-daemonset-r2b9w\" (UID: \"ec9867b1-e917-474a-a2e5-0bbbccb4127f\") " pod="openshift-must-gather-9vddf/perf-node-gather-daemonset-r2b9w" May 25 13:01:02.111224 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.111141 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec9867b1-e917-474a-a2e5-0bbbccb4127f-lib-modules\") pod \"perf-node-gather-daemonset-r2b9w\" (UID: \"ec9867b1-e917-474a-a2e5-0bbbccb4127f\") " pod="openshift-must-gather-9vddf/perf-node-gather-daemonset-r2b9w" May 25 13:01:02.111224 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.111184 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ec9867b1-e917-474a-a2e5-0bbbccb4127f-proc\") pod \"perf-node-gather-daemonset-r2b9w\" (UID: \"ec9867b1-e917-474a-a2e5-0bbbccb4127f\") " pod="openshift-must-gather-9vddf/perf-node-gather-daemonset-r2b9w" May 25 13:01:02.211989 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.211963 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ec9867b1-e917-474a-a2e5-0bbbccb4127f-podres\") pod \"perf-node-gather-daemonset-r2b9w\" (UID: \"ec9867b1-e917-474a-a2e5-0bbbccb4127f\") " pod="openshift-must-gather-9vddf/perf-node-gather-daemonset-r2b9w" May 25 13:01:02.212315 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.211990 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec9867b1-e917-474a-a2e5-0bbbccb4127f-sys\") pod \"perf-node-gather-daemonset-r2b9w\" (UID: \"ec9867b1-e917-474a-a2e5-0bbbccb4127f\") " pod="openshift-must-gather-9vddf/perf-node-gather-daemonset-r2b9w" May 25 13:01:02.212315 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.212016 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9z7lq\" (UniqueName: \"kubernetes.io/projected/ec9867b1-e917-474a-a2e5-0bbbccb4127f-kube-api-access-9z7lq\") pod \"perf-node-gather-daemonset-r2b9w\" (UID: \"ec9867b1-e917-474a-a2e5-0bbbccb4127f\") " pod="openshift-must-gather-9vddf/perf-node-gather-daemonset-r2b9w" May 25 13:01:02.212315 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.212035 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec9867b1-e917-474a-a2e5-0bbbccb4127f-lib-modules\") pod \"perf-node-gather-daemonset-r2b9w\" (UID: \"ec9867b1-e917-474a-a2e5-0bbbccb4127f\") " pod="openshift-must-gather-9vddf/perf-node-gather-daemonset-r2b9w" May 25 13:01:02.212315 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.212070 2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ec9867b1-e917-474a-a2e5-0bbbccb4127f-proc\") pod \"perf-node-gather-daemonset-r2b9w\" (UID: \"ec9867b1-e917-474a-a2e5-0bbbccb4127f\") " pod="openshift-must-gather-9vddf/perf-node-gather-daemonset-r2b9w" May 25 13:01:02.212315 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.212093 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec9867b1-e917-474a-a2e5-0bbbccb4127f-sys\") pod \"perf-node-gather-daemonset-r2b9w\" (UID: \"ec9867b1-e917-474a-a2e5-0bbbccb4127f\") " pod="openshift-must-gather-9vddf/perf-node-gather-daemonset-r2b9w" May 25 13:01:02.212315 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.212117 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ec9867b1-e917-474a-a2e5-0bbbccb4127f-podres\") pod \"perf-node-gather-daemonset-r2b9w\" (UID: \"ec9867b1-e917-474a-a2e5-0bbbccb4127f\") " pod="openshift-must-gather-9vddf/perf-node-gather-daemonset-r2b9w" May 25 13:01:02.212315 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.212169 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ec9867b1-e917-474a-a2e5-0bbbccb4127f-proc\") pod \"perf-node-gather-daemonset-r2b9w\" (UID: \"ec9867b1-e917-474a-a2e5-0bbbccb4127f\") " pod="openshift-must-gather-9vddf/perf-node-gather-daemonset-r2b9w" May 25 13:01:02.212315 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.212179 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec9867b1-e917-474a-a2e5-0bbbccb4127f-lib-modules\") pod \"perf-node-gather-daemonset-r2b9w\" (UID: \"ec9867b1-e917-474a-a2e5-0bbbccb4127f\") " pod="openshift-must-gather-9vddf/perf-node-gather-daemonset-r2b9w" May 25 13:01:02.219892 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.219870 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z7lq\" (UniqueName: \"kubernetes.io/projected/ec9867b1-e917-474a-a2e5-0bbbccb4127f-kube-api-access-9z7lq\") pod \"perf-node-gather-daemonset-r2b9w\" (UID: \"ec9867b1-e917-474a-a2e5-0bbbccb4127f\") " pod="openshift-must-gather-9vddf/perf-node-gather-daemonset-r2b9w" May 25 13:01:02.340220 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.340198 2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9vddf/perf-node-gather-daemonset-r2b9w" May 25 13:01:02.465036 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.465006 2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9vddf/perf-node-gather-daemonset-r2b9w"] May 25 13:01:02.467999 ip-10-0-133-4 kubenswrapper[2569]: W0525 13:01:02.467972 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podec9867b1_e917_474a_a2e5_0bbbccb4127f.slice/crio-86e0531815986133ad4d57fcc4a2018867442d68312b359c8754cf2d36fcf67e WatchSource:0}: Error finding container 86e0531815986133ad4d57fcc4a2018867442d68312b359c8754cf2d36fcf67e: Status 404 returned error can't find the container with id 86e0531815986133ad4d57fcc4a2018867442d68312b359c8754cf2d36fcf67e May 25 13:01:02.783855 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.783787 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6284j_27ca0001-404e-4e5f-ba48-1698e3cee67f/dns/0.log" May 25 13:01:02.807182 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.807161 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6284j_27ca0001-404e-4e5f-ba48-1698e3cee67f/kube-rbac-proxy/0.log" May 25 13:01:02.951787 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:02.951757 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mjhc6_343fb19d-f18b-4f2c-9bc7-7810b24743d8/dns-node-resolver/0.log" May 25 13:01:03.412626 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:03.412600 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-86b49f8787-r57k6_79bc0bd5-7639-4903-a23f-06cb3105e83d/registry/0.log" May 25 13:01:03.423186 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:03.423166 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-86b49f8787-r57k6_79bc0bd5-7639-4903-a23f-06cb3105e83d/registry/1.log" May 25 13:01:03.448833 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:03.448811 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9vddf/perf-node-gather-daemonset-r2b9w" event={"ID":"ec9867b1-e917-474a-a2e5-0bbbccb4127f","Type":"ContainerStarted","Data":"3fd0182a24afd21d718ed707160bc80f90e59f0f5966146a17ed7a7a59eaa36e"} May 25 13:01:03.448963 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:03.448846 2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9vddf/perf-node-gather-daemonset-r2b9w" event={"ID":"ec9867b1-e917-474a-a2e5-0bbbccb4127f","Type":"ContainerStarted","Data":"86e0531815986133ad4d57fcc4a2018867442d68312b359c8754cf2d36fcf67e"} May 25 13:01:03.448963 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:03.448926 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9vddf/perf-node-gather-daemonset-r2b9w" May 25 13:01:03.467031 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:03.466994 2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-9vddf/perf-node-gather-daemonset-r2b9w" podStartSLOduration=1.46698143 podStartE2EDuration="1.46698143s" podCreationTimestamp="2026-05-25 13:01:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 13:01:03.465699264 +0000 UTC m=+2873.693116940" watchObservedRunningTime="2026-05-25 13:01:03.46698143 +0000 UTC m=+2873.694399106" May 25 13:01:03.471468 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:03.471449 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h6vr7_0ee78a86-cc33-496d-a4cf-9c1e6de70f6f/node-ca/0.log" May 25 13:01:04.639984 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:04.639956 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mpnlz_fdb1b8ee-d354-463f-89b6-0b8140aa2dd7/serve-healthcheck-canary/0.log" May 25 13:01:05.220526 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:05.220484 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c8wsw_369e0283-53e0-4f9c-98b7-3f3b7bb86304/kube-rbac-proxy/0.log" May 25 13:01:05.242393 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:05.242369 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c8wsw_369e0283-53e0-4f9c-98b7-3f3b7bb86304/exporter/0.log" May 25 13:01:05.268758 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:05.268737 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c8wsw_369e0283-53e0-4f9c-98b7-3f3b7bb86304/extractor/0.log" May 25 13:01:07.527217 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:07.527189 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-pfmmj_f9e60eac-21f3-4c31-9dd1-a39f2cf8f313/s3-init/0.log" May 25 13:01:07.556925 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:07.556903 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-79f457656b-8wnjx_f5481953-0346-4fd8-8737-9cadc36fd8f7/seaweedfs/0.log" May 25 13:01:09.460385 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:09.460360 2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9vddf/perf-node-gather-daemonset-r2b9w" May 25 13:01:11.674851 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:11.674824 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-7v9wx_cc65ed34-59e1-4c38-94d9-5b66a31b3a46/migrator/0.log" May 25 13:01:11.697770 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:11.697750 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-7v9wx_cc65ed34-59e1-4c38-94d9-5b66a31b3a46/graceful-termination/0.log" May 25 13:01:13.413459 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:13.413430 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wjdzw_e5130231-8dd8-4aa5-8f05-6768b03404bf/kube-multus-additional-cni-plugins/0.log" May 25 13:01:13.438056 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:13.438034 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wjdzw_e5130231-8dd8-4aa5-8f05-6768b03404bf/egress-router-binary-copy/0.log" May 25 13:01:13.462498 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:13.462481 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wjdzw_e5130231-8dd8-4aa5-8f05-6768b03404bf/cni-plugins/0.log" May 25 13:01:13.485161 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:13.485142 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wjdzw_e5130231-8dd8-4aa5-8f05-6768b03404bf/bond-cni-plugin/0.log" May 25 13:01:13.509069 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:13.509050 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wjdzw_e5130231-8dd8-4aa5-8f05-6768b03404bf/routeoverride-cni/0.log" May 25 13:01:13.532532 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:13.532508 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wjdzw_e5130231-8dd8-4aa5-8f05-6768b03404bf/whereabouts-cni-bincopy/0.log" May 25 13:01:13.556571 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:13.556512 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wjdzw_e5130231-8dd8-4aa5-8f05-6768b03404bf/whereabouts-cni/0.log" May 25 13:01:13.585599 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:13.585572 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-n66nj_09ceb244-50a8-477e-8f70-dfa7ab73b894/kube-multus/0.log" May 25 13:01:13.678398 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:13.678374 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xwk2x_cfe666ec-6ce2-4bfe-9149-8b8a058cd681/network-metrics-daemon/0.log" May 25 13:01:13.699964 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:13.699945 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xwk2x_cfe666ec-6ce2-4bfe-9149-8b8a058cd681/kube-rbac-proxy/0.log" May 25 13:01:15.172407 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:15.172384 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/ovn-controller/0.log" May 25 13:01:15.194513 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:15.194490 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/ovn-acl-logging/0.log" May 25 13:01:15.206986 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:15.206968 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/ovn-acl-logging/1.log" May 25 13:01:15.226031 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:15.226011 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/kube-rbac-proxy-node/0.log" May 25 13:01:15.249349 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:15.249330 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/kube-rbac-proxy-ovn-metrics/0.log" May 25 13:01:15.271766 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:15.271750 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/northd/0.log" May 25 13:01:15.294130 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:15.294115 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/nbdb/0.log" May 25 13:01:15.317331 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:15.317316 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/sbdb/0.log" May 25 13:01:15.419326 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:15.419301 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z8r9j_b5b21efc-8e4f-43d2-9f26-7a1832e1cee7/ovnkube-controller/0.log" May 25 13:01:16.456797 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:16.456767 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-vxntb_0398fbca-aafe-47ca-bc5e-7bfeda763426/check-endpoints/0.log" May 25 13:01:16.483903 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:16.483876 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-mldgv_4709a8d8-46d8-4e6d-8e53-17021b442cc8/network-check-target-container/0.log" May 25 13:01:17.497025 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:17.496998 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-gp884_9121ba37-984d-4b12-992f-5ab12f57c886/iptables-alerter/0.log" May 25 13:01:18.151785 ip-10-0-133-4 kubenswrapper[2569]: I0525 13:01:18.151755 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-8mgh5_05328a04-43ba-472e-aa2b-47a64884c691/tuned/0.log"