Aug 04 10:35:21.944229 ip-10-0-142-102 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Aug 04 10:35:21.944238 ip-10-0-142-102 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Aug 04 10:35:21.944245 ip-10-0-142-102 systemd[1]: kubelet.service: Failed with result 'resources'. Aug 04 10:35:21.944549 ip-10-0-142-102 systemd[1]: Failed to start Kubernetes Kubelet. Aug 04 10:35:32.116682 ip-10-0-142-102 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Aug 04 10:35:32.116695 ip-10-0-142-102 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 93165c3079ac404f86b5b5fd4bac91cd -- Aug 04 10:37:27.847662 ip-10-0-142-102 systemd[1]: Starting Kubernetes Kubelet... Aug 04 10:37:28.247898 ip-10-0-142-102 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 04 10:37:28.247898 ip-10-0-142-102 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Aug 04 10:37:28.247898 ip-10-0-142-102 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 04 10:37:28.247898 ip-10-0-142-102 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Aug 04 10:37:28.247898 ip-10-0-142-102 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 04 10:37:28.248919 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.248831 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Aug 04 10:37:28.253083 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253067 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 04 10:37:28.253083 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253084 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 04 10:37:28.253148 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253089 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 04 10:37:28.253148 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253092 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 04 10:37:28.253148 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253095 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 04 10:37:28.253148 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253098 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 04 10:37:28.253148 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253101 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 04 10:37:28.253148 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253104 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 04 10:37:28.253148 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253107 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 04 10:37:28.253148 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253124 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 04 10:37:28.253148 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253129 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 04 10:37:28.253148 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253132 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 04 10:37:28.253148 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253136 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 04 10:37:28.253148 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253138 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 04 10:37:28.253148 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253141 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 04 10:37:28.253148 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253144 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 04 10:37:28.253148 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253147 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 04 10:37:28.253148 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253150 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 04 10:37:28.253148 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253152 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 04 10:37:28.253148 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253155 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 04 10:37:28.253148 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253158 2576 feature_gate.go:328] unrecognized feature gate: Example Aug 04 10:37:28.253616 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253167 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 04 10:37:28.253616 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253170 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 04 10:37:28.253616 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253173 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 04 10:37:28.253616 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253175 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 04 10:37:28.253616 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253178 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 04 10:37:28.253616 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253180 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 04 10:37:28.253616 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253183 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 04 10:37:28.253616 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253185 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 04 10:37:28.253616 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253187 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 04 10:37:28.253616 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253190 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 04 10:37:28.253616 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253192 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 04 10:37:28.253616 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253195 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 04 10:37:28.253616 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253197 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 04 10:37:28.253616 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253200 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 04 10:37:28.253616 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253202 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 04 10:37:28.253616 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253204 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 04 10:37:28.253616 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253207 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 04 10:37:28.253616 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253209 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 04 10:37:28.253616 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253212 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 04 10:37:28.253616 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253214 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 04 10:37:28.254128 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253217 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 04 10:37:28.254128 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253220 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 04 10:37:28.254128 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253222 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 04 10:37:28.254128 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253225 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 04 10:37:28.254128 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253227 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 04 10:37:28.254128 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253230 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 04 10:37:28.254128 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253232 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 04 10:37:28.254128 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253235 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 04 10:37:28.254128 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253237 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 04 10:37:28.254128 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253240 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 04 10:37:28.254128 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253242 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 04 10:37:28.254128 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253245 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 04 10:37:28.254128 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253248 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 04 10:37:28.254128 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253251 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 04 10:37:28.254128 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253253 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 04 10:37:28.254128 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253257 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 04 10:37:28.254128 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253261 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 04 10:37:28.254128 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253263 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 04 10:37:28.254128 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253266 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 04 10:37:28.254621 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253269 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 04 10:37:28.254621 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253272 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 04 10:37:28.254621 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253274 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 04 10:37:28.254621 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253277 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 04 10:37:28.254621 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253280 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 04 10:37:28.254621 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253283 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 04 10:37:28.254621 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253285 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 04 10:37:28.254621 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253288 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 04 10:37:28.254621 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253290 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 04 10:37:28.254621 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253293 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 04 10:37:28.254621 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253295 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 04 10:37:28.254621 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253298 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 04 10:37:28.254621 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253301 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 04 10:37:28.254621 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253304 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 04 10:37:28.254621 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253307 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 04 10:37:28.254621 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253309 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 04 10:37:28.254621 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253312 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 04 10:37:28.254621 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253315 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 04 10:37:28.254621 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253317 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 04 10:37:28.254621 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253320 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 04 10:37:28.255111 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253323 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 04 10:37:28.255111 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253325 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 04 10:37:28.255111 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253327 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 04 10:37:28.255111 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253330 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 04 10:37:28.255111 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253334 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 04 10:37:28.255111 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253338 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 04 10:37:28.255111 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253341 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 04 10:37:28.255111 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253343 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 04 10:37:28.255111 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253347 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 04 10:37:28.255111 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253350 2576 feature_gate.go:328] unrecognized feature gate: Example2 Aug 04 10:37:28.255111 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253353 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 04 10:37:28.255111 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253371 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 04 10:37:28.255111 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253375 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 04 10:37:28.255111 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253377 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 04 10:37:28.255111 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253380 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 04 10:37:28.255111 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253382 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 04 10:37:28.255111 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253385 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 04 10:37:28.255111 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253388 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 04 10:37:28.255111 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.253390 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 04 10:37:28.255574 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254864 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 04 10:37:28.255574 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254872 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 04 10:37:28.255574 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254875 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 04 10:37:28.255574 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254878 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 04 10:37:28.255574 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254881 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 04 10:37:28.255574 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254885 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 04 10:37:28.255574 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254887 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 04 10:37:28.255574 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254890 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 04 10:37:28.255574 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254894 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 04 10:37:28.255574 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254898 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 04 10:37:28.255574 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254901 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 04 10:37:28.255574 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254904 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 04 10:37:28.255574 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254906 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 04 10:37:28.255574 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254910 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 04 10:37:28.255574 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254916 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 04 10:37:28.255574 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254919 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 04 10:37:28.255574 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254922 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 04 10:37:28.255574 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254925 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 04 10:37:28.255574 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254928 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 04 10:37:28.256047 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254931 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 04 10:37:28.256047 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254934 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 04 10:37:28.256047 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254936 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 04 10:37:28.256047 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254939 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 04 10:37:28.256047 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254942 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 04 10:37:28.256047 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254945 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 04 10:37:28.256047 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254947 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 04 10:37:28.256047 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254949 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 04 10:37:28.256047 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254952 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 04 10:37:28.256047 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254955 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 04 10:37:28.256047 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254958 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 04 10:37:28.256047 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254960 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 04 10:37:28.256047 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254962 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 04 10:37:28.256047 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254965 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 04 10:37:28.256047 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254968 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 04 10:37:28.256047 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254970 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 04 10:37:28.256047 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254973 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 04 10:37:28.256047 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254975 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 04 10:37:28.256047 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254978 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 04 10:37:28.256047 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254985 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 04 10:37:28.256546 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254988 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 04 10:37:28.256546 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254991 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 04 10:37:28.256546 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254993 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 04 10:37:28.256546 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254996 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 04 10:37:28.256546 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.254998 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 04 10:37:28.256546 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255000 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 04 10:37:28.256546 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255003 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 04 10:37:28.256546 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255007 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 04 10:37:28.256546 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255010 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 04 10:37:28.256546 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255014 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 04 10:37:28.256546 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255017 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 04 10:37:28.256546 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255020 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 04 10:37:28.256546 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255023 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 04 10:37:28.256546 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255026 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 04 10:37:28.256546 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255029 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 04 10:37:28.256546 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255031 2576 feature_gate.go:328] unrecognized feature gate: Example Aug 04 10:37:28.256546 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255034 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 04 10:37:28.256546 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255037 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 04 10:37:28.256546 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255039 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 04 10:37:28.256546 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255042 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 04 10:37:28.257042 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255045 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 04 10:37:28.257042 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255047 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 04 10:37:28.257042 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255050 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 04 10:37:28.257042 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255052 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 04 10:37:28.257042 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255054 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 04 10:37:28.257042 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255057 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 04 10:37:28.257042 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255060 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 04 10:37:28.257042 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255062 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 04 10:37:28.257042 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255064 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 04 10:37:28.257042 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255067 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 04 10:37:28.257042 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255069 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 04 10:37:28.257042 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255072 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 04 10:37:28.257042 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255075 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 04 10:37:28.257042 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255077 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 04 10:37:28.257042 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255080 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 04 10:37:28.257042 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255083 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 04 10:37:28.257042 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255086 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 04 10:37:28.257042 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255088 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 04 10:37:28.257042 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255091 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 04 10:37:28.257042 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255094 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 04 10:37:28.257557 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255097 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 04 10:37:28.257557 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255099 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 04 10:37:28.257557 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255101 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 04 10:37:28.257557 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255104 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 04 10:37:28.257557 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255106 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 04 10:37:28.257557 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255109 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 04 10:37:28.257557 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255111 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 04 10:37:28.257557 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255114 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 04 10:37:28.257557 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255116 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 04 10:37:28.257557 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255119 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 04 10:37:28.257557 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255121 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 04 10:37:28.257557 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255124 2576 feature_gate.go:328] unrecognized feature gate: Example2 Aug 04 10:37:28.257557 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255126 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 04 10:37:28.257557 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255129 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 04 10:37:28.257557 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255131 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 04 10:37:28.257557 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255134 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 04 10:37:28.257557 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255136 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 04 10:37:28.257557 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255139 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 04 10:37:28.257557 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255141 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 04 10:37:28.257557 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255143 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 04 10:37:28.258061 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255560 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 04 10:37:28.258061 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255567 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 04 10:37:28.258061 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255571 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 04 10:37:28.258061 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255574 2576 feature_gate.go:328] unrecognized feature gate: Example Aug 04 10:37:28.258061 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255580 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 04 10:37:28.258061 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255583 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 04 10:37:28.258061 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255586 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 04 10:37:28.258061 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255589 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 04 10:37:28.258061 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255592 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 04 10:37:28.258061 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255594 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 04 10:37:28.258061 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255597 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 04 10:37:28.258061 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255601 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 04 10:37:28.258061 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255603 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 04 10:37:28.258061 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255606 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 04 10:37:28.258061 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255609 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 04 10:37:28.258061 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255611 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 04 10:37:28.258061 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255614 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 04 10:37:28.258061 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255617 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 04 10:37:28.258061 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255619 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 04 10:37:28.258567 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255622 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 04 10:37:28.258567 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255624 2576 feature_gate.go:328] unrecognized feature gate: Example2 Aug 04 10:37:28.258567 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255627 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 04 10:37:28.258567 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255630 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 04 10:37:28.258567 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255632 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 04 10:37:28.258567 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255634 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 04 10:37:28.258567 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255637 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 04 10:37:28.258567 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255642 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 04 10:37:28.258567 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255645 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 04 10:37:28.258567 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255647 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 04 10:37:28.258567 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255650 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 04 10:37:28.258567 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255652 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 04 10:37:28.258567 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255655 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 04 10:37:28.258567 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255657 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 04 10:37:28.258567 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255660 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 04 10:37:28.258567 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255662 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 04 10:37:28.258567 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255664 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 04 10:37:28.258567 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255667 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 04 10:37:28.258567 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255670 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 04 10:37:28.258567 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255672 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 04 10:37:28.259143 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255675 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 04 10:37:28.259143 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255678 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 04 10:37:28.259143 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255680 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 04 10:37:28.259143 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255683 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 04 10:37:28.259143 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255685 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 04 10:37:28.259143 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255688 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 04 10:37:28.259143 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255690 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 04 10:37:28.259143 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255692 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 04 10:37:28.259143 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255695 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 04 10:37:28.259143 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255697 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 04 10:37:28.259143 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255700 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 04 10:37:28.259143 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255702 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 04 10:37:28.259143 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255704 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 04 10:37:28.259143 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255707 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 04 10:37:28.259143 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255709 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 04 10:37:28.259143 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255712 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 04 10:37:28.259143 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255714 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 04 10:37:28.259143 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255717 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 04 10:37:28.259143 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255720 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 04 10:37:28.259143 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255723 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 04 10:37:28.259676 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255726 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 04 10:37:28.259676 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255732 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 04 10:37:28.259676 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255735 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 04 10:37:28.259676 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255738 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 04 10:37:28.259676 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255740 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 04 10:37:28.259676 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255743 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 04 10:37:28.259676 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255745 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 04 10:37:28.259676 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255748 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 04 10:37:28.259676 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255750 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 04 10:37:28.259676 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255753 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 04 10:37:28.259676 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255755 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 04 10:37:28.259676 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255758 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 04 10:37:28.259676 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255761 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 04 10:37:28.259676 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255763 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 04 10:37:28.259676 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255766 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 04 10:37:28.259676 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255768 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 04 10:37:28.259676 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255771 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 04 10:37:28.259676 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255773 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 04 10:37:28.259676 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255775 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 04 10:37:28.259676 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255778 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 04 10:37:28.260155 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255781 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 04 10:37:28.260155 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255783 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 04 10:37:28.260155 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255785 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 04 10:37:28.260155 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255788 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 04 10:37:28.260155 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255790 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 04 10:37:28.260155 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255793 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 04 10:37:28.260155 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255796 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 04 10:37:28.260155 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255798 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 04 10:37:28.260155 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255801 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 04 10:37:28.260155 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255803 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 04 10:37:28.260155 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255806 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 04 10:37:28.260155 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255811 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 04 10:37:28.260155 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255815 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 04 10:37:28.260155 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255819 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 04 10:37:28.260155 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255823 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 04 10:37:28.260155 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255825 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 04 10:37:28.260155 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255828 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 04 10:37:28.260155 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255831 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 04 10:37:28.260155 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255834 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 04 10:37:28.260634 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.255836 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 04 10:37:28.260634 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.255905 2576 flags.go:64] FLAG: --address="0.0.0.0" Aug 04 10:37:28.260634 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.255912 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Aug 04 10:37:28.260634 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.255918 2576 flags.go:64] FLAG: --anonymous-auth="true" Aug 04 10:37:28.260634 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.255929 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Aug 04 10:37:28.260634 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.255934 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Aug 04 10:37:28.260634 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.255938 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Aug 04 10:37:28.260634 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.255942 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Aug 04 10:37:28.260634 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.255946 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Aug 04 10:37:28.260634 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.255950 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Aug 04 10:37:28.260634 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.255953 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Aug 04 10:37:28.260634 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.255956 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Aug 04 10:37:28.260634 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.255959 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Aug 04 10:37:28.260634 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.255962 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Aug 04 10:37:28.260634 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.255966 2576 flags.go:64] FLAG: --cgroup-root="" Aug 04 10:37:28.260634 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.255969 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Aug 04 10:37:28.260634 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.255972 2576 flags.go:64] FLAG: --client-ca-file="" Aug 04 10:37:28.260634 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.255975 2576 flags.go:64] FLAG: --cloud-provider="external" Aug 04 10:37:28.260634 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.255978 2576 flags.go:64] FLAG: --cluster-dns="[]" Aug 04 10:37:28.260634 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.255983 2576 flags.go:64] FLAG: --cluster-domain="" Aug 04 10:37:28.260634 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.255986 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Aug 04 10:37:28.260634 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.255989 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Aug 04 10:37:28.260634 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.255992 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Aug 04 10:37:28.260634 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.255996 2576 flags.go:64] FLAG: --container-log-max-files="5" Aug 04 10:37:28.261244 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256000 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Aug 04 10:37:28.261244 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256003 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Aug 04 10:37:28.261244 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256008 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Aug 04 10:37:28.261244 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256011 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Aug 04 10:37:28.261244 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256014 2576 flags.go:64] FLAG: --contention-profiling="false" Aug 04 10:37:28.261244 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256017 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Aug 04 10:37:28.261244 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256020 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Aug 04 10:37:28.261244 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256023 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Aug 04 10:37:28.261244 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256026 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Aug 04 10:37:28.261244 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256030 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Aug 04 10:37:28.261244 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256033 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Aug 04 10:37:28.261244 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256036 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Aug 04 10:37:28.261244 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256039 2576 flags.go:64] FLAG: --enable-load-reader="false" Aug 04 10:37:28.261244 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256042 2576 flags.go:64] FLAG: --enable-server="true" Aug 04 10:37:28.261244 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256046 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Aug 04 10:37:28.261244 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256050 2576 flags.go:64] FLAG: --event-burst="100" Aug 04 10:37:28.261244 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256053 2576 flags.go:64] FLAG: --event-qps="50" Aug 04 10:37:28.261244 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256056 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Aug 04 10:37:28.261244 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256059 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Aug 04 10:37:28.261244 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256062 2576 flags.go:64] FLAG: --eviction-hard="" Aug 04 10:37:28.261244 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256065 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Aug 04 10:37:28.261244 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256068 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Aug 04 10:37:28.261244 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256071 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Aug 04 10:37:28.261244 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256074 2576 flags.go:64] FLAG: --eviction-soft="" Aug 04 10:37:28.261244 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256077 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Aug 04 10:37:28.261888 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256080 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Aug 04 10:37:28.261888 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256082 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Aug 04 10:37:28.261888 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256085 2576 flags.go:64] FLAG: --experimental-mounter-path="" Aug 04 10:37:28.261888 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256088 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Aug 04 10:37:28.261888 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256091 2576 flags.go:64] FLAG: --fail-swap-on="true" Aug 04 10:37:28.261888 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256094 2576 flags.go:64] FLAG: --feature-gates="" Aug 04 10:37:28.261888 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256097 2576 flags.go:64] FLAG: --file-check-frequency="20s" Aug 04 10:37:28.261888 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256102 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Aug 04 10:37:28.261888 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256105 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Aug 04 10:37:28.261888 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256109 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Aug 04 10:37:28.261888 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256112 2576 flags.go:64] FLAG: --healthz-port="10248" Aug 04 10:37:28.261888 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256115 2576 flags.go:64] FLAG: --help="false" Aug 04 10:37:28.261888 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256118 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-142-102.ec2.internal" Aug 04 10:37:28.261888 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256121 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Aug 04 10:37:28.261888 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256124 2576 flags.go:64] FLAG: --http-check-frequency="20s" Aug 04 10:37:28.261888 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256126 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Aug 04 10:37:28.261888 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256130 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Aug 04 10:37:28.261888 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256133 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Aug 04 10:37:28.261888 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256136 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Aug 04 10:37:28.261888 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256139 2576 flags.go:64] FLAG: --image-service-endpoint="" Aug 04 10:37:28.261888 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256142 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Aug 04 10:37:28.261888 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256145 2576 flags.go:64] FLAG: --kube-api-burst="100" Aug 04 10:37:28.261888 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256148 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Aug 04 10:37:28.262507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256151 2576 flags.go:64] FLAG: --kube-api-qps="50" Aug 04 10:37:28.262507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256154 2576 flags.go:64] FLAG: --kube-reserved="" Aug 04 10:37:28.262507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256157 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Aug 04 10:37:28.262507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256160 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Aug 04 10:37:28.262507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256163 2576 flags.go:64] FLAG: --kubelet-cgroups="" Aug 04 10:37:28.262507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256165 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Aug 04 10:37:28.262507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256168 2576 flags.go:64] FLAG: --lock-file="" Aug 04 10:37:28.262507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256171 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Aug 04 10:37:28.262507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256174 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Aug 04 10:37:28.262507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256177 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Aug 04 10:37:28.262507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256182 2576 flags.go:64] FLAG: --log-json-split-stream="false" Aug 04 10:37:28.262507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256185 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Aug 04 10:37:28.262507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256187 2576 flags.go:64] FLAG: --log-text-split-stream="false" Aug 04 10:37:28.262507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256190 2576 flags.go:64] FLAG: --logging-format="text" Aug 04 10:37:28.262507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256193 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Aug 04 10:37:28.262507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256196 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Aug 04 10:37:28.262507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256200 2576 flags.go:64] FLAG: --manifest-url="" Aug 04 10:37:28.262507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256203 2576 flags.go:64] FLAG: --manifest-url-header="" Aug 04 10:37:28.262507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256209 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Aug 04 10:37:28.262507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256212 2576 flags.go:64] FLAG: --max-open-files="1000000" Aug 04 10:37:28.262507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256216 2576 flags.go:64] FLAG: --max-pods="110" Aug 04 10:37:28.262507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256219 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Aug 04 10:37:28.262507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256222 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Aug 04 10:37:28.262507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256225 2576 flags.go:64] FLAG: --memory-manager-policy="None" Aug 04 10:37:28.262507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256228 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Aug 04 10:37:28.263122 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256231 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Aug 04 10:37:28.263122 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256234 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Aug 04 10:37:28.263122 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256237 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Aug 04 10:37:28.263122 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256244 2576 flags.go:64] FLAG: --node-status-max-images="50" Aug 04 10:37:28.263122 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256247 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Aug 04 10:37:28.263122 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256250 2576 flags.go:64] FLAG: --oom-score-adj="-999" Aug 04 10:37:28.263122 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256252 2576 flags.go:64] FLAG: --pod-cidr="" Aug 04 10:37:28.263122 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256256 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8" Aug 04 10:37:28.263122 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256261 2576 flags.go:64] FLAG: --pod-manifest-path="" Aug 04 10:37:28.263122 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256264 2576 flags.go:64] FLAG: --pod-max-pids="-1" Aug 04 10:37:28.263122 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256267 2576 flags.go:64] FLAG: --pods-per-core="0" Aug 04 10:37:28.263122 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256270 2576 flags.go:64] FLAG: --port="10250" Aug 04 10:37:28.263122 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256273 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Aug 04 10:37:28.263122 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256275 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0073bd0bd0ef616af" Aug 04 10:37:28.263122 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256279 2576 flags.go:64] FLAG: --qos-reserved="" Aug 04 10:37:28.263122 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256282 2576 flags.go:64] FLAG: --read-only-port="10255" Aug 04 10:37:28.263122 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256284 2576 flags.go:64] FLAG: --register-node="true" Aug 04 10:37:28.263122 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256287 2576 flags.go:64] FLAG: --register-with-taints="" Aug 04 10:37:28.263122 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256291 2576 flags.go:64] FLAG: --registry-burst="10" Aug 04 10:37:28.263122 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256294 2576 flags.go:64] FLAG: --registry-qps="5" Aug 04 10:37:28.263122 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256296 2576 flags.go:64] FLAG: --reserved-cpus="" Aug 04 10:37:28.263122 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256299 2576 flags.go:64] FLAG: --reserved-memory="" Aug 04 10:37:28.263122 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256303 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Aug 04 10:37:28.263122 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256307 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Aug 04 10:37:28.263122 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256310 2576 flags.go:64] FLAG: --rotate-certificates="false" Aug 04 10:37:28.263753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256313 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Aug 04 10:37:28.263753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256317 2576 flags.go:64] FLAG: --runonce="false" Aug 04 10:37:28.263753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256320 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Aug 04 10:37:28.263753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256323 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Aug 04 10:37:28.263753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256326 2576 flags.go:64] FLAG: --seccomp-default="false" Aug 04 10:37:28.263753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256328 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Aug 04 10:37:28.263753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256331 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Aug 04 10:37:28.263753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256334 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Aug 04 10:37:28.263753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256337 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Aug 04 10:37:28.263753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256340 2576 flags.go:64] FLAG: --storage-driver-password="root" Aug 04 10:37:28.263753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256343 2576 flags.go:64] FLAG: --storage-driver-secure="false" Aug 04 10:37:28.263753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256345 2576 flags.go:64] FLAG: --storage-driver-table="stats" Aug 04 10:37:28.263753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256349 2576 flags.go:64] FLAG: --storage-driver-user="root" Aug 04 10:37:28.263753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256351 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Aug 04 10:37:28.263753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256371 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Aug 04 10:37:28.263753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256378 2576 flags.go:64] FLAG: --system-cgroups="" Aug 04 10:37:28.263753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256382 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Aug 04 10:37:28.263753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256390 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Aug 04 10:37:28.263753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256393 2576 flags.go:64] FLAG: --tls-cert-file="" Aug 04 10:37:28.263753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256396 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Aug 04 10:37:28.263753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256401 2576 flags.go:64] FLAG: --tls-min-version="" Aug 04 10:37:28.263753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256405 2576 flags.go:64] FLAG: --tls-private-key-file="" Aug 04 10:37:28.263753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256407 2576 flags.go:64] FLAG: --topology-manager-policy="none" Aug 04 10:37:28.263753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256410 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Aug 04 10:37:28.263753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256413 2576 flags.go:64] FLAG: --topology-manager-scope="container" Aug 04 10:37:28.264351 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256416 2576 flags.go:64] FLAG: --v="2" Aug 04 10:37:28.264351 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256420 2576 flags.go:64] FLAG: --version="false" Aug 04 10:37:28.264351 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256424 2576 flags.go:64] FLAG: --vmodule="" Aug 04 10:37:28.264351 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256428 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Aug 04 10:37:28.264351 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.256431 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Aug 04 10:37:28.264351 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256560 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 04 10:37:28.264351 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256565 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 04 10:37:28.264351 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256569 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 04 10:37:28.264351 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256573 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 04 10:37:28.264351 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256576 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 04 10:37:28.264351 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256579 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 04 10:37:28.264351 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256582 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 04 10:37:28.264351 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256585 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 04 10:37:28.264351 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256587 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 04 10:37:28.264351 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256590 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 04 10:37:28.264351 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256593 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 04 10:37:28.264351 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256596 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 04 10:37:28.264351 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256598 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 04 10:37:28.264351 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256601 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 04 10:37:28.264351 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256605 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 04 10:37:28.264351 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256608 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 04 10:37:28.264907 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256611 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 04 10:37:28.264907 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256615 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 04 10:37:28.264907 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256618 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 04 10:37:28.264907 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256621 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 04 10:37:28.264907 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256624 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 04 10:37:28.264907 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256626 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 04 10:37:28.264907 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256629 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 04 10:37:28.264907 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256632 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 04 10:37:28.264907 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256635 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 04 10:37:28.264907 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256637 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 04 10:37:28.264907 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256640 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 04 10:37:28.264907 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256643 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 04 10:37:28.264907 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256645 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 04 10:37:28.264907 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256648 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 04 10:37:28.264907 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256650 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 04 10:37:28.264907 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256653 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 04 10:37:28.264907 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256657 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 04 10:37:28.264907 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256659 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 04 10:37:28.264907 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256661 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 04 10:37:28.264907 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256665 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 04 10:37:28.265423 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256668 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 04 10:37:28.265423 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256671 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 04 10:37:28.265423 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256673 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 04 10:37:28.265423 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256676 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 04 10:37:28.265423 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256678 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 04 10:37:28.265423 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256681 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 04 10:37:28.265423 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256683 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 04 10:37:28.265423 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256685 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 04 10:37:28.265423 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256688 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 04 10:37:28.265423 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256692 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 04 10:37:28.265423 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256695 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 04 10:37:28.265423 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256698 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 04 10:37:28.265423 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256700 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 04 10:37:28.265423 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256703 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 04 10:37:28.265423 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256706 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 04 10:37:28.265423 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256708 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 04 10:37:28.265423 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256711 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 04 10:37:28.265423 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256713 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 04 10:37:28.265423 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256716 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 04 10:37:28.265882 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256718 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 04 10:37:28.265882 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256721 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 04 10:37:28.265882 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256724 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 04 10:37:28.265882 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256728 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 04 10:37:28.265882 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256730 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 04 10:37:28.265882 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256733 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 04 10:37:28.265882 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256735 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 04 10:37:28.265882 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256738 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 04 10:37:28.265882 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256740 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 04 10:37:28.265882 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256743 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 04 10:37:28.265882 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256746 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 04 10:37:28.265882 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256748 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 04 10:37:28.265882 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256752 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 04 10:37:28.265882 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256755 2576 feature_gate.go:328] unrecognized feature gate: Example2 Aug 04 10:37:28.265882 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256758 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 04 10:37:28.265882 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256760 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 04 10:37:28.265882 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256763 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 04 10:37:28.265882 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256765 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 04 10:37:28.265882 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256768 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 04 10:37:28.266340 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256770 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 04 10:37:28.266340 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256773 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 04 10:37:28.266340 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256775 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 04 10:37:28.266340 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256778 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 04 10:37:28.266340 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256780 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 04 10:37:28.266340 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256783 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 04 10:37:28.266340 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256785 2576 feature_gate.go:328] unrecognized feature gate: Example Aug 04 10:37:28.266340 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256787 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 04 10:37:28.266340 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256790 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 04 10:37:28.266340 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256792 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 04 10:37:28.266340 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256795 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 04 10:37:28.266340 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256798 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 04 10:37:28.266340 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256800 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 04 10:37:28.266340 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256803 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 04 10:37:28.266340 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256805 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 04 10:37:28.266340 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256807 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 04 10:37:28.266340 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256810 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 04 10:37:28.266340 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256812 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 04 10:37:28.266340 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256815 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 04 10:37:28.266340 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256817 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 04 10:37:28.266841 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256820 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 04 10:37:28.266841 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256823 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 04 10:37:28.266841 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256825 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 04 10:37:28.266841 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256828 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 04 10:37:28.266841 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.256830 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 04 10:37:28.266841 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.257335 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 04 10:37:28.266841 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.264122 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Aug 04 10:37:28.266841 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.264140 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Aug 04 10:37:28.266841 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.265004 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Aug 04 10:37:28.266841 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.265018 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Aug 04 10:37:28.266841 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265096 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 04 10:37:28.266841 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265102 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 04 10:37:28.266841 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265106 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 04 10:37:28.266841 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265109 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 04 10:37:28.267191 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265112 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 04 10:37:28.267191 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265114 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 04 10:37:28.267191 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265117 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 04 10:37:28.267191 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265120 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 04 10:37:28.267191 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265122 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 04 10:37:28.267191 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265125 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 04 10:37:28.267191 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265128 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 04 10:37:28.267191 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265130 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 04 10:37:28.267191 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265133 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 04 10:37:28.267191 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265136 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 04 10:37:28.267191 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265138 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 04 10:37:28.267191 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265141 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 04 10:37:28.267191 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265143 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 04 10:37:28.267191 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265146 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 04 10:37:28.267191 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265148 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 04 10:37:28.267191 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265151 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 04 10:37:28.267191 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265153 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 04 10:37:28.267191 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265156 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 04 10:37:28.267191 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265158 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 04 10:37:28.267191 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265161 2576 feature_gate.go:328] unrecognized feature gate: Example2 Aug 04 10:37:28.267757 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265163 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 04 10:37:28.267757 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265165 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 04 10:37:28.267757 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265168 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 04 10:37:28.267757 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265171 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 04 10:37:28.267757 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265173 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 04 10:37:28.267757 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265183 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 04 10:37:28.267757 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265186 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 04 10:37:28.267757 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265189 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 04 10:37:28.267757 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265191 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 04 10:37:28.267757 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265194 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 04 10:37:28.267757 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265196 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 04 10:37:28.267757 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265199 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 04 10:37:28.267757 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265202 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 04 10:37:28.267757 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265204 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 04 10:37:28.267757 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265207 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 04 10:37:28.267757 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265209 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 04 10:37:28.267757 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265212 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 04 10:37:28.267757 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265214 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 04 10:37:28.267757 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265217 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 04 10:37:28.267757 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265219 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 04 10:37:28.268242 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265222 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 04 10:37:28.268242 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265224 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 04 10:37:28.268242 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265227 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 04 10:37:28.268242 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265229 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 04 10:37:28.268242 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265233 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 04 10:37:28.268242 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265237 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 04 10:37:28.268242 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265241 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 04 10:37:28.268242 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265244 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 04 10:37:28.268242 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265246 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 04 10:37:28.268242 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265249 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 04 10:37:28.268242 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265251 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 04 10:37:28.268242 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265254 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 04 10:37:28.268242 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265256 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 04 10:37:28.268242 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265259 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 04 10:37:28.268242 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265261 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 04 10:37:28.268242 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265264 2576 feature_gate.go:328] unrecognized feature gate: Example Aug 04 10:37:28.268242 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265267 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 04 10:37:28.268242 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265270 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 04 10:37:28.268242 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265278 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 04 10:37:28.268242 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265281 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 04 10:37:28.268741 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265284 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 04 10:37:28.268741 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265289 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 04 10:37:28.268741 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265291 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 04 10:37:28.268741 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265294 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 04 10:37:28.268741 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265296 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 04 10:37:28.268741 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265299 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 04 10:37:28.268741 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265301 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 04 10:37:28.268741 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265304 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 04 10:37:28.268741 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265306 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 04 10:37:28.268741 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265309 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 04 10:37:28.268741 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265311 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 04 10:37:28.268741 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265313 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 04 10:37:28.268741 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265316 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 04 10:37:28.268741 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265318 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 04 10:37:28.268741 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265320 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 04 10:37:28.268741 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265323 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 04 10:37:28.268741 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265326 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 04 10:37:28.268741 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265330 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 04 10:37:28.268741 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265333 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 04 10:37:28.268741 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265335 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 04 10:37:28.269216 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265338 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 04 10:37:28.269216 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265341 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 04 10:37:28.269216 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265344 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 04 10:37:28.269216 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265347 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 04 10:37:28.269216 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265350 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 04 10:37:28.269216 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265353 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 04 10:37:28.269216 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265375 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 04 10:37:28.269216 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265378 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 04 10:37:28.269216 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265381 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 04 10:37:28.269216 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265384 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 04 10:37:28.269216 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265387 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 04 10:37:28.269216 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265395 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 04 10:37:28.269216 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265398 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 04 10:37:28.269216 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265400 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 04 10:37:28.269216 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265403 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 04 10:37:28.269602 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.265408 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 04 10:37:28.269602 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265558 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 04 10:37:28.269602 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265563 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 04 10:37:28.269602 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265565 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 04 10:37:28.269602 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265568 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 04 10:37:28.269602 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265571 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 04 10:37:28.269602 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265574 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 04 10:37:28.269602 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265577 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 04 10:37:28.269602 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265579 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 04 10:37:28.269602 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265582 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 04 10:37:28.269602 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265585 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 04 10:37:28.269602 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265587 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 04 10:37:28.269602 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265590 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 04 10:37:28.269602 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265592 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 04 10:37:28.269602 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265595 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 04 10:37:28.269971 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265597 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 04 10:37:28.269971 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265600 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 04 10:37:28.269971 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265602 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 04 10:37:28.269971 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265605 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 04 10:37:28.269971 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265607 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 04 10:37:28.269971 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265610 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 04 10:37:28.269971 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265612 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 04 10:37:28.269971 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265615 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 04 10:37:28.269971 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265617 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 04 10:37:28.269971 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265620 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 04 10:37:28.269971 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265622 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 04 10:37:28.269971 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265626 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 04 10:37:28.269971 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265628 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 04 10:37:28.269971 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265631 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 04 10:37:28.269971 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265639 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 04 10:37:28.269971 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265642 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 04 10:37:28.269971 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265644 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 04 10:37:28.269971 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265647 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 04 10:37:28.269971 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265649 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 04 10:37:28.269971 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265652 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 04 10:37:28.270525 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265654 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 04 10:37:28.270525 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265657 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 04 10:37:28.270525 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265659 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 04 10:37:28.270525 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265661 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 04 10:37:28.270525 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265664 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 04 10:37:28.270525 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265666 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 04 10:37:28.270525 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265669 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 04 10:37:28.270525 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265671 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 04 10:37:28.270525 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265674 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 04 10:37:28.270525 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265677 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 04 10:37:28.270525 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265681 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 04 10:37:28.270525 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265684 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 04 10:37:28.270525 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265687 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 04 10:37:28.270525 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265689 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 04 10:37:28.270525 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265692 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 04 10:37:28.270525 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265694 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 04 10:37:28.270525 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265697 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 04 10:37:28.270525 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265699 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 04 10:37:28.270525 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265701 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 04 10:37:28.270996 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265705 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 04 10:37:28.270996 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265708 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 04 10:37:28.270996 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265711 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 04 10:37:28.270996 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265713 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 04 10:37:28.270996 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265716 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 04 10:37:28.270996 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265719 2576 feature_gate.go:328] unrecognized feature gate: Example Aug 04 10:37:28.270996 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265721 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 04 10:37:28.270996 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265723 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 04 10:37:28.270996 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265731 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 04 10:37:28.270996 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265734 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 04 10:37:28.270996 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265736 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 04 10:37:28.270996 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265739 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 04 10:37:28.270996 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265741 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 04 10:37:28.270996 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265744 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 04 10:37:28.270996 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265746 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 04 10:37:28.270996 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265749 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 04 10:37:28.270996 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265751 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 04 10:37:28.270996 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265753 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 04 10:37:28.270996 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265756 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 04 10:37:28.270996 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265758 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 04 10:37:28.271471 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265760 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 04 10:37:28.271471 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265763 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 04 10:37:28.271471 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265767 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 04 10:37:28.271471 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265770 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 04 10:37:28.271471 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265772 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 04 10:37:28.271471 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265775 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 04 10:37:28.271471 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265777 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 04 10:37:28.271471 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265780 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 04 10:37:28.271471 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265782 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 04 10:37:28.271471 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265785 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 04 10:37:28.271471 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265787 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 04 10:37:28.271471 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265790 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 04 10:37:28.271471 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265792 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 04 10:37:28.271471 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265795 2576 feature_gate.go:328] unrecognized feature gate: Example2 Aug 04 10:37:28.271471 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265797 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 04 10:37:28.271471 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265800 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 04 10:37:28.271471 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265803 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 04 10:37:28.271471 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265805 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 04 10:37:28.271471 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265808 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 04 10:37:28.271931 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265810 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 04 10:37:28.271931 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265813 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 04 10:37:28.271931 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265821 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 04 10:37:28.271931 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265824 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 04 10:37:28.271931 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265826 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 04 10:37:28.271931 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265829 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 04 10:37:28.271931 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:28.265831 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 04 10:37:28.271931 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.265836 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 04 10:37:28.271931 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.265965 2576 server.go:962] "Client rotation is on, will bootstrap in background" Aug 04 10:37:28.271931 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.268317 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Aug 04 10:37:28.271931 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.269668 2576 server.go:1019] "Starting client certificate rotation" Aug 04 10:37:28.271931 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.269780 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 04 10:37:28.271931 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.269833 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 04 10:37:28.272796 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.272783 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 04 10:37:28.277628 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.277607 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 04 10:37:28.286636 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.286621 2576 log.go:25] "Validated CRI v1 runtime API" Aug 04 10:37:28.289113 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.289098 2576 log.go:25] "Validated CRI v1 image API" Aug 04 10:37:28.289953 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.289936 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Aug 04 10:37:28.294592 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.294565 2576 fs.go:135] Filesystem UUIDs: map[2547c256-de5d-46e5-846b-71d915ab9995:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9c670eba-513c-436a-b168-6e39ecda43fe:/dev/nvme0n1p4] Aug 04 10:37:28.294664 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.294592 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Aug 04 10:37:28.299907 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.299793 2576 manager.go:216] Machine: {Timestamp:2026-08-04 10:37:28.298449544 +0000 UTC m=+0.336387352 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102630 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d140056299e9e845c4467ef28dbc9 SystemUUID:ec2d1400-5629-9e9e-845c-4467ef28dbc9 BootID:93165c30-79ac-404f-86b5-b5fd4bac91cd Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:72:da:8e:6c:7d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:72:da:8e:6c:7d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:cc:5f:ed:ee:d1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Aug 04 10:37:28.299907 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.299899 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Aug 04 10:37:28.300069 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.299997 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Aug 04 10:37:28.303077 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.303052 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Aug 04 10:37:28.303209 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.303080 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-102.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Aug 04 10:37:28.303767 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.303756 2576 topology_manager.go:138] "Creating topology manager with none policy" Aug 04 10:37:28.303804 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.303770 2576 container_manager_linux.go:309] "Creating device plugin manager" Aug 04 10:37:28.303804 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.303777 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 04 10:37:28.304430 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.304416 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 04 10:37:28.305264 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.305251 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Aug 04 10:37:28.308724 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.308713 2576 state_mem.go:36] "Initialized new in-memory state store" Aug 04 10:37:28.308841 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.308832 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Aug 04 10:37:28.308877 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.308862 2576 kubelet.go:486] "Attempting to sync node with API server" Aug 04 10:37:28.308877 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.308871 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Aug 04 10:37:28.308931 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.308882 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Aug 04 10:37:28.308931 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.308890 2576 kubelet.go:398] "Adding apiserver pod source" Aug 04 10:37:28.308931 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.308899 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Aug 04 10:37:28.309310 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.309296 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 04 10:37:28.309374 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.309329 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 04 10:37:28.309468 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.309449 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 04 10:37:28.313007 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.312987 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Aug 04 10:37:28.314540 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.314528 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Aug 04 10:37:28.314596 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.314565 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Aug 04 10:37:28.315644 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.315630 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Aug 04 10:37:28.315715 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.315647 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Aug 04 10:37:28.315715 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.315654 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Aug 04 10:37:28.315715 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.315660 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Aug 04 10:37:28.315715 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.315668 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Aug 04 10:37:28.315715 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.315674 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Aug 04 10:37:28.315715 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.315682 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Aug 04 10:37:28.315715 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.315687 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Aug 04 10:37:28.315715 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.315693 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Aug 04 10:37:28.315715 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.315699 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Aug 04 10:37:28.315715 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.315707 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Aug 04 10:37:28.315715 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.315712 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Aug 04 10:37:28.316444 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.316434 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Aug 04 10:37:28.316480 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.316445 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Aug 04 10:37:28.319687 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.319665 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-102.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Aug 04 10:37:28.319687 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:28.319672 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-102.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Aug 04 10:37:28.319815 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:28.319770 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Aug 04 10:37:28.319911 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.319898 2576 server.go:1268] "Started kubelet" Aug 04 10:37:28.319974 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.319950 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Aug 04 10:37:28.320080 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.320052 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Aug 04 10:37:28.320136 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.320098 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Aug 04 10:37:28.320778 ip-10-0-142-102 systemd[1]: Started Kubernetes Kubelet. Aug 04 10:37:28.322317 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.322295 2576 server.go:310] "Adding debug handlers to kubelet server" Aug 04 10:37:28.324154 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.324139 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Aug 04 10:37:28.325479 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:28.325461 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Aug 04 10:37:28.328482 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.328469 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Aug 04 10:37:28.328557 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.328486 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Aug 04 10:37:28.328611 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:28.328594 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-102.ec2.internal\" not found" Aug 04 10:37:28.329089 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.329069 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Aug 04 10:37:28.329089 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.329085 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Aug 04 10:37:28.329191 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.329100 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Aug 04 10:37:28.329191 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.329188 2576 reconstruct.go:97] "Volume reconstruction finished" Aug 04 10:37:28.329273 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.329197 2576 reconciler.go:29] "Reconciler: start to sync state" Aug 04 10:37:28.329273 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.329233 2576 factory.go:55] Registering systemd factory Aug 04 10:37:28.329273 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.329246 2576 factory.go:223] Registration of the systemd container factory successfully Aug 04 10:37:28.329633 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.329613 2576 factory.go:153] Registering CRI-O factory Aug 04 10:37:28.329633 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.329634 2576 factory.go:223] Registration of the crio container factory successfully Aug 04 10:37:28.329751 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.329681 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Aug 04 10:37:28.329751 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.329711 2576 factory.go:103] Registering Raw factory Aug 04 10:37:28.329751 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.329728 2576 manager.go:1196] Started watching for new ooms in manager Aug 04 10:37:28.330461 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:28.329462 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-102.ec2.internal.18c893e158d7e633 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-102.ec2.internal,UID:ip-10-0-142-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-102.ec2.internal,},FirstTimestamp:2026-08-04 10:37:28.319870515 +0000 UTC m=+0.357808304,LastTimestamp:2026-08-04 10:37:28.319870515 +0000 UTC m=+0.357808304,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-102.ec2.internal,}" Aug 04 10:37:28.330836 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.330822 2576 manager.go:349] Starting recovery of all containers Aug 04 10:37:28.338440 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:28.338410 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-102.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Aug 04 10:37:28.338544 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:28.338452 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Aug 04 10:37:28.342782 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.342674 2576 manager.go:354] Recovery completed Aug 04 10:37:28.346669 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.346656 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 10:37:28.348640 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.348620 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientMemory" Aug 04 10:37:28.348719 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.348651 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 10:37:28.348719 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.348661 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientPID" Aug 04 10:37:28.349119 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.349106 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Aug 04 10:37:28.349119 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.349118 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 10:37:28.349205 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.349118 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Aug 04 10:37:28.349205 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.349200 2576 state_mem.go:36] "Initialized new in-memory state store" Aug 04 10:37:28.349825 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.349807 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientMemory" Aug 04 10:37:28.349901 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.349837 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 10:37:28.349901 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.349848 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientPID" Aug 04 10:37:28.350627 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.350616 2576 policy_none.go:49] "None policy: Start" Aug 04 10:37:28.350670 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.350631 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Aug 04 10:37:28.350670 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.350642 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Aug 04 10:37:28.351681 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:28.351614 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-102.ec2.internal.18c893e15a8edc98 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-102.ec2.internal,UID:ip-10-0-142-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-102.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-102.ec2.internal,},FirstTimestamp:2026-08-04 10:37:28.34863836 +0000 UTC m=+0.386576148,LastTimestamp:2026-08-04 10:37:28.34863836 +0000 UTC m=+0.386576148,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-102.ec2.internal,}" Aug 04 10:37:28.351755 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.351740 2576 policy_none.go:47] "Start" Aug 04 10:37:28.360598 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:28.360539 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-102.ec2.internal.18c893e15a8f21a9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-102.ec2.internal,UID:ip-10-0-142-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-102.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-102.ec2.internal,},FirstTimestamp:2026-08-04 10:37:28.348656041 +0000 UTC m=+0.386593829,LastTimestamp:2026-08-04 10:37:28.348656041 +0000 UTC m=+0.386593829,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-102.ec2.internal,}" Aug 04 10:37:28.371285 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:28.371220 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-102.ec2.internal.18c893e15a8f45bd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-102.ec2.internal,UID:ip-10-0-142-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-102.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-102.ec2.internal,},FirstTimestamp:2026-08-04 10:37:28.348665277 +0000 UTC m=+0.386603065,LastTimestamp:2026-08-04 10:37:28.348665277 +0000 UTC m=+0.386603065,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-102.ec2.internal,}" Aug 04 10:37:28.375791 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.375773 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7zfvb" Aug 04 10:37:28.380283 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:28.380225 2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-102.ec2.internal.18c893e15a8edc98\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-102.ec2.internal.18c893e15a8edc98 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-102.ec2.internal,UID:ip-10-0-142-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-102.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-102.ec2.internal,},FirstTimestamp:2026-08-04 10:37:28.34863836 +0000 UTC m=+0.386576148,LastTimestamp:2026-08-04 10:37:28.349823189 +0000 UTC m=+0.387760984,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-102.ec2.internal,}" Aug 04 10:37:28.387931 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.387913 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7zfvb" Aug 04 10:37:28.390210 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:28.390146 2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-102.ec2.internal.18c893e15a8f21a9\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-102.ec2.internal.18c893e15a8f21a9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-102.ec2.internal,UID:ip-10-0-142-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-102.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-102.ec2.internal,},FirstTimestamp:2026-08-04 10:37:28.348656041 +0000 UTC m=+0.386593829,LastTimestamp:2026-08-04 10:37:28.349842638 +0000 UTC m=+0.387780427,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-102.ec2.internal,}" Aug 04 10:37:28.391921 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.391908 2576 manager.go:337] "Starting Device Plugin manager" Aug 04 10:37:28.392004 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:28.391936 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Aug 04 10:37:28.392004 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.391945 2576 server.go:87] "Starting device plugin registration server" Aug 04 10:37:28.392179 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.392166 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Aug 04 10:37:28.392222 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.392181 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Aug 04 10:37:28.392281 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.392266 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Aug 04 10:37:28.392475 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.392342 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Aug 04 10:37:28.392475 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.392353 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Aug 04 10:37:28.392900 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:28.392880 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Aug 04 10:37:28.392967 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:28.392935 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-102.ec2.internal\" not found" Aug 04 10:37:28.481970 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.481934 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Aug 04 10:37:28.483266 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.483249 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Aug 04 10:37:28.483380 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.483293 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Aug 04 10:37:28.483380 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.483324 2576 kubelet.go:2448] "Starting kubelet main sync loop" Aug 04 10:37:28.483486 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:28.483383 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Aug 04 10:37:28.486150 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.486132 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 04 10:37:28.492472 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.492458 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 10:37:28.493292 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.493276 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientMemory" Aug 04 10:37:28.493347 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.493312 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 10:37:28.493347 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.493329 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientPID" Aug 04 10:37:28.493440 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.493354 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-102.ec2.internal" Aug 04 10:37:28.502303 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.502265 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-102.ec2.internal" Aug 04 10:37:28.502303 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:28.502285 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-102.ec2.internal\": node \"ip-10-0-142-102.ec2.internal\" not found" Aug 04 10:37:28.528837 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:28.528819 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-102.ec2.internal\" not found" Aug 04 10:37:28.583663 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.583638 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-102.ec2.internal"] Aug 04 10:37:28.583744 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.583702 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 10:37:28.584615 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.584598 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientMemory" Aug 04 10:37:28.584683 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.584628 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 10:37:28.584683 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.584639 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientPID" Aug 04 10:37:28.586039 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.586027 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 10:37:28.586153 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.586139 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal" Aug 04 10:37:28.586202 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.586170 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 10:37:28.586742 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.586729 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientMemory" Aug 04 10:37:28.586742 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.586740 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientMemory" Aug 04 10:37:28.586846 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.586753 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 10:37:28.586846 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.586758 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 10:37:28.586846 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.586766 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientPID" Aug 04 10:37:28.586846 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.586770 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientPID" Aug 04 10:37:28.587987 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.587973 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-102.ec2.internal" Aug 04 10:37:28.588033 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.588004 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 10:37:28.588662 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.588642 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientMemory" Aug 04 10:37:28.588726 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.588671 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 10:37:28.588726 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.588686 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientPID" Aug 04 10:37:28.611944 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:28.611921 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-102.ec2.internal\" not found" node="ip-10-0-142-102.ec2.internal" Aug 04 10:37:28.616494 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:28.616479 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-102.ec2.internal\" not found" node="ip-10-0-142-102.ec2.internal" Aug 04 10:37:28.629154 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:28.629137 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-102.ec2.internal\" not found" Aug 04 10:37:28.631354 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.631340 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50afa940563be74492f95ffd26264123-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal\" (UID: \"50afa940563be74492f95ffd26264123\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal" Aug 04 10:37:28.631452 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.631378 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d977d9685f76e65bd3916a0635d4beb4-config\") pod \"kube-apiserver-proxy-ip-10-0-142-102.ec2.internal\" (UID: \"d977d9685f76e65bd3916a0635d4beb4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-102.ec2.internal" Aug 04 10:37:28.631452 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.631429 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/50afa940563be74492f95ffd26264123-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal\" (UID: \"50afa940563be74492f95ffd26264123\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal" Aug 04 10:37:28.729768 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:28.729747 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-102.ec2.internal\" not found" Aug 04 10:37:28.731943 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.731917 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/50afa940563be74492f95ffd26264123-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal\" (UID: \"50afa940563be74492f95ffd26264123\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal" Aug 04 10:37:28.731994 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.731952 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50afa940563be74492f95ffd26264123-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal\" (UID: \"50afa940563be74492f95ffd26264123\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal" Aug 04 10:37:28.731994 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.731973 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d977d9685f76e65bd3916a0635d4beb4-config\") pod \"kube-apiserver-proxy-ip-10-0-142-102.ec2.internal\" (UID: \"d977d9685f76e65bd3916a0635d4beb4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-102.ec2.internal" Aug 04 10:37:28.732058 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.732007 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/50afa940563be74492f95ffd26264123-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal\" (UID: \"50afa940563be74492f95ffd26264123\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal" Aug 04 10:37:28.732058 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.732007 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d977d9685f76e65bd3916a0635d4beb4-config\") pod \"kube-apiserver-proxy-ip-10-0-142-102.ec2.internal\" (UID: \"d977d9685f76e65bd3916a0635d4beb4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-102.ec2.internal" Aug 04 10:37:28.732058 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.732019 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50afa940563be74492f95ffd26264123-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal\" (UID: \"50afa940563be74492f95ffd26264123\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal" Aug 04 10:37:28.829949 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:28.829848 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-102.ec2.internal\" not found" Aug 04 10:37:28.915248 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.915217 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal" Aug 04 10:37:28.919877 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:28.919702 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-102.ec2.internal" Aug 04 10:37:28.930941 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:28.930923 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-102.ec2.internal\" not found" Aug 04 10:37:29.031451 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:29.031406 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-102.ec2.internal\" not found" Aug 04 10:37:30.570978 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:30.570948 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-102.ec2.internal\" not found" Aug 04 10:37:30.671461 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:30.671431 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-102.ec2.internal\" not found" Aug 04 10:37:30.708750 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:30.708724 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Aug 04 10:37:30.709183 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:30.708885 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Aug 04 10:37:30.771781 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:30.771755 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-102.ec2.internal\" not found" Aug 04 10:37:30.831230 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:30.831185 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-03 10:32:29 +0000 UTC" deadline="2028-05-21 15:16:47.03647298 +0000 UTC" Aug 04 10:37:30.831230 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:30.831224 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15748h39m16.205251841s" Aug 04 10:37:30.852462 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:30.852441 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 10:37:30.853947 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:30.853928 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientMemory" Aug 04 10:37:30.854036 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:30.853961 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 10:37:30.854036 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:30.853972 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeHasSufficientPID" Aug 04 10:37:30.872133 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:30.872113 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-102.ec2.internal\" not found" Aug 04 10:37:30.893632 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:30.893608 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Aug 04 10:37:30.893910 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:30.893880 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50afa940563be74492f95ffd26264123.slice/crio-7f8a860d3d8bae54f415eeaea888ab7c21f50d795bc0dfca5e403df06ed20233 WatchSource:0}: Error finding container 7f8a860d3d8bae54f415eeaea888ab7c21f50d795bc0dfca5e403df06ed20233: Status 404 returned error can't find the container with id 7f8a860d3d8bae54f415eeaea888ab7c21f50d795bc0dfca5e403df06ed20233 Aug 04 10:37:30.900565 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:30.900552 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 04 10:37:30.925370 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:30.925325 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal" event={"ID":"50afa940563be74492f95ffd26264123","Type":"ContainerStarted","Data":"7f8a860d3d8bae54f415eeaea888ab7c21f50d795bc0dfca5e403df06ed20233"} Aug 04 10:37:30.972670 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:30.972641 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-102.ec2.internal\" not found" Aug 04 10:37:30.991503 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:30.991481 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Aug 04 10:37:31.010081 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:31.010062 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd977d9685f76e65bd3916a0635d4beb4.slice/crio-6c39ced8344c8aa73d32c3f57707870c69e6c21bc23463ff0fed2fdc777971cc WatchSource:0}: Error finding container 6c39ced8344c8aa73d32c3f57707870c69e6c21bc23463ff0fed2fdc777971cc: Status 404 returned error can't find the container with id 6c39ced8344c8aa73d32c3f57707870c69e6c21bc23463ff0fed2fdc777971cc Aug 04 10:37:31.068541 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.068473 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal" Aug 04 10:37:31.084676 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.084656 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 04 10:37:31.086386 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.086374 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-102.ec2.internal" Aug 04 10:37:31.097440 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.097427 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 04 10:37:31.359295 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.359216 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Aug 04 10:37:31.624894 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.624821 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 04 10:37:31.750080 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.750051 2576 apiserver.go:52] "Watching apiserver" Aug 04 10:37:31.759019 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.758997 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Aug 04 10:37:31.759388 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.759362 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj","openshift-cluster-node-tuning-operator/tuned-4srtf","openshift-image-registry/node-ca-xq5bm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal","openshift-multus/multus-additional-cni-plugins-4627p","openshift-multus/network-metrics-daemon-2lbrm","kube-system/konnectivity-agent-ctwz9","openshift-dns/node-resolver-dz4jf","openshift-multus/multus-k4w4p","openshift-network-diagnostics/network-check-target-wfs5z","openshift-network-operator/iptables-alerter-7bsx6","openshift-ovn-kubernetes/ovnkube-node-ltqqw","kube-system/global-pull-secret-syncer-98bfx","kube-system/kube-apiserver-proxy-ip-10-0-142-102.ec2.internal"] Aug 04 10:37:31.761381 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.761360 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:37:31.761491 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:31.761457 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lbrm" podUID="49fd00b0-8477-48c3-bbde-aa2c9ef5df76" Aug 04 10:37:31.762779 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.762761 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.764186 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.764089 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:37:31.764186 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:31.764149 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfs5z" podUID="f60ee252-a9b6-404e-bd02-4b235c92facd" Aug 04 10:37:31.765431 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.765411 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4627p" Aug 04 10:37:31.765964 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.765939 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Aug 04 10:37:31.766599 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.766382 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Aug 04 10:37:31.766599 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.766424 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wxd4t\"" Aug 04 10:37:31.766599 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.766588 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xq5bm" Aug 04 10:37:31.766783 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.766626 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Aug 04 10:37:31.766969 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.766944 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Aug 04 10:37:31.768751 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.768186 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ctwz9" Aug 04 10:37:31.771207 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.771194 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Aug 04 10:37:31.772491 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.772131 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Aug 04 10:37:31.772577 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.772560 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c7z65\"" Aug 04 10:37:31.772630 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.772574 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Aug 04 10:37:31.772770 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.772751 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Aug 04 10:37:31.773221 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.773201 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Aug 04 10:37:31.773301 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.773276 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Aug 04 10:37:31.774248 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.773751 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lkxqm\"" Aug 04 10:37:31.775355 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.775320 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dz4jf" Aug 04 10:37:31.776704 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.776681 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.778267 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.778003 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" Aug 04 10:37:31.778408 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.778370 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c1d7a4bf-2499-43ac-9714-004492eafc30-os-release\") pod \"multus-additional-cni-plugins-4627p\" (UID: \"c1d7a4bf-2499-43ac-9714-004492eafc30\") " pod="openshift-multus/multus-additional-cni-plugins-4627p" Aug 04 10:37:31.778479 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.778426 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-cnibin\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.778479 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.778454 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-cni-binary-copy\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.778580 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.778477 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-hostroot\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.778580 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.778514 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1d7a4bf-2499-43ac-9714-004492eafc30-system-cni-dir\") pod \"multus-additional-cni-plugins-4627p\" (UID: \"c1d7a4bf-2499-43ac-9714-004492eafc30\") " pod="openshift-multus/multus-additional-cni-plugins-4627p" Aug 04 10:37:31.778580 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.778543 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c1d7a4bf-2499-43ac-9714-004492eafc30-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4627p\" (UID: \"c1d7a4bf-2499-43ac-9714-004492eafc30\") " pod="openshift-multus/multus-additional-cni-plugins-4627p" Aug 04 10:37:31.778580 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.778568 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c1d7a4bf-2499-43ac-9714-004492eafc30-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4627p\" (UID: \"c1d7a4bf-2499-43ac-9714-004492eafc30\") " pod="openshift-multus/multus-additional-cni-plugins-4627p" Aug 04 10:37:31.778772 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.778594 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf0c1197-51b3-4912-8503-9d06553abdc0-tmp-dir\") pod \"node-resolver-dz4jf\" (UID: \"bf0c1197-51b3-4912-8503-9d06553abdc0\") " pod="openshift-dns/node-resolver-dz4jf" Aug 04 10:37:31.778890 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.778660 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-system-cni-dir\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.778953 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.778904 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Aug 04 10:37:31.778953 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.778924 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-host-run-netns\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.779051 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.778955 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w669\" (UniqueName: \"kubernetes.io/projected/e20c225e-bf93-46af-a2d3-f3ddaadc3bbd-kube-api-access-5w669\") pod \"node-ca-xq5bm\" (UID: \"e20c225e-bf93-46af-a2d3-f3ddaadc3bbd\") " pod="openshift-image-registry/node-ca-xq5bm" Aug 04 10:37:31.779051 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.778980 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-host-run-k8s-cni-cncf-io\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.779051 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779003 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-host-var-lib-kubelet\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.779051 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779028 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-multus-conf-dir\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.779240 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779050 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-etc-kubernetes\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.779240 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779072 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/364a423a-fde5-4ab7-bc63-dd73aee4e6b2-konnectivity-ca\") pod \"konnectivity-agent-ctwz9\" (UID: \"364a423a-fde5-4ab7-bc63-dd73aee4e6b2\") " pod="kube-system/konnectivity-agent-ctwz9" Aug 04 10:37:31.779240 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779096 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2dkr\" (UniqueName: \"kubernetes.io/projected/bf0c1197-51b3-4912-8503-9d06553abdc0-kube-api-access-s2dkr\") pod \"node-resolver-dz4jf\" (UID: \"bf0c1197-51b3-4912-8503-9d06553abdc0\") " pod="openshift-dns/node-resolver-dz4jf" Aug 04 10:37:31.779240 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779121 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm4mh\" (UniqueName: \"kubernetes.io/projected/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-kube-api-access-rm4mh\") pod \"network-metrics-daemon-2lbrm\" (UID: \"49fd00b0-8477-48c3-bbde-aa2c9ef5df76\") " pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:37:31.779240 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779144 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-host-var-lib-cni-multus\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.779240 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779166 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrn44\" (UniqueName: \"kubernetes.io/projected/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-kube-api-access-nrn44\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.779240 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779191 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Aug 04 10:37:31.779240 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779214 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn5bm\" (UniqueName: \"kubernetes.io/projected/c1d7a4bf-2499-43ac-9714-004492eafc30-kube-api-access-vn5bm\") pod \"multus-additional-cni-plugins-4627p\" (UID: \"c1d7a4bf-2499-43ac-9714-004492eafc30\") " pod="openshift-multus/multus-additional-cni-plugins-4627p" Aug 04 10:37:31.779240 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779221 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Aug 04 10:37:31.779240 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779239 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e20c225e-bf93-46af-a2d3-f3ddaadc3bbd-host\") pod \"node-ca-xq5bm\" (UID: \"e20c225e-bf93-46af-a2d3-f3ddaadc3bbd\") " pod="openshift-image-registry/node-ca-xq5bm" Aug 04 10:37:31.779797 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779248 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qp6sn\"" Aug 04 10:37:31.779797 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779261 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e20c225e-bf93-46af-a2d3-f3ddaadc3bbd-serviceca\") pod \"node-ca-xq5bm\" (UID: \"e20c225e-bf93-46af-a2d3-f3ddaadc3bbd\") " pod="openshift-image-registry/node-ca-xq5bm" Aug 04 10:37:31.779797 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779285 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c1d7a4bf-2499-43ac-9714-004492eafc30-cni-binary-copy\") pod \"multus-additional-cni-plugins-4627p\" (UID: \"c1d7a4bf-2499-43ac-9714-004492eafc30\") " pod="openshift-multus/multus-additional-cni-plugins-4627p" Aug 04 10:37:31.779797 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779307 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nqdv6\"" Aug 04 10:37:31.779797 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779239 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Aug 04 10:37:31.779797 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779307 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-multus-daemon-config\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.779797 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779409 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-host-run-multus-certs\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.779797 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779433 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhg96\" (UniqueName: \"kubernetes.io/projected/f60ee252-a9b6-404e-bd02-4b235c92facd-kube-api-access-fhg96\") pod \"network-check-target-wfs5z\" (UID: \"f60ee252-a9b6-404e-bd02-4b235c92facd\") " pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:37:31.779797 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779458 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c1d7a4bf-2499-43ac-9714-004492eafc30-cnibin\") pod \"multus-additional-cni-plugins-4627p\" (UID: \"c1d7a4bf-2499-43ac-9714-004492eafc30\") " pod="openshift-multus/multus-additional-cni-plugins-4627p" Aug 04 10:37:31.779797 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779480 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf0c1197-51b3-4912-8503-9d06553abdc0-hosts-file\") pod \"node-resolver-dz4jf\" (UID: \"bf0c1197-51b3-4912-8503-9d06553abdc0\") " pod="openshift-dns/node-resolver-dz4jf" Aug 04 10:37:31.779797 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779461 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7bsx6" Aug 04 10:37:31.779797 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779512 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs\") pod \"network-metrics-daemon-2lbrm\" (UID: \"49fd00b0-8477-48c3-bbde-aa2c9ef5df76\") " pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:37:31.779797 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779499 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Aug 04 10:37:31.779797 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779550 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-49rzq\"" Aug 04 10:37:31.779797 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779625 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Aug 04 10:37:31.779797 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779541 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-multus-cni-dir\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.779797 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779677 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-multus-socket-dir-parent\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.779797 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779703 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-host-var-lib-cni-bin\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.779797 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779729 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c1d7a4bf-2499-43ac-9714-004492eafc30-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4627p\" (UID: \"c1d7a4bf-2499-43ac-9714-004492eafc30\") " pod="openshift-multus/multus-additional-cni-plugins-4627p" Aug 04 10:37:31.779797 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779755 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-os-release\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.780725 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.779777 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/364a423a-fde5-4ab7-bc63-dd73aee4e6b2-agent-certs\") pod \"konnectivity-agent-ctwz9\" (UID: \"364a423a-fde5-4ab7-bc63-dd73aee4e6b2\") " pod="kube-system/konnectivity-agent-ctwz9" Aug 04 10:37:31.780782 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.780762 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Aug 04 10:37:31.781088 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.781073 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.781978 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.781960 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Aug 04 10:37:31.782515 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.782473 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:31.782614 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:31.782542 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98bfx" podUID="9f33312d-b1fd-4589-8066-42a262738f91" Aug 04 10:37:31.783140 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.783121 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Aug 04 10:37:31.783340 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.783326 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4frx8\"" Aug 04 10:37:31.783845 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.783821 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Aug 04 10:37:31.783930 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.783847 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Aug 04 10:37:31.784021 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.784008 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cpp52\"" Aug 04 10:37:31.784212 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.784196 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Aug 04 10:37:31.784212 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.784209 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Aug 04 10:37:31.784544 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.784529 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Aug 04 10:37:31.787011 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.786994 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Aug 04 10:37:31.787382 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.787363 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z2nlr\"" Aug 04 10:37:31.787727 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.787709 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Aug 04 10:37:31.787814 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.787709 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Aug 04 10:37:31.787814 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.787750 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Aug 04 10:37:31.799336 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.798912 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 04 10:37:31.821948 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.821930 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cnpkp" Aug 04 10:37:31.837433 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.837411 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cnpkp" Aug 04 10:37:31.869086 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.869063 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Aug 04 10:37:31.881131 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881048 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-systemd-units\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.881131 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881116 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-var-lib-openvswitch\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.881272 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881139 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/28af1687-bc47-47cc-975f-c103486551ee-ovnkube-config\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.881272 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881197 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c1d7a4bf-2499-43ac-9714-004492eafc30-os-release\") pod \"multus-additional-cni-plugins-4627p\" (UID: \"c1d7a4bf-2499-43ac-9714-004492eafc30\") " pod="openshift-multus/multus-additional-cni-plugins-4627p" Aug 04 10:37:31.881272 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881237 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-cnibin\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.881272 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881265 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-var-lib-kubelet\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.881494 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881290 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-host\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.881494 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881315 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9535b521-046d-4fb4-bd37-c88e6cee2e59-iptables-alerter-script\") pod \"iptables-alerter-7bsx6\" (UID: \"9535b521-046d-4fb4-bd37-c88e6cee2e59\") " pod="openshift-network-operator/iptables-alerter-7bsx6" Aug 04 10:37:31.881494 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881341 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82hks\" (UniqueName: \"kubernetes.io/projected/28af1687-bc47-47cc-975f-c103486551ee-kube-api-access-82hks\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.881494 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881347 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c1d7a4bf-2499-43ac-9714-004492eafc30-os-release\") pod \"multus-additional-cni-plugins-4627p\" (UID: \"c1d7a4bf-2499-43ac-9714-004492eafc30\") " pod="openshift-multus/multus-additional-cni-plugins-4627p" Aug 04 10:37:31.881494 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881366 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c1d7a4bf-2499-43ac-9714-004492eafc30-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4627p\" (UID: \"c1d7a4bf-2499-43ac-9714-004492eafc30\") " pod="openshift-multus/multus-additional-cni-plugins-4627p" Aug 04 10:37:31.881494 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881445 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-cnibin\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.881494 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881480 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf0c1197-51b3-4912-8503-9d06553abdc0-tmp-dir\") pod \"node-resolver-dz4jf\" (UID: \"bf0c1197-51b3-4912-8503-9d06553abdc0\") " pod="openshift-dns/node-resolver-dz4jf" Aug 04 10:37:31.881828 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881503 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-system-cni-dir\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.881828 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881530 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-host-run-netns\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.881828 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881535 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c1d7a4bf-2499-43ac-9714-004492eafc30-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4627p\" (UID: \"c1d7a4bf-2499-43ac-9714-004492eafc30\") " pod="openshift-multus/multus-additional-cni-plugins-4627p" Aug 04 10:37:31.881828 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881573 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-host-run-netns\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.881828 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881607 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w669\" (UniqueName: \"kubernetes.io/projected/e20c225e-bf93-46af-a2d3-f3ddaadc3bbd-kube-api-access-5w669\") pod \"node-ca-xq5bm\" (UID: \"e20c225e-bf93-46af-a2d3-f3ddaadc3bbd\") " pod="openshift-image-registry/node-ca-xq5bm" Aug 04 10:37:31.881828 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881635 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-etc-sysconfig\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.881828 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881658 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-node-log\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.881828 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881682 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-host-cni-netd\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.881828 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881716 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/364a423a-fde5-4ab7-bc63-dd73aee4e6b2-konnectivity-ca\") pod \"konnectivity-agent-ctwz9\" (UID: \"364a423a-fde5-4ab7-bc63-dd73aee4e6b2\") " pod="kube-system/konnectivity-agent-ctwz9" Aug 04 10:37:31.881828 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881739 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-lib-modules\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.881828 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881788 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b90f86f8-e151-4bb8-829d-3dcae834140e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qwjpj\" (UID: \"b90f86f8-e151-4bb8-829d-3dcae834140e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" Aug 04 10:37:31.881828 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881819 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf0c1197-51b3-4912-8503-9d06553abdc0-tmp-dir\") pod \"node-resolver-dz4jf\" (UID: \"bf0c1197-51b3-4912-8503-9d06553abdc0\") " pod="openshift-dns/node-resolver-dz4jf" Aug 04 10:37:31.881828 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881827 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrn44\" (UniqueName: \"kubernetes.io/projected/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-kube-api-access-nrn44\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.882533 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881828 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-system-cni-dir\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.882533 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881859 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn5bm\" (UniqueName: \"kubernetes.io/projected/c1d7a4bf-2499-43ac-9714-004492eafc30-kube-api-access-vn5bm\") pod \"multus-additional-cni-plugins-4627p\" (UID: \"c1d7a4bf-2499-43ac-9714-004492eafc30\") " pod="openshift-multus/multus-additional-cni-plugins-4627p" Aug 04 10:37:31.882533 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881887 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-sys\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.882533 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881908 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-log-socket\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.882533 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881929 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-host-cni-bin\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.882533 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881951 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c1d7a4bf-2499-43ac-9714-004492eafc30-cni-binary-copy\") pod \"multus-additional-cni-plugins-4627p\" (UID: \"c1d7a4bf-2499-43ac-9714-004492eafc30\") " pod="openshift-multus/multus-additional-cni-plugins-4627p" Aug 04 10:37:31.882533 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881974 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-host-run-multus-certs\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.882533 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.881997 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhg96\" (UniqueName: \"kubernetes.io/projected/f60ee252-a9b6-404e-bd02-4b235c92facd-kube-api-access-fhg96\") pod \"network-check-target-wfs5z\" (UID: \"f60ee252-a9b6-404e-bd02-4b235c92facd\") " pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:37:31.882533 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba5dfdef-6cac-4db4-968f-51c021836632-etc-tuned\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.882533 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882044 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6s5v\" (UniqueName: \"kubernetes.io/projected/b90f86f8-e151-4bb8-829d-3dcae834140e-kube-api-access-d6s5v\") pod \"aws-ebs-csi-driver-node-qwjpj\" (UID: \"b90f86f8-e151-4bb8-829d-3dcae834140e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" Aug 04 10:37:31.882533 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882069 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-run-ovn\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.882533 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882087 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-host-run-multus-certs\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.882533 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882092 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/28af1687-bc47-47cc-975f-c103486551ee-ovn-node-metrics-cert\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.882533 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882115 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9f33312d-b1fd-4589-8066-42a262738f91-dbus\") pod \"global-pull-secret-syncer-98bfx\" (UID: \"9f33312d-b1fd-4589-8066-42a262738f91\") " pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:31.882533 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882140 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs\") pod \"network-metrics-daemon-2lbrm\" (UID: \"49fd00b0-8477-48c3-bbde-aa2c9ef5df76\") " pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:37:31.882533 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882163 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-multus-cni-dir\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.882533 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882187 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-host-var-lib-cni-bin\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.883311 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882210 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-run\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.883311 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882232 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.883311 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882258 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c1d7a4bf-2499-43ac-9714-004492eafc30-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4627p\" (UID: \"c1d7a4bf-2499-43ac-9714-004492eafc30\") " pod="openshift-multus/multus-additional-cni-plugins-4627p" Aug 04 10:37:31.883311 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882286 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-os-release\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.883311 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882312 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-cni-binary-copy\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.883311 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882341 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/364a423a-fde5-4ab7-bc63-dd73aee4e6b2-konnectivity-ca\") pod \"konnectivity-agent-ctwz9\" (UID: \"364a423a-fde5-4ab7-bc63-dd73aee4e6b2\") " pod="kube-system/konnectivity-agent-ctwz9" Aug 04 10:37:31.883311 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882362 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-host-var-lib-cni-bin\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.883311 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882365 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-hostroot\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.883311 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882436 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b90f86f8-e151-4bb8-829d-3dcae834140e-registration-dir\") pod \"aws-ebs-csi-driver-node-qwjpj\" (UID: \"b90f86f8-e151-4bb8-829d-3dcae834140e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" Aug 04 10:37:31.883311 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:31.882478 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 10:37:31.883311 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882507 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b90f86f8-e151-4bb8-829d-3dcae834140e-device-dir\") pod \"aws-ebs-csi-driver-node-qwjpj\" (UID: \"b90f86f8-e151-4bb8-829d-3dcae834140e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" Aug 04 10:37:31.883311 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882535 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-host-kubelet\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.883311 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882538 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-multus-cni-dir\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.883311 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882540 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c1d7a4bf-2499-43ac-9714-004492eafc30-cni-binary-copy\") pod \"multus-additional-cni-plugins-4627p\" (UID: \"c1d7a4bf-2499-43ac-9714-004492eafc30\") " pod="openshift-multus/multus-additional-cni-plugins-4627p" Aug 04 10:37:31.883311 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:31.882548 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs podName:49fd00b0-8477-48c3-bbde-aa2c9ef5df76 nodeName:}" failed. No retries permitted until 2026-08-04 10:37:32.38252908 +0000 UTC m=+2.981433433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs") pod "network-metrics-daemon-2lbrm" (UID: "49fd00b0-8477-48c3-bbde-aa2c9ef5df76") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 10:37:31.883311 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882614 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-hostroot\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.883311 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882625 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-os-release\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.884111 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882684 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-run-systemd\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.884111 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882711 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1d7a4bf-2499-43ac-9714-004492eafc30-system-cni-dir\") pod \"multus-additional-cni-plugins-4627p\" (UID: \"c1d7a4bf-2499-43ac-9714-004492eafc30\") " pod="openshift-multus/multus-additional-cni-plugins-4627p" Aug 04 10:37:31.884111 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882737 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c1d7a4bf-2499-43ac-9714-004492eafc30-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4627p\" (UID: \"c1d7a4bf-2499-43ac-9714-004492eafc30\") " pod="openshift-multus/multus-additional-cni-plugins-4627p" Aug 04 10:37:31.884111 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882760 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-etc-systemd\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.884111 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882781 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scg8j\" (UniqueName: \"kubernetes.io/projected/ba5dfdef-6cac-4db4-968f-51c021836632-kube-api-access-scg8j\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.884111 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882817 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b90f86f8-e151-4bb8-829d-3dcae834140e-sys-fs\") pod \"aws-ebs-csi-driver-node-qwjpj\" (UID: \"b90f86f8-e151-4bb8-829d-3dcae834140e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" Aug 04 10:37:31.884111 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882864 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-cni-binary-copy\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.884111 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882929 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-run-openvswitch\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.884111 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882938 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1d7a4bf-2499-43ac-9714-004492eafc30-system-cni-dir\") pod \"multus-additional-cni-plugins-4627p\" (UID: \"c1d7a4bf-2499-43ac-9714-004492eafc30\") " pod="openshift-multus/multus-additional-cni-plugins-4627p" Aug 04 10:37:31.884111 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882958 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-host-run-k8s-cni-cncf-io\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.884111 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882963 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c1d7a4bf-2499-43ac-9714-004492eafc30-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4627p\" (UID: \"c1d7a4bf-2499-43ac-9714-004492eafc30\") " pod="openshift-multus/multus-additional-cni-plugins-4627p" Aug 04 10:37:31.884111 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882980 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-host-var-lib-kubelet\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.884111 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.882996 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-multus-conf-dir\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.884111 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883015 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-etc-kubernetes\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.884111 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883041 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-etc-kubernetes\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.884111 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883053 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-etc-kubernetes\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.884111 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883059 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-multus-conf-dir\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.884835 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883052 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-host-var-lib-kubelet\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.884835 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-host-slash\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.884835 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883016 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-host-run-k8s-cni-cncf-io\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.884835 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883092 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-host-run-netns\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.884835 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883108 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2dkr\" (UniqueName: \"kubernetes.io/projected/bf0c1197-51b3-4912-8503-9d06553abdc0-kube-api-access-s2dkr\") pod \"node-resolver-dz4jf\" (UID: \"bf0c1197-51b3-4912-8503-9d06553abdc0\") " pod="openshift-dns/node-resolver-dz4jf" Aug 04 10:37:31.884835 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883131 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm4mh\" (UniqueName: \"kubernetes.io/projected/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-kube-api-access-rm4mh\") pod \"network-metrics-daemon-2lbrm\" (UID: \"49fd00b0-8477-48c3-bbde-aa2c9ef5df76\") " pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:37:31.884835 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883154 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-host-var-lib-cni-multus\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.884835 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883220 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c1d7a4bf-2499-43ac-9714-004492eafc30-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4627p\" (UID: \"c1d7a4bf-2499-43ac-9714-004492eafc30\") " pod="openshift-multus/multus-additional-cni-plugins-4627p" Aug 04 10:37:31.884835 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883208 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-host-var-lib-cni-multus\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.884835 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883291 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-etc-sysctl-conf\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.884835 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883323 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b90f86f8-e151-4bb8-829d-3dcae834140e-socket-dir\") pod \"aws-ebs-csi-driver-node-qwjpj\" (UID: \"b90f86f8-e151-4bb8-829d-3dcae834140e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" Aug 04 10:37:31.884835 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883352 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9535b521-046d-4fb4-bd37-c88e6cee2e59-host-slash\") pod \"iptables-alerter-7bsx6\" (UID: \"9535b521-046d-4fb4-bd37-c88e6cee2e59\") " pod="openshift-network-operator/iptables-alerter-7bsx6" Aug 04 10:37:31.884835 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/28af1687-bc47-47cc-975f-c103486551ee-env-overrides\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.884835 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e20c225e-bf93-46af-a2d3-f3ddaadc3bbd-host\") pod \"node-ca-xq5bm\" (UID: \"e20c225e-bf93-46af-a2d3-f3ddaadc3bbd\") " pod="openshift-image-registry/node-ca-xq5bm" Aug 04 10:37:31.884835 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883446 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e20c225e-bf93-46af-a2d3-f3ddaadc3bbd-serviceca\") pod \"node-ca-xq5bm\" (UID: \"e20c225e-bf93-46af-a2d3-f3ddaadc3bbd\") " pod="openshift-image-registry/node-ca-xq5bm" Aug 04 10:37:31.884835 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883459 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e20c225e-bf93-46af-a2d3-f3ddaadc3bbd-host\") pod \"node-ca-xq5bm\" (UID: \"e20c225e-bf93-46af-a2d3-f3ddaadc3bbd\") " pod="openshift-image-registry/node-ca-xq5bm" Aug 04 10:37:31.884835 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883469 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-etc-sysctl-d\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.885569 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883492 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b90f86f8-e151-4bb8-829d-3dcae834140e-etc-selinux\") pod \"aws-ebs-csi-driver-node-qwjpj\" (UID: \"b90f86f8-e151-4bb8-829d-3dcae834140e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" Aug 04 10:37:31.885569 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883515 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9f33312d-b1fd-4589-8066-42a262738f91-kubelet-config\") pod \"global-pull-secret-syncer-98bfx\" (UID: \"9f33312d-b1fd-4589-8066-42a262738f91\") " pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:31.885569 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883556 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f33312d-b1fd-4589-8066-42a262738f91-original-pull-secret\") pod \"global-pull-secret-syncer-98bfx\" (UID: \"9f33312d-b1fd-4589-8066-42a262738f91\") " pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:31.885569 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883590 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-multus-daemon-config\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.885569 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883621 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-etc-openvswitch\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.885569 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883650 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.885569 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883680 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c1d7a4bf-2499-43ac-9714-004492eafc30-cnibin\") pod \"multus-additional-cni-plugins-4627p\" (UID: \"c1d7a4bf-2499-43ac-9714-004492eafc30\") " pod="openshift-multus/multus-additional-cni-plugins-4627p" Aug 04 10:37:31.885569 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883730 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c1d7a4bf-2499-43ac-9714-004492eafc30-cnibin\") pod \"multus-additional-cni-plugins-4627p\" (UID: \"c1d7a4bf-2499-43ac-9714-004492eafc30\") " pod="openshift-multus/multus-additional-cni-plugins-4627p" Aug 04 10:37:31.885569 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf0c1197-51b3-4912-8503-9d06553abdc0-hosts-file\") pod \"node-resolver-dz4jf\" (UID: \"bf0c1197-51b3-4912-8503-9d06553abdc0\") " pod="openshift-dns/node-resolver-dz4jf" Aug 04 10:37:31.885569 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883811 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-multus-socket-dir-parent\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.885569 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883840 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-etc-modprobe-d\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.885569 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883857 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e20c225e-bf93-46af-a2d3-f3ddaadc3bbd-serviceca\") pod \"node-ca-xq5bm\" (UID: \"e20c225e-bf93-46af-a2d3-f3ddaadc3bbd\") " pod="openshift-image-registry/node-ca-xq5bm" Aug 04 10:37:31.885569 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnpsh\" (UniqueName: \"kubernetes.io/projected/9535b521-046d-4fb4-bd37-c88e6cee2e59-kube-api-access-mnpsh\") pod \"iptables-alerter-7bsx6\" (UID: \"9535b521-046d-4fb4-bd37-c88e6cee2e59\") " pod="openshift-network-operator/iptables-alerter-7bsx6" Aug 04 10:37:31.885569 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883912 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/28af1687-bc47-47cc-975f-c103486551ee-ovnkube-script-lib\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.885569 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883917 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf0c1197-51b3-4912-8503-9d06553abdc0-hosts-file\") pod \"node-resolver-dz4jf\" (UID: \"bf0c1197-51b3-4912-8503-9d06553abdc0\") " pod="openshift-dns/node-resolver-dz4jf" Aug 04 10:37:31.885569 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883938 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/364a423a-fde5-4ab7-bc63-dd73aee4e6b2-agent-certs\") pod \"konnectivity-agent-ctwz9\" (UID: \"364a423a-fde5-4ab7-bc63-dd73aee4e6b2\") " pod="kube-system/konnectivity-agent-ctwz9" Aug 04 10:37:31.885569 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883961 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba5dfdef-6cac-4db4-968f-51c021836632-tmp\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.886316 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.883973 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-multus-socket-dir-parent\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.886316 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.884194 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-multus-daemon-config\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.886316 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.884303 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Aug 04 10:37:31.891925 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.889003 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/364a423a-fde5-4ab7-bc63-dd73aee4e6b2-agent-certs\") pod \"konnectivity-agent-ctwz9\" (UID: \"364a423a-fde5-4ab7-bc63-dd73aee4e6b2\") " pod="kube-system/konnectivity-agent-ctwz9" Aug 04 10:37:31.895781 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:31.895761 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 10:37:31.895880 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:31.895787 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 10:37:31.895880 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:31.895801 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fhg96 for pod openshift-network-diagnostics/network-check-target-wfs5z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 10:37:31.895880 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:31.895867 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f60ee252-a9b6-404e-bd02-4b235c92facd-kube-api-access-fhg96 podName:f60ee252-a9b6-404e-bd02-4b235c92facd nodeName:}" failed. No retries permitted until 2026-08-04 10:37:32.395848374 +0000 UTC m=+2.994752749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fhg96" (UniqueName: "kubernetes.io/projected/f60ee252-a9b6-404e-bd02-4b235c92facd-kube-api-access-fhg96") pod "network-check-target-wfs5z" (UID: "f60ee252-a9b6-404e-bd02-4b235c92facd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 10:37:31.905417 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.897763 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w669\" (UniqueName: \"kubernetes.io/projected/e20c225e-bf93-46af-a2d3-f3ddaadc3bbd-kube-api-access-5w669\") pod \"node-ca-xq5bm\" (UID: \"e20c225e-bf93-46af-a2d3-f3ddaadc3bbd\") " pod="openshift-image-registry/node-ca-xq5bm" Aug 04 10:37:31.905417 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.898999 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2dkr\" (UniqueName: \"kubernetes.io/projected/bf0c1197-51b3-4912-8503-9d06553abdc0-kube-api-access-s2dkr\") pod \"node-resolver-dz4jf\" (UID: \"bf0c1197-51b3-4912-8503-9d06553abdc0\") " pod="openshift-dns/node-resolver-dz4jf" Aug 04 10:37:31.905417 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.899591 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm4mh\" (UniqueName: \"kubernetes.io/projected/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-kube-api-access-rm4mh\") pod \"network-metrics-daemon-2lbrm\" (UID: \"49fd00b0-8477-48c3-bbde-aa2c9ef5df76\") " pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:37:31.905417 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.900314 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn5bm\" (UniqueName: \"kubernetes.io/projected/c1d7a4bf-2499-43ac-9714-004492eafc30-kube-api-access-vn5bm\") pod \"multus-additional-cni-plugins-4627p\" (UID: \"c1d7a4bf-2499-43ac-9714-004492eafc30\") " pod="openshift-multus/multus-additional-cni-plugins-4627p" Aug 04 10:37:31.905417 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.902042 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrn44\" (UniqueName: \"kubernetes.io/projected/48f0bcb8-ecf4-457c-991a-12e6fd0aaec8-kube-api-access-nrn44\") pod \"multus-k4w4p\" (UID: \"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8\") " pod="openshift-multus/multus-k4w4p" Aug 04 10:37:31.928303 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.928277 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-102.ec2.internal" event={"ID":"d977d9685f76e65bd3916a0635d4beb4","Type":"ContainerStarted","Data":"6c39ced8344c8aa73d32c3f57707870c69e6c21bc23463ff0fed2fdc777971cc"} Aug 04 10:37:31.984332 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.984303 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-sys\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.984487 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.984340 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-log-socket\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.984487 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.984371 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-host-cni-bin\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.984487 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.984426 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba5dfdef-6cac-4db4-968f-51c021836632-etc-tuned\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.984487 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.984450 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6s5v\" (UniqueName: \"kubernetes.io/projected/b90f86f8-e151-4bb8-829d-3dcae834140e-kube-api-access-d6s5v\") pod \"aws-ebs-csi-driver-node-qwjpj\" (UID: \"b90f86f8-e151-4bb8-829d-3dcae834140e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" Aug 04 10:37:31.984487 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.984472 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-run-ovn\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.984744 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.984493 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/28af1687-bc47-47cc-975f-c103486551ee-ovn-node-metrics-cert\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.984744 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.984525 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9f33312d-b1fd-4589-8066-42a262738f91-dbus\") pod \"global-pull-secret-syncer-98bfx\" (UID: \"9f33312d-b1fd-4589-8066-42a262738f91\") " pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:31.984744 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.984562 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-run\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.984744 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.984586 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.984744 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.984616 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b90f86f8-e151-4bb8-829d-3dcae834140e-registration-dir\") pod \"aws-ebs-csi-driver-node-qwjpj\" (UID: \"b90f86f8-e151-4bb8-829d-3dcae834140e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" Aug 04 10:37:31.984744 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.984642 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b90f86f8-e151-4bb8-829d-3dcae834140e-device-dir\") pod \"aws-ebs-csi-driver-node-qwjpj\" (UID: \"b90f86f8-e151-4bb8-829d-3dcae834140e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" Aug 04 10:37:31.984744 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.984668 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-host-kubelet\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.984744 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.984692 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-run-systemd\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.984744 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.984719 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-etc-systemd\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.984744 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.984743 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scg8j\" (UniqueName: \"kubernetes.io/projected/ba5dfdef-6cac-4db4-968f-51c021836632-kube-api-access-scg8j\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.985206 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.984765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b90f86f8-e151-4bb8-829d-3dcae834140e-sys-fs\") pod \"aws-ebs-csi-driver-node-qwjpj\" (UID: \"b90f86f8-e151-4bb8-829d-3dcae834140e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" Aug 04 10:37:31.985206 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.984805 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-run-openvswitch\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.985206 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.984834 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-etc-kubernetes\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.985206 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.984868 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-host-slash\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.985206 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.984894 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-host-run-netns\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.985206 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.984922 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-etc-sysctl-conf\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.985206 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.984945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b90f86f8-e151-4bb8-829d-3dcae834140e-socket-dir\") pod \"aws-ebs-csi-driver-node-qwjpj\" (UID: \"b90f86f8-e151-4bb8-829d-3dcae834140e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" Aug 04 10:37:31.985206 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.984969 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9535b521-046d-4fb4-bd37-c88e6cee2e59-host-slash\") pod \"iptables-alerter-7bsx6\" (UID: \"9535b521-046d-4fb4-bd37-c88e6cee2e59\") " pod="openshift-network-operator/iptables-alerter-7bsx6" Aug 04 10:37:31.985206 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.984992 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/28af1687-bc47-47cc-975f-c103486551ee-env-overrides\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.985206 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.985019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-etc-sysctl-d\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.985206 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.985052 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b90f86f8-e151-4bb8-829d-3dcae834140e-etc-selinux\") pod \"aws-ebs-csi-driver-node-qwjpj\" (UID: \"b90f86f8-e151-4bb8-829d-3dcae834140e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" Aug 04 10:37:31.985206 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.985075 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9f33312d-b1fd-4589-8066-42a262738f91-kubelet-config\") pod \"global-pull-secret-syncer-98bfx\" (UID: \"9f33312d-b1fd-4589-8066-42a262738f91\") " pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:31.985206 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.985100 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f33312d-b1fd-4589-8066-42a262738f91-original-pull-secret\") pod \"global-pull-secret-syncer-98bfx\" (UID: \"9f33312d-b1fd-4589-8066-42a262738f91\") " pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:31.985206 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.985124 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-etc-openvswitch\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.985206 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.985153 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.985206 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.985183 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-etc-modprobe-d\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.985987 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.985238 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnpsh\" (UniqueName: \"kubernetes.io/projected/9535b521-046d-4fb4-bd37-c88e6cee2e59-kube-api-access-mnpsh\") pod \"iptables-alerter-7bsx6\" (UID: \"9535b521-046d-4fb4-bd37-c88e6cee2e59\") " pod="openshift-network-operator/iptables-alerter-7bsx6" Aug 04 10:37:31.985987 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.985291 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/28af1687-bc47-47cc-975f-c103486551ee-ovnkube-script-lib\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.985987 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.985317 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba5dfdef-6cac-4db4-968f-51c021836632-tmp\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.985987 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.985341 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-systemd-units\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.985987 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.985367 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-var-lib-openvswitch\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.985987 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.985409 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/28af1687-bc47-47cc-975f-c103486551ee-ovnkube-config\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.985987 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.985438 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-var-lib-kubelet\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.985987 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.985463 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-host\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.985987 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.985488 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9535b521-046d-4fb4-bd37-c88e6cee2e59-iptables-alerter-script\") pod \"iptables-alerter-7bsx6\" (UID: \"9535b521-046d-4fb4-bd37-c88e6cee2e59\") " pod="openshift-network-operator/iptables-alerter-7bsx6" Aug 04 10:37:31.985987 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.985513 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82hks\" (UniqueName: \"kubernetes.io/projected/28af1687-bc47-47cc-975f-c103486551ee-kube-api-access-82hks\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.985987 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.985544 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-etc-sysconfig\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.985987 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.985568 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-node-log\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.985987 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.985599 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-host-cni-netd\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.985987 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.985625 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-lib-modules\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.985987 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.985648 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b90f86f8-e151-4bb8-829d-3dcae834140e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qwjpj\" (UID: \"b90f86f8-e151-4bb8-829d-3dcae834140e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" Aug 04 10:37:31.985987 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.985790 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b90f86f8-e151-4bb8-829d-3dcae834140e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qwjpj\" (UID: \"b90f86f8-e151-4bb8-829d-3dcae834140e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" Aug 04 10:37:31.985987 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.985847 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-sys\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.986786 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.985887 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-log-socket\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.986786 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.985923 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-host-cni-bin\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.986786 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.986372 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-run\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.986786 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.986378 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b90f86f8-e151-4bb8-829d-3dcae834140e-registration-dir\") pod \"aws-ebs-csi-driver-node-qwjpj\" (UID: \"b90f86f8-e151-4bb8-829d-3dcae834140e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" Aug 04 10:37:31.986786 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.986443 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.986786 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.986460 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b90f86f8-e151-4bb8-829d-3dcae834140e-device-dir\") pod \"aws-ebs-csi-driver-node-qwjpj\" (UID: \"b90f86f8-e151-4bb8-829d-3dcae834140e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" Aug 04 10:37:31.986786 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.986500 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-host-kubelet\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.986786 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.986656 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-host-slash\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.986786 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.986690 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-run-ovn\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.986786 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.986705 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-etc-kubernetes\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.986786 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.986713 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-host-run-netns\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.986786 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.986756 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-etc-systemd\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.986786 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.986762 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9f33312d-b1fd-4589-8066-42a262738f91-dbus\") pod \"global-pull-secret-syncer-98bfx\" (UID: \"9f33312d-b1fd-4589-8066-42a262738f91\") " pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:31.986786 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.986773 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9f33312d-b1fd-4589-8066-42a262738f91-kubelet-config\") pod \"global-pull-secret-syncer-98bfx\" (UID: \"9f33312d-b1fd-4589-8066-42a262738f91\") " pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:31.987384 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.986807 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-run-openvswitch\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.987384 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.986824 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b90f86f8-e151-4bb8-829d-3dcae834140e-sys-fs\") pod \"aws-ebs-csi-driver-node-qwjpj\" (UID: \"b90f86f8-e151-4bb8-829d-3dcae834140e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" Aug 04 10:37:31.987384 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.986860 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-run-systemd\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.987384 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.986887 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-etc-sysctl-d\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.987384 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.986943 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-etc-sysctl-conf\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.987384 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.986973 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b90f86f8-e151-4bb8-829d-3dcae834140e-socket-dir\") pod \"aws-ebs-csi-driver-node-qwjpj\" (UID: \"b90f86f8-e151-4bb8-829d-3dcae834140e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" Aug 04 10:37:31.987384 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.986987 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9535b521-046d-4fb4-bd37-c88e6cee2e59-host-slash\") pod \"iptables-alerter-7bsx6\" (UID: \"9535b521-046d-4fb4-bd37-c88e6cee2e59\") " pod="openshift-network-operator/iptables-alerter-7bsx6" Aug 04 10:37:31.987384 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.987030 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-var-lib-openvswitch\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.987384 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.987052 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b90f86f8-e151-4bb8-829d-3dcae834140e-etc-selinux\") pod \"aws-ebs-csi-driver-node-qwjpj\" (UID: \"b90f86f8-e151-4bb8-829d-3dcae834140e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" Aug 04 10:37:31.987384 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:31.987076 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 10:37:31.987384 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.987105 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-etc-modprobe-d\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.987384 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:31.987152 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f33312d-b1fd-4589-8066-42a262738f91-original-pull-secret podName:9f33312d-b1fd-4589-8066-42a262738f91 nodeName:}" failed. No retries permitted until 2026-08-04 10:37:32.487132938 +0000 UTC m=+3.086037311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f33312d-b1fd-4589-8066-42a262738f91-original-pull-secret") pod "global-pull-secret-syncer-98bfx" (UID: "9f33312d-b1fd-4589-8066-42a262738f91") : object "kube-system"/"original-pull-secret" not registered Aug 04 10:37:31.987384 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.987194 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-etc-openvswitch\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.987384 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.987366 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-var-lib-kubelet\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.988058 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.987432 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.988058 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.987442 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/28af1687-bc47-47cc-975f-c103486551ee-env-overrides\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.988058 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.987440 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-host\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.988058 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.987512 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-node-log\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.988058 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.987522 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-etc-sysconfig\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.988058 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.987560 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-host-cni-netd\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.988058 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.987666 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba5dfdef-6cac-4db4-968f-51c021836632-lib-modules\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.988058 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.987710 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/28af1687-bc47-47cc-975f-c103486551ee-systemd-units\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.988058 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.987950 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9535b521-046d-4fb4-bd37-c88e6cee2e59-iptables-alerter-script\") pod \"iptables-alerter-7bsx6\" (UID: \"9535b521-046d-4fb4-bd37-c88e6cee2e59\") " pod="openshift-network-operator/iptables-alerter-7bsx6" Aug 04 10:37:31.988495 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.988199 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/28af1687-bc47-47cc-975f-c103486551ee-ovnkube-config\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.988495 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.988296 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/28af1687-bc47-47cc-975f-c103486551ee-ovnkube-script-lib\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:31.988989 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.988966 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba5dfdef-6cac-4db4-968f-51c021836632-etc-tuned\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.989829 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.989811 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba5dfdef-6cac-4db4-968f-51c021836632-tmp\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:31.991074 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:31.991051 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/28af1687-bc47-47cc-975f-c103486551ee-ovn-node-metrics-cert\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:32.015248 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.015223 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnpsh\" (UniqueName: \"kubernetes.io/projected/9535b521-046d-4fb4-bd37-c88e6cee2e59-kube-api-access-mnpsh\") pod \"iptables-alerter-7bsx6\" (UID: \"9535b521-046d-4fb4-bd37-c88e6cee2e59\") " pod="openshift-network-operator/iptables-alerter-7bsx6" Aug 04 10:37:32.016215 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.016193 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scg8j\" (UniqueName: \"kubernetes.io/projected/ba5dfdef-6cac-4db4-968f-51c021836632-kube-api-access-scg8j\") pod \"tuned-4srtf\" (UID: \"ba5dfdef-6cac-4db4-968f-51c021836632\") " pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:32.016582 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.016560 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6s5v\" (UniqueName: \"kubernetes.io/projected/b90f86f8-e151-4bb8-829d-3dcae834140e-kube-api-access-d6s5v\") pod \"aws-ebs-csi-driver-node-qwjpj\" (UID: \"b90f86f8-e151-4bb8-829d-3dcae834140e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" Aug 04 10:37:32.017491 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.017450 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82hks\" (UniqueName: \"kubernetes.io/projected/28af1687-bc47-47cc-975f-c103486551ee-kube-api-access-82hks\") pod \"ovnkube-node-ltqqw\" (UID: \"28af1687-bc47-47cc-975f-c103486551ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:32.076501 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.076479 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k4w4p" Aug 04 10:37:32.085754 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.085732 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4627p" Aug 04 10:37:32.101092 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.101065 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xq5bm" Aug 04 10:37:32.105912 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.105889 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ctwz9" Aug 04 10:37:32.113944 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.113916 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dz4jf" Aug 04 10:37:32.121916 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.121898 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4srtf" Aug 04 10:37:32.130666 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.130647 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" Aug 04 10:37:32.141492 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.141355 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7bsx6" Aug 04 10:37:32.149222 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.149203 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:32.158801 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:32.158776 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48f0bcb8_ecf4_457c_991a_12e6fd0aaec8.slice/crio-82f7228826e35767771702aa9d3ac6832ff34bde1576bae885d774c84da166bc WatchSource:0}: Error finding container 82f7228826e35767771702aa9d3ac6832ff34bde1576bae885d774c84da166bc: Status 404 returned error can't find the container with id 82f7228826e35767771702aa9d3ac6832ff34bde1576bae885d774c84da166bc Aug 04 10:37:32.160142 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:32.160117 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba5dfdef_6cac_4db4_968f_51c021836632.slice/crio-79087c7d75c452b92c4244212a5ea61ff3640fdd0025b00bce97aaf3060dd348 WatchSource:0}: Error finding container 79087c7d75c452b92c4244212a5ea61ff3640fdd0025b00bce97aaf3060dd348: Status 404 returned error can't find the container with id 79087c7d75c452b92c4244212a5ea61ff3640fdd0025b00bce97aaf3060dd348 Aug 04 10:37:32.164998 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:32.164976 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb90f86f8_e151_4bb8_829d_3dcae834140e.slice/crio-b67d897671aadbd5442add16e0572ec0313536401815f96c19a1014e5e485006 WatchSource:0}: Error finding container b67d897671aadbd5442add16e0572ec0313536401815f96c19a1014e5e485006: Status 404 returned error can't find the container with id b67d897671aadbd5442add16e0572ec0313536401815f96c19a1014e5e485006 Aug 04 10:37:32.168436 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:32.168409 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9535b521_046d_4fb4_bd37_c88e6cee2e59.slice/crio-ceabf94de448746d0611449babedf2e75e7ba43771886b7ccc5dea49810c7036 WatchSource:0}: Error finding container ceabf94de448746d0611449babedf2e75e7ba43771886b7ccc5dea49810c7036: Status 404 returned error can't find the container with id ceabf94de448746d0611449babedf2e75e7ba43771886b7ccc5dea49810c7036 Aug 04 10:37:32.168999 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:37:32.168978 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28af1687_bc47_47cc_975f_c103486551ee.slice/crio-25ae95b49b2c056b492d28a02a4963edb81c259bec54e32fb5b83d0d46aec9ea WatchSource:0}: Error finding container 25ae95b49b2c056b492d28a02a4963edb81c259bec54e32fb5b83d0d46aec9ea: Status 404 returned error can't find the container with id 25ae95b49b2c056b492d28a02a4963edb81c259bec54e32fb5b83d0d46aec9ea Aug 04 10:37:32.389570 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.389346 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs\") pod \"network-metrics-daemon-2lbrm\" (UID: \"49fd00b0-8477-48c3-bbde-aa2c9ef5df76\") " pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:37:32.389696 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:32.389507 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 10:37:32.389696 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:32.389677 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs podName:49fd00b0-8477-48c3-bbde-aa2c9ef5df76 nodeName:}" failed. No retries permitted until 2026-08-04 10:37:33.389655032 +0000 UTC m=+3.988559388 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs") pod "network-metrics-daemon-2lbrm" (UID: "49fd00b0-8477-48c3-bbde-aa2c9ef5df76") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 10:37:32.490161 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.490124 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f33312d-b1fd-4589-8066-42a262738f91-original-pull-secret\") pod \"global-pull-secret-syncer-98bfx\" (UID: \"9f33312d-b1fd-4589-8066-42a262738f91\") " pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:32.490297 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.490172 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhg96\" (UniqueName: \"kubernetes.io/projected/f60ee252-a9b6-404e-bd02-4b235c92facd-kube-api-access-fhg96\") pod \"network-check-target-wfs5z\" (UID: \"f60ee252-a9b6-404e-bd02-4b235c92facd\") " pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:37:32.490297 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:32.490268 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 10:37:32.490297 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:32.490280 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 10:37:32.490463 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:32.490299 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 10:37:32.490463 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:32.490313 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fhg96 for pod openshift-network-diagnostics/network-check-target-wfs5z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 10:37:32.490463 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:32.490337 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f33312d-b1fd-4589-8066-42a262738f91-original-pull-secret podName:9f33312d-b1fd-4589-8066-42a262738f91 nodeName:}" failed. No retries permitted until 2026-08-04 10:37:33.490317752 +0000 UTC m=+4.089222116 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f33312d-b1fd-4589-8066-42a262738f91-original-pull-secret") pod "global-pull-secret-syncer-98bfx" (UID: "9f33312d-b1fd-4589-8066-42a262738f91") : object "kube-system"/"original-pull-secret" not registered Aug 04 10:37:32.490463 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:32.490359 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f60ee252-a9b6-404e-bd02-4b235c92facd-kube-api-access-fhg96 podName:f60ee252-a9b6-404e-bd02-4b235c92facd nodeName:}" failed. No retries permitted until 2026-08-04 10:37:33.490345405 +0000 UTC m=+4.089249758 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fhg96" (UniqueName: "kubernetes.io/projected/f60ee252-a9b6-404e-bd02-4b235c92facd-kube-api-access-fhg96") pod "network-check-target-wfs5z" (UID: "f60ee252-a9b6-404e-bd02-4b235c92facd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 10:37:32.840066 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.840004 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 10:32:31 +0000 UTC" deadline="2028-04-18 18:18:23.42247273 +0000 UTC" Aug 04 10:37:32.840066 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.840066 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14959h40m50.582411026s" Aug 04 10:37:32.922776 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.922750 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:37:32.922947 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:32.922869 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfs5z" podUID="f60ee252-a9b6-404e-bd02-4b235c92facd" Aug 04 10:37:32.934290 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.934259 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xq5bm" event={"ID":"e20c225e-bf93-46af-a2d3-f3ddaadc3bbd","Type":"ContainerStarted","Data":"fbaf5a55e47a8022f78591d04333d21f2c1ee1405f738abb0793f22f9548e084"} Aug 04 10:37:32.936208 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.936185 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" event={"ID":"28af1687-bc47-47cc-975f-c103486551ee","Type":"ContainerStarted","Data":"25ae95b49b2c056b492d28a02a4963edb81c259bec54e32fb5b83d0d46aec9ea"} Aug 04 10:37:32.938891 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.938868 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k4w4p" event={"ID":"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8","Type":"ContainerStarted","Data":"82f7228826e35767771702aa9d3ac6832ff34bde1576bae885d774c84da166bc"} Aug 04 10:37:32.941907 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.941880 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ctwz9" event={"ID":"364a423a-fde5-4ab7-bc63-dd73aee4e6b2","Type":"ContainerStarted","Data":"fa52f40fceb0968fa1c2068c464dc779f5e5ac6e112d161843ea8bc8f426263c"} Aug 04 10:37:32.943569 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.943545 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dz4jf" event={"ID":"bf0c1197-51b3-4912-8503-9d06553abdc0","Type":"ContainerStarted","Data":"f86af079a75859cab1545b1acf1062fc1dc24b6731ff100beb82faecd8279352"} Aug 04 10:37:32.947111 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.947086 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4627p" event={"ID":"c1d7a4bf-2499-43ac-9714-004492eafc30","Type":"ContainerStarted","Data":"b6effb81badbdb7bb7ea3c641193bd80c1dec83fc63fbfba09c0040dc050b661"} Aug 04 10:37:32.951501 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.950658 2576 generic.go:356] "Generic (PLEG): container finished" podID="50afa940563be74492f95ffd26264123" containerID="7c6732ce4ac63d848379288c405aeee9e17a4b7256f1792dff56b0baf3d0afdc" exitCode=0 Aug 04 10:37:32.951501 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.950732 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal" event={"ID":"50afa940563be74492f95ffd26264123","Type":"ContainerDied","Data":"7c6732ce4ac63d848379288c405aeee9e17a4b7256f1792dff56b0baf3d0afdc"} Aug 04 10:37:32.953553 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.953529 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7bsx6" event={"ID":"9535b521-046d-4fb4-bd37-c88e6cee2e59","Type":"ContainerStarted","Data":"ceabf94de448746d0611449babedf2e75e7ba43771886b7ccc5dea49810c7036"} Aug 04 10:37:32.956173 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.955474 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" event={"ID":"b90f86f8-e151-4bb8-829d-3dcae834140e","Type":"ContainerStarted","Data":"b67d897671aadbd5442add16e0572ec0313536401815f96c19a1014e5e485006"} Aug 04 10:37:32.960659 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:32.960605 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4srtf" event={"ID":"ba5dfdef-6cac-4db4-968f-51c021836632","Type":"ContainerStarted","Data":"79087c7d75c452b92c4244212a5ea61ff3640fdd0025b00bce97aaf3060dd348"} Aug 04 10:37:33.401582 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:33.400415 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs\") pod \"network-metrics-daemon-2lbrm\" (UID: \"49fd00b0-8477-48c3-bbde-aa2c9ef5df76\") " pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:37:33.401582 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:33.400607 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 10:37:33.401582 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:33.400663 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs podName:49fd00b0-8477-48c3-bbde-aa2c9ef5df76 nodeName:}" failed. No retries permitted until 2026-08-04 10:37:35.400645268 +0000 UTC m=+5.999549637 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs") pod "network-metrics-daemon-2lbrm" (UID: "49fd00b0-8477-48c3-bbde-aa2c9ef5df76") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 10:37:33.501690 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:33.501375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhg96\" (UniqueName: \"kubernetes.io/projected/f60ee252-a9b6-404e-bd02-4b235c92facd-kube-api-access-fhg96\") pod \"network-check-target-wfs5z\" (UID: \"f60ee252-a9b6-404e-bd02-4b235c92facd\") " pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:37:33.501690 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:33.501468 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f33312d-b1fd-4589-8066-42a262738f91-original-pull-secret\") pod \"global-pull-secret-syncer-98bfx\" (UID: \"9f33312d-b1fd-4589-8066-42a262738f91\") " pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:33.501690 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:33.501518 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 10:37:33.501690 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:33.501537 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 10:37:33.501690 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:33.501543 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 10:37:33.501690 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:33.501551 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fhg96 for pod openshift-network-diagnostics/network-check-target-wfs5z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 10:37:33.501690 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:33.501606 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f33312d-b1fd-4589-8066-42a262738f91-original-pull-secret podName:9f33312d-b1fd-4589-8066-42a262738f91 nodeName:}" failed. No retries permitted until 2026-08-04 10:37:35.50158028 +0000 UTC m=+6.100484647 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f33312d-b1fd-4589-8066-42a262738f91-original-pull-secret") pod "global-pull-secret-syncer-98bfx" (UID: "9f33312d-b1fd-4589-8066-42a262738f91") : object "kube-system"/"original-pull-secret" not registered Aug 04 10:37:33.501690 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:33.501624 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f60ee252-a9b6-404e-bd02-4b235c92facd-kube-api-access-fhg96 podName:f60ee252-a9b6-404e-bd02-4b235c92facd nodeName:}" failed. No retries permitted until 2026-08-04 10:37:35.501614309 +0000 UTC m=+6.100518662 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fhg96" (UniqueName: "kubernetes.io/projected/f60ee252-a9b6-404e-bd02-4b235c92facd-kube-api-access-fhg96") pod "network-check-target-wfs5z" (UID: "f60ee252-a9b6-404e-bd02-4b235c92facd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 10:37:33.842412 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:33.840536 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 10:32:31 +0000 UTC" deadline="2028-05-16 11:19:00.314321398 +0000 UTC" Aug 04 10:37:33.842412 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:33.840573 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15624h41m26.473753117s" Aug 04 10:37:33.925270 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:33.924511 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:33.925270 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:33.924647 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98bfx" podUID="9f33312d-b1fd-4589-8066-42a262738f91" Aug 04 10:37:33.925270 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:33.925074 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:37:33.925270 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:33.925169 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lbrm" podUID="49fd00b0-8477-48c3-bbde-aa2c9ef5df76" Aug 04 10:37:33.965529 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:33.965498 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal" event={"ID":"50afa940563be74492f95ffd26264123","Type":"ContainerStarted","Data":"4e0748203ab1c67b87ce4e2dc9a6983d4c31adccbf0126c829cf6fd75755c8c0"} Aug 04 10:37:33.974784 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:33.974416 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-102.ec2.internal" event={"ID":"d977d9685f76e65bd3916a0635d4beb4","Type":"ContainerStarted","Data":"04ce9cad7b19d6005f60cda5f91076aaa15355f0a301472c5d1b887af53830b2"} Aug 04 10:37:33.984697 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:33.983872 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-102.ec2.internal" podStartSLOduration=2.9838576850000003 podStartE2EDuration="2.983857685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 10:37:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:37:33.983229493 +0000 UTC m=+4.582133869" watchObservedRunningTime="2026-08-04 10:37:33.983857685 +0000 UTC m=+4.582762061" Aug 04 10:37:34.923011 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:34.922798 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:37:34.923011 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:34.922918 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfs5z" podUID="f60ee252-a9b6-404e-bd02-4b235c92facd" Aug 04 10:37:35.416475 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:35.416377 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs\") pod \"network-metrics-daemon-2lbrm\" (UID: \"49fd00b0-8477-48c3-bbde-aa2c9ef5df76\") " pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:37:35.416645 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:35.416560 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 10:37:35.416645 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:35.416625 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs podName:49fd00b0-8477-48c3-bbde-aa2c9ef5df76 nodeName:}" failed. No retries permitted until 2026-08-04 10:37:39.41660698 +0000 UTC m=+10.015511334 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs") pod "network-metrics-daemon-2lbrm" (UID: "49fd00b0-8477-48c3-bbde-aa2c9ef5df76") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 10:37:35.517649 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:35.517583 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f33312d-b1fd-4589-8066-42a262738f91-original-pull-secret\") pod \"global-pull-secret-syncer-98bfx\" (UID: \"9f33312d-b1fd-4589-8066-42a262738f91\") " pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:35.517825 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:35.517666 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhg96\" (UniqueName: \"kubernetes.io/projected/f60ee252-a9b6-404e-bd02-4b235c92facd-kube-api-access-fhg96\") pod \"network-check-target-wfs5z\" (UID: \"f60ee252-a9b6-404e-bd02-4b235c92facd\") " pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:37:35.517915 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:35.517829 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 10:37:35.517915 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:35.517848 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 10:37:35.517915 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:35.517860 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fhg96 for pod openshift-network-diagnostics/network-check-target-wfs5z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 10:37:35.518069 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:35.517929 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f60ee252-a9b6-404e-bd02-4b235c92facd-kube-api-access-fhg96 podName:f60ee252-a9b6-404e-bd02-4b235c92facd nodeName:}" failed. No retries permitted until 2026-08-04 10:37:39.517910408 +0000 UTC m=+10.116814764 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fhg96" (UniqueName: "kubernetes.io/projected/f60ee252-a9b6-404e-bd02-4b235c92facd-kube-api-access-fhg96") pod "network-check-target-wfs5z" (UID: "f60ee252-a9b6-404e-bd02-4b235c92facd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 10:37:35.518318 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:35.518302 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 10:37:35.518372 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:35.518354 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f33312d-b1fd-4589-8066-42a262738f91-original-pull-secret podName:9f33312d-b1fd-4589-8066-42a262738f91 nodeName:}" failed. No retries permitted until 2026-08-04 10:37:39.518338331 +0000 UTC m=+10.117242686 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f33312d-b1fd-4589-8066-42a262738f91-original-pull-secret") pod "global-pull-secret-syncer-98bfx" (UID: "9f33312d-b1fd-4589-8066-42a262738f91") : object "kube-system"/"original-pull-secret" not registered Aug 04 10:37:35.924521 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:35.924489 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:35.924968 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:35.924623 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98bfx" podUID="9f33312d-b1fd-4589-8066-42a262738f91" Aug 04 10:37:35.926368 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:35.926222 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:37:35.926368 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:35.926330 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lbrm" podUID="49fd00b0-8477-48c3-bbde-aa2c9ef5df76" Aug 04 10:37:36.923003 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:36.922971 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:37:36.923175 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:36.923107 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfs5z" podUID="f60ee252-a9b6-404e-bd02-4b235c92facd" Aug 04 10:37:37.923527 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:37.923493 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:37.924025 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:37.923625 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98bfx" podUID="9f33312d-b1fd-4589-8066-42a262738f91" Aug 04 10:37:37.924098 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:37.924056 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:37:37.924211 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:37.924182 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lbrm" podUID="49fd00b0-8477-48c3-bbde-aa2c9ef5df76" Aug 04 10:37:38.923469 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:38.923435 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:37:38.923695 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:38.923666 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfs5z" podUID="f60ee252-a9b6-404e-bd02-4b235c92facd" Aug 04 10:37:39.452847 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:39.452805 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs\") pod \"network-metrics-daemon-2lbrm\" (UID: \"49fd00b0-8477-48c3-bbde-aa2c9ef5df76\") " pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:37:39.452991 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:39.452954 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 10:37:39.453039 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:39.453018 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs podName:49fd00b0-8477-48c3-bbde-aa2c9ef5df76 nodeName:}" failed. No retries permitted until 2026-08-04 10:37:47.452998603 +0000 UTC m=+18.051902958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs") pod "network-metrics-daemon-2lbrm" (UID: "49fd00b0-8477-48c3-bbde-aa2c9ef5df76") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 10:37:39.553300 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:39.553263 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhg96\" (UniqueName: \"kubernetes.io/projected/f60ee252-a9b6-404e-bd02-4b235c92facd-kube-api-access-fhg96\") pod \"network-check-target-wfs5z\" (UID: \"f60ee252-a9b6-404e-bd02-4b235c92facd\") " pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:37:39.553481 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:39.553354 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f33312d-b1fd-4589-8066-42a262738f91-original-pull-secret\") pod \"global-pull-secret-syncer-98bfx\" (UID: \"9f33312d-b1fd-4589-8066-42a262738f91\") " pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:39.553481 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:39.553468 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 10:37:39.553615 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:39.553479 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 10:37:39.553615 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:39.553497 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 10:37:39.553615 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:39.553511 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fhg96 for pod openshift-network-diagnostics/network-check-target-wfs5z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 10:37:39.553615 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:39.553544 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f33312d-b1fd-4589-8066-42a262738f91-original-pull-secret podName:9f33312d-b1fd-4589-8066-42a262738f91 nodeName:}" failed. No retries permitted until 2026-08-04 10:37:47.553525928 +0000 UTC m=+18.152430303 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f33312d-b1fd-4589-8066-42a262738f91-original-pull-secret") pod "global-pull-secret-syncer-98bfx" (UID: "9f33312d-b1fd-4589-8066-42a262738f91") : object "kube-system"/"original-pull-secret" not registered Aug 04 10:37:39.553615 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:39.553568 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f60ee252-a9b6-404e-bd02-4b235c92facd-kube-api-access-fhg96 podName:f60ee252-a9b6-404e-bd02-4b235c92facd nodeName:}" failed. No retries permitted until 2026-08-04 10:37:47.553550964 +0000 UTC m=+18.152455318 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fhg96" (UniqueName: "kubernetes.io/projected/f60ee252-a9b6-404e-bd02-4b235c92facd-kube-api-access-fhg96") pod "network-check-target-wfs5z" (UID: "f60ee252-a9b6-404e-bd02-4b235c92facd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 10:37:39.923513 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:39.923438 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:39.923672 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:39.923548 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98bfx" podUID="9f33312d-b1fd-4589-8066-42a262738f91" Aug 04 10:37:39.924226 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:39.924035 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:37:39.924226 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:39.924176 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lbrm" podUID="49fd00b0-8477-48c3-bbde-aa2c9ef5df76" Aug 04 10:37:40.922896 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:40.922815 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:37:40.923092 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:40.922934 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfs5z" podUID="f60ee252-a9b6-404e-bd02-4b235c92facd" Aug 04 10:37:41.922971 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:41.922934 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:41.923347 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:41.922983 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:37:41.923347 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:41.923090 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98bfx" podUID="9f33312d-b1fd-4589-8066-42a262738f91" Aug 04 10:37:41.923347 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:41.923199 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lbrm" podUID="49fd00b0-8477-48c3-bbde-aa2c9ef5df76" Aug 04 10:37:42.923606 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:42.923574 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:37:42.923983 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:42.923673 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfs5z" podUID="f60ee252-a9b6-404e-bd02-4b235c92facd" Aug 04 10:37:43.923115 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:43.923079 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:43.923115 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:43.923103 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:37:43.923339 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:43.923228 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98bfx" podUID="9f33312d-b1fd-4589-8066-42a262738f91" Aug 04 10:37:43.923422 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:43.923340 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lbrm" podUID="49fd00b0-8477-48c3-bbde-aa2c9ef5df76" Aug 04 10:37:44.922680 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:44.922641 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:37:44.923141 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:44.922748 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfs5z" podUID="f60ee252-a9b6-404e-bd02-4b235c92facd" Aug 04 10:37:45.923005 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:45.922974 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:45.923451 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:45.922987 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:37:45.923451 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:45.923102 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98bfx" podUID="9f33312d-b1fd-4589-8066-42a262738f91" Aug 04 10:37:45.923451 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:45.923187 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lbrm" podUID="49fd00b0-8477-48c3-bbde-aa2c9ef5df76" Aug 04 10:37:46.922644 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:46.922603 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:37:46.922884 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:46.922724 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfs5z" podUID="f60ee252-a9b6-404e-bd02-4b235c92facd" Aug 04 10:37:47.510901 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:47.510806 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs\") pod \"network-metrics-daemon-2lbrm\" (UID: \"49fd00b0-8477-48c3-bbde-aa2c9ef5df76\") " pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:37:47.511357 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:47.510974 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 10:37:47.511357 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:47.511041 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs podName:49fd00b0-8477-48c3-bbde-aa2c9ef5df76 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:03.511023408 +0000 UTC m=+34.109927979 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs") pod "network-metrics-daemon-2lbrm" (UID: "49fd00b0-8477-48c3-bbde-aa2c9ef5df76") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 10:37:47.612141 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:47.612105 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f33312d-b1fd-4589-8066-42a262738f91-original-pull-secret\") pod \"global-pull-secret-syncer-98bfx\" (UID: \"9f33312d-b1fd-4589-8066-42a262738f91\") " pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:47.612313 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:47.612160 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhg96\" (UniqueName: \"kubernetes.io/projected/f60ee252-a9b6-404e-bd02-4b235c92facd-kube-api-access-fhg96\") pod \"network-check-target-wfs5z\" (UID: \"f60ee252-a9b6-404e-bd02-4b235c92facd\") " pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:37:47.612313 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:47.612271 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 10:37:47.612313 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:47.612295 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 10:37:47.612313 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:47.612312 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 10:37:47.612534 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:47.612321 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fhg96 for pod openshift-network-diagnostics/network-check-target-wfs5z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 10:37:47.612534 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:47.612342 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f33312d-b1fd-4589-8066-42a262738f91-original-pull-secret podName:9f33312d-b1fd-4589-8066-42a262738f91 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:03.612327425 +0000 UTC m=+34.211231777 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f33312d-b1fd-4589-8066-42a262738f91-original-pull-secret") pod "global-pull-secret-syncer-98bfx" (UID: "9f33312d-b1fd-4589-8066-42a262738f91") : object "kube-system"/"original-pull-secret" not registered Aug 04 10:37:47.612534 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:47.612359 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f60ee252-a9b6-404e-bd02-4b235c92facd-kube-api-access-fhg96 podName:f60ee252-a9b6-404e-bd02-4b235c92facd nodeName:}" failed. No retries permitted until 2026-08-04 10:38:03.612348985 +0000 UTC m=+34.211253339 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fhg96" (UniqueName: "kubernetes.io/projected/f60ee252-a9b6-404e-bd02-4b235c92facd-kube-api-access-fhg96") pod "network-check-target-wfs5z" (UID: "f60ee252-a9b6-404e-bd02-4b235c92facd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 10:37:47.923595 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:47.923507 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:47.923763 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:47.923508 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:37:47.923763 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:47.923630 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98bfx" podUID="9f33312d-b1fd-4589-8066-42a262738f91" Aug 04 10:37:47.923763 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:47.923734 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lbrm" podUID="49fd00b0-8477-48c3-bbde-aa2c9ef5df76" Aug 04 10:37:48.923355 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:48.923321 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:37:48.923812 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:48.923438 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfs5z" podUID="f60ee252-a9b6-404e-bd02-4b235c92facd" Aug 04 10:37:49.923674 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:49.923646 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:49.924051 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:49.923737 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98bfx" podUID="9f33312d-b1fd-4589-8066-42a262738f91" Aug 04 10:37:49.924106 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:49.924075 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:37:49.924198 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:49.924172 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lbrm" podUID="49fd00b0-8477-48c3-bbde-aa2c9ef5df76" Aug 04 10:37:50.923341 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:50.923311 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:37:50.923531 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:50.923422 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfs5z" podUID="f60ee252-a9b6-404e-bd02-4b235c92facd" Aug 04 10:37:51.923442 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:51.922999 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:51.924232 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:51.923000 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:37:51.924232 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:51.923555 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98bfx" podUID="9f33312d-b1fd-4589-8066-42a262738f91" Aug 04 10:37:51.924232 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:51.923603 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lbrm" podUID="49fd00b0-8477-48c3-bbde-aa2c9ef5df76" Aug 04 10:37:52.015290 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.015214 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" event={"ID":"b90f86f8-e151-4bb8-829d-3dcae834140e","Type":"ContainerStarted","Data":"e0af99aef2f6d3fa972d56c68204ebff8d24b3e2640968bf4e5657d4a04d11af"} Aug 04 10:37:52.017448 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.017416 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4srtf" event={"ID":"ba5dfdef-6cac-4db4-968f-51c021836632","Type":"ContainerStarted","Data":"c0f5f90e2d295afbf929a4f53223ede38a99627b91a0b360e320fb11041cf58b"} Aug 04 10:37:52.018850 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.018826 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xq5bm" event={"ID":"e20c225e-bf93-46af-a2d3-f3ddaadc3bbd","Type":"ContainerStarted","Data":"cd46bd5ed0bb7877b3e8faf8a05df44f91f253baa989a43f8afcdb4cbc87498e"} Aug 04 10:37:52.024978 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.024936 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" event={"ID":"28af1687-bc47-47cc-975f-c103486551ee","Type":"ContainerStarted","Data":"afce123b9bd4daefb3e34e9e373b35e3da3bb64ab729c06921266dfbd1af7002"} Aug 04 10:37:52.025100 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.025040 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" event={"ID":"28af1687-bc47-47cc-975f-c103486551ee","Type":"ContainerStarted","Data":"d4073107b59944b92a3715036564f528127cd12078ef5be0c8cc26e0614582dc"} Aug 04 10:37:52.025100 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.025092 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" event={"ID":"28af1687-bc47-47cc-975f-c103486551ee","Type":"ContainerStarted","Data":"7b178301e497db715ad7515b80d2270db4d3fcf3cf173ce4dfbf64dd2b6c5a18"} Aug 04 10:37:52.025210 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.025138 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" event={"ID":"28af1687-bc47-47cc-975f-c103486551ee","Type":"ContainerStarted","Data":"fa1dfcf02be7870e4c01e50ef3726513eb51af02738632afdd23704de0576597"} Aug 04 10:37:52.025210 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.025187 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" event={"ID":"28af1687-bc47-47cc-975f-c103486551ee","Type":"ContainerStarted","Data":"849f6491fa2961daca58d17ca562c7adc691e31daa5b29117a9109fac7d1feee"} Aug 04 10:37:52.025309 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.025235 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" event={"ID":"28af1687-bc47-47cc-975f-c103486551ee","Type":"ContainerStarted","Data":"ee36406e45e4e2164c53c41a9c842f9671917cd6530c14a10f4f9ee3e60815c7"} Aug 04 10:37:52.026468 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.026446 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k4w4p" event={"ID":"48f0bcb8-ecf4-457c-991a-12e6fd0aaec8","Type":"ContainerStarted","Data":"b57e774b740063b0b093a60d3fea1e0ceaf9c8c02126ed4fb262c50fe7e51462"} Aug 04 10:37:52.027713 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.027694 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ctwz9" event={"ID":"364a423a-fde5-4ab7-bc63-dd73aee4e6b2","Type":"ContainerStarted","Data":"0836e7755732b7fc9b40713b24842d893d0638c77196898f8f4041f0a455ed39"} Aug 04 10:37:52.029104 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.029084 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dz4jf" event={"ID":"bf0c1197-51b3-4912-8503-9d06553abdc0","Type":"ContainerStarted","Data":"40588b65c2d171ec5e68d9ae6c3ed49a77ad96b84453af2b790f7870cdd1c874"} Aug 04 10:37:52.032704 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.031183 2576 generic.go:356] "Generic (PLEG): container finished" podID="c1d7a4bf-2499-43ac-9714-004492eafc30" containerID="5c6c9d48e15bb108f0b0e75b126ee847addd134aba75df23a77743142a40f7c7" exitCode=0 Aug 04 10:37:52.032704 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.031225 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4627p" event={"ID":"c1d7a4bf-2499-43ac-9714-004492eafc30","Type":"ContainerDied","Data":"5c6c9d48e15bb108f0b0e75b126ee847addd134aba75df23a77743142a40f7c7"} Aug 04 10:37:52.038064 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.038020 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-102.ec2.internal" podStartSLOduration=21.038008778 podStartE2EDuration="21.038008778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 10:37:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:37:34.001059027 +0000 UTC m=+4.599963418" watchObservedRunningTime="2026-08-04 10:37:52.038008778 +0000 UTC m=+22.636913152" Aug 04 10:37:52.038159 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.038142 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4srtf" podStartSLOduration=3.149186832 podStartE2EDuration="22.038136549s" totalImagesPullingTime="18.888949717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 10:37:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:37:52.037746322 +0000 UTC m=+22.636650696" watchObservedRunningTime="2026-08-04 10:37:52.038136549 +0000 UTC m=+22.637040923" Aug 04 10:37:52.059293 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.059239 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-k4w4p" podStartSLOduration=4.058241058 podStartE2EDuration="23.059219814s" totalImagesPullingTime="19.000978756s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 10:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:37:52.058671832 +0000 UTC m=+22.657576232" watchObservedRunningTime="2026-08-04 10:37:52.059219814 +0000 UTC m=+22.658124189" Aug 04 10:37:52.098227 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.098176 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xq5bm" podStartSLOduration=6.9831857920000004 podStartE2EDuration="22.098161701s" totalImagesPullingTime="15.114975909s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 10:37:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:37:52.097953511 +0000 UTC m=+22.696857886" watchObservedRunningTime="2026-08-04 10:37:52.098161701 +0000 UTC m=+22.697066074" Aug 04 10:37:52.155791 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.155729 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ctwz9" podStartSLOduration=3.259509219 podStartE2EDuration="22.155713894s" totalImagesPullingTime="18.896204675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:37:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:37:52.122969166 +0000 UTC m=+22.721873542" watchObservedRunningTime="2026-08-04 10:37:52.155713894 +0000 UTC m=+22.754618267" Aug 04 10:37:52.241195 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.241172 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ctwz9" Aug 04 10:37:52.241746 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.241729 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ctwz9" Aug 04 10:37:52.261019 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.260986 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dz4jf" podStartSLOduration=3.35196636 podStartE2EDuration="22.260973062s" totalImagesPullingTime="18.909006702s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 10:37:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:37:52.156825684 +0000 UTC m=+22.755730057" watchObservedRunningTime="2026-08-04 10:37:52.260973062 +0000 UTC m=+22.859877436" Aug 04 10:37:52.607684 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.607655 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Aug 04 10:37:52.841618 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.841451 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-04T10:37:52.607671556Z","UUID":"b15535f6-da47-4318-8504-66f87bf6ce76","Handler":null,"Name":"","Endpoint":""} Aug 04 10:37:52.842813 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.842797 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Aug 04 10:37:52.842901 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.842830 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Aug 04 10:37:52.923561 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:52.923495 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:37:52.923943 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:52.923619 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfs5z" podUID="f60ee252-a9b6-404e-bd02-4b235c92facd" Aug 04 10:37:53.035065 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:53.035012 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7bsx6" event={"ID":"9535b521-046d-4fb4-bd37-c88e6cee2e59","Type":"ContainerStarted","Data":"e7457e2560f215b48ddf8a1fa2142e967e579dab22e9ea9f223dbb9a5212a4e3"} Aug 04 10:37:53.037132 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:53.037104 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" event={"ID":"b90f86f8-e151-4bb8-829d-3dcae834140e","Type":"ContainerStarted","Data":"cd181060c4db4078168cd72c4e7220cba54fc93bbef8ce9e1a7b001e0abd0db2"} Aug 04 10:37:53.037849 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:53.037808 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ctwz9" Aug 04 10:37:53.038314 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:53.038292 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ctwz9" Aug 04 10:37:53.066604 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:53.066557 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7bsx6" podStartSLOduration=4.185295103 podStartE2EDuration="23.066540476s" totalImagesPullingTime="18.881245373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 10:37:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:37:53.050589681 +0000 UTC m=+23.649494052" watchObservedRunningTime="2026-08-04 10:37:53.066540476 +0000 UTC m=+23.665444850" Aug 04 10:37:53.923609 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:53.923581 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:53.923996 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:53.923592 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:37:53.923996 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:53.923719 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98bfx" podUID="9f33312d-b1fd-4589-8066-42a262738f91" Aug 04 10:37:53.923996 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:53.923801 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lbrm" podUID="49fd00b0-8477-48c3-bbde-aa2c9ef5df76" Aug 04 10:37:54.923343 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:54.923152 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:37:54.923649 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:54.923465 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfs5z" podUID="f60ee252-a9b6-404e-bd02-4b235c92facd" Aug 04 10:37:55.048059 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:55.048018 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" event={"ID":"b90f86f8-e151-4bb8-829d-3dcae834140e","Type":"ContainerStarted","Data":"f0dd04626782d1bc2a1e73321bae5b502f1a255c724d032bf09b832aec792f98"} Aug 04 10:37:55.051707 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:55.051660 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" event={"ID":"28af1687-bc47-47cc-975f-c103486551ee","Type":"ContainerStarted","Data":"0aaa003b7eb7a665073ff400c1285e69d1f12f6ff779a2fe39f0e9a04a8f31c3"} Aug 04 10:37:55.067567 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:55.067523 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qwjpj" podStartSLOduration=3.649944841 podStartE2EDuration="25.067509261s" totalImagesPullingTime="21.41756442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 10:37:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:37:55.067351528 +0000 UTC m=+25.666255920" watchObservedRunningTime="2026-08-04 10:37:55.067509261 +0000 UTC m=+25.666413639" Aug 04 10:37:55.922912 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:55.922878 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:55.923123 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:55.923009 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98bfx" podUID="9f33312d-b1fd-4589-8066-42a262738f91" Aug 04 10:37:55.923123 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:55.923106 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:37:55.923250 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:55.923223 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lbrm" podUID="49fd00b0-8477-48c3-bbde-aa2c9ef5df76" Aug 04 10:37:56.922804 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:56.922774 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:37:56.923555 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:56.922900 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfs5z" podUID="f60ee252-a9b6-404e-bd02-4b235c92facd" Aug 04 10:37:57.059521 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:57.059247 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" event={"ID":"28af1687-bc47-47cc-975f-c103486551ee","Type":"ContainerStarted","Data":"c692feb6b7f874cc2b4e37b92ed6730f8c4a8ec93c137e5ed898ad89bf6a5b28"} Aug 04 10:37:57.059673 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:57.059624 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:57.059732 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:57.059677 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:57.076529 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:57.076497 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:57.076707 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:57.076688 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:37:57.092085 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:57.092042 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" podStartSLOduration=8.158089937 podStartE2EDuration="27.092026302s" totalImagesPullingTime="18.933936365s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 10:37:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:37:57.091664298 +0000 UTC m=+27.690568688" watchObservedRunningTime="2026-08-04 10:37:57.092026302 +0000 UTC m=+27.690930676" Aug 04 10:37:57.923608 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:57.923538 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:37:57.923608 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:57.923574 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:57.924004 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:57.923645 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lbrm" podUID="49fd00b0-8477-48c3-bbde-aa2c9ef5df76" Aug 04 10:37:57.924004 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:57.923782 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98bfx" podUID="9f33312d-b1fd-4589-8066-42a262738f91" Aug 04 10:37:58.063118 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:58.063082 2576 generic.go:356] "Generic (PLEG): container finished" podID="c1d7a4bf-2499-43ac-9714-004492eafc30" containerID="e8c816fd545274a840c25823466f53570311961ecd37ced2aea34d5faf914e1e" exitCode=0 Aug 04 10:37:58.063317 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:58.063175 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4627p" event={"ID":"c1d7a4bf-2499-43ac-9714-004492eafc30","Type":"ContainerDied","Data":"e8c816fd545274a840c25823466f53570311961ecd37ced2aea34d5faf914e1e"} Aug 04 10:37:58.063317 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:58.063208 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Aug 04 10:37:58.922546 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:58.922520 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:37:58.922768 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:58.922628 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfs5z" podUID="f60ee252-a9b6-404e-bd02-4b235c92facd" Aug 04 10:37:58.924710 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:58.924687 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wfs5z"] Aug 04 10:37:58.927874 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:58.927855 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2lbrm"] Aug 04 10:37:58.928016 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:58.927946 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:37:58.928071 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:58.928045 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lbrm" podUID="49fd00b0-8477-48c3-bbde-aa2c9ef5df76" Aug 04 10:37:58.930789 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:58.929342 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-98bfx"] Aug 04 10:37:58.930789 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:58.929502 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:37:58.930789 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:58.929626 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98bfx" podUID="9f33312d-b1fd-4589-8066-42a262738f91" Aug 04 10:37:59.065237 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:59.065166 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:37:59.065237 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:37:59.065231 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Aug 04 10:37:59.065436 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:37:59.065287 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfs5z" podUID="f60ee252-a9b6-404e-bd02-4b235c92facd" Aug 04 10:38:00.068878 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:00.068686 2576 generic.go:356] "Generic (PLEG): container finished" podID="c1d7a4bf-2499-43ac-9714-004492eafc30" containerID="871e5a0cafc18714935d9c5f8b11f08b61483b6052a7f04fe01bbb050108cf0d" exitCode=0 Aug 04 10:38:00.069253 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:00.068776 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4627p" event={"ID":"c1d7a4bf-2499-43ac-9714-004492eafc30","Type":"ContainerDied","Data":"871e5a0cafc18714935d9c5f8b11f08b61483b6052a7f04fe01bbb050108cf0d"} Aug 04 10:38:00.721426 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:00.721380 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:38:00.922902 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:00.922832 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:38:00.922902 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:00.922863 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:38:00.923114 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:00.922965 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfs5z" podUID="f60ee252-a9b6-404e-bd02-4b235c92facd" Aug 04 10:38:00.923114 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:00.923013 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:38:00.923114 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:00.923092 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98bfx" podUID="9f33312d-b1fd-4589-8066-42a262738f91" Aug 04 10:38:00.923266 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:00.923205 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lbrm" podUID="49fd00b0-8477-48c3-bbde-aa2c9ef5df76" Aug 04 10:38:02.075246 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:02.075209 2576 generic.go:356] "Generic (PLEG): container finished" podID="c1d7a4bf-2499-43ac-9714-004492eafc30" containerID="3108ad89a24f255c0239b2233e8b8bb2ea100dcb3870e43144470f1a1bd54102" exitCode=0 Aug 04 10:38:02.076028 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:02.075279 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4627p" event={"ID":"c1d7a4bf-2499-43ac-9714-004492eafc30","Type":"ContainerDied","Data":"3108ad89a24f255c0239b2233e8b8bb2ea100dcb3870e43144470f1a1bd54102"} Aug 04 10:38:02.923043 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:02.923009 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:38:02.923239 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:02.923009 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:38:02.923239 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:02.923136 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-98bfx" podUID="9f33312d-b1fd-4589-8066-42a262738f91" Aug 04 10:38:02.923239 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:02.923009 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:38:02.923239 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:02.923226 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2lbrm" podUID="49fd00b0-8477-48c3-bbde-aa2c9ef5df76" Aug 04 10:38:02.923486 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:02.923244 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wfs5z" podUID="f60ee252-a9b6-404e-bd02-4b235c92facd" Aug 04 10:38:03.538772 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.538732 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs\") pod \"network-metrics-daemon-2lbrm\" (UID: \"49fd00b0-8477-48c3-bbde-aa2c9ef5df76\") " pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:38:03.539363 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:03.538908 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 10:38:03.539363 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:03.538991 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs podName:49fd00b0-8477-48c3-bbde-aa2c9ef5df76 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:35.538968874 +0000 UTC m=+66.137873244 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs") pod "network-metrics-daemon-2lbrm" (UID: "49fd00b0-8477-48c3-bbde-aa2c9ef5df76") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 10:38:03.639102 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.639071 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhg96\" (UniqueName: \"kubernetes.io/projected/f60ee252-a9b6-404e-bd02-4b235c92facd-kube-api-access-fhg96\") pod \"network-check-target-wfs5z\" (UID: \"f60ee252-a9b6-404e-bd02-4b235c92facd\") " pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:38:03.639218 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.639141 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f33312d-b1fd-4589-8066-42a262738f91-original-pull-secret\") pod \"global-pull-secret-syncer-98bfx\" (UID: \"9f33312d-b1fd-4589-8066-42a262738f91\") " pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:38:03.639263 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:03.639242 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 10:38:03.639263 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:03.639244 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 10:38:03.639344 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:03.639266 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 10:38:03.639344 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:03.639278 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fhg96 for pod openshift-network-diagnostics/network-check-target-wfs5z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 10:38:03.639344 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:03.639304 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f33312d-b1fd-4589-8066-42a262738f91-original-pull-secret podName:9f33312d-b1fd-4589-8066-42a262738f91 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:35.639285119 +0000 UTC m=+66.238189477 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9f33312d-b1fd-4589-8066-42a262738f91-original-pull-secret") pod "global-pull-secret-syncer-98bfx" (UID: "9f33312d-b1fd-4589-8066-42a262738f91") : object "kube-system"/"original-pull-secret" not registered Aug 04 10:38:03.639344 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:03.639320 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f60ee252-a9b6-404e-bd02-4b235c92facd-kube-api-access-fhg96 podName:f60ee252-a9b6-404e-bd02-4b235c92facd nodeName:}" failed. No retries permitted until 2026-08-04 10:38:35.639311649 +0000 UTC m=+66.238216005 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fhg96" (UniqueName: "kubernetes.io/projected/f60ee252-a9b6-404e-bd02-4b235c92facd-kube-api-access-fhg96") pod "network-check-target-wfs5z" (UID: "f60ee252-a9b6-404e-bd02-4b235c92facd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 10:38:03.698934 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.698902 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-102.ec2.internal" event="NodeReady" Aug 04 10:38:03.699062 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.699027 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Aug 04 10:38:03.754151 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.754106 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tvksr"] Aug 04 10:38:03.756245 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.756225 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ssnvq"] Aug 04 10:38:03.756353 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.756342 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tvksr" Aug 04 10:38:03.758382 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.758362 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ssnvq" Aug 04 10:38:03.759691 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.759668 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f4ggs\"" Aug 04 10:38:03.759900 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.759876 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Aug 04 10:38:03.761270 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.761253 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Aug 04 10:38:03.761652 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.761627 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Aug 04 10:38:03.761758 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.761650 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Aug 04 10:38:03.761879 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.761863 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Aug 04 10:38:03.761936 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.761897 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l5h9c\"" Aug 04 10:38:03.771655 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.771633 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tvksr"] Aug 04 10:38:03.774549 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.774525 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ssnvq"] Aug 04 10:38:03.840223 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.840152 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vkrr\" (UniqueName: \"kubernetes.io/projected/4756e1b9-37a8-46e2-a62d-7eb3c0a56f99-kube-api-access-6vkrr\") pod \"ingress-canary-ssnvq\" (UID: \"4756e1b9-37a8-46e2-a62d-7eb3c0a56f99\") " pod="openshift-ingress-canary/ingress-canary-ssnvq" Aug 04 10:38:03.840223 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.840180 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6cebbba9-957c-4011-9ba2-9d5255894e51-config-volume\") pod \"dns-default-tvksr\" (UID: \"6cebbba9-957c-4011-9ba2-9d5255894e51\") " pod="openshift-dns/dns-default-tvksr" Aug 04 10:38:03.840223 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.840203 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cebbba9-957c-4011-9ba2-9d5255894e51-tmp-dir\") pod \"dns-default-tvksr\" (UID: \"6cebbba9-957c-4011-9ba2-9d5255894e51\") " pod="openshift-dns/dns-default-tvksr" Aug 04 10:38:03.840445 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.840313 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44thv\" (UniqueName: \"kubernetes.io/projected/6cebbba9-957c-4011-9ba2-9d5255894e51-kube-api-access-44thv\") pod \"dns-default-tvksr\" (UID: \"6cebbba9-957c-4011-9ba2-9d5255894e51\") " pod="openshift-dns/dns-default-tvksr" Aug 04 10:38:03.840445 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.840347 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4756e1b9-37a8-46e2-a62d-7eb3c0a56f99-cert\") pod \"ingress-canary-ssnvq\" (UID: \"4756e1b9-37a8-46e2-a62d-7eb3c0a56f99\") " pod="openshift-ingress-canary/ingress-canary-ssnvq" Aug 04 10:38:03.840445 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.840373 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cebbba9-957c-4011-9ba2-9d5255894e51-metrics-tls\") pod \"dns-default-tvksr\" (UID: \"6cebbba9-957c-4011-9ba2-9d5255894e51\") " pod="openshift-dns/dns-default-tvksr" Aug 04 10:38:03.941678 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.941651 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vkrr\" (UniqueName: \"kubernetes.io/projected/4756e1b9-37a8-46e2-a62d-7eb3c0a56f99-kube-api-access-6vkrr\") pod \"ingress-canary-ssnvq\" (UID: \"4756e1b9-37a8-46e2-a62d-7eb3c0a56f99\") " pod="openshift-ingress-canary/ingress-canary-ssnvq" Aug 04 10:38:03.941678 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.941685 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6cebbba9-957c-4011-9ba2-9d5255894e51-config-volume\") pod \"dns-default-tvksr\" (UID: \"6cebbba9-957c-4011-9ba2-9d5255894e51\") " pod="openshift-dns/dns-default-tvksr" Aug 04 10:38:03.941881 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.941703 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cebbba9-957c-4011-9ba2-9d5255894e51-tmp-dir\") pod \"dns-default-tvksr\" (UID: \"6cebbba9-957c-4011-9ba2-9d5255894e51\") " pod="openshift-dns/dns-default-tvksr" Aug 04 10:38:03.941881 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.941755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44thv\" (UniqueName: \"kubernetes.io/projected/6cebbba9-957c-4011-9ba2-9d5255894e51-kube-api-access-44thv\") pod \"dns-default-tvksr\" (UID: \"6cebbba9-957c-4011-9ba2-9d5255894e51\") " pod="openshift-dns/dns-default-tvksr" Aug 04 10:38:03.941881 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.941820 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4756e1b9-37a8-46e2-a62d-7eb3c0a56f99-cert\") pod \"ingress-canary-ssnvq\" (UID: \"4756e1b9-37a8-46e2-a62d-7eb3c0a56f99\") " pod="openshift-ingress-canary/ingress-canary-ssnvq" Aug 04 10:38:03.941881 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.941839 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cebbba9-957c-4011-9ba2-9d5255894e51-metrics-tls\") pod \"dns-default-tvksr\" (UID: \"6cebbba9-957c-4011-9ba2-9d5255894e51\") " pod="openshift-dns/dns-default-tvksr" Aug 04 10:38:03.942079 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:03.941946 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 04 10:38:03.942079 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:03.942003 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cebbba9-957c-4011-9ba2-9d5255894e51-metrics-tls podName:6cebbba9-957c-4011-9ba2-9d5255894e51 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:04.441984569 +0000 UTC m=+35.040888923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cebbba9-957c-4011-9ba2-9d5255894e51-metrics-tls") pod "dns-default-tvksr" (UID: "6cebbba9-957c-4011-9ba2-9d5255894e51") : secret "dns-default-metrics-tls" not found Aug 04 10:38:03.942437 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.942321 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6cebbba9-957c-4011-9ba2-9d5255894e51-config-volume\") pod \"dns-default-tvksr\" (UID: \"6cebbba9-957c-4011-9ba2-9d5255894e51\") " pod="openshift-dns/dns-default-tvksr" Aug 04 10:38:03.942536 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.942519 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cebbba9-957c-4011-9ba2-9d5255894e51-tmp-dir\") pod \"dns-default-tvksr\" (UID: \"6cebbba9-957c-4011-9ba2-9d5255894e51\") " pod="openshift-dns/dns-default-tvksr" Aug 04 10:38:03.947103 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.947079 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4756e1b9-37a8-46e2-a62d-7eb3c0a56f99-cert\") pod \"ingress-canary-ssnvq\" (UID: \"4756e1b9-37a8-46e2-a62d-7eb3c0a56f99\") " pod="openshift-ingress-canary/ingress-canary-ssnvq" Aug 04 10:38:03.951330 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.951308 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44thv\" (UniqueName: \"kubernetes.io/projected/6cebbba9-957c-4011-9ba2-9d5255894e51-kube-api-access-44thv\") pod \"dns-default-tvksr\" (UID: \"6cebbba9-957c-4011-9ba2-9d5255894e51\") " pod="openshift-dns/dns-default-tvksr" Aug 04 10:38:03.951793 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:03.951771 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vkrr\" (UniqueName: \"kubernetes.io/projected/4756e1b9-37a8-46e2-a62d-7eb3c0a56f99-kube-api-access-6vkrr\") pod \"ingress-canary-ssnvq\" (UID: \"4756e1b9-37a8-46e2-a62d-7eb3c0a56f99\") " pod="openshift-ingress-canary/ingress-canary-ssnvq" Aug 04 10:38:04.077489 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:04.077456 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ssnvq" Aug 04 10:38:04.240211 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:04.240038 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ssnvq"] Aug 04 10:38:04.244899 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:38:04.244871 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4756e1b9_37a8_46e2_a62d_7eb3c0a56f99.slice/crio-c3fc6baea41981ce87fe5e5aa5c14e226a7f6e51c6542ea3d7ce571e51aceef7 WatchSource:0}: Error finding container c3fc6baea41981ce87fe5e5aa5c14e226a7f6e51c6542ea3d7ce571e51aceef7: Status 404 returned error can't find the container with id c3fc6baea41981ce87fe5e5aa5c14e226a7f6e51c6542ea3d7ce571e51aceef7 Aug 04 10:38:04.446187 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:04.446107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cebbba9-957c-4011-9ba2-9d5255894e51-metrics-tls\") pod \"dns-default-tvksr\" (UID: \"6cebbba9-957c-4011-9ba2-9d5255894e51\") " pod="openshift-dns/dns-default-tvksr" Aug 04 10:38:04.446313 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:04.446253 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 04 10:38:04.446357 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:04.446316 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cebbba9-957c-4011-9ba2-9d5255894e51-metrics-tls podName:6cebbba9-957c-4011-9ba2-9d5255894e51 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:05.446299902 +0000 UTC m=+36.045204254 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cebbba9-957c-4011-9ba2-9d5255894e51-metrics-tls") pod "dns-default-tvksr" (UID: "6cebbba9-957c-4011-9ba2-9d5255894e51") : secret "dns-default-metrics-tls" not found Aug 04 10:38:04.923607 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:04.923573 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:38:04.924108 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:04.923578 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:38:04.924108 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:04.923704 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:38:04.929307 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:04.929284 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qf5ds\"" Aug 04 10:38:04.929307 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:04.929297 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 04 10:38:04.929522 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:04.929487 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 04 10:38:04.929584 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:04.929565 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Aug 04 10:38:04.929936 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:04.929763 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Aug 04 10:38:04.929936 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:04.929830 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t7blv\"" Aug 04 10:38:05.085037 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:05.085007 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ssnvq" event={"ID":"4756e1b9-37a8-46e2-a62d-7eb3c0a56f99","Type":"ContainerStarted","Data":"c3fc6baea41981ce87fe5e5aa5c14e226a7f6e51c6542ea3d7ce571e51aceef7"} Aug 04 10:38:05.452418 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:05.452378 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cebbba9-957c-4011-9ba2-9d5255894e51-metrics-tls\") pod \"dns-default-tvksr\" (UID: \"6cebbba9-957c-4011-9ba2-9d5255894e51\") " pod="openshift-dns/dns-default-tvksr" Aug 04 10:38:05.452582 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:05.452547 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 04 10:38:05.452643 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:05.452618 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cebbba9-957c-4011-9ba2-9d5255894e51-metrics-tls podName:6cebbba9-957c-4011-9ba2-9d5255894e51 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:07.452603247 +0000 UTC m=+38.051507598 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cebbba9-957c-4011-9ba2-9d5255894e51-metrics-tls") pod "dns-default-tvksr" (UID: "6cebbba9-957c-4011-9ba2-9d5255894e51") : secret "dns-default-metrics-tls" not found Aug 04 10:38:07.469332 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:07.469070 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cebbba9-957c-4011-9ba2-9d5255894e51-metrics-tls\") pod \"dns-default-tvksr\" (UID: \"6cebbba9-957c-4011-9ba2-9d5255894e51\") " pod="openshift-dns/dns-default-tvksr" Aug 04 10:38:07.469332 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:07.469251 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 04 10:38:07.469332 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:07.469335 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cebbba9-957c-4011-9ba2-9d5255894e51-metrics-tls podName:6cebbba9-957c-4011-9ba2-9d5255894e51 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:11.469315046 +0000 UTC m=+42.068219403 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cebbba9-957c-4011-9ba2-9d5255894e51-metrics-tls") pod "dns-default-tvksr" (UID: "6cebbba9-957c-4011-9ba2-9d5255894e51") : secret "dns-default-metrics-tls" not found Aug 04 10:38:08.098073 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:08.095266 2576 generic.go:356] "Generic (PLEG): container finished" podID="c1d7a4bf-2499-43ac-9714-004492eafc30" containerID="ceff4db09fd96992324f15685f5a6e24dadfce34045360276384d49f6fa2884f" exitCode=0 Aug 04 10:38:08.098073 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:08.095896 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4627p" event={"ID":"c1d7a4bf-2499-43ac-9714-004492eafc30","Type":"ContainerDied","Data":"ceff4db09fd96992324f15685f5a6e24dadfce34045360276384d49f6fa2884f"} Aug 04 10:38:08.099478 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:08.099445 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ssnvq" event={"ID":"4756e1b9-37a8-46e2-a62d-7eb3c0a56f99","Type":"ContainerStarted","Data":"7e325911b6f21637f2aa11ac9aea8c9827af622da3496a364128fea78c2ba546"} Aug 04 10:38:08.142868 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:08.142804 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ssnvq" podStartSLOduration=2.125168004 podStartE2EDuration="5.142783143s" totalImagesPullingTime="3.017615139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:38:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:38:08.141874882 +0000 UTC m=+38.740779278" watchObservedRunningTime="2026-08-04 10:38:08.142783143 +0000 UTC m=+38.741687518" Aug 04 10:38:09.104548 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:09.104509 2576 generic.go:356] "Generic (PLEG): container finished" podID="c1d7a4bf-2499-43ac-9714-004492eafc30" containerID="dd6afa3c2cc358d54e9fb377c8c17c68f2c5c6f4a501e19d22d31919175f8fb3" exitCode=0 Aug 04 10:38:09.105198 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:09.104575 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4627p" event={"ID":"c1d7a4bf-2499-43ac-9714-004492eafc30","Type":"ContainerDied","Data":"dd6afa3c2cc358d54e9fb377c8c17c68f2c5c6f4a501e19d22d31919175f8fb3"} Aug 04 10:38:10.109868 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:10.109837 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4627p" event={"ID":"c1d7a4bf-2499-43ac-9714-004492eafc30","Type":"ContainerStarted","Data":"03b8aba658dc856227113c68414c064759786331cb50391dcf0ba32555e1a422"} Aug 04 10:38:10.141053 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:10.141016 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4627p" podStartSLOduration=12.173690454 podStartE2EDuration="40.141002454s" totalImagesPullingTime="27.967312s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 10:37:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:38:10.139772738 +0000 UTC m=+40.738677112" watchObservedRunningTime="2026-08-04 10:38:10.141002454 +0000 UTC m=+40.739906827" Aug 04 10:38:11.495611 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:11.495584 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cebbba9-957c-4011-9ba2-9d5255894e51-metrics-tls\") pod \"dns-default-tvksr\" (UID: \"6cebbba9-957c-4011-9ba2-9d5255894e51\") " pod="openshift-dns/dns-default-tvksr" Aug 04 10:38:11.495922 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:11.495677 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 04 10:38:11.495922 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:11.495722 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cebbba9-957c-4011-9ba2-9d5255894e51-metrics-tls podName:6cebbba9-957c-4011-9ba2-9d5255894e51 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:19.495709335 +0000 UTC m=+50.094613687 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cebbba9-957c-4011-9ba2-9d5255894e51-metrics-tls") pod "dns-default-tvksr" (UID: "6cebbba9-957c-4011-9ba2-9d5255894e51") : secret "dns-default-metrics-tls" not found Aug 04 10:38:19.546607 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:19.546574 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cebbba9-957c-4011-9ba2-9d5255894e51-metrics-tls\") pod \"dns-default-tvksr\" (UID: \"6cebbba9-957c-4011-9ba2-9d5255894e51\") " pod="openshift-dns/dns-default-tvksr" Aug 04 10:38:19.547043 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:19.546724 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 04 10:38:19.547043 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:19.546795 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cebbba9-957c-4011-9ba2-9d5255894e51-metrics-tls podName:6cebbba9-957c-4011-9ba2-9d5255894e51 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:35.546778449 +0000 UTC m=+66.145682802 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cebbba9-957c-4011-9ba2-9d5255894e51-metrics-tls") pod "dns-default-tvksr" (UID: "6cebbba9-957c-4011-9ba2-9d5255894e51") : secret "dns-default-metrics-tls" not found Aug 04 10:38:30.732166 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:30.732140 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ltqqw" Aug 04 10:38:35.546195 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:35.546156 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs\") pod \"network-metrics-daemon-2lbrm\" (UID: \"49fd00b0-8477-48c3-bbde-aa2c9ef5df76\") " pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:38:35.549285 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:35.549265 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 04 10:38:35.556671 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:35.556656 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Aug 04 10:38:35.556737 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:35.556708 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs podName:49fd00b0-8477-48c3-bbde-aa2c9ef5df76 nodeName:}" failed. No retries permitted until 2026-08-04 10:39:39.556694108 +0000 UTC m=+130.155598459 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs") pod "network-metrics-daemon-2lbrm" (UID: "49fd00b0-8477-48c3-bbde-aa2c9ef5df76") : secret "metrics-daemon-secret" not found Aug 04 10:38:35.646707 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:35.646679 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhg96\" (UniqueName: \"kubernetes.io/projected/f60ee252-a9b6-404e-bd02-4b235c92facd-kube-api-access-fhg96\") pod \"network-check-target-wfs5z\" (UID: \"f60ee252-a9b6-404e-bd02-4b235c92facd\") " pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:38:35.646804 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:35.646733 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cebbba9-957c-4011-9ba2-9d5255894e51-metrics-tls\") pod \"dns-default-tvksr\" (UID: \"6cebbba9-957c-4011-9ba2-9d5255894e51\") " pod="openshift-dns/dns-default-tvksr" Aug 04 10:38:35.646804 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:35.646776 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f33312d-b1fd-4589-8066-42a262738f91-original-pull-secret\") pod \"global-pull-secret-syncer-98bfx\" (UID: \"9f33312d-b1fd-4589-8066-42a262738f91\") " pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:38:35.646910 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:35.646876 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 04 10:38:35.646964 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:35.646924 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cebbba9-957c-4011-9ba2-9d5255894e51-metrics-tls podName:6cebbba9-957c-4011-9ba2-9d5255894e51 nodeName:}" failed. No retries permitted until 2026-08-04 10:39:07.646909588 +0000 UTC m=+98.245813941 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cebbba9-957c-4011-9ba2-9d5255894e51-metrics-tls") pod "dns-default-tvksr" (UID: "6cebbba9-957c-4011-9ba2-9d5255894e51") : secret "dns-default-metrics-tls" not found Aug 04 10:38:35.650052 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:35.650023 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Aug 04 10:38:35.650137 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:35.650072 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 04 10:38:35.659567 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:35.659541 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Aug 04 10:38:35.663951 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:35.663930 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9f33312d-b1fd-4589-8066-42a262738f91-original-pull-secret\") pod \"global-pull-secret-syncer-98bfx\" (UID: \"9f33312d-b1fd-4589-8066-42a262738f91\") " pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:38:35.670492 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:35.670473 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhg96\" (UniqueName: \"kubernetes.io/projected/f60ee252-a9b6-404e-bd02-4b235c92facd-kube-api-access-fhg96\") pod \"network-check-target-wfs5z\" (UID: \"f60ee252-a9b6-404e-bd02-4b235c92facd\") " pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:38:35.848519 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:35.848464 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qf5ds\"" Aug 04 10:38:35.852154 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:35.852140 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-98bfx" Aug 04 10:38:35.856281 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:35.856269 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:38:36.014149 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:36.014123 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-98bfx"] Aug 04 10:38:36.018066 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:38:36.018041 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f33312d_b1fd_4589_8066_42a262738f91.slice/crio-cbe17fb3745c702b7ff5afafa837f18278b5eaee5a2c647a1f532875efbeb1b6 WatchSource:0}: Error finding container cbe17fb3745c702b7ff5afafa837f18278b5eaee5a2c647a1f532875efbeb1b6: Status 404 returned error can't find the container with id cbe17fb3745c702b7ff5afafa837f18278b5eaee5a2c647a1f532875efbeb1b6 Aug 04 10:38:36.034664 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:36.034640 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wfs5z"] Aug 04 10:38:36.036976 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:38:36.036956 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf60ee252_a9b6_404e_bd02_4b235c92facd.slice/crio-0232dd420acbbad1ff24d1ad1333a1694ead9e2ad837bcfaa00edf7980233b64 WatchSource:0}: Error finding container 0232dd420acbbad1ff24d1ad1333a1694ead9e2ad837bcfaa00edf7980233b64: Status 404 returned error can't find the container with id 0232dd420acbbad1ff24d1ad1333a1694ead9e2ad837bcfaa00edf7980233b64 Aug 04 10:38:36.170681 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:36.170603 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-98bfx" event={"ID":"9f33312d-b1fd-4589-8066-42a262738f91","Type":"ContainerStarted","Data":"cbe17fb3745c702b7ff5afafa837f18278b5eaee5a2c647a1f532875efbeb1b6"} Aug 04 10:38:36.171619 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:36.171599 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wfs5z" event={"ID":"f60ee252-a9b6-404e-bd02-4b235c92facd","Type":"ContainerStarted","Data":"0232dd420acbbad1ff24d1ad1333a1694ead9e2ad837bcfaa00edf7980233b64"} Aug 04 10:38:39.180220 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:39.180173 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wfs5z" event={"ID":"f60ee252-a9b6-404e-bd02-4b235c92facd","Type":"ContainerStarted","Data":"26e8df5a5798f2fcdfe37ac0b824e93895b19bf925cea5a76f78596ea6ecd104"} Aug 04 10:38:39.180678 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:39.180315 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:38:39.200005 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:39.199913 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wfs5z" podStartSLOduration=66.297680992 podStartE2EDuration="1m9.199897816s" totalImagesPullingTime="2.902216824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:37:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:38:39.199339752 +0000 UTC m=+69.798244151" watchObservedRunningTime="2026-08-04 10:38:39.199897816 +0000 UTC m=+69.798802192" Aug 04 10:38:43.191300 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:43.191265 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-98bfx" event={"ID":"9f33312d-b1fd-4589-8066-42a262738f91","Type":"ContainerStarted","Data":"4eb3ba5fa253138673725d731704ee668d2c5d99048d719e1685a905b085248c"} Aug 04 10:38:43.208379 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:43.208333 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-98bfx" podStartSLOduration=66.933412026 podStartE2EDuration="1m13.208319479s" totalImagesPullingTime="6.274907453s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 10:37:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:38:43.208015165 +0000 UTC m=+73.806919539" watchObservedRunningTime="2026-08-04 10:38:43.208319479 +0000 UTC m=+73.807223853" Aug 04 10:38:44.646149 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.646120 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-pkgdb"] Aug 04 10:38:44.648009 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.647994 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-pkgdb" Aug 04 10:38:44.651284 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.651229 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Aug 04 10:38:44.651449 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.651428 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-b47qj\"" Aug 04 10:38:44.652350 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.652335 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Aug 04 10:38:44.664551 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.664523 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-pkgdb"] Aug 04 10:38:44.707797 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.707768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-599vl\" (UniqueName: \"kubernetes.io/projected/ddedd35f-550d-4a9b-8856-162289a087e1-kube-api-access-599vl\") pod \"volume-data-source-validator-5b8776669-pkgdb\" (UID: \"ddedd35f-550d-4a9b-8856-162289a087e1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-pkgdb" Aug 04 10:38:44.747929 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.747899 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-bl62w"] Aug 04 10:38:44.749851 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.749837 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-bl62w" Aug 04 10:38:44.752717 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.752690 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Aug 04 10:38:44.753217 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.753194 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Aug 04 10:38:44.753417 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.753378 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Aug 04 10:38:44.753856 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.753701 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Aug 04 10:38:44.753947 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.753919 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-zfb7s\"" Aug 04 10:38:44.759957 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.759934 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Aug 04 10:38:44.765161 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.765140 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-bl62w"] Aug 04 10:38:44.808401 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.808375 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f93ae815-8c4c-4b43-987b-5bf70573393d-trusted-ca-bundle\") pod \"insights-operator-77696685b-bl62w\" (UID: \"f93ae815-8c4c-4b43-987b-5bf70573393d\") " pod="openshift-insights/insights-operator-77696685b-bl62w" Aug 04 10:38:44.808492 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.808423 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f93ae815-8c4c-4b43-987b-5bf70573393d-tmp\") pod \"insights-operator-77696685b-bl62w\" (UID: \"f93ae815-8c4c-4b43-987b-5bf70573393d\") " pod="openshift-insights/insights-operator-77696685b-bl62w" Aug 04 10:38:44.808492 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.808450 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f93ae815-8c4c-4b43-987b-5bf70573393d-service-ca-bundle\") pod \"insights-operator-77696685b-bl62w\" (UID: \"f93ae815-8c4c-4b43-987b-5bf70573393d\") " pod="openshift-insights/insights-operator-77696685b-bl62w" Aug 04 10:38:44.808492 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.808484 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7mqq\" (UniqueName: \"kubernetes.io/projected/f93ae815-8c4c-4b43-987b-5bf70573393d-kube-api-access-g7mqq\") pod \"insights-operator-77696685b-bl62w\" (UID: \"f93ae815-8c4c-4b43-987b-5bf70573393d\") " pod="openshift-insights/insights-operator-77696685b-bl62w" Aug 04 10:38:44.808588 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.808543 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f93ae815-8c4c-4b43-987b-5bf70573393d-serving-cert\") pod \"insights-operator-77696685b-bl62w\" (UID: \"f93ae815-8c4c-4b43-987b-5bf70573393d\") " pod="openshift-insights/insights-operator-77696685b-bl62w" Aug 04 10:38:44.808620 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.808588 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-599vl\" (UniqueName: \"kubernetes.io/projected/ddedd35f-550d-4a9b-8856-162289a087e1-kube-api-access-599vl\") pod \"volume-data-source-validator-5b8776669-pkgdb\" (UID: \"ddedd35f-550d-4a9b-8856-162289a087e1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-pkgdb" Aug 04 10:38:44.808620 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.808607 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f93ae815-8c4c-4b43-987b-5bf70573393d-snapshots\") pod \"insights-operator-77696685b-bl62w\" (UID: \"f93ae815-8c4c-4b43-987b-5bf70573393d\") " pod="openshift-insights/insights-operator-77696685b-bl62w" Aug 04 10:38:44.818270 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.818245 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-599vl\" (UniqueName: \"kubernetes.io/projected/ddedd35f-550d-4a9b-8856-162289a087e1-kube-api-access-599vl\") pod \"volume-data-source-validator-5b8776669-pkgdb\" (UID: \"ddedd35f-550d-4a9b-8856-162289a087e1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-pkgdb" Aug 04 10:38:44.909149 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.909072 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f93ae815-8c4c-4b43-987b-5bf70573393d-trusted-ca-bundle\") pod \"insights-operator-77696685b-bl62w\" (UID: \"f93ae815-8c4c-4b43-987b-5bf70573393d\") " pod="openshift-insights/insights-operator-77696685b-bl62w" Aug 04 10:38:44.909149 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.909109 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f93ae815-8c4c-4b43-987b-5bf70573393d-tmp\") pod \"insights-operator-77696685b-bl62w\" (UID: \"f93ae815-8c4c-4b43-987b-5bf70573393d\") " pod="openshift-insights/insights-operator-77696685b-bl62w" Aug 04 10:38:44.909149 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.909127 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f93ae815-8c4c-4b43-987b-5bf70573393d-service-ca-bundle\") pod \"insights-operator-77696685b-bl62w\" (UID: \"f93ae815-8c4c-4b43-987b-5bf70573393d\") " pod="openshift-insights/insights-operator-77696685b-bl62w" Aug 04 10:38:44.909380 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.909155 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7mqq\" (UniqueName: \"kubernetes.io/projected/f93ae815-8c4c-4b43-987b-5bf70573393d-kube-api-access-g7mqq\") pod \"insights-operator-77696685b-bl62w\" (UID: \"f93ae815-8c4c-4b43-987b-5bf70573393d\") " pod="openshift-insights/insights-operator-77696685b-bl62w" Aug 04 10:38:44.909380 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.909188 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f93ae815-8c4c-4b43-987b-5bf70573393d-serving-cert\") pod \"insights-operator-77696685b-bl62w\" (UID: \"f93ae815-8c4c-4b43-987b-5bf70573393d\") " pod="openshift-insights/insights-operator-77696685b-bl62w" Aug 04 10:38:44.909380 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.909255 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f93ae815-8c4c-4b43-987b-5bf70573393d-snapshots\") pod \"insights-operator-77696685b-bl62w\" (UID: \"f93ae815-8c4c-4b43-987b-5bf70573393d\") " pod="openshift-insights/insights-operator-77696685b-bl62w" Aug 04 10:38:44.909719 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.909697 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f93ae815-8c4c-4b43-987b-5bf70573393d-tmp\") pod \"insights-operator-77696685b-bl62w\" (UID: \"f93ae815-8c4c-4b43-987b-5bf70573393d\") " pod="openshift-insights/insights-operator-77696685b-bl62w" Aug 04 10:38:44.909888 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.909863 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f93ae815-8c4c-4b43-987b-5bf70573393d-service-ca-bundle\") pod \"insights-operator-77696685b-bl62w\" (UID: \"f93ae815-8c4c-4b43-987b-5bf70573393d\") " pod="openshift-insights/insights-operator-77696685b-bl62w" Aug 04 10:38:44.910023 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.910002 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f93ae815-8c4c-4b43-987b-5bf70573393d-snapshots\") pod \"insights-operator-77696685b-bl62w\" (UID: \"f93ae815-8c4c-4b43-987b-5bf70573393d\") " pod="openshift-insights/insights-operator-77696685b-bl62w" Aug 04 10:38:44.910408 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.910373 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f93ae815-8c4c-4b43-987b-5bf70573393d-trusted-ca-bundle\") pod \"insights-operator-77696685b-bl62w\" (UID: \"f93ae815-8c4c-4b43-987b-5bf70573393d\") " pod="openshift-insights/insights-operator-77696685b-bl62w" Aug 04 10:38:44.911671 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.911642 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f93ae815-8c4c-4b43-987b-5bf70573393d-serving-cert\") pod \"insights-operator-77696685b-bl62w\" (UID: \"f93ae815-8c4c-4b43-987b-5bf70573393d\") " pod="openshift-insights/insights-operator-77696685b-bl62w" Aug 04 10:38:44.919593 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.919575 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7mqq\" (UniqueName: \"kubernetes.io/projected/f93ae815-8c4c-4b43-987b-5bf70573393d-kube-api-access-g7mqq\") pod \"insights-operator-77696685b-bl62w\" (UID: \"f93ae815-8c4c-4b43-987b-5bf70573393d\") " pod="openshift-insights/insights-operator-77696685b-bl62w" Aug 04 10:38:44.956548 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:44.956517 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-pkgdb" Aug 04 10:38:45.060816 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:45.060786 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-bl62w" Aug 04 10:38:45.098013 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:45.097973 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-pkgdb"] Aug 04 10:38:45.102312 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:38:45.102286 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddedd35f_550d_4a9b_8856_162289a087e1.slice/crio-cfb004fa526f656e7a531b65c0d52c659153a4bddce715e4377447494bc9642b WatchSource:0}: Error finding container cfb004fa526f656e7a531b65c0d52c659153a4bddce715e4377447494bc9642b: Status 404 returned error can't find the container with id cfb004fa526f656e7a531b65c0d52c659153a4bddce715e4377447494bc9642b Aug 04 10:38:45.188239 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:45.188164 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-bl62w"] Aug 04 10:38:45.191178 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:38:45.191153 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf93ae815_8c4c_4b43_987b_5bf70573393d.slice/crio-f47983f434ce0e88a51fdd72ee18fa82ee1f5edbfa6362bb3f9079033880c49d WatchSource:0}: Error finding container f47983f434ce0e88a51fdd72ee18fa82ee1f5edbfa6362bb3f9079033880c49d: Status 404 returned error can't find the container with id f47983f434ce0e88a51fdd72ee18fa82ee1f5edbfa6362bb3f9079033880c49d Aug 04 10:38:45.197293 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:45.197268 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-pkgdb" event={"ID":"ddedd35f-550d-4a9b-8856-162289a087e1","Type":"ContainerStarted","Data":"cfb004fa526f656e7a531b65c0d52c659153a4bddce715e4377447494bc9642b"} Aug 04 10:38:45.198363 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:45.198308 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-bl62w" event={"ID":"f93ae815-8c4c-4b43-987b-5bf70573393d","Type":"ContainerStarted","Data":"f47983f434ce0e88a51fdd72ee18fa82ee1f5edbfa6362bb3f9079033880c49d"} Aug 04 10:38:46.641427 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:46.641375 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-qm7p8"] Aug 04 10:38:46.644200 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:46.644180 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-qm7p8" Aug 04 10:38:46.646917 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:46.646896 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Aug 04 10:38:46.648188 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:46.648164 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-dkj2z\"" Aug 04 10:38:46.648447 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:46.648431 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Aug 04 10:38:46.648541 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:46.648486 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Aug 04 10:38:46.648709 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:46.648690 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Aug 04 10:38:46.654625 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:46.653885 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-qm7p8"] Aug 04 10:38:46.654691 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:46.654640 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Aug 04 10:38:46.722323 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:46.722293 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db761abf-6fd4-438a-89ce-d7c2eae67bae-config\") pod \"console-operator-5ccd6b445f-qm7p8\" (UID: \"db761abf-6fd4-438a-89ce-d7c2eae67bae\") " pod="openshift-console-operator/console-operator-5ccd6b445f-qm7p8" Aug 04 10:38:46.722490 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:46.722409 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db761abf-6fd4-438a-89ce-d7c2eae67bae-trusted-ca\") pod \"console-operator-5ccd6b445f-qm7p8\" (UID: \"db761abf-6fd4-438a-89ce-d7c2eae67bae\") " pod="openshift-console-operator/console-operator-5ccd6b445f-qm7p8" Aug 04 10:38:46.722490 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:46.722442 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db761abf-6fd4-438a-89ce-d7c2eae67bae-serving-cert\") pod \"console-operator-5ccd6b445f-qm7p8\" (UID: \"db761abf-6fd4-438a-89ce-d7c2eae67bae\") " pod="openshift-console-operator/console-operator-5ccd6b445f-qm7p8" Aug 04 10:38:46.722490 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:46.722473 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6vqh\" (UniqueName: \"kubernetes.io/projected/db761abf-6fd4-438a-89ce-d7c2eae67bae-kube-api-access-k6vqh\") pod \"console-operator-5ccd6b445f-qm7p8\" (UID: \"db761abf-6fd4-438a-89ce-d7c2eae67bae\") " pod="openshift-console-operator/console-operator-5ccd6b445f-qm7p8" Aug 04 10:38:46.823667 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:46.823637 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db761abf-6fd4-438a-89ce-d7c2eae67bae-config\") pod \"console-operator-5ccd6b445f-qm7p8\" (UID: \"db761abf-6fd4-438a-89ce-d7c2eae67bae\") " pod="openshift-console-operator/console-operator-5ccd6b445f-qm7p8" Aug 04 10:38:46.823841 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:46.823722 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db761abf-6fd4-438a-89ce-d7c2eae67bae-trusted-ca\") pod \"console-operator-5ccd6b445f-qm7p8\" (UID: \"db761abf-6fd4-438a-89ce-d7c2eae67bae\") " pod="openshift-console-operator/console-operator-5ccd6b445f-qm7p8" Aug 04 10:38:46.823841 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:46.823751 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db761abf-6fd4-438a-89ce-d7c2eae67bae-serving-cert\") pod \"console-operator-5ccd6b445f-qm7p8\" (UID: \"db761abf-6fd4-438a-89ce-d7c2eae67bae\") " pod="openshift-console-operator/console-operator-5ccd6b445f-qm7p8" Aug 04 10:38:46.823841 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:46.823778 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6vqh\" (UniqueName: \"kubernetes.io/projected/db761abf-6fd4-438a-89ce-d7c2eae67bae-kube-api-access-k6vqh\") pod \"console-operator-5ccd6b445f-qm7p8\" (UID: \"db761abf-6fd4-438a-89ce-d7c2eae67bae\") " pod="openshift-console-operator/console-operator-5ccd6b445f-qm7p8" Aug 04 10:38:46.825230 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:46.825186 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db761abf-6fd4-438a-89ce-d7c2eae67bae-config\") pod \"console-operator-5ccd6b445f-qm7p8\" (UID: \"db761abf-6fd4-438a-89ce-d7c2eae67bae\") " pod="openshift-console-operator/console-operator-5ccd6b445f-qm7p8" Aug 04 10:38:46.825363 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:46.825269 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db761abf-6fd4-438a-89ce-d7c2eae67bae-trusted-ca\") pod \"console-operator-5ccd6b445f-qm7p8\" (UID: \"db761abf-6fd4-438a-89ce-d7c2eae67bae\") " pod="openshift-console-operator/console-operator-5ccd6b445f-qm7p8" Aug 04 10:38:46.828380 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:46.826986 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db761abf-6fd4-438a-89ce-d7c2eae67bae-serving-cert\") pod \"console-operator-5ccd6b445f-qm7p8\" (UID: \"db761abf-6fd4-438a-89ce-d7c2eae67bae\") " pod="openshift-console-operator/console-operator-5ccd6b445f-qm7p8" Aug 04 10:38:46.834586 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:46.834562 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6vqh\" (UniqueName: \"kubernetes.io/projected/db761abf-6fd4-438a-89ce-d7c2eae67bae-kube-api-access-k6vqh\") pod \"console-operator-5ccd6b445f-qm7p8\" (UID: \"db761abf-6fd4-438a-89ce-d7c2eae67bae\") " pod="openshift-console-operator/console-operator-5ccd6b445f-qm7p8" Aug 04 10:38:46.955318 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:46.955231 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-qm7p8" Aug 04 10:38:47.142569 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:47.142544 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-qm7p8"] Aug 04 10:38:47.145210 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:38:47.145178 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb761abf_6fd4_438a_89ce_d7c2eae67bae.slice/crio-4bd8cac7c894e9dbb964e2ede9f2f086e6a2199419a55dbdfcc3f59a131a621a WatchSource:0}: Error finding container 4bd8cac7c894e9dbb964e2ede9f2f086e6a2199419a55dbdfcc3f59a131a621a: Status 404 returned error can't find the container with id 4bd8cac7c894e9dbb964e2ede9f2f086e6a2199419a55dbdfcc3f59a131a621a Aug 04 10:38:47.204944 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:47.204907 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-qm7p8" event={"ID":"db761abf-6fd4-438a-89ce-d7c2eae67bae","Type":"ContainerStarted","Data":"4bd8cac7c894e9dbb964e2ede9f2f086e6a2199419a55dbdfcc3f59a131a621a"} Aug 04 10:38:47.206430 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:47.206349 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-pkgdb" event={"ID":"ddedd35f-550d-4a9b-8856-162289a087e1","Type":"ContainerStarted","Data":"f3f9843957ccde34a6b50ea7f6c519bbf31580676b2fe70718422e8a81867e9f"} Aug 04 10:38:47.207805 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:47.207781 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-bl62w" event={"ID":"f93ae815-8c4c-4b43-987b-5bf70573393d","Type":"ContainerStarted","Data":"62c791966b969c3b544d3087d6eb64718f367fa1ab559450d91c2bbddf4a4907"} Aug 04 10:38:47.224513 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:47.224466 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-pkgdb" podStartSLOduration=2.141240766 podStartE2EDuration="3.224448901s" totalImagesPullingTime="1.083208135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:38:47.223513501 +0000 UTC m=+77.822417896" watchObservedRunningTime="2026-08-04 10:38:47.224448901 +0000 UTC m=+77.823353273" Aug 04 10:38:47.242479 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:47.242447 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-bl62w" podStartSLOduration=1.3854167560000001 podStartE2EDuration="3.242435382s" totalImagesPullingTime="1.857018626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:38:47.242325801 +0000 UTC m=+77.841230204" watchObservedRunningTime="2026-08-04 10:38:47.242435382 +0000 UTC m=+77.841339755" Aug 04 10:38:48.382434 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:48.382382 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bfwzl"] Aug 04 10:38:48.385022 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:48.384997 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:38:48.388081 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:48.388046 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Aug 04 10:38:48.388231 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:48.388053 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v8c5x\"" Aug 04 10:38:48.391896 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:48.391873 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Aug 04 10:38:48.395704 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:48.395330 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bfwzl"] Aug 04 10:38:48.434408 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:48.434364 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-data-volume\") pod \"insights-runtime-extractor-bfwzl\" (UID: \"d5215ef8-edac-48ef-ad97-7a2a0de5cd79\") " pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:38:48.434408 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:48.434409 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgpgg\" (UniqueName: \"kubernetes.io/projected/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-kube-api-access-rgpgg\") pod \"insights-runtime-extractor-bfwzl\" (UID: \"d5215ef8-edac-48ef-ad97-7a2a0de5cd79\") " pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:38:48.434585 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:48.434483 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bfwzl\" (UID: \"d5215ef8-edac-48ef-ad97-7a2a0de5cd79\") " pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:38:48.434585 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:48.434535 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bfwzl\" (UID: \"d5215ef8-edac-48ef-ad97-7a2a0de5cd79\") " pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:38:48.434585 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:48.434573 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-crio-socket\") pod \"insights-runtime-extractor-bfwzl\" (UID: \"d5215ef8-edac-48ef-ad97-7a2a0de5cd79\") " pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:38:48.534872 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:48.534841 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bfwzl\" (UID: \"d5215ef8-edac-48ef-ad97-7a2a0de5cd79\") " pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:38:48.535019 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:48.534879 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-crio-socket\") pod \"insights-runtime-extractor-bfwzl\" (UID: \"d5215ef8-edac-48ef-ad97-7a2a0de5cd79\") " pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:38:48.535019 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:48.534916 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-data-volume\") pod \"insights-runtime-extractor-bfwzl\" (UID: \"d5215ef8-edac-48ef-ad97-7a2a0de5cd79\") " pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:38:48.535019 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:48.534938 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgpgg\" (UniqueName: \"kubernetes.io/projected/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-kube-api-access-rgpgg\") pod \"insights-runtime-extractor-bfwzl\" (UID: \"d5215ef8-edac-48ef-ad97-7a2a0de5cd79\") " pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:38:48.535019 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:48.534974 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 04 10:38:48.535019 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:48.534984 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-crio-socket\") pod \"insights-runtime-extractor-bfwzl\" (UID: \"d5215ef8-edac-48ef-ad97-7a2a0de5cd79\") " pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:38:48.535019 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:48.534988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bfwzl\" (UID: \"d5215ef8-edac-48ef-ad97-7a2a0de5cd79\") " pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:38:48.535313 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:48.535047 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-kube-rbac-proxy-cm podName:d5215ef8-edac-48ef-ad97-7a2a0de5cd79 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:49.035025231 +0000 UTC m=+79.633929601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bfwzl" (UID: "d5215ef8-edac-48ef-ad97-7a2a0de5cd79") : configmap "kube-rbac-proxy" not found Aug 04 10:38:48.535313 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:48.535066 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 04 10:38:48.535313 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:48.535127 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-insights-runtime-extractor-tls podName:d5215ef8-edac-48ef-ad97-7a2a0de5cd79 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:49.035111463 +0000 UTC m=+79.634015822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bfwzl" (UID: "d5215ef8-edac-48ef-ad97-7a2a0de5cd79") : secret "insights-runtime-extractor-tls" not found Aug 04 10:38:48.535313 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:48.535230 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-data-volume\") pod \"insights-runtime-extractor-bfwzl\" (UID: \"d5215ef8-edac-48ef-ad97-7a2a0de5cd79\") " pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:38:48.546421 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:48.546382 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgpgg\" (UniqueName: \"kubernetes.io/projected/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-kube-api-access-rgpgg\") pod \"insights-runtime-extractor-bfwzl\" (UID: \"d5215ef8-edac-48ef-ad97-7a2a0de5cd79\") " pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:38:49.039697 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:49.039660 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bfwzl\" (UID: \"d5215ef8-edac-48ef-ad97-7a2a0de5cd79\") " pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:38:49.039887 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:49.039723 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bfwzl\" (UID: \"d5215ef8-edac-48ef-ad97-7a2a0de5cd79\") " pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:38:49.039887 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:49.039811 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 04 10:38:49.039887 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:49.039826 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 04 10:38:49.040025 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:49.039893 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-kube-rbac-proxy-cm podName:d5215ef8-edac-48ef-ad97-7a2a0de5cd79 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:50.039872913 +0000 UTC m=+80.638777279 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bfwzl" (UID: "d5215ef8-edac-48ef-ad97-7a2a0de5cd79") : configmap "kube-rbac-proxy" not found Aug 04 10:38:49.040025 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:49.039913 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-insights-runtime-extractor-tls podName:d5215ef8-edac-48ef-ad97-7a2a0de5cd79 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:50.039904352 +0000 UTC m=+80.638808705 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bfwzl" (UID: "d5215ef8-edac-48ef-ad97-7a2a0de5cd79") : secret "insights-runtime-extractor-tls" not found Aug 04 10:38:50.046753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:50.046719 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bfwzl\" (UID: \"d5215ef8-edac-48ef-ad97-7a2a0de5cd79\") " pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:38:50.047138 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:50.046759 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bfwzl\" (UID: \"d5215ef8-edac-48ef-ad97-7a2a0de5cd79\") " pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:38:50.047138 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:50.046823 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 04 10:38:50.047138 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:50.046865 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 04 10:38:50.047138 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:50.046873 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-kube-rbac-proxy-cm podName:d5215ef8-edac-48ef-ad97-7a2a0de5cd79 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:52.046859877 +0000 UTC m=+82.645764229 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bfwzl" (UID: "d5215ef8-edac-48ef-ad97-7a2a0de5cd79") : configmap "kube-rbac-proxy" not found Aug 04 10:38:50.047138 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:50.046923 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-insights-runtime-extractor-tls podName:d5215ef8-edac-48ef-ad97-7a2a0de5cd79 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:52.046909031 +0000 UTC m=+82.645813383 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bfwzl" (UID: "d5215ef8-edac-48ef-ad97-7a2a0de5cd79") : secret "insights-runtime-extractor-tls" not found Aug 04 10:38:50.109964 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:50.109932 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dz4jf_bf0c1197-51b3-4912-8503-9d06553abdc0/dns-node-resolver/0.log" Aug 04 10:38:50.217483 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:50.217346 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/0.log" Aug 04 10:38:50.217483 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:50.217412 2576 generic.go:356] "Generic (PLEG): container finished" podID="db761abf-6fd4-438a-89ce-d7c2eae67bae" containerID="39fe0c4db13059154b704e345e280430db4437f04915e4325f7d2c462bcf027b" exitCode=255 Aug 04 10:38:50.217483 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:50.217470 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-qm7p8" event={"ID":"db761abf-6fd4-438a-89ce-d7c2eae67bae","Type":"ContainerDied","Data":"39fe0c4db13059154b704e345e280430db4437f04915e4325f7d2c462bcf027b"} Aug 04 10:38:50.217774 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:50.217726 2576 scope.go:117] "RemoveContainer" containerID="39fe0c4db13059154b704e345e280430db4437f04915e4325f7d2c462bcf027b" Aug 04 10:38:50.569783 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:50.569753 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-hrxqd"] Aug 04 10:38:50.571905 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:50.571889 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-hrxqd" Aug 04 10:38:50.576231 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:50.576185 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Aug 04 10:38:50.576331 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:50.576266 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-sd9j5\"" Aug 04 10:38:50.576446 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:50.576431 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Aug 04 10:38:50.583940 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:50.583918 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-hrxqd"] Aug 04 10:38:50.651890 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:50.651865 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lppvq\" (UniqueName: \"kubernetes.io/projected/e230df0e-f556-47ef-95f8-d693104f4a54-kube-api-access-lppvq\") pod \"migrator-68bc745d87-hrxqd\" (UID: \"e230df0e-f556-47ef-95f8-d693104f4a54\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-hrxqd" Aug 04 10:38:50.752501 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:50.752473 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lppvq\" (UniqueName: \"kubernetes.io/projected/e230df0e-f556-47ef-95f8-d693104f4a54-kube-api-access-lppvq\") pod \"migrator-68bc745d87-hrxqd\" (UID: \"e230df0e-f556-47ef-95f8-d693104f4a54\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-hrxqd" Aug 04 10:38:50.762501 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:50.762468 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lppvq\" (UniqueName: \"kubernetes.io/projected/e230df0e-f556-47ef-95f8-d693104f4a54-kube-api-access-lppvq\") pod \"migrator-68bc745d87-hrxqd\" (UID: \"e230df0e-f556-47ef-95f8-d693104f4a54\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-hrxqd" Aug 04 10:38:50.881015 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:50.880965 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-hrxqd" Aug 04 10:38:51.002211 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.002186 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-hrxqd"] Aug 04 10:38:51.005387 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:38:51.005361 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode230df0e_f556_47ef_95f8_d693104f4a54.slice/crio-7b3425b7023d44f809bd4bafcffc730b08f91a17c33c499430db438e7da1c902 WatchSource:0}: Error finding container 7b3425b7023d44f809bd4bafcffc730b08f91a17c33c499430db438e7da1c902: Status 404 returned error can't find the container with id 7b3425b7023d44f809bd4bafcffc730b08f91a17c33c499430db438e7da1c902 Aug 04 10:38:51.222139 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.222082 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 10:38:51.222493 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.222468 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/0.log" Aug 04 10:38:51.222551 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.222498 2576 generic.go:356] "Generic (PLEG): container finished" podID="db761abf-6fd4-438a-89ce-d7c2eae67bae" containerID="85bd67d0a92bbea1515ee7a4235bfe1589ac417413d4800269eb39cfbe7e773d" exitCode=255 Aug 04 10:38:51.222615 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.222592 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-qm7p8" event={"ID":"db761abf-6fd4-438a-89ce-d7c2eae67bae","Type":"ContainerDied","Data":"85bd67d0a92bbea1515ee7a4235bfe1589ac417413d4800269eb39cfbe7e773d"} Aug 04 10:38:51.222668 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.222648 2576 scope.go:117] "RemoveContainer" containerID="39fe0c4db13059154b704e345e280430db4437f04915e4325f7d2c462bcf027b" Aug 04 10:38:51.222851 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.222825 2576 scope.go:117] "RemoveContainer" containerID="85bd67d0a92bbea1515ee7a4235bfe1589ac417413d4800269eb39cfbe7e773d" Aug 04 10:38:51.223003 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:51.222982 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-qm7p8_openshift-console-operator(db761abf-6fd4-438a-89ce-d7c2eae67bae)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-qm7p8" podUID="db761abf-6fd4-438a-89ce-d7c2eae67bae" Aug 04 10:38:51.223695 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.223675 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-hrxqd" event={"ID":"e230df0e-f556-47ef-95f8-d693104f4a54","Type":"ContainerStarted","Data":"7b3425b7023d44f809bd4bafcffc730b08f91a17c33c499430db438e7da1c902"} Aug 04 10:38:51.311381 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.311355 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xq5bm_e20c225e-bf93-46af-a2d3-f3ddaadc3bbd/node-ca/0.log" Aug 04 10:38:51.658416 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.658375 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-dd445d9f8-jqmxq"] Aug 04 10:38:51.661161 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.661146 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:51.664052 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.664033 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Aug 04 10:38:51.664172 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.664059 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xjf6f\"" Aug 04 10:38:51.664282 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.664266 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Aug 04 10:38:51.665274 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.665258 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Aug 04 10:38:51.672501 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.672480 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Aug 04 10:38:51.677536 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.677515 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-dd445d9f8-jqmxq"] Aug 04 10:38:51.759560 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.759534 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7f69dd5e-7e95-4738-a2a6-831a5513d66f-image-registry-private-configuration\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:51.759651 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.759565 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7f69dd5e-7e95-4738-a2a6-831a5513d66f-registry-certificates\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:51.759651 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.759588 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-registry-tls\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:51.759651 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.759646 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-bound-sa-token\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:51.759813 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.759669 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7f69dd5e-7e95-4738-a2a6-831a5513d66f-trusted-ca\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:51.759813 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.759687 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7f69dd5e-7e95-4738-a2a6-831a5513d66f-ca-trust-extracted\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:51.759813 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.759725 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4psx\" (UniqueName: \"kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-kube-api-access-x4psx\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:51.759813 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.759754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7f69dd5e-7e95-4738-a2a6-831a5513d66f-installation-pull-secrets\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:51.860082 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.860053 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7f69dd5e-7e95-4738-a2a6-831a5513d66f-image-registry-private-configuration\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:51.860199 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.860094 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7f69dd5e-7e95-4738-a2a6-831a5513d66f-registry-certificates\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:51.860320 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.860284 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-registry-tls\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:51.860427 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.860379 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-bound-sa-token\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:51.860493 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.860437 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7f69dd5e-7e95-4738-a2a6-831a5513d66f-trusted-ca\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:51.860493 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:51.860451 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 04 10:38:51.860493 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.860460 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7f69dd5e-7e95-4738-a2a6-831a5513d66f-ca-trust-extracted\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:51.860493 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:51.860469 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dd445d9f8-jqmxq: secret "image-registry-tls" not found Aug 04 10:38:51.860689 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:51.860548 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-registry-tls podName:7f69dd5e-7e95-4738-a2a6-831a5513d66f nodeName:}" failed. No retries permitted until 2026-08-04 10:38:52.360529304 +0000 UTC m=+82.959433659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-registry-tls") pod "image-registry-dd445d9f8-jqmxq" (UID: "7f69dd5e-7e95-4738-a2a6-831a5513d66f") : secret "image-registry-tls" not found Aug 04 10:38:51.860689 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.860482 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4psx\" (UniqueName: \"kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-kube-api-access-x4psx\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:51.860689 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.860621 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7f69dd5e-7e95-4738-a2a6-831a5513d66f-installation-pull-secrets\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:51.861207 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.861180 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7f69dd5e-7e95-4738-a2a6-831a5513d66f-ca-trust-extracted\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:51.861472 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.861425 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7f69dd5e-7e95-4738-a2a6-831a5513d66f-registry-certificates\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:51.861945 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.861919 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7f69dd5e-7e95-4738-a2a6-831a5513d66f-trusted-ca\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:51.863724 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.863701 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7f69dd5e-7e95-4738-a2a6-831a5513d66f-image-registry-private-configuration\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:51.863812 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.863701 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7f69dd5e-7e95-4738-a2a6-831a5513d66f-installation-pull-secrets\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:51.869757 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.869737 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-bound-sa-token\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:51.870009 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.869994 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4psx\" (UniqueName: \"kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-kube-api-access-x4psx\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:51.909728 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:51.909634 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ssnvq_4756e1b9-37a8-46e2-a62d-7eb3c0a56f99/serve-healthcheck-canary/0.log" Aug 04 10:38:52.063069 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:52.063035 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bfwzl\" (UID: \"d5215ef8-edac-48ef-ad97-7a2a0de5cd79\") " pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:38:52.063069 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:52.063081 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bfwzl\" (UID: \"d5215ef8-edac-48ef-ad97-7a2a0de5cd79\") " pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:38:52.063281 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:52.063157 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 04 10:38:52.063281 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:52.063204 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 04 10:38:52.063281 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:52.063220 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-kube-rbac-proxy-cm podName:d5215ef8-edac-48ef-ad97-7a2a0de5cd79 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:56.063201864 +0000 UTC m=+86.662106242 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bfwzl" (UID: "d5215ef8-edac-48ef-ad97-7a2a0de5cd79") : configmap "kube-rbac-proxy" not found Aug 04 10:38:52.063471 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:52.063289 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-insights-runtime-extractor-tls podName:d5215ef8-edac-48ef-ad97-7a2a0de5cd79 nodeName:}" failed. No retries permitted until 2026-08-04 10:38:56.063273492 +0000 UTC m=+86.662177860 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bfwzl" (UID: "d5215ef8-edac-48ef-ad97-7a2a0de5cd79") : secret "insights-runtime-extractor-tls" not found Aug 04 10:38:52.230494 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:52.230420 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 10:38:52.230926 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:52.230853 2576 scope.go:117] "RemoveContainer" containerID="85bd67d0a92bbea1515ee7a4235bfe1589ac417413d4800269eb39cfbe7e773d" Aug 04 10:38:52.231076 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:52.231046 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-qm7p8_openshift-console-operator(db761abf-6fd4-438a-89ce-d7c2eae67bae)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-qm7p8" podUID="db761abf-6fd4-438a-89ce-d7c2eae67bae" Aug 04 10:38:52.366340 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:52.366314 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-registry-tls\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:52.366468 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:52.366452 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 04 10:38:52.366510 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:52.366470 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dd445d9f8-jqmxq: secret "image-registry-tls" not found Aug 04 10:38:52.366541 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:52.366533 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-registry-tls podName:7f69dd5e-7e95-4738-a2a6-831a5513d66f nodeName:}" failed. No retries permitted until 2026-08-04 10:38:53.36651811 +0000 UTC m=+83.965422466 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-registry-tls") pod "image-registry-dd445d9f8-jqmxq" (UID: "7f69dd5e-7e95-4738-a2a6-831a5513d66f") : secret "image-registry-tls" not found Aug 04 10:38:53.235880 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:53.235832 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-hrxqd" event={"ID":"e230df0e-f556-47ef-95f8-d693104f4a54","Type":"ContainerStarted","Data":"f6c39d068a34c8eeee924f5f939e499e2a5cfdb91816bed9ae4cde278743b249"} Aug 04 10:38:53.236305 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:53.235909 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-hrxqd" event={"ID":"e230df0e-f556-47ef-95f8-d693104f4a54","Type":"ContainerStarted","Data":"4e8c86eab5b2ec142cd897ad33c178f5f437d0caaac260071954df0d711299f7"} Aug 04 10:38:53.254369 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:53.254314 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-hrxqd" podStartSLOduration=1.9180681819999998 podStartE2EDuration="3.254298825s" totalImagesPullingTime="1.336230643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:38:53.252596325 +0000 UTC m=+83.851500701" watchObservedRunningTime="2026-08-04 10:38:53.254298825 +0000 UTC m=+83.853203260" Aug 04 10:38:53.374683 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:53.374656 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-registry-tls\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:53.374829 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:53.374780 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 04 10:38:53.374829 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:53.374792 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dd445d9f8-jqmxq: secret "image-registry-tls" not found Aug 04 10:38:53.374924 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:53.374842 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-registry-tls podName:7f69dd5e-7e95-4738-a2a6-831a5513d66f nodeName:}" failed. No retries permitted until 2026-08-04 10:38:55.374829003 +0000 UTC m=+85.973733356 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-registry-tls") pod "image-registry-dd445d9f8-jqmxq" (UID: "7f69dd5e-7e95-4738-a2a6-831a5513d66f") : secret "image-registry-tls" not found Aug 04 10:38:55.389027 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:55.388932 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-registry-tls\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:55.389027 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:55.389017 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 04 10:38:55.389027 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:55.389032 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dd445d9f8-jqmxq: secret "image-registry-tls" not found Aug 04 10:38:55.389488 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:55.389080 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-registry-tls podName:7f69dd5e-7e95-4738-a2a6-831a5513d66f nodeName:}" failed. No retries permitted until 2026-08-04 10:38:59.389067138 +0000 UTC m=+89.987971491 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-registry-tls") pod "image-registry-dd445d9f8-jqmxq" (UID: "7f69dd5e-7e95-4738-a2a6-831a5513d66f") : secret "image-registry-tls" not found Aug 04 10:38:56.094480 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:56.094448 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bfwzl\" (UID: \"d5215ef8-edac-48ef-ad97-7a2a0de5cd79\") " pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:38:56.094642 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:56.094489 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bfwzl\" (UID: \"d5215ef8-edac-48ef-ad97-7a2a0de5cd79\") " pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:38:56.094642 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:56.094570 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 04 10:38:56.094642 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:56.094595 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 04 10:38:56.094642 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:56.094629 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-kube-rbac-proxy-cm podName:d5215ef8-edac-48ef-ad97-7a2a0de5cd79 nodeName:}" failed. No retries permitted until 2026-08-04 10:39:04.094612015 +0000 UTC m=+94.693516373 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bfwzl" (UID: "d5215ef8-edac-48ef-ad97-7a2a0de5cd79") : configmap "kube-rbac-proxy" not found Aug 04 10:38:56.094778 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:56.094644 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-insights-runtime-extractor-tls podName:d5215ef8-edac-48ef-ad97-7a2a0de5cd79 nodeName:}" failed. No retries permitted until 2026-08-04 10:39:04.094638177 +0000 UTC m=+94.693542530 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bfwzl" (UID: "d5215ef8-edac-48ef-ad97-7a2a0de5cd79") : secret "insights-runtime-extractor-tls" not found Aug 04 10:38:56.955436 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:56.955385 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-qm7p8" Aug 04 10:38:56.955807 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:56.955457 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-qm7p8" Aug 04 10:38:56.955807 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:56.955782 2576 scope.go:117] "RemoveContainer" containerID="85bd67d0a92bbea1515ee7a4235bfe1589ac417413d4800269eb39cfbe7e773d" Aug 04 10:38:56.955940 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:38:56.955922 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-qm7p8_openshift-console-operator(db761abf-6fd4-438a-89ce-d7c2eae67bae)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-qm7p8" podUID="db761abf-6fd4-438a-89ce-d7c2eae67bae" Aug 04 10:38:59.420801 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:59.420760 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-registry-tls\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:59.423286 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:59.423262 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-registry-tls\") pod \"image-registry-dd445d9f8-jqmxq\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:59.473872 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:59.473838 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:38:59.606552 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:38:59.606522 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-dd445d9f8-jqmxq"] Aug 04 10:38:59.610287 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:38:59.610257 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f69dd5e_7e95_4738_a2a6_831a5513d66f.slice/crio-cff1816b77cb27212101b5991feb8508b326a256e75c921a01a647e8fcd72d69 WatchSource:0}: Error finding container cff1816b77cb27212101b5991feb8508b326a256e75c921a01a647e8fcd72d69: Status 404 returned error can't find the container with id cff1816b77cb27212101b5991feb8508b326a256e75c921a01a647e8fcd72d69 Aug 04 10:39:00.260904 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:00.260870 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" event={"ID":"7f69dd5e-7e95-4738-a2a6-831a5513d66f","Type":"ContainerStarted","Data":"a90c95d03a469a885a9131ac0c1206b5a727818d6e89b2edd7528decfc4bc516"} Aug 04 10:39:00.261054 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:00.260945 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" event={"ID":"7f69dd5e-7e95-4738-a2a6-831a5513d66f","Type":"ContainerStarted","Data":"cff1816b77cb27212101b5991feb8508b326a256e75c921a01a647e8fcd72d69"} Aug 04 10:39:00.261054 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:00.260998 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:39:00.287471 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:00.287429 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" podStartSLOduration=9.287417072 podStartE2EDuration="9.287417072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:38:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:39:00.285837081 +0000 UTC m=+90.884741496" watchObservedRunningTime="2026-08-04 10:39:00.287417072 +0000 UTC m=+90.886321446" Aug 04 10:39:04.162009 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:04.161967 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bfwzl\" (UID: \"d5215ef8-edac-48ef-ad97-7a2a0de5cd79\") " pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:39:04.162557 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:04.162065 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bfwzl\" (UID: \"d5215ef8-edac-48ef-ad97-7a2a0de5cd79\") " pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:39:04.162557 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:39:04.162157 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 04 10:39:04.162557 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:39:04.162209 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-insights-runtime-extractor-tls podName:d5215ef8-edac-48ef-ad97-7a2a0de5cd79 nodeName:}" failed. No retries permitted until 2026-08-04 10:39:20.162196439 +0000 UTC m=+110.761100791 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bfwzl" (UID: "d5215ef8-edac-48ef-ad97-7a2a0de5cd79") : secret "insights-runtime-extractor-tls" not found Aug 04 10:39:04.162675 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:04.162567 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bfwzl\" (UID: \"d5215ef8-edac-48ef-ad97-7a2a0de5cd79\") " pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:39:07.686801 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:07.686762 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cebbba9-957c-4011-9ba2-9d5255894e51-metrics-tls\") pod \"dns-default-tvksr\" (UID: \"6cebbba9-957c-4011-9ba2-9d5255894e51\") " pod="openshift-dns/dns-default-tvksr" Aug 04 10:39:07.689270 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:07.689246 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cebbba9-957c-4011-9ba2-9d5255894e51-metrics-tls\") pod \"dns-default-tvksr\" (UID: \"6cebbba9-957c-4011-9ba2-9d5255894e51\") " pod="openshift-dns/dns-default-tvksr" Aug 04 10:39:07.972091 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:07.972018 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f4ggs\"" Aug 04 10:39:07.980363 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:07.980346 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tvksr" Aug 04 10:39:08.108017 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:08.107856 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tvksr"] Aug 04 10:39:08.110500 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:39:08.110469 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cebbba9_957c_4011_9ba2_9d5255894e51.slice/crio-5bc5c72bdabe358d022fe4d3aded06429e225e7e5641d3fa1f9d6a84ece9b52b WatchSource:0}: Error finding container 5bc5c72bdabe358d022fe4d3aded06429e225e7e5641d3fa1f9d6a84ece9b52b: Status 404 returned error can't find the container with id 5bc5c72bdabe358d022fe4d3aded06429e225e7e5641d3fa1f9d6a84ece9b52b Aug 04 10:39:08.284944 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:08.284912 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tvksr" event={"ID":"6cebbba9-957c-4011-9ba2-9d5255894e51","Type":"ContainerStarted","Data":"5bc5c72bdabe358d022fe4d3aded06429e225e7e5641d3fa1f9d6a84ece9b52b"} Aug 04 10:39:10.185125 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:10.185092 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wfs5z" Aug 04 10:39:10.923887 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:10.923853 2576 scope.go:117] "RemoveContainer" containerID="85bd67d0a92bbea1515ee7a4235bfe1589ac417413d4800269eb39cfbe7e773d" Aug 04 10:39:11.296259 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:11.296229 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 10:39:11.296728 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:11.296279 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-qm7p8" event={"ID":"db761abf-6fd4-438a-89ce-d7c2eae67bae","Type":"ContainerStarted","Data":"1cb62a46fcb87884d24f99141bb8751edf4bd410132460f36fa725efc8888ff3"} Aug 04 10:39:11.296852 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:11.296735 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-qm7p8" Aug 04 10:39:11.318804 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:11.318756 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5ccd6b445f-qm7p8" podStartSLOduration=23.227765 podStartE2EDuration="25.318737244s" totalImagesPullingTime="2.090972244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:39:11.318531033 +0000 UTC m=+101.917435408" watchObservedRunningTime="2026-08-04 10:39:11.318737244 +0000 UTC m=+101.917641622" Aug 04 10:39:11.639956 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:11.639881 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5ccd6b445f-qm7p8" Aug 04 10:39:12.301523 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:12.301488 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tvksr" event={"ID":"6cebbba9-957c-4011-9ba2-9d5255894e51","Type":"ContainerStarted","Data":"0503a3f5e6c715321d5b34ac2296245820a3e38eee013eef195aa4cdb86f22e6"} Aug 04 10:39:12.301897 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:12.301546 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tvksr" event={"ID":"6cebbba9-957c-4011-9ba2-9d5255894e51","Type":"ContainerStarted","Data":"6414ca45af38ab76288d2e43bf395a4680517019cb31bbdd176a4e7965622059"} Aug 04 10:39:12.327007 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:12.326968 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tvksr" podStartSLOduration=65.536196472 podStartE2EDuration="1m9.326953438s" totalImagesPullingTime="3.790756966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:38:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:39:12.326319497 +0000 UTC m=+102.925223872" watchObservedRunningTime="2026-08-04 10:39:12.326953438 +0000 UTC m=+102.925857848" Aug 04 10:39:13.304462 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:13.304430 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tvksr" Aug 04 10:39:16.160615 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:16.160582 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-dd445d9f8-jqmxq"] Aug 04 10:39:16.164814 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:16.164783 2576 patch_prober.go:28] interesting pod/image-registry-dd445d9f8-jqmxq container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Aug 04 10:39:16.164944 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:16.164835 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" podUID="7f69dd5e-7e95-4738-a2a6-831a5513d66f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 04 10:39:16.190126 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:16.190105 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-kz55f"] Aug 04 10:39:16.202869 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:16.202842 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-kz55f" Aug 04 10:39:16.207059 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:16.207040 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-mjmsf\"" Aug 04 10:39:16.207300 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:16.207281 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Aug 04 10:39:16.207344 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:16.207336 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Aug 04 10:39:16.218737 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:16.218717 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-kz55f"] Aug 04 10:39:16.352570 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:16.352539 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc5t8\" (UniqueName: \"kubernetes.io/projected/872a0621-2d81-485a-b3ac-ed1319cd8f09-kube-api-access-kc5t8\") pod \"downloads-77c974ffcf-kz55f\" (UID: \"872a0621-2d81-485a-b3ac-ed1319cd8f09\") " pod="openshift-console/downloads-77c974ffcf-kz55f" Aug 04 10:39:16.453706 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:16.453631 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc5t8\" (UniqueName: \"kubernetes.io/projected/872a0621-2d81-485a-b3ac-ed1319cd8f09-kube-api-access-kc5t8\") pod \"downloads-77c974ffcf-kz55f\" (UID: \"872a0621-2d81-485a-b3ac-ed1319cd8f09\") " pod="openshift-console/downloads-77c974ffcf-kz55f" Aug 04 10:39:16.464486 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:16.464464 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc5t8\" (UniqueName: \"kubernetes.io/projected/872a0621-2d81-485a-b3ac-ed1319cd8f09-kube-api-access-kc5t8\") pod \"downloads-77c974ffcf-kz55f\" (UID: \"872a0621-2d81-485a-b3ac-ed1319cd8f09\") " pod="openshift-console/downloads-77c974ffcf-kz55f" Aug 04 10:39:16.511243 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:16.511216 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-kz55f" Aug 04 10:39:16.664772 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:16.664749 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-kz55f"] Aug 04 10:39:16.667044 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:39:16.667014 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod872a0621_2d81_485a_b3ac_ed1319cd8f09.slice/crio-1eaee5120f7bc332df029fa74582e7eadbe9422401b13bab3b8d0adfd8185716 WatchSource:0}: Error finding container 1eaee5120f7bc332df029fa74582e7eadbe9422401b13bab3b8d0adfd8185716: Status 404 returned error can't find the container with id 1eaee5120f7bc332df029fa74582e7eadbe9422401b13bab3b8d0adfd8185716 Aug 04 10:39:17.317554 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:17.317518 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-kz55f" event={"ID":"872a0621-2d81-485a-b3ac-ed1319cd8f09","Type":"ContainerStarted","Data":"1eaee5120f7bc332df029fa74582e7eadbe9422401b13bab3b8d0adfd8185716"} Aug 04 10:39:20.187908 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.187873 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bfwzl\" (UID: \"d5215ef8-edac-48ef-ad97-7a2a0de5cd79\") " pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:39:20.190656 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.190625 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5215ef8-edac-48ef-ad97-7a2a0de5cd79-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bfwzl\" (UID: \"d5215ef8-edac-48ef-ad97-7a2a0de5cd79\") " pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:39:20.199545 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.199522 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bfwzl" Aug 04 10:39:20.340580 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.340550 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bfwzl"] Aug 04 10:39:20.344961 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:39:20.344928 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5215ef8_edac_48ef_ad97_7a2a0de5cd79.slice/crio-b4082e34d892b3319223cbc74697b7d0ab85ee3c6da425b8657409a190c14291 WatchSource:0}: Error finding container b4082e34d892b3319223cbc74697b7d0ab85ee3c6da425b8657409a190c14291: Status 404 returned error can't find the container with id b4082e34d892b3319223cbc74697b7d0ab85ee3c6da425b8657409a190c14291 Aug 04 10:39:20.545700 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.545660 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-ff5669589-99ng8"] Aug 04 10:39:20.548032 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.548006 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ff5669589-99ng8" Aug 04 10:39:20.553905 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.553873 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Aug 04 10:39:20.553905 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.553898 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Aug 04 10:39:20.554093 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.553899 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4wctm\"" Aug 04 10:39:20.554093 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.553898 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Aug 04 10:39:20.556179 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.556161 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Aug 04 10:39:20.556310 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.556294 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Aug 04 10:39:20.560489 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.560465 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ff5669589-99ng8"] Aug 04 10:39:20.692085 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.692056 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckzjc\" (UniqueName: \"kubernetes.io/projected/cc903a4b-8fd0-41ba-ad9f-597aa478d946-kube-api-access-ckzjc\") pod \"console-ff5669589-99ng8\" (UID: \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\") " pod="openshift-console/console-ff5669589-99ng8" Aug 04 10:39:20.692222 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.692120 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc903a4b-8fd0-41ba-ad9f-597aa478d946-console-config\") pod \"console-ff5669589-99ng8\" (UID: \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\") " pod="openshift-console/console-ff5669589-99ng8" Aug 04 10:39:20.692222 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.692194 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc903a4b-8fd0-41ba-ad9f-597aa478d946-console-oauth-config\") pod \"console-ff5669589-99ng8\" (UID: \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\") " pod="openshift-console/console-ff5669589-99ng8" Aug 04 10:39:20.692326 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.692254 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc903a4b-8fd0-41ba-ad9f-597aa478d946-console-serving-cert\") pod \"console-ff5669589-99ng8\" (UID: \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\") " pod="openshift-console/console-ff5669589-99ng8" Aug 04 10:39:20.692326 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.692289 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc903a4b-8fd0-41ba-ad9f-597aa478d946-service-ca\") pod \"console-ff5669589-99ng8\" (UID: \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\") " pod="openshift-console/console-ff5669589-99ng8" Aug 04 10:39:20.692459 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.692343 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc903a4b-8fd0-41ba-ad9f-597aa478d946-oauth-serving-cert\") pod \"console-ff5669589-99ng8\" (UID: \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\") " pod="openshift-console/console-ff5669589-99ng8" Aug 04 10:39:20.793175 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.793141 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckzjc\" (UniqueName: \"kubernetes.io/projected/cc903a4b-8fd0-41ba-ad9f-597aa478d946-kube-api-access-ckzjc\") pod \"console-ff5669589-99ng8\" (UID: \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\") " pod="openshift-console/console-ff5669589-99ng8" Aug 04 10:39:20.793339 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.793196 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc903a4b-8fd0-41ba-ad9f-597aa478d946-console-config\") pod \"console-ff5669589-99ng8\" (UID: \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\") " pod="openshift-console/console-ff5669589-99ng8" Aug 04 10:39:20.793433 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.793369 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc903a4b-8fd0-41ba-ad9f-597aa478d946-console-oauth-config\") pod \"console-ff5669589-99ng8\" (UID: \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\") " pod="openshift-console/console-ff5669589-99ng8" Aug 04 10:39:20.793498 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.793481 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc903a4b-8fd0-41ba-ad9f-597aa478d946-console-serving-cert\") pod \"console-ff5669589-99ng8\" (UID: \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\") " pod="openshift-console/console-ff5669589-99ng8" Aug 04 10:39:20.793536 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.793521 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc903a4b-8fd0-41ba-ad9f-597aa478d946-service-ca\") pod \"console-ff5669589-99ng8\" (UID: \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\") " pod="openshift-console/console-ff5669589-99ng8" Aug 04 10:39:20.793569 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.793558 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc903a4b-8fd0-41ba-ad9f-597aa478d946-oauth-serving-cert\") pod \"console-ff5669589-99ng8\" (UID: \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\") " pod="openshift-console/console-ff5669589-99ng8" Aug 04 10:39:20.794286 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.793971 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc903a4b-8fd0-41ba-ad9f-597aa478d946-console-config\") pod \"console-ff5669589-99ng8\" (UID: \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\") " pod="openshift-console/console-ff5669589-99ng8" Aug 04 10:39:20.794286 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.794138 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc903a4b-8fd0-41ba-ad9f-597aa478d946-oauth-serving-cert\") pod \"console-ff5669589-99ng8\" (UID: \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\") " pod="openshift-console/console-ff5669589-99ng8" Aug 04 10:39:20.794507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.794325 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc903a4b-8fd0-41ba-ad9f-597aa478d946-service-ca\") pod \"console-ff5669589-99ng8\" (UID: \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\") " pod="openshift-console/console-ff5669589-99ng8" Aug 04 10:39:20.796530 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.796477 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc903a4b-8fd0-41ba-ad9f-597aa478d946-console-oauth-config\") pod \"console-ff5669589-99ng8\" (UID: \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\") " pod="openshift-console/console-ff5669589-99ng8" Aug 04 10:39:20.796610 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.796557 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc903a4b-8fd0-41ba-ad9f-597aa478d946-console-serving-cert\") pod \"console-ff5669589-99ng8\" (UID: \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\") " pod="openshift-console/console-ff5669589-99ng8" Aug 04 10:39:20.804168 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.804146 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckzjc\" (UniqueName: \"kubernetes.io/projected/cc903a4b-8fd0-41ba-ad9f-597aa478d946-kube-api-access-ckzjc\") pod \"console-ff5669589-99ng8\" (UID: \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\") " pod="openshift-console/console-ff5669589-99ng8" Aug 04 10:39:20.859284 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:20.859251 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ff5669589-99ng8" Aug 04 10:39:21.006476 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:21.006369 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ff5669589-99ng8"] Aug 04 10:39:21.088607 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:39:21.088527 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc903a4b_8fd0_41ba_ad9f_597aa478d946.slice/crio-aaed2ef2e75a90b2b56244a18682d7c4e3e98c6fe5eb7eb8f11e0938094eb772 WatchSource:0}: Error finding container aaed2ef2e75a90b2b56244a18682d7c4e3e98c6fe5eb7eb8f11e0938094eb772: Status 404 returned error can't find the container with id aaed2ef2e75a90b2b56244a18682d7c4e3e98c6fe5eb7eb8f11e0938094eb772 Aug 04 10:39:21.339246 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:21.339165 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ff5669589-99ng8" event={"ID":"cc903a4b-8fd0-41ba-ad9f-597aa478d946","Type":"ContainerStarted","Data":"aaed2ef2e75a90b2b56244a18682d7c4e3e98c6fe5eb7eb8f11e0938094eb772"} Aug 04 10:39:21.341194 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:21.341164 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bfwzl" event={"ID":"d5215ef8-edac-48ef-ad97-7a2a0de5cd79","Type":"ContainerStarted","Data":"5382cc7049e48179caa2241cc557ec4f5b59772448ca488911605c83f0392046"} Aug 04 10:39:21.341311 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:21.341226 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bfwzl" event={"ID":"d5215ef8-edac-48ef-ad97-7a2a0de5cd79","Type":"ContainerStarted","Data":"c2604a00b2b64b8e007c4ce7d8a2e49d9302b7b34477a04fc60d98d302d34135"} Aug 04 10:39:21.341311 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:21.341260 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bfwzl" event={"ID":"d5215ef8-edac-48ef-ad97-7a2a0de5cd79","Type":"ContainerStarted","Data":"b4082e34d892b3319223cbc74697b7d0ab85ee3c6da425b8657409a190c14291"} Aug 04 10:39:23.309812 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:23.309781 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tvksr" Aug 04 10:39:24.549374 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:24.548208 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7787b544cf-bhzwl"] Aug 04 10:39:24.551254 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:24.551227 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:24.563624 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:24.563425 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Aug 04 10:39:24.565162 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:24.565104 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7787b544cf-bhzwl"] Aug 04 10:39:24.730846 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:24.730780 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97b809f8-ed54-4bf1-a138-3481bb016d0f-oauth-serving-cert\") pod \"console-7787b544cf-bhzwl\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:24.730846 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:24.730822 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x8tc\" (UniqueName: \"kubernetes.io/projected/97b809f8-ed54-4bf1-a138-3481bb016d0f-kube-api-access-9x8tc\") pod \"console-7787b544cf-bhzwl\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:24.731032 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:24.730873 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97b809f8-ed54-4bf1-a138-3481bb016d0f-trusted-ca-bundle\") pod \"console-7787b544cf-bhzwl\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:24.731032 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:24.730895 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97b809f8-ed54-4bf1-a138-3481bb016d0f-service-ca\") pod \"console-7787b544cf-bhzwl\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:24.731032 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:24.730924 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97b809f8-ed54-4bf1-a138-3481bb016d0f-console-serving-cert\") pod \"console-7787b544cf-bhzwl\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:24.731032 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:24.730947 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97b809f8-ed54-4bf1-a138-3481bb016d0f-console-config\") pod \"console-7787b544cf-bhzwl\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:24.731032 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:24.730988 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97b809f8-ed54-4bf1-a138-3481bb016d0f-console-oauth-config\") pod \"console-7787b544cf-bhzwl\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:24.832338 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:24.832281 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97b809f8-ed54-4bf1-a138-3481bb016d0f-oauth-serving-cert\") pod \"console-7787b544cf-bhzwl\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:24.832338 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:24.832317 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x8tc\" (UniqueName: \"kubernetes.io/projected/97b809f8-ed54-4bf1-a138-3481bb016d0f-kube-api-access-9x8tc\") pod \"console-7787b544cf-bhzwl\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:24.832548 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:24.832369 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97b809f8-ed54-4bf1-a138-3481bb016d0f-trusted-ca-bundle\") pod \"console-7787b544cf-bhzwl\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:24.832548 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:24.832385 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97b809f8-ed54-4bf1-a138-3481bb016d0f-service-ca\") pod \"console-7787b544cf-bhzwl\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:24.832548 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:24.832429 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97b809f8-ed54-4bf1-a138-3481bb016d0f-console-serving-cert\") pod \"console-7787b544cf-bhzwl\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:24.832548 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:24.832453 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97b809f8-ed54-4bf1-a138-3481bb016d0f-console-config\") pod \"console-7787b544cf-bhzwl\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:24.832548 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:24.832494 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97b809f8-ed54-4bf1-a138-3481bb016d0f-console-oauth-config\") pod \"console-7787b544cf-bhzwl\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:24.833055 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:24.833005 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97b809f8-ed54-4bf1-a138-3481bb016d0f-oauth-serving-cert\") pod \"console-7787b544cf-bhzwl\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:24.833271 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:24.833226 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97b809f8-ed54-4bf1-a138-3481bb016d0f-service-ca\") pod \"console-7787b544cf-bhzwl\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:24.833782 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:24.833756 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97b809f8-ed54-4bf1-a138-3481bb016d0f-console-config\") pod \"console-7787b544cf-bhzwl\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:24.833875 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:24.833846 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97b809f8-ed54-4bf1-a138-3481bb016d0f-trusted-ca-bundle\") pod \"console-7787b544cf-bhzwl\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:24.835900 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:24.835873 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97b809f8-ed54-4bf1-a138-3481bb016d0f-console-serving-cert\") pod \"console-7787b544cf-bhzwl\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:24.836063 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:24.836043 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97b809f8-ed54-4bf1-a138-3481bb016d0f-console-oauth-config\") pod \"console-7787b544cf-bhzwl\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:24.843543 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:24.843520 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x8tc\" (UniqueName: \"kubernetes.io/projected/97b809f8-ed54-4bf1-a138-3481bb016d0f-kube-api-access-9x8tc\") pod \"console-7787b544cf-bhzwl\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:24.867455 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:24.867430 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:25.022670 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:25.022596 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7787b544cf-bhzwl"] Aug 04 10:39:25.026826 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:39:25.026792 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97b809f8_ed54_4bf1_a138_3481bb016d0f.slice/crio-b5bf9f8d5b3c60daffcd2d19ff5660f2bbefb267d5adb5b32dca9036a3a7c3b9 WatchSource:0}: Error finding container b5bf9f8d5b3c60daffcd2d19ff5660f2bbefb267d5adb5b32dca9036a3a7c3b9: Status 404 returned error can't find the container with id b5bf9f8d5b3c60daffcd2d19ff5660f2bbefb267d5adb5b32dca9036a3a7c3b9 Aug 04 10:39:25.365253 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:25.365210 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7787b544cf-bhzwl" event={"ID":"97b809f8-ed54-4bf1-a138-3481bb016d0f","Type":"ContainerStarted","Data":"b5bf9f8d5b3c60daffcd2d19ff5660f2bbefb267d5adb5b32dca9036a3a7c3b9"} Aug 04 10:39:25.368114 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:25.368084 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bfwzl" event={"ID":"d5215ef8-edac-48ef-ad97-7a2a0de5cd79","Type":"ContainerStarted","Data":"eec7be4841227ba8322dfa9337d825d39ed6bfc71126aed296c1b9d54b0feeb5"} Aug 04 10:39:25.387939 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:25.387871 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bfwzl" podStartSLOduration=33.130383886 podStartE2EDuration="37.387854548s" totalImagesPullingTime="4.257470662s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 10:38:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:39:25.387729344 +0000 UTC m=+115.986633738" watchObservedRunningTime="2026-08-04 10:39:25.387854548 +0000 UTC m=+115.986758920" Aug 04 10:39:26.166924 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.166884 2576 patch_prober.go:28] interesting pod/image-registry-dd445d9f8-jqmxq container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Aug 04 10:39:26.167414 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.166949 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" podUID="7f69dd5e-7e95-4738-a2a6-831a5513d66f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 04 10:39:26.757807 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.757778 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gfr84"] Aug 04 10:39:26.764761 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.764737 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gfr84" Aug 04 10:39:26.767689 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.767440 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Aug 04 10:39:26.767689 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.767463 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Aug 04 10:39:26.767689 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.767491 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Aug 04 10:39:26.768757 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.768729 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-whcwk\"" Aug 04 10:39:26.768757 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.768741 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Aug 04 10:39:26.768947 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.768870 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Aug 04 10:39:26.782882 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.782861 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gfr84"] Aug 04 10:39:26.786612 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.786588 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97"] Aug 04 10:39:26.790534 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.790515 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97" Aug 04 10:39:26.793409 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.793372 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Aug 04 10:39:26.793512 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.793418 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Aug 04 10:39:26.793565 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.793505 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-vj7lt\"" Aug 04 10:39:26.793706 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.793690 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Aug 04 10:39:26.805170 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.805148 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97"] Aug 04 10:39:26.817704 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.817683 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mjqkb"] Aug 04 10:39:26.820053 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.820032 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:26.822805 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.822783 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Aug 04 10:39:26.823234 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.823078 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Aug 04 10:39:26.823234 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.823149 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Aug 04 10:39:26.823424 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.823386 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8vcbw\"" Aug 04 10:39:26.949009 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.948978 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5sq8\" (UniqueName: \"kubernetes.io/projected/199a78c5-6901-40a8-b8d4-ba3ab6659acf-kube-api-access-f5sq8\") pod \"kube-state-metrics-6bd9664c4-4dp97\" (UID: \"199a78c5-6901-40a8-b8d4-ba3ab6659acf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97" Aug 04 10:39:26.949177 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.949019 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/158e7fb9-5766-47b4-962c-2f48f4887ffa-node-exporter-textfile\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:26.949177 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.949037 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/158e7fb9-5766-47b4-962c-2f48f4887ffa-node-exporter-wtmp\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:26.949177 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.949093 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2e98470-aaf1-4af9-bd6a-9e6f735e80db-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-gfr84\" (UID: \"b2e98470-aaf1-4af9-bd6a-9e6f735e80db\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gfr84" Aug 04 10:39:26.949177 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.949152 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/158e7fb9-5766-47b4-962c-2f48f4887ffa-node-exporter-tls\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:26.949385 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.949188 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/158e7fb9-5766-47b4-962c-2f48f4887ffa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:26.949385 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.949240 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/199a78c5-6901-40a8-b8d4-ba3ab6659acf-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-4dp97\" (UID: \"199a78c5-6901-40a8-b8d4-ba3ab6659acf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97" Aug 04 10:39:26.949385 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.949312 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/158e7fb9-5766-47b4-962c-2f48f4887ffa-node-exporter-accelerators-collector-config\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:26.949385 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.949359 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/199a78c5-6901-40a8-b8d4-ba3ab6659acf-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-4dp97\" (UID: \"199a78c5-6901-40a8-b8d4-ba3ab6659acf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97" Aug 04 10:39:26.949618 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.949388 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/199a78c5-6901-40a8-b8d4-ba3ab6659acf-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-4dp97\" (UID: \"199a78c5-6901-40a8-b8d4-ba3ab6659acf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97" Aug 04 10:39:26.949618 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.949443 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2e98470-aaf1-4af9-bd6a-9e6f735e80db-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-gfr84\" (UID: \"b2e98470-aaf1-4af9-bd6a-9e6f735e80db\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gfr84" Aug 04 10:39:26.949618 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.949470 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2e98470-aaf1-4af9-bd6a-9e6f735e80db-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-gfr84\" (UID: \"b2e98470-aaf1-4af9-bd6a-9e6f735e80db\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gfr84" Aug 04 10:39:26.949618 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.949497 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/158e7fb9-5766-47b4-962c-2f48f4887ffa-metrics-client-ca\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:26.949618 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.949522 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/199a78c5-6901-40a8-b8d4-ba3ab6659acf-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-4dp97\" (UID: \"199a78c5-6901-40a8-b8d4-ba3ab6659acf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97" Aug 04 10:39:26.949618 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.949553 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/199a78c5-6901-40a8-b8d4-ba3ab6659acf-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-4dp97\" (UID: \"199a78c5-6901-40a8-b8d4-ba3ab6659acf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97" Aug 04 10:39:26.949618 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.949585 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmkz7\" (UniqueName: \"kubernetes.io/projected/b2e98470-aaf1-4af9-bd6a-9e6f735e80db-kube-api-access-fmkz7\") pod \"openshift-state-metrics-6bb4d7b4dd-gfr84\" (UID: \"b2e98470-aaf1-4af9-bd6a-9e6f735e80db\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gfr84" Aug 04 10:39:26.949618 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.949613 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/158e7fb9-5766-47b4-962c-2f48f4887ffa-sys\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:26.949901 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.949666 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/158e7fb9-5766-47b4-962c-2f48f4887ffa-root\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:26.949901 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:26.949702 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq9dr\" (UniqueName: \"kubernetes.io/projected/158e7fb9-5766-47b4-962c-2f48f4887ffa-kube-api-access-hq9dr\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:27.050630 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.050550 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/158e7fb9-5766-47b4-962c-2f48f4887ffa-node-exporter-textfile\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:27.050630 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.050594 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/158e7fb9-5766-47b4-962c-2f48f4887ffa-node-exporter-wtmp\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:27.050870 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.050730 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2e98470-aaf1-4af9-bd6a-9e6f735e80db-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-gfr84\" (UID: \"b2e98470-aaf1-4af9-bd6a-9e6f735e80db\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gfr84" Aug 04 10:39:27.050870 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.050746 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/158e7fb9-5766-47b4-962c-2f48f4887ffa-node-exporter-wtmp\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:27.050870 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.050797 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/158e7fb9-5766-47b4-962c-2f48f4887ffa-node-exporter-tls\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:27.050870 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.050829 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/158e7fb9-5766-47b4-962c-2f48f4887ffa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:27.050870 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.050855 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/199a78c5-6901-40a8-b8d4-ba3ab6659acf-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-4dp97\" (UID: \"199a78c5-6901-40a8-b8d4-ba3ab6659acf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97" Aug 04 10:39:27.051125 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.050885 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/158e7fb9-5766-47b4-962c-2f48f4887ffa-node-exporter-accelerators-collector-config\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:27.051125 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.050924 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/158e7fb9-5766-47b4-962c-2f48f4887ffa-node-exporter-textfile\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:27.051125 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.051034 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/199a78c5-6901-40a8-b8d4-ba3ab6659acf-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-4dp97\" (UID: \"199a78c5-6901-40a8-b8d4-ba3ab6659acf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97" Aug 04 10:39:27.051125 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.051068 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/199a78c5-6901-40a8-b8d4-ba3ab6659acf-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-4dp97\" (UID: \"199a78c5-6901-40a8-b8d4-ba3ab6659acf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97" Aug 04 10:39:27.051125 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.051101 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2e98470-aaf1-4af9-bd6a-9e6f735e80db-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-gfr84\" (UID: \"b2e98470-aaf1-4af9-bd6a-9e6f735e80db\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gfr84" Aug 04 10:39:27.051362 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.051129 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2e98470-aaf1-4af9-bd6a-9e6f735e80db-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-gfr84\" (UID: \"b2e98470-aaf1-4af9-bd6a-9e6f735e80db\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gfr84" Aug 04 10:39:27.051362 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.051159 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/158e7fb9-5766-47b4-962c-2f48f4887ffa-metrics-client-ca\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:27.051362 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.051185 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/199a78c5-6901-40a8-b8d4-ba3ab6659acf-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-4dp97\" (UID: \"199a78c5-6901-40a8-b8d4-ba3ab6659acf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97" Aug 04 10:39:27.051362 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.051221 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/199a78c5-6901-40a8-b8d4-ba3ab6659acf-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-4dp97\" (UID: \"199a78c5-6901-40a8-b8d4-ba3ab6659acf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97" Aug 04 10:39:27.051362 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:39:27.051301 2576 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Aug 04 10:39:27.051653 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:39:27.051378 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2e98470-aaf1-4af9-bd6a-9e6f735e80db-openshift-state-metrics-tls podName:b2e98470-aaf1-4af9-bd6a-9e6f735e80db nodeName:}" failed. No retries permitted until 2026-08-04 10:39:27.551353276 +0000 UTC m=+118.150257631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b2e98470-aaf1-4af9-bd6a-9e6f735e80db-openshift-state-metrics-tls") pod "openshift-state-metrics-6bb4d7b4dd-gfr84" (UID: "b2e98470-aaf1-4af9-bd6a-9e6f735e80db") : secret "openshift-state-metrics-tls" not found Aug 04 10:39:27.051653 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.051481 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/158e7fb9-5766-47b4-962c-2f48f4887ffa-node-exporter-accelerators-collector-config\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:27.051653 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.051618 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2e98470-aaf1-4af9-bd6a-9e6f735e80db-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-gfr84\" (UID: \"b2e98470-aaf1-4af9-bd6a-9e6f735e80db\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gfr84" Aug 04 10:39:27.051984 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.051668 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmkz7\" (UniqueName: \"kubernetes.io/projected/b2e98470-aaf1-4af9-bd6a-9e6f735e80db-kube-api-access-fmkz7\") pod \"openshift-state-metrics-6bb4d7b4dd-gfr84\" (UID: \"b2e98470-aaf1-4af9-bd6a-9e6f735e80db\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gfr84" Aug 04 10:39:27.051984 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.051703 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/158e7fb9-5766-47b4-962c-2f48f4887ffa-sys\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:27.051984 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.051745 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/199a78c5-6901-40a8-b8d4-ba3ab6659acf-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-4dp97\" (UID: \"199a78c5-6901-40a8-b8d4-ba3ab6659acf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97" Aug 04 10:39:27.051984 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.051758 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/158e7fb9-5766-47b4-962c-2f48f4887ffa-root\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:27.051984 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.051796 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq9dr\" (UniqueName: \"kubernetes.io/projected/158e7fb9-5766-47b4-962c-2f48f4887ffa-kube-api-access-hq9dr\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:27.051984 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.051843 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5sq8\" (UniqueName: \"kubernetes.io/projected/199a78c5-6901-40a8-b8d4-ba3ab6659acf-kube-api-access-f5sq8\") pod \"kube-state-metrics-6bd9664c4-4dp97\" (UID: \"199a78c5-6901-40a8-b8d4-ba3ab6659acf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97" Aug 04 10:39:27.051984 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.051852 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/158e7fb9-5766-47b4-962c-2f48f4887ffa-sys\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:27.051984 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.051873 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/199a78c5-6901-40a8-b8d4-ba3ab6659acf-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-4dp97\" (UID: \"199a78c5-6901-40a8-b8d4-ba3ab6659acf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97" Aug 04 10:39:27.051984 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.051948 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/158e7fb9-5766-47b4-962c-2f48f4887ffa-root\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:27.052459 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.052307 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/199a78c5-6901-40a8-b8d4-ba3ab6659acf-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-4dp97\" (UID: \"199a78c5-6901-40a8-b8d4-ba3ab6659acf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97" Aug 04 10:39:27.053030 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.053005 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/158e7fb9-5766-47b4-962c-2f48f4887ffa-metrics-client-ca\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:27.053798 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.053776 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/158e7fb9-5766-47b4-962c-2f48f4887ffa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:27.054220 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.054152 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/199a78c5-6901-40a8-b8d4-ba3ab6659acf-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-4dp97\" (UID: \"199a78c5-6901-40a8-b8d4-ba3ab6659acf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97" Aug 04 10:39:27.054532 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.054513 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/199a78c5-6901-40a8-b8d4-ba3ab6659acf-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-4dp97\" (UID: \"199a78c5-6901-40a8-b8d4-ba3ab6659acf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97" Aug 04 10:39:27.054822 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.054803 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/158e7fb9-5766-47b4-962c-2f48f4887ffa-node-exporter-tls\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:27.054982 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.054958 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2e98470-aaf1-4af9-bd6a-9e6f735e80db-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-gfr84\" (UID: \"b2e98470-aaf1-4af9-bd6a-9e6f735e80db\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gfr84" Aug 04 10:39:27.063620 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.063592 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5sq8\" (UniqueName: \"kubernetes.io/projected/199a78c5-6901-40a8-b8d4-ba3ab6659acf-kube-api-access-f5sq8\") pod \"kube-state-metrics-6bd9664c4-4dp97\" (UID: \"199a78c5-6901-40a8-b8d4-ba3ab6659acf\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97" Aug 04 10:39:27.063760 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.063736 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmkz7\" (UniqueName: \"kubernetes.io/projected/b2e98470-aaf1-4af9-bd6a-9e6f735e80db-kube-api-access-fmkz7\") pod \"openshift-state-metrics-6bb4d7b4dd-gfr84\" (UID: \"b2e98470-aaf1-4af9-bd6a-9e6f735e80db\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gfr84" Aug 04 10:39:27.064547 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.064503 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq9dr\" (UniqueName: \"kubernetes.io/projected/158e7fb9-5766-47b4-962c-2f48f4887ffa-kube-api-access-hq9dr\") pod \"node-exporter-mjqkb\" (UID: \"158e7fb9-5766-47b4-962c-2f48f4887ffa\") " pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:27.099731 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.099704 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97" Aug 04 10:39:27.130996 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.130944 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mjqkb" Aug 04 10:39:27.556045 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.556005 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2e98470-aaf1-4af9-bd6a-9e6f735e80db-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-gfr84\" (UID: \"b2e98470-aaf1-4af9-bd6a-9e6f735e80db\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gfr84" Aug 04 10:39:27.558785 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.558758 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2e98470-aaf1-4af9-bd6a-9e6f735e80db-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-gfr84\" (UID: \"b2e98470-aaf1-4af9-bd6a-9e6f735e80db\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gfr84" Aug 04 10:39:27.676367 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:27.676336 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gfr84" Aug 04 10:39:31.042190 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.042150 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7b67f6577d-pjfdx"] Aug 04 10:39:31.045305 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.045281 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:39:31.048019 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.047994 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-kc8wc\"" Aug 04 10:39:31.049667 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.049347 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Aug 04 10:39:31.049667 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.049373 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2fqa1mn8h2c1a\"" Aug 04 10:39:31.049667 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.049373 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Aug 04 10:39:31.050577 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.050556 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Aug 04 10:39:31.050660 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.050574 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Aug 04 10:39:31.062593 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.062539 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b67f6577d-pjfdx"] Aug 04 10:39:31.086712 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.086683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bca2e9d9-198a-47c6-958f-c5304771bc5a-metrics-server-audit-profiles\") pod \"metrics-server-7b67f6577d-pjfdx\" (UID: \"bca2e9d9-198a-47c6-958f-c5304771bc5a\") " pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:39:31.086810 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.086730 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bca2e9d9-198a-47c6-958f-c5304771bc5a-client-ca-bundle\") pod \"metrics-server-7b67f6577d-pjfdx\" (UID: \"bca2e9d9-198a-47c6-958f-c5304771bc5a\") " pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:39:31.086810 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.086780 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6slpq\" (UniqueName: \"kubernetes.io/projected/bca2e9d9-198a-47c6-958f-c5304771bc5a-kube-api-access-6slpq\") pod \"metrics-server-7b67f6577d-pjfdx\" (UID: \"bca2e9d9-198a-47c6-958f-c5304771bc5a\") " pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:39:31.086896 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.086864 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bca2e9d9-198a-47c6-958f-c5304771bc5a-secret-metrics-server-client-certs\") pod \"metrics-server-7b67f6577d-pjfdx\" (UID: \"bca2e9d9-198a-47c6-958f-c5304771bc5a\") " pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:39:31.086931 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.086912 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bca2e9d9-198a-47c6-958f-c5304771bc5a-audit-log\") pod \"metrics-server-7b67f6577d-pjfdx\" (UID: \"bca2e9d9-198a-47c6-958f-c5304771bc5a\") " pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:39:31.086996 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.086960 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bca2e9d9-198a-47c6-958f-c5304771bc5a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b67f6577d-pjfdx\" (UID: \"bca2e9d9-198a-47c6-958f-c5304771bc5a\") " pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:39:31.087047 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.087006 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bca2e9d9-198a-47c6-958f-c5304771bc5a-secret-metrics-server-tls\") pod \"metrics-server-7b67f6577d-pjfdx\" (UID: \"bca2e9d9-198a-47c6-958f-c5304771bc5a\") " pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:39:31.188263 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.188230 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bca2e9d9-198a-47c6-958f-c5304771bc5a-secret-metrics-server-client-certs\") pod \"metrics-server-7b67f6577d-pjfdx\" (UID: \"bca2e9d9-198a-47c6-958f-c5304771bc5a\") " pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:39:31.188429 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.188295 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bca2e9d9-198a-47c6-958f-c5304771bc5a-audit-log\") pod \"metrics-server-7b67f6577d-pjfdx\" (UID: \"bca2e9d9-198a-47c6-958f-c5304771bc5a\") " pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:39:31.188429 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.188346 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bca2e9d9-198a-47c6-958f-c5304771bc5a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b67f6577d-pjfdx\" (UID: \"bca2e9d9-198a-47c6-958f-c5304771bc5a\") " pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:39:31.188429 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.188404 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bca2e9d9-198a-47c6-958f-c5304771bc5a-secret-metrics-server-tls\") pod \"metrics-server-7b67f6577d-pjfdx\" (UID: \"bca2e9d9-198a-47c6-958f-c5304771bc5a\") " pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:39:31.188617 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.188451 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bca2e9d9-198a-47c6-958f-c5304771bc5a-metrics-server-audit-profiles\") pod \"metrics-server-7b67f6577d-pjfdx\" (UID: \"bca2e9d9-198a-47c6-958f-c5304771bc5a\") " pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:39:31.188617 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.188484 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bca2e9d9-198a-47c6-958f-c5304771bc5a-client-ca-bundle\") pod \"metrics-server-7b67f6577d-pjfdx\" (UID: \"bca2e9d9-198a-47c6-958f-c5304771bc5a\") " pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:39:31.188617 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.188511 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6slpq\" (UniqueName: \"kubernetes.io/projected/bca2e9d9-198a-47c6-958f-c5304771bc5a-kube-api-access-6slpq\") pod \"metrics-server-7b67f6577d-pjfdx\" (UID: \"bca2e9d9-198a-47c6-958f-c5304771bc5a\") " pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:39:31.189495 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.189465 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bca2e9d9-198a-47c6-958f-c5304771bc5a-metrics-server-audit-profiles\") pod \"metrics-server-7b67f6577d-pjfdx\" (UID: \"bca2e9d9-198a-47c6-958f-c5304771bc5a\") " pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:39:31.189638 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.189607 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bca2e9d9-198a-47c6-958f-c5304771bc5a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b67f6577d-pjfdx\" (UID: \"bca2e9d9-198a-47c6-958f-c5304771bc5a\") " pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:39:31.189756 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.189719 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bca2e9d9-198a-47c6-958f-c5304771bc5a-audit-log\") pod \"metrics-server-7b67f6577d-pjfdx\" (UID: \"bca2e9d9-198a-47c6-958f-c5304771bc5a\") " pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:39:31.191172 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.191148 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bca2e9d9-198a-47c6-958f-c5304771bc5a-secret-metrics-server-client-certs\") pod \"metrics-server-7b67f6577d-pjfdx\" (UID: \"bca2e9d9-198a-47c6-958f-c5304771bc5a\") " pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:39:31.191318 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.191276 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bca2e9d9-198a-47c6-958f-c5304771bc5a-secret-metrics-server-tls\") pod \"metrics-server-7b67f6577d-pjfdx\" (UID: \"bca2e9d9-198a-47c6-958f-c5304771bc5a\") " pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:39:31.191426 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.191321 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bca2e9d9-198a-47c6-958f-c5304771bc5a-client-ca-bundle\") pod \"metrics-server-7b67f6577d-pjfdx\" (UID: \"bca2e9d9-198a-47c6-958f-c5304771bc5a\") " pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:39:31.197607 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.197584 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6slpq\" (UniqueName: \"kubernetes.io/projected/bca2e9d9-198a-47c6-958f-c5304771bc5a-kube-api-access-6slpq\") pod \"metrics-server-7b67f6577d-pjfdx\" (UID: \"bca2e9d9-198a-47c6-958f-c5304771bc5a\") " pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:39:31.356270 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.356190 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:39:31.546154 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.546116 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-ff5669589-99ng8"] Aug 04 10:39:31.587278 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.587249 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c75bcbdcc-mvhjz"] Aug 04 10:39:31.590237 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.590217 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:31.601061 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.601041 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c75bcbdcc-mvhjz"] Aug 04 10:39:31.692567 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.692487 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7342394f-9399-4fc9-b3c0-519264a0ca55-console-serving-cert\") pod \"console-6c75bcbdcc-mvhjz\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:31.692567 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.692526 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7342394f-9399-4fc9-b3c0-519264a0ca55-console-oauth-config\") pod \"console-6c75bcbdcc-mvhjz\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:31.692567 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.692556 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7342394f-9399-4fc9-b3c0-519264a0ca55-service-ca\") pod \"console-6c75bcbdcc-mvhjz\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:31.692800 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.692689 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7342394f-9399-4fc9-b3c0-519264a0ca55-trusted-ca-bundle\") pod \"console-6c75bcbdcc-mvhjz\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:31.692800 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.692726 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7342394f-9399-4fc9-b3c0-519264a0ca55-oauth-serving-cert\") pod \"console-6c75bcbdcc-mvhjz\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:31.692800 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.692748 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6296\" (UniqueName: \"kubernetes.io/projected/7342394f-9399-4fc9-b3c0-519264a0ca55-kube-api-access-q6296\") pod \"console-6c75bcbdcc-mvhjz\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:31.692941 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.692853 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7342394f-9399-4fc9-b3c0-519264a0ca55-console-config\") pod \"console-6c75bcbdcc-mvhjz\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:31.793635 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.793608 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7342394f-9399-4fc9-b3c0-519264a0ca55-trusted-ca-bundle\") pod \"console-6c75bcbdcc-mvhjz\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:31.793815 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.793652 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7342394f-9399-4fc9-b3c0-519264a0ca55-oauth-serving-cert\") pod \"console-6c75bcbdcc-mvhjz\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:31.793815 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.793691 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6296\" (UniqueName: \"kubernetes.io/projected/7342394f-9399-4fc9-b3c0-519264a0ca55-kube-api-access-q6296\") pod \"console-6c75bcbdcc-mvhjz\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:31.793815 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.793747 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7342394f-9399-4fc9-b3c0-519264a0ca55-console-config\") pod \"console-6c75bcbdcc-mvhjz\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:31.793815 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.793799 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7342394f-9399-4fc9-b3c0-519264a0ca55-console-serving-cert\") pod \"console-6c75bcbdcc-mvhjz\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:31.794017 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.793824 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7342394f-9399-4fc9-b3c0-519264a0ca55-console-oauth-config\") pod \"console-6c75bcbdcc-mvhjz\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:31.794017 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.793856 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7342394f-9399-4fc9-b3c0-519264a0ca55-service-ca\") pod \"console-6c75bcbdcc-mvhjz\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:31.794772 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.794575 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7342394f-9399-4fc9-b3c0-519264a0ca55-console-config\") pod \"console-6c75bcbdcc-mvhjz\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:31.794772 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.794618 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7342394f-9399-4fc9-b3c0-519264a0ca55-service-ca\") pod \"console-6c75bcbdcc-mvhjz\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:31.794772 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.794636 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7342394f-9399-4fc9-b3c0-519264a0ca55-trusted-ca-bundle\") pod \"console-6c75bcbdcc-mvhjz\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:31.794772 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.794718 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7342394f-9399-4fc9-b3c0-519264a0ca55-oauth-serving-cert\") pod \"console-6c75bcbdcc-mvhjz\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:31.797078 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.797053 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7342394f-9399-4fc9-b3c0-519264a0ca55-console-oauth-config\") pod \"console-6c75bcbdcc-mvhjz\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:31.797229 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.797208 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7342394f-9399-4fc9-b3c0-519264a0ca55-console-serving-cert\") pod \"console-6c75bcbdcc-mvhjz\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:31.806090 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.806073 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6296\" (UniqueName: \"kubernetes.io/projected/7342394f-9399-4fc9-b3c0-519264a0ca55-kube-api-access-q6296\") pod \"console-6c75bcbdcc-mvhjz\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:31.901518 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:31.901485 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:33.111016 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.110985 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 04 10:39:33.114053 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.114034 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.118961 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.118939 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Aug 04 10:39:33.119067 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.118971 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Aug 04 10:39:33.119134 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.119081 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Aug 04 10:39:33.119295 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.119278 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Aug 04 10:39:33.119474 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.119372 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Aug 04 10:39:33.124968 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.124945 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Aug 04 10:39:33.125136 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.125117 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Aug 04 10:39:33.125194 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.125160 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bsqp2jqj3ga3s\"" Aug 04 10:39:33.125914 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.125860 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Aug 04 10:39:33.125914 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.125870 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Aug 04 10:39:33.125914 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.125904 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Aug 04 10:39:33.126112 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.126089 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Aug 04 10:39:33.126311 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.126290 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Aug 04 10:39:33.126412 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.126329 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ztxnd\"" Aug 04 10:39:33.128317 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.128298 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Aug 04 10:39:33.131777 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.131760 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Aug 04 10:39:33.153516 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.153494 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 04 10:39:33.205449 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.205426 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.205580 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.205460 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.205580 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.205490 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.205580 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.205546 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22trl\" (UniqueName: \"kubernetes.io/projected/34ffb959-f83b-4cd1-943f-04293bd3ba12-kube-api-access-22trl\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.205704 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.205613 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-web-config\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.205704 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.205635 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.205704 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.205651 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.205704 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.205667 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.205884 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.205802 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34ffb959-f83b-4cd1-943f-04293bd3ba12-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.205884 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.205838 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.205884 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.205867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.206013 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.205904 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.206013 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.205945 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.206013 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.205973 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-config\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.206013 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.205987 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34ffb959-f83b-4cd1-943f-04293bd3ba12-config-out\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.206013 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.206003 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.206187 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.206060 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.206187 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.206082 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.206187 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.206097 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.206187 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.206134 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.306640 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.306613 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.306793 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.306655 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22trl\" (UniqueName: \"kubernetes.io/projected/34ffb959-f83b-4cd1-943f-04293bd3ba12-kube-api-access-22trl\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.306793 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.306695 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-web-config\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.306793 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.306720 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.306793 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.306742 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.306793 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.306765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.307186 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.307056 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.307186 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.307148 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34ffb959-f83b-4cd1-943f-04293bd3ba12-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.307329 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.307186 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.307329 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.307213 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.307329 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.307254 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.307329 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.307280 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.307329 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.307307 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-config\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.307600 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.307329 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34ffb959-f83b-4cd1-943f-04293bd3ba12-config-out\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.307600 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.307352 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.307600 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.307413 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.307600 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.307449 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.307600 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.307476 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.307600 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.307503 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.307600 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.307516 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.307600 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.307542 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.307600 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.307543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.307600 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.307587 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.309079 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.308087 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.309079 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.308727 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.309079 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.308768 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.310075 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.310051 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.310854 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.310828 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.312744 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.312250 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.312744 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.312462 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34ffb959-f83b-4cd1-943f-04293bd3ba12-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.312744 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.312695 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-web-config\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.313141 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.313115 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.313502 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.313481 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34ffb959-f83b-4cd1-943f-04293bd3ba12-config-out\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.313657 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.313633 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.313957 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.313931 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.314053 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.314027 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.314547 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.314526 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-config\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.314910 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.314886 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.315196 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.315175 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.317033 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.317013 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22trl\" (UniqueName: \"kubernetes.io/projected/34ffb959-f83b-4cd1-943f-04293bd3ba12-kube-api-access-22trl\") pod \"prometheus-k8s-0\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:33.425248 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:33.425180 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:34.071292 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:34.071210 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b67f6577d-pjfdx"] Aug 04 10:39:34.078033 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:39:34.077993 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbca2e9d9_198a_47c6_958f_c5304771bc5a.slice/crio-40d4379456afd538a3a10d2c6e94e025faa32698e4143b1315bd2d99b2b01896 WatchSource:0}: Error finding container 40d4379456afd538a3a10d2c6e94e025faa32698e4143b1315bd2d99b2b01896: Status 404 returned error can't find the container with id 40d4379456afd538a3a10d2c6e94e025faa32698e4143b1315bd2d99b2b01896 Aug 04 10:39:34.120832 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:34.118562 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 04 10:39:34.121598 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:39:34.121546 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34ffb959_f83b_4cd1_943f_04293bd3ba12.slice/crio-908443b2cf8cb751d71d4dd6f5f8db56b1e6a66e4f3af70d7afdbbc451e9df28 WatchSource:0}: Error finding container 908443b2cf8cb751d71d4dd6f5f8db56b1e6a66e4f3af70d7afdbbc451e9df28: Status 404 returned error can't find the container with id 908443b2cf8cb751d71d4dd6f5f8db56b1e6a66e4f3af70d7afdbbc451e9df28 Aug 04 10:39:34.147277 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:34.147217 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97"] Aug 04 10:39:34.151751 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:34.149860 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c75bcbdcc-mvhjz"] Aug 04 10:39:34.151751 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:39:34.150134 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod199a78c5_6901_40a8_b8d4_ba3ab6659acf.slice/crio-e6b20b2f1541cb5660597dada7e147591b275a26a7b981ad479915d78fe9df8c WatchSource:0}: Error finding container e6b20b2f1541cb5660597dada7e147591b275a26a7b981ad479915d78fe9df8c: Status 404 returned error can't find the container with id e6b20b2f1541cb5660597dada7e147591b275a26a7b981ad479915d78fe9df8c Aug 04 10:39:34.152913 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:39:34.152819 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7342394f_9399_4fc9_b3c0_519264a0ca55.slice/crio-38535faa39dc17940efcc8ceb7aaa8db446614b54c6c94ca48ed55dd697844e0 WatchSource:0}: Error finding container 38535faa39dc17940efcc8ceb7aaa8db446614b54c6c94ca48ed55dd697844e0: Status 404 returned error can't find the container with id 38535faa39dc17940efcc8ceb7aaa8db446614b54c6c94ca48ed55dd697844e0 Aug 04 10:39:34.297507 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:34.297456 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gfr84"] Aug 04 10:39:34.301032 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:39:34.301003 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e98470_aaf1_4af9_bd6a_9e6f735e80db.slice/crio-8103d125671d8001663f5975ad746505c1b14b0e97f47f8801fbd158f01514a2 WatchSource:0}: Error finding container 8103d125671d8001663f5975ad746505c1b14b0e97f47f8801fbd158f01514a2: Status 404 returned error can't find the container with id 8103d125671d8001663f5975ad746505c1b14b0e97f47f8801fbd158f01514a2 Aug 04 10:39:34.406604 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:34.405805 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gfr84" event={"ID":"b2e98470-aaf1-4af9-bd6a-9e6f735e80db","Type":"ContainerStarted","Data":"0f0ff58da49e19fc84f7c0ab886b5f65c8bb62b5a8a8f1682b0bd40ecae2339d"} Aug 04 10:39:34.406604 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:34.405879 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gfr84" event={"ID":"b2e98470-aaf1-4af9-bd6a-9e6f735e80db","Type":"ContainerStarted","Data":"8103d125671d8001663f5975ad746505c1b14b0e97f47f8801fbd158f01514a2"} Aug 04 10:39:34.407469 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:34.407376 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" event={"ID":"bca2e9d9-198a-47c6-958f-c5304771bc5a","Type":"ContainerStarted","Data":"40d4379456afd538a3a10d2c6e94e025faa32698e4143b1315bd2d99b2b01896"} Aug 04 10:39:34.409664 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:34.408769 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mjqkb" event={"ID":"158e7fb9-5766-47b4-962c-2f48f4887ffa","Type":"ContainerStarted","Data":"bbf36386205c7ed2038ebe8f1e4187f2f63aba4d2a9a0047616ef000ef932dc1"} Aug 04 10:39:34.411325 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:34.410563 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c75bcbdcc-mvhjz" event={"ID":"7342394f-9399-4fc9-b3c0-519264a0ca55","Type":"ContainerStarted","Data":"c7bc8d0bc0db408120d57129a12ab49e53765bcc3e4de305e501e93efe6af391"} Aug 04 10:39:34.411325 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:34.410610 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c75bcbdcc-mvhjz" event={"ID":"7342394f-9399-4fc9-b3c0-519264a0ca55","Type":"ContainerStarted","Data":"38535faa39dc17940efcc8ceb7aaa8db446614b54c6c94ca48ed55dd697844e0"} Aug 04 10:39:34.412851 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:34.412826 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ff5669589-99ng8" event={"ID":"cc903a4b-8fd0-41ba-ad9f-597aa478d946","Type":"ContainerStarted","Data":"3a42eb2e787d314fff00844d3e5ce4124ef22d776778115fe07806f66a12585a"} Aug 04 10:39:34.415377 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:34.415356 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7787b544cf-bhzwl" event={"ID":"97b809f8-ed54-4bf1-a138-3481bb016d0f","Type":"ContainerStarted","Data":"720e68a52dd57a6904b4154f203f02b23eabe70116a390a8746d2b732e1815cf"} Aug 04 10:39:34.417174 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:34.417140 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34ffb959-f83b-4cd1-943f-04293bd3ba12","Type":"ContainerStarted","Data":"908443b2cf8cb751d71d4dd6f5f8db56b1e6a66e4f3af70d7afdbbc451e9df28"} Aug 04 10:39:34.419761 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:34.418843 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-kz55f" event={"ID":"872a0621-2d81-485a-b3ac-ed1319cd8f09","Type":"ContainerStarted","Data":"104a628a1d3e0c4eb062bba163978801c4b17fea472cc6255dfd39c5a291c81e"} Aug 04 10:39:34.419761 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:34.419534 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-kz55f" Aug 04 10:39:34.422072 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:34.421974 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97" event={"ID":"199a78c5-6901-40a8-b8d4-ba3ab6659acf","Type":"ContainerStarted","Data":"e6b20b2f1541cb5660597dada7e147591b275a26a7b981ad479915d78fe9df8c"} Aug 04 10:39:34.434546 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:34.434525 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-kz55f" Aug 04 10:39:34.441338 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:34.440248 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c75bcbdcc-mvhjz" podStartSLOduration=3.4402286 podStartE2EDuration="3.4402286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:39:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:39:34.434887678 +0000 UTC m=+125.033792052" watchObservedRunningTime="2026-08-04 10:39:34.4402286 +0000 UTC m=+125.039132985" Aug 04 10:39:34.460216 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:34.459435 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-ff5669589-99ng8" podStartSLOduration=1.665416412 podStartE2EDuration="14.459416594s" totalImagesPullingTime="12.794000182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:39:34.458858912 +0000 UTC m=+125.057763285" watchObservedRunningTime="2026-08-04 10:39:34.459416594 +0000 UTC m=+125.058320970" Aug 04 10:39:34.502454 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:34.502127 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7787b544cf-bhzwl" podStartSLOduration=1.670725027 podStartE2EDuration="10.50211286s" totalImagesPullingTime="8.831387833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:39:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:39:34.480037147 +0000 UTC m=+125.078941541" watchObservedRunningTime="2026-08-04 10:39:34.50211286 +0000 UTC m=+125.101017233" Aug 04 10:39:34.502659 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:34.502563 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-kz55f" podStartSLOduration=1.231737295 podStartE2EDuration="18.502556653s" totalImagesPullingTime="17.270819358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:39:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:39:34.501168623 +0000 UTC m=+125.100073032" watchObservedRunningTime="2026-08-04 10:39:34.502556653 +0000 UTC m=+125.101461027" Aug 04 10:39:34.867697 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:34.867539 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:34.867697 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:34.867648 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:34.873471 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:34.873439 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:35.433430 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:35.433026 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gfr84" event={"ID":"b2e98470-aaf1-4af9-bd6a-9e6f735e80db","Type":"ContainerStarted","Data":"9a6f6abe5637aca2ed02b24c7b5691cd2238bc33b2a87d861cbde3b09326bf5f"} Aug 04 10:39:35.440200 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:35.440178 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:39:36.165539 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:36.165513 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:39:39.453829 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:39.453740 2576 generic.go:356] "Generic (PLEG): container finished" podID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerID="3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c" exitCode=0 Aug 04 10:39:39.454263 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:39.453842 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34ffb959-f83b-4cd1-943f-04293bd3ba12","Type":"ContainerDied","Data":"3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c"} Aug 04 10:39:39.457519 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:39.457495 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97" event={"ID":"199a78c5-6901-40a8-b8d4-ba3ab6659acf","Type":"ContainerStarted","Data":"6ea8ba7108643150d04a70b66cfeccc5ea2b414eea4290834b334e7e553a7de2"} Aug 04 10:39:39.457661 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:39.457549 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97" event={"ID":"199a78c5-6901-40a8-b8d4-ba3ab6659acf","Type":"ContainerStarted","Data":"fd54046df4f6ba288a87580fa96bfec0d0d49c52ec018809f0d5c0d9373f7e42"} Aug 04 10:39:39.457661 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:39.457573 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97" event={"ID":"199a78c5-6901-40a8-b8d4-ba3ab6659acf","Type":"ContainerStarted","Data":"094712f535d0c3bb09ed7fbfc3cd156b1162e2ddd7a9580a7267a44771d30f63"} Aug 04 10:39:39.459982 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:39.459954 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gfr84" event={"ID":"b2e98470-aaf1-4af9-bd6a-9e6f735e80db","Type":"ContainerStarted","Data":"c926b4e04ffe9c08338e524369c569bf0999b57d84a8b518933e67fb920b50fb"} Aug 04 10:39:39.461790 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:39.461761 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" event={"ID":"bca2e9d9-198a-47c6-958f-c5304771bc5a","Type":"ContainerStarted","Data":"a199e0260bd718f488c4dcafb76990391684e303fe57aef31447375e6451a6e4"} Aug 04 10:39:39.463606 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:39.463584 2576 generic.go:356] "Generic (PLEG): container finished" podID="158e7fb9-5766-47b4-962c-2f48f4887ffa" containerID="1d96c238a769e556a9f8286ff1c65f9a5493b52e7c3ec8dc247a191bc762753f" exitCode=0 Aug 04 10:39:39.463717 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:39.463642 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mjqkb" event={"ID":"158e7fb9-5766-47b4-962c-2f48f4887ffa","Type":"ContainerDied","Data":"1d96c238a769e556a9f8286ff1c65f9a5493b52e7c3ec8dc247a191bc762753f"} Aug 04 10:39:39.523821 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:39.523763 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" podStartSLOduration=4.046668465 podStartE2EDuration="8.523741729s" totalImagesPullingTime="4.477073264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:39:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:39:39.521642113 +0000 UTC m=+130.120546510" watchObservedRunningTime="2026-08-04 10:39:39.523741729 +0000 UTC m=+130.122646104" Aug 04 10:39:39.562062 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:39.562013 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-gfr84" podStartSLOduration=9.462910449 podStartE2EDuration="13.56199767s" totalImagesPullingTime="4.099087221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:39:39.541733598 +0000 UTC m=+130.140637991" watchObservedRunningTime="2026-08-04 10:39:39.56199767 +0000 UTC m=+130.160902046" Aug 04 10:39:39.587905 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:39.585308 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs\") pod \"network-metrics-daemon-2lbrm\" (UID: \"49fd00b0-8477-48c3-bbde-aa2c9ef5df76\") " pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:39:39.593798 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:39.593770 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49fd00b0-8477-48c3-bbde-aa2c9ef5df76-metrics-certs\") pod \"network-metrics-daemon-2lbrm\" (UID: \"49fd00b0-8477-48c3-bbde-aa2c9ef5df76\") " pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:39:39.739902 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:39.739869 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t7blv\"" Aug 04 10:39:39.747343 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:39.747312 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2lbrm" Aug 04 10:39:39.915131 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:39.915067 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-4dp97" podStartSLOduration=9.509222778 podStartE2EDuration="13.915041938s" totalImagesPullingTime="4.40581916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:39:39.58986324 +0000 UTC m=+130.188767631" watchObservedRunningTime="2026-08-04 10:39:39.915041938 +0000 UTC m=+130.513946335" Aug 04 10:39:39.917288 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:39.917267 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2lbrm"] Aug 04 10:39:39.919458 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:39:39.919429 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49fd00b0_8477_48c3_bbde_aa2c9ef5df76.slice/crio-48454108b083e19c0465fb04b8fb4ff37605bd2a941efcfc5c0beafd54a36df0 WatchSource:0}: Error finding container 48454108b083e19c0465fb04b8fb4ff37605bd2a941efcfc5c0beafd54a36df0: Status 404 returned error can't find the container with id 48454108b083e19c0465fb04b8fb4ff37605bd2a941efcfc5c0beafd54a36df0 Aug 04 10:39:40.472198 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:40.472155 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mjqkb" event={"ID":"158e7fb9-5766-47b4-962c-2f48f4887ffa","Type":"ContainerStarted","Data":"4d02b1372ee441771a5cd84caf28beb8c3dbd3d3266be8f02b8b2bd483ba4e1c"} Aug 04 10:39:40.472818 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:40.472226 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mjqkb" event={"ID":"158e7fb9-5766-47b4-962c-2f48f4887ffa","Type":"ContainerStarted","Data":"b2e615e8786c21d570c99661f566e67e6bff27730934f0c86b1021fc7f70a439"} Aug 04 10:39:40.474451 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:40.474421 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2lbrm" event={"ID":"49fd00b0-8477-48c3-bbde-aa2c9ef5df76","Type":"ContainerStarted","Data":"48454108b083e19c0465fb04b8fb4ff37605bd2a941efcfc5c0beafd54a36df0"} Aug 04 10:39:40.493636 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:40.493580 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mjqkb" podStartSLOduration=9.268722063 podStartE2EDuration="14.493559338s" totalImagesPullingTime="5.099488142s" totalInitContainerRuntime="125.349133ms" isStatefulPod=true podCreationTimestamp="2026-08-04 10:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:39:40.491844343 +0000 UTC m=+131.090748741" watchObservedRunningTime="2026-08-04 10:39:40.493559338 +0000 UTC m=+131.092463713" Aug 04 10:39:40.860134 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:40.859895 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-ff5669589-99ng8" Aug 04 10:39:41.180738 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:41.180586 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" podUID="7f69dd5e-7e95-4738-a2a6-831a5513d66f" containerName="registry" containerID="cri-o://a90c95d03a469a885a9131ac0c1206b5a727818d6e89b2edd7528decfc4bc516" gracePeriod=30 Aug 04 10:39:41.790087 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:41.790041 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:39:41.902637 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:41.902064 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:41.902637 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:41.902150 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:41.907723 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:41.907701 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:41.914373 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:41.914351 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-registry-tls\") pod \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " Aug 04 10:39:41.914503 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:41.914410 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4psx\" (UniqueName: \"kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-kube-api-access-x4psx\") pod \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " Aug 04 10:39:41.914503 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:41.914447 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7f69dd5e-7e95-4738-a2a6-831a5513d66f-trusted-ca\") pod \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " Aug 04 10:39:41.914618 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:41.914503 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7f69dd5e-7e95-4738-a2a6-831a5513d66f-ca-trust-extracted\") pod \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " Aug 04 10:39:41.914618 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:41.914546 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7f69dd5e-7e95-4738-a2a6-831a5513d66f-installation-pull-secrets\") pod \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " Aug 04 10:39:41.914618 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:41.914584 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7f69dd5e-7e95-4738-a2a6-831a5513d66f-image-registry-private-configuration\") pod \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " Aug 04 10:39:41.914748 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:41.914622 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-bound-sa-token\") pod \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " Aug 04 10:39:41.914748 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:41.914646 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7f69dd5e-7e95-4738-a2a6-831a5513d66f-registry-certificates\") pod \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\" (UID: \"7f69dd5e-7e95-4738-a2a6-831a5513d66f\") " Aug 04 10:39:41.915621 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:41.915597 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f69dd5e-7e95-4738-a2a6-831a5513d66f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7f69dd5e-7e95-4738-a2a6-831a5513d66f" (UID: "7f69dd5e-7e95-4738-a2a6-831a5513d66f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:39:41.916156 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:41.916129 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f69dd5e-7e95-4738-a2a6-831a5513d66f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7f69dd5e-7e95-4738-a2a6-831a5513d66f" (UID: "7f69dd5e-7e95-4738-a2a6-831a5513d66f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:39:41.917793 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:41.917766 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7f69dd5e-7e95-4738-a2a6-831a5513d66f" (UID: "7f69dd5e-7e95-4738-a2a6-831a5513d66f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 10:39:41.918146 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:41.918097 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f69dd5e-7e95-4738-a2a6-831a5513d66f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7f69dd5e-7e95-4738-a2a6-831a5513d66f" (UID: "7f69dd5e-7e95-4738-a2a6-831a5513d66f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 10:39:41.918415 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:41.918351 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-kube-api-access-x4psx" (OuterVolumeSpecName: "kube-api-access-x4psx") pod "7f69dd5e-7e95-4738-a2a6-831a5513d66f" (UID: "7f69dd5e-7e95-4738-a2a6-831a5513d66f"). InnerVolumeSpecName "kube-api-access-x4psx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 10:39:41.919304 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:41.919216 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f69dd5e-7e95-4738-a2a6-831a5513d66f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7f69dd5e-7e95-4738-a2a6-831a5513d66f" (UID: "7f69dd5e-7e95-4738-a2a6-831a5513d66f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 10:39:41.920100 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:41.920076 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7f69dd5e-7e95-4738-a2a6-831a5513d66f" (UID: "7f69dd5e-7e95-4738-a2a6-831a5513d66f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 10:39:41.927434 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:41.927387 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f69dd5e-7e95-4738-a2a6-831a5513d66f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7f69dd5e-7e95-4738-a2a6-831a5513d66f" (UID: "7f69dd5e-7e95-4738-a2a6-831a5513d66f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 10:39:42.017302 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:42.017266 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7f69dd5e-7e95-4738-a2a6-831a5513d66f-trusted-ca\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:39:42.017302 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:42.017300 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7f69dd5e-7e95-4738-a2a6-831a5513d66f-ca-trust-extracted\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:39:42.017540 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:42.017314 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7f69dd5e-7e95-4738-a2a6-831a5513d66f-installation-pull-secrets\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:39:42.017540 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:42.017328 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7f69dd5e-7e95-4738-a2a6-831a5513d66f-image-registry-private-configuration\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:39:42.017540 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:42.017341 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-bound-sa-token\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:39:42.017540 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:42.017353 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7f69dd5e-7e95-4738-a2a6-831a5513d66f-registry-certificates\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:39:42.017540 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:42.017364 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-registry-tls\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:39:42.017540 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:42.017374 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4psx\" (UniqueName: \"kubernetes.io/projected/7f69dd5e-7e95-4738-a2a6-831a5513d66f-kube-api-access-x4psx\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:39:42.487527 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:42.487480 2576 generic.go:356] "Generic (PLEG): container finished" podID="7f69dd5e-7e95-4738-a2a6-831a5513d66f" containerID="a90c95d03a469a885a9131ac0c1206b5a727818d6e89b2edd7528decfc4bc516" exitCode=0 Aug 04 10:39:42.487789 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:42.487662 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" Aug 04 10:39:42.487789 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:42.487678 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" event={"ID":"7f69dd5e-7e95-4738-a2a6-831a5513d66f","Type":"ContainerDied","Data":"a90c95d03a469a885a9131ac0c1206b5a727818d6e89b2edd7528decfc4bc516"} Aug 04 10:39:42.487789 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:42.487726 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dd445d9f8-jqmxq" event={"ID":"7f69dd5e-7e95-4738-a2a6-831a5513d66f","Type":"ContainerDied","Data":"cff1816b77cb27212101b5991feb8508b326a256e75c921a01a647e8fcd72d69"} Aug 04 10:39:42.487789 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:42.487752 2576 scope.go:117] "RemoveContainer" containerID="a90c95d03a469a885a9131ac0c1206b5a727818d6e89b2edd7528decfc4bc516" Aug 04 10:39:42.494132 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:42.493378 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:39:42.508256 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:42.508229 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-dd445d9f8-jqmxq"] Aug 04 10:39:42.510965 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:42.510940 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-dd445d9f8-jqmxq"] Aug 04 10:39:42.557029 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:42.555724 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7787b544cf-bhzwl"] Aug 04 10:39:43.364563 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:43.364529 2576 scope.go:117] "RemoveContainer" containerID="a90c95d03a469a885a9131ac0c1206b5a727818d6e89b2edd7528decfc4bc516" Aug 04 10:39:43.364909 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:39:43.364882 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a90c95d03a469a885a9131ac0c1206b5a727818d6e89b2edd7528decfc4bc516\": container with ID starting with a90c95d03a469a885a9131ac0c1206b5a727818d6e89b2edd7528decfc4bc516 not found: ID does not exist" containerID="a90c95d03a469a885a9131ac0c1206b5a727818d6e89b2edd7528decfc4bc516" Aug 04 10:39:43.364968 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:43.364924 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a90c95d03a469a885a9131ac0c1206b5a727818d6e89b2edd7528decfc4bc516"} err="failed to get container status \"a90c95d03a469a885a9131ac0c1206b5a727818d6e89b2edd7528decfc4bc516\": rpc error: code = NotFound desc = could not find container \"a90c95d03a469a885a9131ac0c1206b5a727818d6e89b2edd7528decfc4bc516\": container with ID starting with a90c95d03a469a885a9131ac0c1206b5a727818d6e89b2edd7528decfc4bc516 not found: ID does not exist" Aug 04 10:39:43.930662 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:43.928717 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f69dd5e-7e95-4738-a2a6-831a5513d66f" path="/var/lib/kubelet/pods/7f69dd5e-7e95-4738-a2a6-831a5513d66f/volumes" Aug 04 10:39:44.499181 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:44.499143 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34ffb959-f83b-4cd1-943f-04293bd3ba12","Type":"ContainerStarted","Data":"c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299"} Aug 04 10:39:44.499694 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:44.499221 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34ffb959-f83b-4cd1-943f-04293bd3ba12","Type":"ContainerStarted","Data":"33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f"} Aug 04 10:39:44.500915 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:44.500890 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2lbrm" event={"ID":"49fd00b0-8477-48c3-bbde-aa2c9ef5df76","Type":"ContainerStarted","Data":"ab8697f848a704e9c2060529ae03c10ef36e7f76b2f31621b6db5c460beafcb3"} Aug 04 10:39:44.501015 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:44.500931 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2lbrm" event={"ID":"49fd00b0-8477-48c3-bbde-aa2c9ef5df76","Type":"ContainerStarted","Data":"c43bae35cb7cca7b2a08ff55d96b7eee477b9cee78913c7e48285fde8d8c0981"} Aug 04 10:39:44.520918 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:44.520862 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2lbrm" podStartSLOduration=132.076896928 podStartE2EDuration="2m15.520843559s" totalImagesPullingTime="3.443946631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:39:44.519110978 +0000 UTC m=+135.118015353" watchObservedRunningTime="2026-08-04 10:39:44.520843559 +0000 UTC m=+135.119747934" Aug 04 10:39:46.527449 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:46.527423 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34ffb959-f83b-4cd1-943f-04293bd3ba12","Type":"ContainerStarted","Data":"2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e"} Aug 04 10:39:46.527784 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:46.527487 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34ffb959-f83b-4cd1-943f-04293bd3ba12","Type":"ContainerStarted","Data":"cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e"} Aug 04 10:39:47.534325 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:47.534295 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34ffb959-f83b-4cd1-943f-04293bd3ba12","Type":"ContainerStarted","Data":"bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283"} Aug 04 10:39:47.534693 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:47.534354 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34ffb959-f83b-4cd1-943f-04293bd3ba12","Type":"ContainerStarted","Data":"1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02"} Aug 04 10:39:47.565099 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:47.565043 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.501386069 podStartE2EDuration="14.565022023s" totalImagesPullingTime="11.025303161s" totalInitContainerRuntime="38.332793ms" isStatefulPod=false podCreationTimestamp="2026-08-04 10:39:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:39:47.562723184 +0000 UTC m=+138.161627616" watchObservedRunningTime="2026-08-04 10:39:47.565022023 +0000 UTC m=+138.163926397" Aug 04 10:39:48.425278 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:48.425249 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:39:51.356509 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:51.356476 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:39:51.356882 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:51.356534 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:39:59.446526 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:59.446456 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-ff5669589-99ng8" podUID="cc903a4b-8fd0-41ba-ad9f-597aa478d946" containerName="console" containerID="cri-o://3a42eb2e787d314fff00844d3e5ce4124ef22d776778115fe07806f66a12585a" gracePeriod=15 Aug 04 10:39:59.584659 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:59.584629 2576 generic.go:356] "Generic (PLEG): container finished" podID="cc903a4b-8fd0-41ba-ad9f-597aa478d946" containerID="3a42eb2e787d314fff00844d3e5ce4124ef22d776778115fe07806f66a12585a" exitCode=0 Aug 04 10:39:59.584768 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:59.584696 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ff5669589-99ng8" event={"ID":"cc903a4b-8fd0-41ba-ad9f-597aa478d946","Type":"ContainerDied","Data":"3a42eb2e787d314fff00844d3e5ce4124ef22d776778115fe07806f66a12585a"} Aug 04 10:39:59.746942 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:59.746919 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ff5669589-99ng8" Aug 04 10:39:59.877788 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:59.877760 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc903a4b-8fd0-41ba-ad9f-597aa478d946-console-oauth-config\") pod \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\" (UID: \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\") " Aug 04 10:39:59.877953 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:59.877805 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc903a4b-8fd0-41ba-ad9f-597aa478d946-console-config\") pod \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\" (UID: \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\") " Aug 04 10:39:59.878010 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:59.877990 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc903a4b-8fd0-41ba-ad9f-597aa478d946-service-ca\") pod \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\" (UID: \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\") " Aug 04 10:39:59.878050 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:59.878029 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc903a4b-8fd0-41ba-ad9f-597aa478d946-console-serving-cert\") pod \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\" (UID: \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\") " Aug 04 10:39:59.878111 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:59.878100 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc903a4b-8fd0-41ba-ad9f-597aa478d946-oauth-serving-cert\") pod \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\" (UID: \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\") " Aug 04 10:39:59.878154 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:59.878125 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckzjc\" (UniqueName: \"kubernetes.io/projected/cc903a4b-8fd0-41ba-ad9f-597aa478d946-kube-api-access-ckzjc\") pod \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\" (UID: \"cc903a4b-8fd0-41ba-ad9f-597aa478d946\") " Aug 04 10:39:59.878253 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:59.878230 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc903a4b-8fd0-41ba-ad9f-597aa478d946-console-config" (OuterVolumeSpecName: "console-config") pod "cc903a4b-8fd0-41ba-ad9f-597aa478d946" (UID: "cc903a4b-8fd0-41ba-ad9f-597aa478d946"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:39:59.878419 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:59.878374 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc903a4b-8fd0-41ba-ad9f-597aa478d946-console-config\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:39:59.878419 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:59.878378 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc903a4b-8fd0-41ba-ad9f-597aa478d946-service-ca" (OuterVolumeSpecName: "service-ca") pod "cc903a4b-8fd0-41ba-ad9f-597aa478d946" (UID: "cc903a4b-8fd0-41ba-ad9f-597aa478d946"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:39:59.878780 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:59.878522 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc903a4b-8fd0-41ba-ad9f-597aa478d946-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cc903a4b-8fd0-41ba-ad9f-597aa478d946" (UID: "cc903a4b-8fd0-41ba-ad9f-597aa478d946"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:39:59.884324 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:59.884293 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc903a4b-8fd0-41ba-ad9f-597aa478d946-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cc903a4b-8fd0-41ba-ad9f-597aa478d946" (UID: "cc903a4b-8fd0-41ba-ad9f-597aa478d946"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 10:39:59.884759 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:59.884645 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc903a4b-8fd0-41ba-ad9f-597aa478d946-kube-api-access-ckzjc" (OuterVolumeSpecName: "kube-api-access-ckzjc") pod "cc903a4b-8fd0-41ba-ad9f-597aa478d946" (UID: "cc903a4b-8fd0-41ba-ad9f-597aa478d946"). InnerVolumeSpecName "kube-api-access-ckzjc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 10:39:59.884759 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:59.884608 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc903a4b-8fd0-41ba-ad9f-597aa478d946-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cc903a4b-8fd0-41ba-ad9f-597aa478d946" (UID: "cc903a4b-8fd0-41ba-ad9f-597aa478d946"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 10:39:59.979538 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:59.979462 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc903a4b-8fd0-41ba-ad9f-597aa478d946-service-ca\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:39:59.979538 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:59.979489 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc903a4b-8fd0-41ba-ad9f-597aa478d946-console-serving-cert\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:39:59.979538 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:59.979499 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc903a4b-8fd0-41ba-ad9f-597aa478d946-oauth-serving-cert\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:39:59.979538 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:59.979507 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckzjc\" (UniqueName: \"kubernetes.io/projected/cc903a4b-8fd0-41ba-ad9f-597aa478d946-kube-api-access-ckzjc\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:39:59.979538 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:39:59.979517 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc903a4b-8fd0-41ba-ad9f-597aa478d946-console-oauth-config\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:00.589915 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:00.589875 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ff5669589-99ng8" event={"ID":"cc903a4b-8fd0-41ba-ad9f-597aa478d946","Type":"ContainerDied","Data":"aaed2ef2e75a90b2b56244a18682d7c4e3e98c6fe5eb7eb8f11e0938094eb772"} Aug 04 10:40:00.590356 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:00.589933 2576 scope.go:117] "RemoveContainer" containerID="3a42eb2e787d314fff00844d3e5ce4124ef22d776778115fe07806f66a12585a" Aug 04 10:40:00.590356 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:00.589890 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ff5669589-99ng8" Aug 04 10:40:00.620703 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:00.620673 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-ff5669589-99ng8"] Aug 04 10:40:00.629341 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:00.629320 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-ff5669589-99ng8"] Aug 04 10:40:01.927918 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:01.927887 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc903a4b-8fd0-41ba-ad9f-597aa478d946" path="/var/lib/kubelet/pods/cc903a4b-8fd0-41ba-ad9f-597aa478d946/volumes" Aug 04 10:40:07.588677 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:07.588641 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7787b544cf-bhzwl" podUID="97b809f8-ed54-4bf1-a138-3481bb016d0f" containerName="console" containerID="cri-o://720e68a52dd57a6904b4154f203f02b23eabe70116a390a8746d2b732e1815cf" gracePeriod=15 Aug 04 10:40:07.617876 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:07.617849 2576 generic.go:356] "Generic (PLEG): container finished" podID="f93ae815-8c4c-4b43-987b-5bf70573393d" containerID="62c791966b969c3b544d3087d6eb64718f367fa1ab559450d91c2bbddf4a4907" exitCode=0 Aug 04 10:40:07.617968 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:07.617933 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-bl62w" event={"ID":"f93ae815-8c4c-4b43-987b-5bf70573393d","Type":"ContainerDied","Data":"62c791966b969c3b544d3087d6eb64718f367fa1ab559450d91c2bbddf4a4907"} Aug 04 10:40:07.618371 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:07.618354 2576 scope.go:117] "RemoveContainer" containerID="62c791966b969c3b544d3087d6eb64718f367fa1ab559450d91c2bbddf4a4907" Aug 04 10:40:07.875597 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:07.875573 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:40:07.940069 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:07.940032 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97b809f8-ed54-4bf1-a138-3481bb016d0f-trusted-ca-bundle\") pod \"97b809f8-ed54-4bf1-a138-3481bb016d0f\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " Aug 04 10:40:07.940210 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:07.940088 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97b809f8-ed54-4bf1-a138-3481bb016d0f-oauth-serving-cert\") pod \"97b809f8-ed54-4bf1-a138-3481bb016d0f\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " Aug 04 10:40:07.940210 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:07.940132 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97b809f8-ed54-4bf1-a138-3481bb016d0f-console-oauth-config\") pod \"97b809f8-ed54-4bf1-a138-3481bb016d0f\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " Aug 04 10:40:07.940210 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:07.940155 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97b809f8-ed54-4bf1-a138-3481bb016d0f-console-config\") pod \"97b809f8-ed54-4bf1-a138-3481bb016d0f\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " Aug 04 10:40:07.940210 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:07.940186 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97b809f8-ed54-4bf1-a138-3481bb016d0f-service-ca\") pod \"97b809f8-ed54-4bf1-a138-3481bb016d0f\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " Aug 04 10:40:07.940433 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:07.940229 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9x8tc\" (UniqueName: \"kubernetes.io/projected/97b809f8-ed54-4bf1-a138-3481bb016d0f-kube-api-access-9x8tc\") pod \"97b809f8-ed54-4bf1-a138-3481bb016d0f\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " Aug 04 10:40:07.940433 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:07.940272 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97b809f8-ed54-4bf1-a138-3481bb016d0f-console-serving-cert\") pod \"97b809f8-ed54-4bf1-a138-3481bb016d0f\" (UID: \"97b809f8-ed54-4bf1-a138-3481bb016d0f\") " Aug 04 10:40:07.940541 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:07.940490 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97b809f8-ed54-4bf1-a138-3481bb016d0f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "97b809f8-ed54-4bf1-a138-3481bb016d0f" (UID: "97b809f8-ed54-4bf1-a138-3481bb016d0f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:40:07.940597 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:07.940532 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97b809f8-ed54-4bf1-a138-3481bb016d0f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "97b809f8-ed54-4bf1-a138-3481bb016d0f" (UID: "97b809f8-ed54-4bf1-a138-3481bb016d0f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:40:07.940597 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:07.940537 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97b809f8-ed54-4bf1-a138-3481bb016d0f-console-config" (OuterVolumeSpecName: "console-config") pod "97b809f8-ed54-4bf1-a138-3481bb016d0f" (UID: "97b809f8-ed54-4bf1-a138-3481bb016d0f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:40:07.940702 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:07.940601 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97b809f8-ed54-4bf1-a138-3481bb016d0f-service-ca" (OuterVolumeSpecName: "service-ca") pod "97b809f8-ed54-4bf1-a138-3481bb016d0f" (UID: "97b809f8-ed54-4bf1-a138-3481bb016d0f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:40:07.942324 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:07.942303 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97b809f8-ed54-4bf1-a138-3481bb016d0f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "97b809f8-ed54-4bf1-a138-3481bb016d0f" (UID: "97b809f8-ed54-4bf1-a138-3481bb016d0f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 10:40:07.942458 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:07.942415 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97b809f8-ed54-4bf1-a138-3481bb016d0f-kube-api-access-9x8tc" (OuterVolumeSpecName: "kube-api-access-9x8tc") pod "97b809f8-ed54-4bf1-a138-3481bb016d0f" (UID: "97b809f8-ed54-4bf1-a138-3481bb016d0f"). InnerVolumeSpecName "kube-api-access-9x8tc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 10:40:07.942694 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:07.942675 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97b809f8-ed54-4bf1-a138-3481bb016d0f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "97b809f8-ed54-4bf1-a138-3481bb016d0f" (UID: "97b809f8-ed54-4bf1-a138-3481bb016d0f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 10:40:08.040978 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:08.040899 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9x8tc\" (UniqueName: \"kubernetes.io/projected/97b809f8-ed54-4bf1-a138-3481bb016d0f-kube-api-access-9x8tc\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:08.040978 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:08.040929 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97b809f8-ed54-4bf1-a138-3481bb016d0f-console-serving-cert\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:08.040978 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:08.040944 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97b809f8-ed54-4bf1-a138-3481bb016d0f-trusted-ca-bundle\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:08.040978 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:08.040958 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97b809f8-ed54-4bf1-a138-3481bb016d0f-oauth-serving-cert\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:08.040978 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:08.040970 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97b809f8-ed54-4bf1-a138-3481bb016d0f-console-oauth-config\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:08.041219 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:08.040982 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97b809f8-ed54-4bf1-a138-3481bb016d0f-console-config\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:08.041219 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:08.040994 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97b809f8-ed54-4bf1-a138-3481bb016d0f-service-ca\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:08.622571 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:08.622536 2576 generic.go:356] "Generic (PLEG): container finished" podID="97b809f8-ed54-4bf1-a138-3481bb016d0f" containerID="720e68a52dd57a6904b4154f203f02b23eabe70116a390a8746d2b732e1815cf" exitCode=0 Aug 04 10:40:08.622961 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:08.622587 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7787b544cf-bhzwl" Aug 04 10:40:08.622961 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:08.622627 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7787b544cf-bhzwl" event={"ID":"97b809f8-ed54-4bf1-a138-3481bb016d0f","Type":"ContainerDied","Data":"720e68a52dd57a6904b4154f203f02b23eabe70116a390a8746d2b732e1815cf"} Aug 04 10:40:08.622961 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:08.622687 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7787b544cf-bhzwl" event={"ID":"97b809f8-ed54-4bf1-a138-3481bb016d0f","Type":"ContainerDied","Data":"b5bf9f8d5b3c60daffcd2d19ff5660f2bbefb267d5adb5b32dca9036a3a7c3b9"} Aug 04 10:40:08.622961 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:08.622717 2576 scope.go:117] "RemoveContainer" containerID="720e68a52dd57a6904b4154f203f02b23eabe70116a390a8746d2b732e1815cf" Aug 04 10:40:08.624939 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:08.624916 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-bl62w" event={"ID":"f93ae815-8c4c-4b43-987b-5bf70573393d","Type":"ContainerStarted","Data":"34389dcb35b94bbe89e292dcc00303f83ecad6e47cf68e440eb537be5e519ded"} Aug 04 10:40:08.631651 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:08.631622 2576 scope.go:117] "RemoveContainer" containerID="720e68a52dd57a6904b4154f203f02b23eabe70116a390a8746d2b732e1815cf" Aug 04 10:40:08.631902 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:40:08.631883 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"720e68a52dd57a6904b4154f203f02b23eabe70116a390a8746d2b732e1815cf\": container with ID starting with 720e68a52dd57a6904b4154f203f02b23eabe70116a390a8746d2b732e1815cf not found: ID does not exist" containerID="720e68a52dd57a6904b4154f203f02b23eabe70116a390a8746d2b732e1815cf" Aug 04 10:40:08.631948 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:08.631910 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"720e68a52dd57a6904b4154f203f02b23eabe70116a390a8746d2b732e1815cf"} err="failed to get container status \"720e68a52dd57a6904b4154f203f02b23eabe70116a390a8746d2b732e1815cf\": rpc error: code = NotFound desc = could not find container \"720e68a52dd57a6904b4154f203f02b23eabe70116a390a8746d2b732e1815cf\": container with ID starting with 720e68a52dd57a6904b4154f203f02b23eabe70116a390a8746d2b732e1815cf not found: ID does not exist" Aug 04 10:40:08.668825 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:08.668796 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7787b544cf-bhzwl"] Aug 04 10:40:08.669951 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:08.669934 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7787b544cf-bhzwl"] Aug 04 10:40:09.927373 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:09.927342 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97b809f8-ed54-4bf1-a138-3481bb016d0f" path="/var/lib/kubelet/pods/97b809f8-ed54-4bf1-a138-3481bb016d0f/volumes" Aug 04 10:40:11.362649 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:11.362619 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:40:11.366622 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:11.366599 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7b67f6577d-pjfdx" Aug 04 10:40:33.425890 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:33.425857 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:33.445919 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:33.445889 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:33.737568 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:33.737498 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:51.453791 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.453762 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 04 10:40:51.454279 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.454050 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerName="prometheus" containerID="cri-o://33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f" gracePeriod=600 Aug 04 10:40:51.454279 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.454054 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerName="kube-rbac-proxy" containerID="cri-o://1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02" gracePeriod=600 Aug 04 10:40:51.454279 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.454086 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerName="kube-rbac-proxy-thanos" containerID="cri-o://bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283" gracePeriod=600 Aug 04 10:40:51.454279 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.454104 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerName="thanos-sidecar" containerID="cri-o://cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e" gracePeriod=600 Aug 04 10:40:51.454279 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.454143 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerName="config-reloader" containerID="cri-o://c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299" gracePeriod=600 Aug 04 10:40:51.454279 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.454156 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerName="kube-rbac-proxy-web" containerID="cri-o://2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e" gracePeriod=600 Aug 04 10:40:51.693850 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.693827 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:51.793380 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.793350 2576 generic.go:356] "Generic (PLEG): container finished" podID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerID="bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283" exitCode=0 Aug 04 10:40:51.793380 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.793376 2576 generic.go:356] "Generic (PLEG): container finished" podID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerID="1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02" exitCode=0 Aug 04 10:40:51.793380 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.793385 2576 generic.go:356] "Generic (PLEG): container finished" podID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerID="2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e" exitCode=0 Aug 04 10:40:51.793615 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.793413 2576 generic.go:356] "Generic (PLEG): container finished" podID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerID="cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e" exitCode=0 Aug 04 10:40:51.793615 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.793419 2576 generic.go:356] "Generic (PLEG): container finished" podID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerID="c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299" exitCode=0 Aug 04 10:40:51.793615 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.793425 2576 generic.go:356] "Generic (PLEG): container finished" podID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerID="33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f" exitCode=0 Aug 04 10:40:51.793615 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.793443 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:51.793615 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.793440 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34ffb959-f83b-4cd1-943f-04293bd3ba12","Type":"ContainerDied","Data":"bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283"} Aug 04 10:40:51.793615 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.793588 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34ffb959-f83b-4cd1-943f-04293bd3ba12","Type":"ContainerDied","Data":"1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02"} Aug 04 10:40:51.793803 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.793635 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34ffb959-f83b-4cd1-943f-04293bd3ba12","Type":"ContainerDied","Data":"2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e"} Aug 04 10:40:51.793803 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.793648 2576 scope.go:117] "RemoveContainer" containerID="bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283" Aug 04 10:40:51.793803 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.793676 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34ffb959-f83b-4cd1-943f-04293bd3ba12","Type":"ContainerDied","Data":"cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e"} Aug 04 10:40:51.793803 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.793719 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34ffb959-f83b-4cd1-943f-04293bd3ba12","Type":"ContainerDied","Data":"c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299"} Aug 04 10:40:51.793803 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.793760 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34ffb959-f83b-4cd1-943f-04293bd3ba12","Type":"ContainerDied","Data":"33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f"} Aug 04 10:40:51.793803 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.793799 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"34ffb959-f83b-4cd1-943f-04293bd3ba12","Type":"ContainerDied","Data":"908443b2cf8cb751d71d4dd6f5f8db56b1e6a66e4f3af70d7afdbbc451e9df28"} Aug 04 10:40:51.800831 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.800812 2576 scope.go:117] "RemoveContainer" containerID="1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02" Aug 04 10:40:51.807386 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.807371 2576 scope.go:117] "RemoveContainer" containerID="2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e" Aug 04 10:40:51.809375 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.809360 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34ffb959-f83b-4cd1-943f-04293bd3ba12-config-out\") pod \"34ffb959-f83b-4cd1-943f-04293bd3ba12\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " Aug 04 10:40:51.809444 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.809406 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-k8s-rulefiles-2\") pod \"34ffb959-f83b-4cd1-943f-04293bd3ba12\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " Aug 04 10:40:51.809444 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.809427 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"34ffb959-f83b-4cd1-943f-04293bd3ba12\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " Aug 04 10:40:51.809557 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.809452 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"34ffb959-f83b-4cd1-943f-04293bd3ba12\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " Aug 04 10:40:51.809609 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.809580 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-config\") pod \"34ffb959-f83b-4cd1-943f-04293bd3ba12\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " Aug 04 10:40:51.809664 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.809625 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-thanos-prometheus-http-client-file\") pod \"34ffb959-f83b-4cd1-943f-04293bd3ba12\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " Aug 04 10:40:51.809718 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.809673 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34ffb959-f83b-4cd1-943f-04293bd3ba12-tls-assets\") pod \"34ffb959-f83b-4cd1-943f-04293bd3ba12\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " Aug 04 10:40:51.809718 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.809702 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-k8s-rulefiles-0\") pod \"34ffb959-f83b-4cd1-943f-04293bd3ba12\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " Aug 04 10:40:51.809818 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.809741 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22trl\" (UniqueName: \"kubernetes.io/projected/34ffb959-f83b-4cd1-943f-04293bd3ba12-kube-api-access-22trl\") pod \"34ffb959-f83b-4cd1-943f-04293bd3ba12\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " Aug 04 10:40:51.809818 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.809747 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "34ffb959-f83b-4cd1-943f-04293bd3ba12" (UID: "34ffb959-f83b-4cd1-943f-04293bd3ba12"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:40:51.809818 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.809767 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-kube-rbac-proxy\") pod \"34ffb959-f83b-4cd1-943f-04293bd3ba12\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " Aug 04 10:40:51.809818 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.809793 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-configmap-serving-certs-ca-bundle\") pod \"34ffb959-f83b-4cd1-943f-04293bd3ba12\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " Aug 04 10:40:51.810013 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.809836 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-k8s-db\") pod \"34ffb959-f83b-4cd1-943f-04293bd3ba12\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " Aug 04 10:40:51.810013 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.809868 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-configmap-metrics-client-ca\") pod \"34ffb959-f83b-4cd1-943f-04293bd3ba12\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " Aug 04 10:40:51.810013 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.809896 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-grpc-tls\") pod \"34ffb959-f83b-4cd1-943f-04293bd3ba12\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " Aug 04 10:40:51.811967 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.810820 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "34ffb959-f83b-4cd1-943f-04293bd3ba12" (UID: "34ffb959-f83b-4cd1-943f-04293bd3ba12"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:40:51.811967 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.811177 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-web-config\") pod \"34ffb959-f83b-4cd1-943f-04293bd3ba12\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " Aug 04 10:40:51.811967 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.811227 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-metrics-client-certs\") pod \"34ffb959-f83b-4cd1-943f-04293bd3ba12\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " Aug 04 10:40:51.811967 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.811284 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-configmap-kubelet-serving-ca-bundle\") pod \"34ffb959-f83b-4cd1-943f-04293bd3ba12\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " Aug 04 10:40:51.811967 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.811315 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-prometheus-k8s-tls\") pod \"34ffb959-f83b-4cd1-943f-04293bd3ba12\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " Aug 04 10:40:51.811967 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.811350 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-trusted-ca-bundle\") pod \"34ffb959-f83b-4cd1-943f-04293bd3ba12\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " Aug 04 10:40:51.811967 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.811411 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-k8s-rulefiles-1\") pod \"34ffb959-f83b-4cd1-943f-04293bd3ba12\" (UID: \"34ffb959-f83b-4cd1-943f-04293bd3ba12\") " Aug 04 10:40:51.811967 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.811535 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "34ffb959-f83b-4cd1-943f-04293bd3ba12" (UID: "34ffb959-f83b-4cd1-943f-04293bd3ba12"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:40:51.811967 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.811691 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:51.811967 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.811709 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:51.811967 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.811725 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:51.812772 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.812249 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "34ffb959-f83b-4cd1-943f-04293bd3ba12" (UID: "34ffb959-f83b-4cd1-943f-04293bd3ba12"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:40:51.812772 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.812420 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "34ffb959-f83b-4cd1-943f-04293bd3ba12" (UID: "34ffb959-f83b-4cd1-943f-04293bd3ba12"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 10:40:51.812772 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.812587 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "34ffb959-f83b-4cd1-943f-04293bd3ba12" (UID: "34ffb959-f83b-4cd1-943f-04293bd3ba12"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:40:51.812932 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.812913 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34ffb959-f83b-4cd1-943f-04293bd3ba12-kube-api-access-22trl" (OuterVolumeSpecName: "kube-api-access-22trl") pod "34ffb959-f83b-4cd1-943f-04293bd3ba12" (UID: "34ffb959-f83b-4cd1-943f-04293bd3ba12"). InnerVolumeSpecName "kube-api-access-22trl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 10:40:51.813550 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.813050 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "34ffb959-f83b-4cd1-943f-04293bd3ba12" (UID: "34ffb959-f83b-4cd1-943f-04293bd3ba12"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 10:40:51.813550 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.813497 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "34ffb959-f83b-4cd1-943f-04293bd3ba12" (UID: "34ffb959-f83b-4cd1-943f-04293bd3ba12"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:40:51.813550 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.813503 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "34ffb959-f83b-4cd1-943f-04293bd3ba12" (UID: "34ffb959-f83b-4cd1-943f-04293bd3ba12"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:40:51.813747 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.813575 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34ffb959-f83b-4cd1-943f-04293bd3ba12-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "34ffb959-f83b-4cd1-943f-04293bd3ba12" (UID: "34ffb959-f83b-4cd1-943f-04293bd3ba12"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 10:40:51.813747 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.813718 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "34ffb959-f83b-4cd1-943f-04293bd3ba12" (UID: "34ffb959-f83b-4cd1-943f-04293bd3ba12"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 10:40:51.814044 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.813973 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "34ffb959-f83b-4cd1-943f-04293bd3ba12" (UID: "34ffb959-f83b-4cd1-943f-04293bd3ba12"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 10:40:51.814961 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.814905 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "34ffb959-f83b-4cd1-943f-04293bd3ba12" (UID: "34ffb959-f83b-4cd1-943f-04293bd3ba12"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 10:40:51.814961 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.814919 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-config" (OuterVolumeSpecName: "config") pod "34ffb959-f83b-4cd1-943f-04293bd3ba12" (UID: "34ffb959-f83b-4cd1-943f-04293bd3ba12"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 10:40:51.814961 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.814941 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "34ffb959-f83b-4cd1-943f-04293bd3ba12" (UID: "34ffb959-f83b-4cd1-943f-04293bd3ba12"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 10:40:51.815166 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.815124 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "34ffb959-f83b-4cd1-943f-04293bd3ba12" (UID: "34ffb959-f83b-4cd1-943f-04293bd3ba12"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 10:40:51.815614 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.815587 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34ffb959-f83b-4cd1-943f-04293bd3ba12-config-out" (OuterVolumeSpecName: "config-out") pod "34ffb959-f83b-4cd1-943f-04293bd3ba12" (UID: "34ffb959-f83b-4cd1-943f-04293bd3ba12"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 10:40:51.816144 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.816117 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "34ffb959-f83b-4cd1-943f-04293bd3ba12" (UID: "34ffb959-f83b-4cd1-943f-04293bd3ba12"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 10:40:51.817366 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.817349 2576 scope.go:117] "RemoveContainer" containerID="cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e" Aug 04 10:40:51.824456 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.824438 2576 scope.go:117] "RemoveContainer" containerID="c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299" Aug 04 10:40:51.826893 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.826872 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-web-config" (OuterVolumeSpecName: "web-config") pod "34ffb959-f83b-4cd1-943f-04293bd3ba12" (UID: "34ffb959-f83b-4cd1-943f-04293bd3ba12"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 10:40:51.830763 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.830748 2576 scope.go:117] "RemoveContainer" containerID="33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f" Aug 04 10:40:51.837437 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.837377 2576 scope.go:117] "RemoveContainer" containerID="3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c" Aug 04 10:40:51.843678 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.843662 2576 scope.go:117] "RemoveContainer" containerID="bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283" Aug 04 10:40:51.843906 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:40:51.843888 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283\": container with ID starting with bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283 not found: ID does not exist" containerID="bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283" Aug 04 10:40:51.843956 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.843914 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283"} err="failed to get container status \"bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283\": rpc error: code = NotFound desc = could not find container \"bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283\": container with ID starting with bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283 not found: ID does not exist" Aug 04 10:40:51.843956 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.843933 2576 scope.go:117] "RemoveContainer" containerID="1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02" Aug 04 10:40:51.844121 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:40:51.844105 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02\": container with ID starting with 1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02 not found: ID does not exist" containerID="1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02" Aug 04 10:40:51.844171 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.844127 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02"} err="failed to get container status \"1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02\": rpc error: code = NotFound desc = could not find container \"1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02\": container with ID starting with 1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02 not found: ID does not exist" Aug 04 10:40:51.844171 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.844143 2576 scope.go:117] "RemoveContainer" containerID="2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e" Aug 04 10:40:51.844374 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:40:51.844357 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e\": container with ID starting with 2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e not found: ID does not exist" containerID="2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e" Aug 04 10:40:51.844473 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.844382 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e"} err="failed to get container status \"2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e\": rpc error: code = NotFound desc = could not find container \"2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e\": container with ID starting with 2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e not found: ID does not exist" Aug 04 10:40:51.844473 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.844420 2576 scope.go:117] "RemoveContainer" containerID="cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e" Aug 04 10:40:51.844633 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:40:51.844618 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e\": container with ID starting with cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e not found: ID does not exist" containerID="cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e" Aug 04 10:40:51.844671 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.844637 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e"} err="failed to get container status \"cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e\": rpc error: code = NotFound desc = could not find container \"cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e\": container with ID starting with cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e not found: ID does not exist" Aug 04 10:40:51.844671 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.844649 2576 scope.go:117] "RemoveContainer" containerID="c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299" Aug 04 10:40:51.844879 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:40:51.844863 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299\": container with ID starting with c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299 not found: ID does not exist" containerID="c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299" Aug 04 10:40:51.844925 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.844883 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299"} err="failed to get container status \"c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299\": rpc error: code = NotFound desc = could not find container \"c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299\": container with ID starting with c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299 not found: ID does not exist" Aug 04 10:40:51.844925 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.844896 2576 scope.go:117] "RemoveContainer" containerID="33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f" Aug 04 10:40:51.845106 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:40:51.845087 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f\": container with ID starting with 33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f not found: ID does not exist" containerID="33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f" Aug 04 10:40:51.845148 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.845111 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f"} err="failed to get container status \"33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f\": rpc error: code = NotFound desc = could not find container \"33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f\": container with ID starting with 33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f not found: ID does not exist" Aug 04 10:40:51.845148 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.845125 2576 scope.go:117] "RemoveContainer" containerID="3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c" Aug 04 10:40:51.845368 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:40:51.845352 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c\": container with ID starting with 3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c not found: ID does not exist" containerID="3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c" Aug 04 10:40:51.845491 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.845375 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c"} err="failed to get container status \"3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c\": rpc error: code = NotFound desc = could not find container \"3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c\": container with ID starting with 3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c not found: ID does not exist" Aug 04 10:40:51.845491 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.845412 2576 scope.go:117] "RemoveContainer" containerID="bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283" Aug 04 10:40:51.845657 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.845640 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283"} err="failed to get container status \"bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283\": rpc error: code = NotFound desc = could not find container \"bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283\": container with ID starting with bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283 not found: ID does not exist" Aug 04 10:40:51.845702 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.845657 2576 scope.go:117] "RemoveContainer" containerID="1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02" Aug 04 10:40:51.845865 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.845846 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02"} err="failed to get container status \"1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02\": rpc error: code = NotFound desc = could not find container \"1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02\": container with ID starting with 1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02 not found: ID does not exist" Aug 04 10:40:51.845910 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.845867 2576 scope.go:117] "RemoveContainer" containerID="2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e" Aug 04 10:40:51.846092 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.846073 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e"} err="failed to get container status \"2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e\": rpc error: code = NotFound desc = could not find container \"2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e\": container with ID starting with 2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e not found: ID does not exist" Aug 04 10:40:51.846144 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.846092 2576 scope.go:117] "RemoveContainer" containerID="cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e" Aug 04 10:40:51.846307 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.846290 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e"} err="failed to get container status \"cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e\": rpc error: code = NotFound desc = could not find container \"cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e\": container with ID starting with cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e not found: ID does not exist" Aug 04 10:40:51.846349 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.846307 2576 scope.go:117] "RemoveContainer" containerID="c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299" Aug 04 10:40:51.846580 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.846563 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299"} err="failed to get container status \"c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299\": rpc error: code = NotFound desc = could not find container \"c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299\": container with ID starting with c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299 not found: ID does not exist" Aug 04 10:40:51.846636 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.846580 2576 scope.go:117] "RemoveContainer" containerID="33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f" Aug 04 10:40:51.846793 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.846778 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f"} err="failed to get container status \"33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f\": rpc error: code = NotFound desc = could not find container \"33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f\": container with ID starting with 33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f not found: ID does not exist" Aug 04 10:40:51.846848 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.846793 2576 scope.go:117] "RemoveContainer" containerID="3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c" Aug 04 10:40:51.847024 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.846994 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c"} err="failed to get container status \"3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c\": rpc error: code = NotFound desc = could not find container \"3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c\": container with ID starting with 3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c not found: ID does not exist" Aug 04 10:40:51.847024 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.847014 2576 scope.go:117] "RemoveContainer" containerID="bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283" Aug 04 10:40:51.847220 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.847202 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283"} err="failed to get container status \"bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283\": rpc error: code = NotFound desc = could not find container \"bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283\": container with ID starting with bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283 not found: ID does not exist" Aug 04 10:40:51.847287 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.847221 2576 scope.go:117] "RemoveContainer" containerID="1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02" Aug 04 10:40:51.847463 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.847448 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02"} err="failed to get container status \"1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02\": rpc error: code = NotFound desc = could not find container \"1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02\": container with ID starting with 1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02 not found: ID does not exist" Aug 04 10:40:51.847516 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.847464 2576 scope.go:117] "RemoveContainer" containerID="2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e" Aug 04 10:40:51.847685 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.847668 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e"} err="failed to get container status \"2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e\": rpc error: code = NotFound desc = could not find container \"2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e\": container with ID starting with 2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e not found: ID does not exist" Aug 04 10:40:51.847751 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.847687 2576 scope.go:117] "RemoveContainer" containerID="cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e" Aug 04 10:40:51.847885 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.847868 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e"} err="failed to get container status \"cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e\": rpc error: code = NotFound desc = could not find container \"cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e\": container with ID starting with cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e not found: ID does not exist" Aug 04 10:40:51.847926 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.847887 2576 scope.go:117] "RemoveContainer" containerID="c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299" Aug 04 10:40:51.848081 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.848064 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299"} err="failed to get container status \"c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299\": rpc error: code = NotFound desc = could not find container \"c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299\": container with ID starting with c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299 not found: ID does not exist" Aug 04 10:40:51.848140 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.848083 2576 scope.go:117] "RemoveContainer" containerID="33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f" Aug 04 10:40:51.848291 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.848275 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f"} err="failed to get container status \"33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f\": rpc error: code = NotFound desc = could not find container \"33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f\": container with ID starting with 33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f not found: ID does not exist" Aug 04 10:40:51.848356 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.848292 2576 scope.go:117] "RemoveContainer" containerID="3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c" Aug 04 10:40:51.848497 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.848478 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c"} err="failed to get container status \"3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c\": rpc error: code = NotFound desc = could not find container \"3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c\": container with ID starting with 3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c not found: ID does not exist" Aug 04 10:40:51.848544 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.848498 2576 scope.go:117] "RemoveContainer" containerID="bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283" Aug 04 10:40:51.848665 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.848650 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283"} err="failed to get container status \"bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283\": rpc error: code = NotFound desc = could not find container \"bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283\": container with ID starting with bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283 not found: ID does not exist" Aug 04 10:40:51.848707 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.848665 2576 scope.go:117] "RemoveContainer" containerID="1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02" Aug 04 10:40:51.848857 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.848840 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02"} err="failed to get container status \"1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02\": rpc error: code = NotFound desc = could not find container \"1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02\": container with ID starting with 1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02 not found: ID does not exist" Aug 04 10:40:51.848893 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.848859 2576 scope.go:117] "RemoveContainer" containerID="2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e" Aug 04 10:40:51.849042 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.849028 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e"} err="failed to get container status \"2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e\": rpc error: code = NotFound desc = could not find container \"2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e\": container with ID starting with 2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e not found: ID does not exist" Aug 04 10:40:51.849082 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.849042 2576 scope.go:117] "RemoveContainer" containerID="cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e" Aug 04 10:40:51.849227 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.849211 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e"} err="failed to get container status \"cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e\": rpc error: code = NotFound desc = could not find container \"cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e\": container with ID starting with cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e not found: ID does not exist" Aug 04 10:40:51.849271 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.849228 2576 scope.go:117] "RemoveContainer" containerID="c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299" Aug 04 10:40:51.849417 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.849386 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299"} err="failed to get container status \"c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299\": rpc error: code = NotFound desc = could not find container \"c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299\": container with ID starting with c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299 not found: ID does not exist" Aug 04 10:40:51.849417 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.849417 2576 scope.go:117] "RemoveContainer" containerID="33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f" Aug 04 10:40:51.849623 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.849606 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f"} err="failed to get container status \"33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f\": rpc error: code = NotFound desc = could not find container \"33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f\": container with ID starting with 33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f not found: ID does not exist" Aug 04 10:40:51.849682 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.849622 2576 scope.go:117] "RemoveContainer" containerID="3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c" Aug 04 10:40:51.849809 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.849791 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c"} err="failed to get container status \"3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c\": rpc error: code = NotFound desc = could not find container \"3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c\": container with ID starting with 3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c not found: ID does not exist" Aug 04 10:40:51.849874 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.849812 2576 scope.go:117] "RemoveContainer" containerID="bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283" Aug 04 10:40:51.850044 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.850023 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283"} err="failed to get container status \"bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283\": rpc error: code = NotFound desc = could not find container \"bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283\": container with ID starting with bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283 not found: ID does not exist" Aug 04 10:40:51.850083 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.850046 2576 scope.go:117] "RemoveContainer" containerID="1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02" Aug 04 10:40:51.850257 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.850239 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02"} err="failed to get container status \"1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02\": rpc error: code = NotFound desc = could not find container \"1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02\": container with ID starting with 1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02 not found: ID does not exist" Aug 04 10:40:51.850298 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.850258 2576 scope.go:117] "RemoveContainer" containerID="2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e" Aug 04 10:40:51.850461 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.850445 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e"} err="failed to get container status \"2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e\": rpc error: code = NotFound desc = could not find container \"2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e\": container with ID starting with 2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e not found: ID does not exist" Aug 04 10:40:51.850529 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.850461 2576 scope.go:117] "RemoveContainer" containerID="cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e" Aug 04 10:40:51.850672 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.850655 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e"} err="failed to get container status \"cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e\": rpc error: code = NotFound desc = could not find container \"cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e\": container with ID starting with cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e not found: ID does not exist" Aug 04 10:40:51.850725 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.850673 2576 scope.go:117] "RemoveContainer" containerID="c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299" Aug 04 10:40:51.850907 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.850887 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299"} err="failed to get container status \"c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299\": rpc error: code = NotFound desc = could not find container \"c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299\": container with ID starting with c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299 not found: ID does not exist" Aug 04 10:40:51.850907 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.850906 2576 scope.go:117] "RemoveContainer" containerID="33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f" Aug 04 10:40:51.851112 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.851095 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f"} err="failed to get container status \"33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f\": rpc error: code = NotFound desc = could not find container \"33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f\": container with ID starting with 33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f not found: ID does not exist" Aug 04 10:40:51.851112 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.851111 2576 scope.go:117] "RemoveContainer" containerID="3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c" Aug 04 10:40:51.851301 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.851283 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c"} err="failed to get container status \"3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c\": rpc error: code = NotFound desc = could not find container \"3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c\": container with ID starting with 3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c not found: ID does not exist" Aug 04 10:40:51.851354 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.851303 2576 scope.go:117] "RemoveContainer" containerID="bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283" Aug 04 10:40:51.851485 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.851466 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283"} err="failed to get container status \"bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283\": rpc error: code = NotFound desc = could not find container \"bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283\": container with ID starting with bb4f4efa146a848bd812cf80995b3dd8fdf3698927540afdc81c029e83e7e283 not found: ID does not exist" Aug 04 10:40:51.851560 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.851486 2576 scope.go:117] "RemoveContainer" containerID="1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02" Aug 04 10:40:51.851686 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.851668 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02"} err="failed to get container status \"1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02\": rpc error: code = NotFound desc = could not find container \"1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02\": container with ID starting with 1e07a5f0320e743365eac1e2499045a872d5367c829b237b8b211f2366a6ba02 not found: ID does not exist" Aug 04 10:40:51.851722 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.851689 2576 scope.go:117] "RemoveContainer" containerID="2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e" Aug 04 10:40:51.851925 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.851908 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e"} err="failed to get container status \"2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e\": rpc error: code = NotFound desc = could not find container \"2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e\": container with ID starting with 2abaecbb0221013343d629bcdcc9beb3f439b874cb77002451cad49b814eeb7e not found: ID does not exist" Aug 04 10:40:51.851985 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.851927 2576 scope.go:117] "RemoveContainer" containerID="cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e" Aug 04 10:40:51.852142 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.852122 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e"} err="failed to get container status \"cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e\": rpc error: code = NotFound desc = could not find container \"cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e\": container with ID starting with cf2ea77551c53049033d7d90edf50debaa9f35fce522d2df71b3289d192a8f2e not found: ID does not exist" Aug 04 10:40:51.852142 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.852140 2576 scope.go:117] "RemoveContainer" containerID="c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299" Aug 04 10:40:51.852362 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.852346 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299"} err="failed to get container status \"c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299\": rpc error: code = NotFound desc = could not find container \"c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299\": container with ID starting with c9a56c47de82a615b4c4370b3ff2ec27d21cf5c5b0cd405513ed023fb93f1299 not found: ID does not exist" Aug 04 10:40:51.852362 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.852361 2576 scope.go:117] "RemoveContainer" containerID="33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f" Aug 04 10:40:51.852550 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.852534 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f"} err="failed to get container status \"33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f\": rpc error: code = NotFound desc = could not find container \"33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f\": container with ID starting with 33e9352773fffe2696fc28a28bf56efaf40783e9619351e83be8b400bb40ad4f not found: ID does not exist" Aug 04 10:40:51.852601 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.852550 2576 scope.go:117] "RemoveContainer" containerID="3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c" Aug 04 10:40:51.852731 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.852716 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c"} err="failed to get container status \"3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c\": rpc error: code = NotFound desc = could not find container \"3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c\": container with ID starting with 3bd8f610d70b11a6ff6321ef14d86de9ee4d9b4f87498bf252caf7cb635ecd6c not found: ID does not exist" Aug 04 10:40:51.912520 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.912480 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:51.912609 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.912532 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:51.912609 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.912558 2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-config\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:51.912609 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.912570 2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:51.912609 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.912582 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34ffb959-f83b-4cd1-943f-04293bd3ba12-tls-assets\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:51.912755 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.912606 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22trl\" (UniqueName: \"kubernetes.io/projected/34ffb959-f83b-4cd1-943f-04293bd3ba12-kube-api-access-22trl\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:51.912755 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.912635 2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-kube-rbac-proxy\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:51.912755 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.912654 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-k8s-db\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:51.912755 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.912677 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-configmap-metrics-client-ca\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:51.912755 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.912700 2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-grpc-tls\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:51.912755 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.912716 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-web-config\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:51.912755 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.912725 2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-metrics-client-certs\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:51.912755 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.912741 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:51.912999 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.912759 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/34ffb959-f83b-4cd1-943f-04293bd3ba12-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:51.912999 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.912782 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:51.912999 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.912801 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/34ffb959-f83b-4cd1-943f-04293bd3ba12-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:51.912999 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:51.912815 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34ffb959-f83b-4cd1-943f-04293bd3ba12-config-out\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:40:52.115061 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.114997 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 04 10:40:52.122465 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.122441 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 04 10:40:52.152678 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.152653 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 04 10:40:52.152950 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.152936 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerName="kube-rbac-proxy" Aug 04 10:40:52.152990 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.152954 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerName="kube-rbac-proxy" Aug 04 10:40:52.152990 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.152971 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f69dd5e-7e95-4738-a2a6-831a5513d66f" containerName="registry" Aug 04 10:40:52.152990 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.152977 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f69dd5e-7e95-4738-a2a6-831a5513d66f" containerName="registry" Aug 04 10:40:52.152990 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.152984 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97b809f8-ed54-4bf1-a138-3481bb016d0f" containerName="console" Aug 04 10:40:52.152990 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.152990 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="97b809f8-ed54-4bf1-a138-3481bb016d0f" containerName="console" Aug 04 10:40:52.153130 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.153000 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerName="thanos-sidecar" Aug 04 10:40:52.153130 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.153005 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerName="thanos-sidecar" Aug 04 10:40:52.153130 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.153012 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerName="init-config-reloader" Aug 04 10:40:52.153130 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.153017 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerName="init-config-reloader" Aug 04 10:40:52.153130 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.153023 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc903a4b-8fd0-41ba-ad9f-597aa478d946" containerName="console" Aug 04 10:40:52.153130 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.153028 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc903a4b-8fd0-41ba-ad9f-597aa478d946" containerName="console" Aug 04 10:40:52.153130 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.153037 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerName="kube-rbac-proxy-web" Aug 04 10:40:52.153130 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.153046 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerName="kube-rbac-proxy-web" Aug 04 10:40:52.153130 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.153054 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerName="prometheus" Aug 04 10:40:52.153130 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.153060 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerName="prometheus" Aug 04 10:40:52.153130 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.153067 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerName="kube-rbac-proxy-thanos" Aug 04 10:40:52.153130 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.153071 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerName="kube-rbac-proxy-thanos" Aug 04 10:40:52.153130 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.153077 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerName="config-reloader" Aug 04 10:40:52.153130 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.153083 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerName="config-reloader" Aug 04 10:40:52.153542 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.153138 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerName="kube-rbac-proxy" Aug 04 10:40:52.153542 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.153147 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="97b809f8-ed54-4bf1-a138-3481bb016d0f" containerName="console" Aug 04 10:40:52.153542 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.153154 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerName="prometheus" Aug 04 10:40:52.153542 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.153159 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerName="thanos-sidecar" Aug 04 10:40:52.153542 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.153164 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerName="kube-rbac-proxy-thanos" Aug 04 10:40:52.153542 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.153170 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f69dd5e-7e95-4738-a2a6-831a5513d66f" containerName="registry" Aug 04 10:40:52.153542 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.153175 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc903a4b-8fd0-41ba-ad9f-597aa478d946" containerName="console" Aug 04 10:40:52.153542 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.153180 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerName="config-reloader" Aug 04 10:40:52.153542 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.153186 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" containerName="kube-rbac-proxy-web" Aug 04 10:40:52.157013 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.156997 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.159699 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.159645 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Aug 04 10:40:52.159823 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.159700 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Aug 04 10:40:52.159823 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.159749 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Aug 04 10:40:52.159958 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.159940 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Aug 04 10:40:52.160884 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.160636 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bsqp2jqj3ga3s\"" Aug 04 10:40:52.160884 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.160664 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Aug 04 10:40:52.160884 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.160727 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Aug 04 10:40:52.160884 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.160740 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Aug 04 10:40:52.160884 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.160756 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Aug 04 10:40:52.160884 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.160768 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Aug 04 10:40:52.160884 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.160788 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Aug 04 10:40:52.160884 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.160731 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ztxnd\"" Aug 04 10:40:52.160884 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.160873 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Aug 04 10:40:52.160884 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.160887 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Aug 04 10:40:52.164018 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.164000 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Aug 04 10:40:52.166980 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.166959 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Aug 04 10:40:52.172803 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.172783 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 04 10:40:52.315347 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.315321 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.315347 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.315347 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.315523 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.315365 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.315523 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.315384 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.315523 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.315416 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.315523 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.315452 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sb9s\" (UniqueName: \"kubernetes.io/projected/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-kube-api-access-6sb9s\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.315523 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.315472 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.315523 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.315487 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.315523 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.315523 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.315753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.315540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.315753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.315563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.315753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.315605 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.315753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.315624 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.315753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.315641 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.315753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.315657 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.315753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.315674 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-web-config\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.315753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.315732 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.315753 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.315753 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-config-out\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.316020 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.315770 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.316020 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.315796 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-config\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.416335 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.416278 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-config-out\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.416335 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.416310 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.416335 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.416327 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-config\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.416579 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.416349 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.416579 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.416444 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.416579 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.416487 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.416579 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.416513 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.416579 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.416550 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.416579 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.416570 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sb9s\" (UniqueName: \"kubernetes.io/projected/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-kube-api-access-6sb9s\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.416876 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.416601 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.416876 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.416627 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.416876 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.416657 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.416876 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.416684 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.416876 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.416715 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.416876 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.416745 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.416876 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.416784 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.416876 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.416809 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.416876 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.416828 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.416876 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.416859 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-web-config\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.417356 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.416910 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.417356 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.417230 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.418293 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.417934 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.418418 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.418307 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.419289 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.418843 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.419289 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.419185 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.419289 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.419199 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.419289 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.419232 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.420314 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.419929 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-config\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.420314 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.420089 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-config-out\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.420510 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.420468 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.421588 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.421026 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.421689 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.421664 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.421775 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.421717 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.421856 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.421778 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.422054 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.422034 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.422112 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.422067 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.422573 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.422553 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.422809 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.422786 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-web-config\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.423149 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.423126 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.426885 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.426863 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sb9s\" (UniqueName: \"kubernetes.io/projected/65d3b68a-6b0b-473e-9ad2-f0aebca496b4-kube-api-access-6sb9s\") pod \"prometheus-k8s-0\" (UID: \"65d3b68a-6b0b-473e-9ad2-f0aebca496b4\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.467001 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.466977 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:40:52.612245 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.612217 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 04 10:40:52.616223 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:40:52.616198 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65d3b68a_6b0b_473e_9ad2_f0aebca496b4.slice/crio-793c2a6a8198390c6c5d39bd8b2d8e8d2e095b586e75bd70dad09aef83e4271f WatchSource:0}: Error finding container 793c2a6a8198390c6c5d39bd8b2d8e8d2e095b586e75bd70dad09aef83e4271f: Status 404 returned error can't find the container with id 793c2a6a8198390c6c5d39bd8b2d8e8d2e095b586e75bd70dad09aef83e4271f Aug 04 10:40:52.798956 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.798924 2576 generic.go:356] "Generic (PLEG): container finished" podID="65d3b68a-6b0b-473e-9ad2-f0aebca496b4" containerID="add0023bbe78fd8e128609c926c0d6c9439ac52e7522c98010dcc6bb32f3ebb1" exitCode=0 Aug 04 10:40:52.799117 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.799011 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"65d3b68a-6b0b-473e-9ad2-f0aebca496b4","Type":"ContainerDied","Data":"add0023bbe78fd8e128609c926c0d6c9439ac52e7522c98010dcc6bb32f3ebb1"} Aug 04 10:40:52.799117 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:52.799100 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"65d3b68a-6b0b-473e-9ad2-f0aebca496b4","Type":"ContainerStarted","Data":"793c2a6a8198390c6c5d39bd8b2d8e8d2e095b586e75bd70dad09aef83e4271f"} Aug 04 10:40:53.807791 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:53.807754 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"65d3b68a-6b0b-473e-9ad2-f0aebca496b4","Type":"ContainerStarted","Data":"b7102c1d621259a5cf03045f0276692a90abc63c51dd94cbd006adf0fb0d6117"} Aug 04 10:40:53.808269 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:53.807862 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"65d3b68a-6b0b-473e-9ad2-f0aebca496b4","Type":"ContainerStarted","Data":"e36481a77bc35b198a9533a3bfc1e95aa45f69b65fefa35019ad3d1f419f672a"} Aug 04 10:40:53.808269 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:53.807913 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"65d3b68a-6b0b-473e-9ad2-f0aebca496b4","Type":"ContainerStarted","Data":"d6210671e37e49252fc764195d952f839c7a711cc52da59adc916363222fef24"} Aug 04 10:40:53.808269 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:53.807957 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"65d3b68a-6b0b-473e-9ad2-f0aebca496b4","Type":"ContainerStarted","Data":"486b540d6dfd6d8d89cf67dd24f32f157334b33410d4948dd43365a8976ad98c"} Aug 04 10:40:53.808269 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:53.807993 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"65d3b68a-6b0b-473e-9ad2-f0aebca496b4","Type":"ContainerStarted","Data":"79d954a81e92fbc74a91a933a3462ca30ce7c07b7c47ecab3f9263fab4294ca0"} Aug 04 10:40:53.808269 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:53.808031 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"65d3b68a-6b0b-473e-9ad2-f0aebca496b4","Type":"ContainerStarted","Data":"7ca569889629b88b1efdfa4fe6f43ed58444795183088c959b9b34046eb50d4c"} Aug 04 10:40:53.842127 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:53.842062 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.819842929 podStartE2EDuration="1.842044615s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.201686ms" isStatefulPod=false podCreationTimestamp="2026-08-04 10:40:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:40:53.840666181 +0000 UTC m=+204.439570600" watchObservedRunningTime="2026-08-04 10:40:53.842044615 +0000 UTC m=+204.440948993" Aug 04 10:40:53.928369 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:53.928333 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34ffb959-f83b-4cd1-943f-04293bd3ba12" path="/var/lib/kubelet/pods/34ffb959-f83b-4cd1-943f-04293bd3ba12/volumes" Aug 04 10:40:54.528488 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:54.528453 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bdfdbff4-wmkwr"] Aug 04 10:40:54.531468 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:54.531442 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:40:54.547264 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:54.547233 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bdfdbff4-wmkwr"] Aug 04 10:40:54.637453 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:54.637412 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a08efc4b-cf2c-4c88-941b-3508e7890d64-console-config\") pod \"console-bdfdbff4-wmkwr\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:40:54.637453 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:54.637459 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a08efc4b-cf2c-4c88-941b-3508e7890d64-console-oauth-config\") pod \"console-bdfdbff4-wmkwr\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:40:54.637684 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:54.637486 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08efc4b-cf2c-4c88-941b-3508e7890d64-trusted-ca-bundle\") pod \"console-bdfdbff4-wmkwr\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:40:54.637684 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:54.637504 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a08efc4b-cf2c-4c88-941b-3508e7890d64-oauth-serving-cert\") pod \"console-bdfdbff4-wmkwr\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:40:54.637684 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:54.637588 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5xsp\" (UniqueName: \"kubernetes.io/projected/a08efc4b-cf2c-4c88-941b-3508e7890d64-kube-api-access-f5xsp\") pod \"console-bdfdbff4-wmkwr\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:40:54.637684 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:54.637632 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a08efc4b-cf2c-4c88-941b-3508e7890d64-console-serving-cert\") pod \"console-bdfdbff4-wmkwr\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:40:54.637684 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:54.637659 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a08efc4b-cf2c-4c88-941b-3508e7890d64-service-ca\") pod \"console-bdfdbff4-wmkwr\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:40:54.739051 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:54.739013 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a08efc4b-cf2c-4c88-941b-3508e7890d64-console-config\") pod \"console-bdfdbff4-wmkwr\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:40:54.739051 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:54.739059 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a08efc4b-cf2c-4c88-941b-3508e7890d64-console-oauth-config\") pod \"console-bdfdbff4-wmkwr\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:40:54.739308 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:54.739076 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08efc4b-cf2c-4c88-941b-3508e7890d64-trusted-ca-bundle\") pod \"console-bdfdbff4-wmkwr\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:40:54.739308 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:54.739093 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a08efc4b-cf2c-4c88-941b-3508e7890d64-oauth-serving-cert\") pod \"console-bdfdbff4-wmkwr\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:40:54.739308 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:54.739133 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5xsp\" (UniqueName: \"kubernetes.io/projected/a08efc4b-cf2c-4c88-941b-3508e7890d64-kube-api-access-f5xsp\") pod \"console-bdfdbff4-wmkwr\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:40:54.739308 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:54.739171 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a08efc4b-cf2c-4c88-941b-3508e7890d64-console-serving-cert\") pod \"console-bdfdbff4-wmkwr\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:40:54.739308 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:54.739209 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a08efc4b-cf2c-4c88-941b-3508e7890d64-service-ca\") pod \"console-bdfdbff4-wmkwr\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:40:54.739844 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:54.739811 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a08efc4b-cf2c-4c88-941b-3508e7890d64-console-config\") pod \"console-bdfdbff4-wmkwr\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:40:54.739964 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:54.739919 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a08efc4b-cf2c-4c88-941b-3508e7890d64-oauth-serving-cert\") pod \"console-bdfdbff4-wmkwr\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:40:54.740062 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:54.739961 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a08efc4b-cf2c-4c88-941b-3508e7890d64-service-ca\") pod \"console-bdfdbff4-wmkwr\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:40:54.740062 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:54.740029 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08efc4b-cf2c-4c88-941b-3508e7890d64-trusted-ca-bundle\") pod \"console-bdfdbff4-wmkwr\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:40:54.741725 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:54.741697 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a08efc4b-cf2c-4c88-941b-3508e7890d64-console-oauth-config\") pod \"console-bdfdbff4-wmkwr\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:40:54.741808 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:54.741787 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a08efc4b-cf2c-4c88-941b-3508e7890d64-console-serving-cert\") pod \"console-bdfdbff4-wmkwr\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:40:54.749795 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:54.749764 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5xsp\" (UniqueName: \"kubernetes.io/projected/a08efc4b-cf2c-4c88-941b-3508e7890d64-kube-api-access-f5xsp\") pod \"console-bdfdbff4-wmkwr\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:40:54.842204 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:54.842112 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:40:54.978090 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:54.978066 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bdfdbff4-wmkwr"] Aug 04 10:40:54.980322 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:40:54.980297 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda08efc4b_cf2c_4c88_941b_3508e7890d64.slice/crio-8d6860b47a6ce706332ff4a2b155d2c82d283f77b6b58b36a659e5e249cf0df9 WatchSource:0}: Error finding container 8d6860b47a6ce706332ff4a2b155d2c82d283f77b6b58b36a659e5e249cf0df9: Status 404 returned error can't find the container with id 8d6860b47a6ce706332ff4a2b155d2c82d283f77b6b58b36a659e5e249cf0df9 Aug 04 10:40:55.818564 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:55.818524 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bdfdbff4-wmkwr" event={"ID":"a08efc4b-cf2c-4c88-941b-3508e7890d64","Type":"ContainerStarted","Data":"bcd5ef5ef489655b9fb6ffb1cf23bb955f49c000a3523d53300804dd0dbf5d5f"} Aug 04 10:40:55.818729 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:55.818605 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bdfdbff4-wmkwr" event={"ID":"a08efc4b-cf2c-4c88-941b-3508e7890d64","Type":"ContainerStarted","Data":"8d6860b47a6ce706332ff4a2b155d2c82d283f77b6b58b36a659e5e249cf0df9"} Aug 04 10:40:55.838863 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:55.838816 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bdfdbff4-wmkwr" podStartSLOduration=1.838799946 podStartE2EDuration="1.838799946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:40:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:40:55.838099341 +0000 UTC m=+206.437003717" watchObservedRunningTime="2026-08-04 10:40:55.838799946 +0000 UTC m=+206.437704379" Aug 04 10:40:57.467152 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:40:57.467121 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:41:04.842992 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:04.842940 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:41:04.843456 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:04.843020 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:41:04.847826 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:04.847800 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:41:04.857582 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:04.857564 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:41:04.914609 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:04.914581 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c75bcbdcc-mvhjz"] Aug 04 10:41:29.939035 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:29.939000 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c75bcbdcc-mvhjz" podUID="7342394f-9399-4fc9-b3c0-519264a0ca55" containerName="console" containerID="cri-o://c7bc8d0bc0db408120d57129a12ab49e53765bcc3e4de305e501e93efe6af391" gracePeriod=15 Aug 04 10:41:30.179867 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.179843 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:41:30.227060 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.227027 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7342394f-9399-4fc9-b3c0-519264a0ca55-trusted-ca-bundle\") pod \"7342394f-9399-4fc9-b3c0-519264a0ca55\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " Aug 04 10:41:30.227223 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.227088 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7342394f-9399-4fc9-b3c0-519264a0ca55-console-oauth-config\") pod \"7342394f-9399-4fc9-b3c0-519264a0ca55\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " Aug 04 10:41:30.227223 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.227159 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7342394f-9399-4fc9-b3c0-519264a0ca55-oauth-serving-cert\") pod \"7342394f-9399-4fc9-b3c0-519264a0ca55\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " Aug 04 10:41:30.227223 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.227195 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7342394f-9399-4fc9-b3c0-519264a0ca55-console-serving-cert\") pod \"7342394f-9399-4fc9-b3c0-519264a0ca55\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " Aug 04 10:41:30.227414 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.227228 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7342394f-9399-4fc9-b3c0-519264a0ca55-service-ca\") pod \"7342394f-9399-4fc9-b3c0-519264a0ca55\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " Aug 04 10:41:30.227414 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.227273 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7342394f-9399-4fc9-b3c0-519264a0ca55-console-config\") pod \"7342394f-9399-4fc9-b3c0-519264a0ca55\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " Aug 04 10:41:30.227414 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.227325 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6296\" (UniqueName: \"kubernetes.io/projected/7342394f-9399-4fc9-b3c0-519264a0ca55-kube-api-access-q6296\") pod \"7342394f-9399-4fc9-b3c0-519264a0ca55\" (UID: \"7342394f-9399-4fc9-b3c0-519264a0ca55\") " Aug 04 10:41:30.227587 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.227418 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7342394f-9399-4fc9-b3c0-519264a0ca55-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7342394f-9399-4fc9-b3c0-519264a0ca55" (UID: "7342394f-9399-4fc9-b3c0-519264a0ca55"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:41:30.227692 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.227671 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7342394f-9399-4fc9-b3c0-519264a0ca55-trusted-ca-bundle\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:41:30.227757 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.227693 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7342394f-9399-4fc9-b3c0-519264a0ca55-service-ca" (OuterVolumeSpecName: "service-ca") pod "7342394f-9399-4fc9-b3c0-519264a0ca55" (UID: "7342394f-9399-4fc9-b3c0-519264a0ca55"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:41:30.227975 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.227822 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7342394f-9399-4fc9-b3c0-519264a0ca55-console-config" (OuterVolumeSpecName: "console-config") pod "7342394f-9399-4fc9-b3c0-519264a0ca55" (UID: "7342394f-9399-4fc9-b3c0-519264a0ca55"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:41:30.228163 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.228137 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7342394f-9399-4fc9-b3c0-519264a0ca55-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7342394f-9399-4fc9-b3c0-519264a0ca55" (UID: "7342394f-9399-4fc9-b3c0-519264a0ca55"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:41:30.229571 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.229548 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7342394f-9399-4fc9-b3c0-519264a0ca55-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7342394f-9399-4fc9-b3c0-519264a0ca55" (UID: "7342394f-9399-4fc9-b3c0-519264a0ca55"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 10:41:30.229571 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.229565 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7342394f-9399-4fc9-b3c0-519264a0ca55-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7342394f-9399-4fc9-b3c0-519264a0ca55" (UID: "7342394f-9399-4fc9-b3c0-519264a0ca55"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 10:41:30.229724 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.229567 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7342394f-9399-4fc9-b3c0-519264a0ca55-kube-api-access-q6296" (OuterVolumeSpecName: "kube-api-access-q6296") pod "7342394f-9399-4fc9-b3c0-519264a0ca55" (UID: "7342394f-9399-4fc9-b3c0-519264a0ca55"). InnerVolumeSpecName "kube-api-access-q6296". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 10:41:30.328320 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.328249 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6296\" (UniqueName: \"kubernetes.io/projected/7342394f-9399-4fc9-b3c0-519264a0ca55-kube-api-access-q6296\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:41:30.328320 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.328274 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7342394f-9399-4fc9-b3c0-519264a0ca55-console-oauth-config\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:41:30.328320 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.328284 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7342394f-9399-4fc9-b3c0-519264a0ca55-oauth-serving-cert\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:41:30.328320 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.328292 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7342394f-9399-4fc9-b3c0-519264a0ca55-console-serving-cert\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:41:30.328320 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.328301 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7342394f-9399-4fc9-b3c0-519264a0ca55-service-ca\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:41:30.328320 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.328309 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7342394f-9399-4fc9-b3c0-519264a0ca55-console-config\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:41:30.957267 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.957233 2576 generic.go:356] "Generic (PLEG): container finished" podID="7342394f-9399-4fc9-b3c0-519264a0ca55" containerID="c7bc8d0bc0db408120d57129a12ab49e53765bcc3e4de305e501e93efe6af391" exitCode=0 Aug 04 10:41:30.957776 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.957282 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c75bcbdcc-mvhjz" event={"ID":"7342394f-9399-4fc9-b3c0-519264a0ca55","Type":"ContainerDied","Data":"c7bc8d0bc0db408120d57129a12ab49e53765bcc3e4de305e501e93efe6af391"} Aug 04 10:41:30.957776 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.957285 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c75bcbdcc-mvhjz" Aug 04 10:41:30.957776 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.957315 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c75bcbdcc-mvhjz" event={"ID":"7342394f-9399-4fc9-b3c0-519264a0ca55","Type":"ContainerDied","Data":"38535faa39dc17940efcc8ceb7aaa8db446614b54c6c94ca48ed55dd697844e0"} Aug 04 10:41:30.957776 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.957334 2576 scope.go:117] "RemoveContainer" containerID="c7bc8d0bc0db408120d57129a12ab49e53765bcc3e4de305e501e93efe6af391" Aug 04 10:41:30.966152 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.966131 2576 scope.go:117] "RemoveContainer" containerID="c7bc8d0bc0db408120d57129a12ab49e53765bcc3e4de305e501e93efe6af391" Aug 04 10:41:30.966432 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:41:30.966386 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7bc8d0bc0db408120d57129a12ab49e53765bcc3e4de305e501e93efe6af391\": container with ID starting with c7bc8d0bc0db408120d57129a12ab49e53765bcc3e4de305e501e93efe6af391 not found: ID does not exist" containerID="c7bc8d0bc0db408120d57129a12ab49e53765bcc3e4de305e501e93efe6af391" Aug 04 10:41:30.966508 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.966439 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7bc8d0bc0db408120d57129a12ab49e53765bcc3e4de305e501e93efe6af391"} err="failed to get container status \"c7bc8d0bc0db408120d57129a12ab49e53765bcc3e4de305e501e93efe6af391\": rpc error: code = NotFound desc = could not find container \"c7bc8d0bc0db408120d57129a12ab49e53765bcc3e4de305e501e93efe6af391\": container with ID starting with c7bc8d0bc0db408120d57129a12ab49e53765bcc3e4de305e501e93efe6af391 not found: ID does not exist" Aug 04 10:41:30.977906 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.977883 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c75bcbdcc-mvhjz"] Aug 04 10:41:30.983575 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:30.983556 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c75bcbdcc-mvhjz"] Aug 04 10:41:31.927706 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:31.927677 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7342394f-9399-4fc9-b3c0-519264a0ca55" path="/var/lib/kubelet/pods/7342394f-9399-4fc9-b3c0-519264a0ca55/volumes" Aug 04 10:41:52.468121 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:52.468029 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:41:52.484118 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:52.484094 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:41:53.055544 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:41:53.055516 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Aug 04 10:42:06.915792 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:06.915756 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6ffc6d67c5-62stl"] Aug 04 10:42:06.916716 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:06.916176 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7342394f-9399-4fc9-b3c0-519264a0ca55" containerName="console" Aug 04 10:42:06.916716 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:06.916195 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7342394f-9399-4fc9-b3c0-519264a0ca55" containerName="console" Aug 04 10:42:06.916716 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:06.916290 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7342394f-9399-4fc9-b3c0-519264a0ca55" containerName="console" Aug 04 10:42:06.919204 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:06.919182 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:06.931004 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:06.930981 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ffc6d67c5-62stl"] Aug 04 10:42:07.016157 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:07.016124 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9b43b0d-2fb7-4412-9ece-7d41c650967a-oauth-serving-cert\") pod \"console-6ffc6d67c5-62stl\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:07.016308 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:07.016164 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9b43b0d-2fb7-4412-9ece-7d41c650967a-service-ca\") pod \"console-6ffc6d67c5-62stl\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:07.016308 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:07.016222 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rnrg\" (UniqueName: \"kubernetes.io/projected/c9b43b0d-2fb7-4412-9ece-7d41c650967a-kube-api-access-6rnrg\") pod \"console-6ffc6d67c5-62stl\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:07.016308 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:07.016249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9b43b0d-2fb7-4412-9ece-7d41c650967a-console-oauth-config\") pod \"console-6ffc6d67c5-62stl\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:07.016308 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:07.016271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9b43b0d-2fb7-4412-9ece-7d41c650967a-trusted-ca-bundle\") pod \"console-6ffc6d67c5-62stl\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:07.016308 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:07.016301 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9b43b0d-2fb7-4412-9ece-7d41c650967a-console-config\") pod \"console-6ffc6d67c5-62stl\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:07.016505 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:07.016318 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9b43b0d-2fb7-4412-9ece-7d41c650967a-console-serving-cert\") pod \"console-6ffc6d67c5-62stl\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:07.116705 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:07.116674 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9b43b0d-2fb7-4412-9ece-7d41c650967a-service-ca\") pod \"console-6ffc6d67c5-62stl\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:07.116860 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:07.116726 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rnrg\" (UniqueName: \"kubernetes.io/projected/c9b43b0d-2fb7-4412-9ece-7d41c650967a-kube-api-access-6rnrg\") pod \"console-6ffc6d67c5-62stl\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:07.116860 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:07.116758 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9b43b0d-2fb7-4412-9ece-7d41c650967a-console-oauth-config\") pod \"console-6ffc6d67c5-62stl\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:07.116860 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:07.116772 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9b43b0d-2fb7-4412-9ece-7d41c650967a-trusted-ca-bundle\") pod \"console-6ffc6d67c5-62stl\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:07.117019 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:07.116825 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9b43b0d-2fb7-4412-9ece-7d41c650967a-console-config\") pod \"console-6ffc6d67c5-62stl\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:07.117019 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:07.116898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9b43b0d-2fb7-4412-9ece-7d41c650967a-console-serving-cert\") pod \"console-6ffc6d67c5-62stl\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:07.117019 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:07.116938 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9b43b0d-2fb7-4412-9ece-7d41c650967a-oauth-serving-cert\") pod \"console-6ffc6d67c5-62stl\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:07.117664 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:07.117634 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9b43b0d-2fb7-4412-9ece-7d41c650967a-console-config\") pod \"console-6ffc6d67c5-62stl\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:07.117785 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:07.117639 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9b43b0d-2fb7-4412-9ece-7d41c650967a-oauth-serving-cert\") pod \"console-6ffc6d67c5-62stl\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:07.117785 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:07.117683 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9b43b0d-2fb7-4412-9ece-7d41c650967a-service-ca\") pod \"console-6ffc6d67c5-62stl\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:07.117982 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:07.117966 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9b43b0d-2fb7-4412-9ece-7d41c650967a-trusted-ca-bundle\") pod \"console-6ffc6d67c5-62stl\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:07.119197 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:07.119178 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9b43b0d-2fb7-4412-9ece-7d41c650967a-console-oauth-config\") pod \"console-6ffc6d67c5-62stl\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:07.119303 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:07.119267 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9b43b0d-2fb7-4412-9ece-7d41c650967a-console-serving-cert\") pod \"console-6ffc6d67c5-62stl\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:07.128883 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:07.128856 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rnrg\" (UniqueName: \"kubernetes.io/projected/c9b43b0d-2fb7-4412-9ece-7d41c650967a-kube-api-access-6rnrg\") pod \"console-6ffc6d67c5-62stl\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:07.229162 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:07.229104 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:07.364597 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:07.364574 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ffc6d67c5-62stl"] Aug 04 10:42:07.366865 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:42:07.366843 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9b43b0d_2fb7_4412_9ece_7d41c650967a.slice/crio-525830a9a43af5448aa45b6bbe86105eb3a2763c9baa14958c4ee0cb9fe18dce WatchSource:0}: Error finding container 525830a9a43af5448aa45b6bbe86105eb3a2763c9baa14958c4ee0cb9fe18dce: Status 404 returned error can't find the container with id 525830a9a43af5448aa45b6bbe86105eb3a2763c9baa14958c4ee0cb9fe18dce Aug 04 10:42:08.098002 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:08.097970 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ffc6d67c5-62stl" event={"ID":"c9b43b0d-2fb7-4412-9ece-7d41c650967a","Type":"ContainerStarted","Data":"a76d6d0a1666ceaec6c5ca1d2b3137bf0420521ec227eae89c608bf2b82fff3e"} Aug 04 10:42:08.098347 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:08.098022 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ffc6d67c5-62stl" event={"ID":"c9b43b0d-2fb7-4412-9ece-7d41c650967a","Type":"ContainerStarted","Data":"525830a9a43af5448aa45b6bbe86105eb3a2763c9baa14958c4ee0cb9fe18dce"} Aug 04 10:42:08.117376 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:08.117322 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6ffc6d67c5-62stl" podStartSLOduration=2.117304497 podStartE2EDuration="2.117304497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:42:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:42:08.116863793 +0000 UTC m=+278.715768168" watchObservedRunningTime="2026-08-04 10:42:08.117304497 +0000 UTC m=+278.716208873" Aug 04 10:42:17.229644 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:17.229608 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:17.230215 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:17.229659 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:17.235237 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:17.235216 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:18.137227 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:18.137199 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:42:18.191663 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:18.191635 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bdfdbff4-wmkwr"] Aug 04 10:42:29.784237 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:29.784194 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 10:42:29.788949 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:29.788930 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 10:42:29.796761 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:29.796739 2576 kubelet.go:1648] "Image garbage collection succeeded" Aug 04 10:42:43.211455 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:43.211365 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-bdfdbff4-wmkwr" podUID="a08efc4b-cf2c-4c88-941b-3508e7890d64" containerName="console" containerID="cri-o://bcd5ef5ef489655b9fb6ffb1cf23bb955f49c000a3523d53300804dd0dbf5d5f" gracePeriod=15 Aug 04 10:42:43.445453 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:43.445432 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:42:43.610494 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:43.610453 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a08efc4b-cf2c-4c88-941b-3508e7890d64-service-ca\") pod \"a08efc4b-cf2c-4c88-941b-3508e7890d64\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " Aug 04 10:42:43.610650 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:43.610512 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a08efc4b-cf2c-4c88-941b-3508e7890d64-console-oauth-config\") pod \"a08efc4b-cf2c-4c88-941b-3508e7890d64\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " Aug 04 10:42:43.610650 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:43.610563 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a08efc4b-cf2c-4c88-941b-3508e7890d64-oauth-serving-cert\") pod \"a08efc4b-cf2c-4c88-941b-3508e7890d64\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " Aug 04 10:42:43.610650 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:43.610615 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a08efc4b-cf2c-4c88-941b-3508e7890d64-console-config\") pod \"a08efc4b-cf2c-4c88-941b-3508e7890d64\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " Aug 04 10:42:43.610767 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:43.610658 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08efc4b-cf2c-4c88-941b-3508e7890d64-trusted-ca-bundle\") pod \"a08efc4b-cf2c-4c88-941b-3508e7890d64\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " Aug 04 10:42:43.610767 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:43.610681 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5xsp\" (UniqueName: \"kubernetes.io/projected/a08efc4b-cf2c-4c88-941b-3508e7890d64-kube-api-access-f5xsp\") pod \"a08efc4b-cf2c-4c88-941b-3508e7890d64\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " Aug 04 10:42:43.610767 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:43.610705 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a08efc4b-cf2c-4c88-941b-3508e7890d64-console-serving-cert\") pod \"a08efc4b-cf2c-4c88-941b-3508e7890d64\" (UID: \"a08efc4b-cf2c-4c88-941b-3508e7890d64\") " Aug 04 10:42:43.611036 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:43.610884 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a08efc4b-cf2c-4c88-941b-3508e7890d64-service-ca" (OuterVolumeSpecName: "service-ca") pod "a08efc4b-cf2c-4c88-941b-3508e7890d64" (UID: "a08efc4b-cf2c-4c88-941b-3508e7890d64"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:42:43.611036 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:43.611011 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a08efc4b-cf2c-4c88-941b-3508e7890d64-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a08efc4b-cf2c-4c88-941b-3508e7890d64" (UID: "a08efc4b-cf2c-4c88-941b-3508e7890d64"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:42:43.611226 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:43.611077 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a08efc4b-cf2c-4c88-941b-3508e7890d64-console-config" (OuterVolumeSpecName: "console-config") pod "a08efc4b-cf2c-4c88-941b-3508e7890d64" (UID: "a08efc4b-cf2c-4c88-941b-3508e7890d64"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:42:43.611226 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:43.611086 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a08efc4b-cf2c-4c88-941b-3508e7890d64-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a08efc4b-cf2c-4c88-941b-3508e7890d64" (UID: "a08efc4b-cf2c-4c88-941b-3508e7890d64"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:42:43.613009 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:43.612982 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a08efc4b-cf2c-4c88-941b-3508e7890d64-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a08efc4b-cf2c-4c88-941b-3508e7890d64" (UID: "a08efc4b-cf2c-4c88-941b-3508e7890d64"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 10:42:43.613100 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:43.613041 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a08efc4b-cf2c-4c88-941b-3508e7890d64-kube-api-access-f5xsp" (OuterVolumeSpecName: "kube-api-access-f5xsp") pod "a08efc4b-cf2c-4c88-941b-3508e7890d64" (UID: "a08efc4b-cf2c-4c88-941b-3508e7890d64"). InnerVolumeSpecName "kube-api-access-f5xsp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 10:42:43.613166 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:43.613140 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a08efc4b-cf2c-4c88-941b-3508e7890d64-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a08efc4b-cf2c-4c88-941b-3508e7890d64" (UID: "a08efc4b-cf2c-4c88-941b-3508e7890d64"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 10:42:43.711980 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:43.711959 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a08efc4b-cf2c-4c88-941b-3508e7890d64-oauth-serving-cert\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:42:43.712083 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:43.711979 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a08efc4b-cf2c-4c88-941b-3508e7890d64-console-config\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:42:43.712083 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:43.712001 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08efc4b-cf2c-4c88-941b-3508e7890d64-trusted-ca-bundle\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:42:43.712083 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:43.712010 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5xsp\" (UniqueName: \"kubernetes.io/projected/a08efc4b-cf2c-4c88-941b-3508e7890d64-kube-api-access-f5xsp\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:42:43.712083 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:43.712019 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a08efc4b-cf2c-4c88-941b-3508e7890d64-console-serving-cert\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:42:43.712083 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:43.712027 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a08efc4b-cf2c-4c88-941b-3508e7890d64-service-ca\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:42:43.712083 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:43.712035 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a08efc4b-cf2c-4c88-941b-3508e7890d64-console-oauth-config\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:42:44.233469 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:44.233358 2576 generic.go:356] "Generic (PLEG): container finished" podID="a08efc4b-cf2c-4c88-941b-3508e7890d64" containerID="bcd5ef5ef489655b9fb6ffb1cf23bb955f49c000a3523d53300804dd0dbf5d5f" exitCode=0 Aug 04 10:42:44.233469 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:44.233424 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bdfdbff4-wmkwr" Aug 04 10:42:44.233469 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:44.233453 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bdfdbff4-wmkwr" event={"ID":"a08efc4b-cf2c-4c88-941b-3508e7890d64","Type":"ContainerDied","Data":"bcd5ef5ef489655b9fb6ffb1cf23bb955f49c000a3523d53300804dd0dbf5d5f"} Aug 04 10:42:44.233943 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:44.233505 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bdfdbff4-wmkwr" event={"ID":"a08efc4b-cf2c-4c88-941b-3508e7890d64","Type":"ContainerDied","Data":"8d6860b47a6ce706332ff4a2b155d2c82d283f77b6b58b36a659e5e249cf0df9"} Aug 04 10:42:44.233943 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:44.233532 2576 scope.go:117] "RemoveContainer" containerID="bcd5ef5ef489655b9fb6ffb1cf23bb955f49c000a3523d53300804dd0dbf5d5f" Aug 04 10:42:44.241421 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:44.241409 2576 scope.go:117] "RemoveContainer" containerID="bcd5ef5ef489655b9fb6ffb1cf23bb955f49c000a3523d53300804dd0dbf5d5f" Aug 04 10:42:44.241686 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:42:44.241668 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcd5ef5ef489655b9fb6ffb1cf23bb955f49c000a3523d53300804dd0dbf5d5f\": container with ID starting with bcd5ef5ef489655b9fb6ffb1cf23bb955f49c000a3523d53300804dd0dbf5d5f not found: ID does not exist" containerID="bcd5ef5ef489655b9fb6ffb1cf23bb955f49c000a3523d53300804dd0dbf5d5f" Aug 04 10:42:44.241767 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:44.241693 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcd5ef5ef489655b9fb6ffb1cf23bb955f49c000a3523d53300804dd0dbf5d5f"} err="failed to get container status \"bcd5ef5ef489655b9fb6ffb1cf23bb955f49c000a3523d53300804dd0dbf5d5f\": rpc error: code = NotFound desc = could not find container \"bcd5ef5ef489655b9fb6ffb1cf23bb955f49c000a3523d53300804dd0dbf5d5f\": container with ID starting with bcd5ef5ef489655b9fb6ffb1cf23bb955f49c000a3523d53300804dd0dbf5d5f not found: ID does not exist" Aug 04 10:42:44.250527 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:44.250506 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bdfdbff4-wmkwr"] Aug 04 10:42:44.254626 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:44.254605 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bdfdbff4-wmkwr"] Aug 04 10:42:45.927842 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:42:45.927807 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a08efc4b-cf2c-4c88-941b-3508e7890d64" path="/var/lib/kubelet/pods/a08efc4b-cf2c-4c88-941b-3508e7890d64/volumes" Aug 04 10:44:53.172703 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.172600 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59f56cb47-xtlrc"] Aug 04 10:44:53.173187 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.173044 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a08efc4b-cf2c-4c88-941b-3508e7890d64" containerName="console" Aug 04 10:44:53.173187 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.173064 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a08efc4b-cf2c-4c88-941b-3508e7890d64" containerName="console" Aug 04 10:44:53.173187 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.173131 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a08efc4b-cf2c-4c88-941b-3508e7890d64" containerName="console" Aug 04 10:44:53.176218 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.176195 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:44:53.187791 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.187761 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59f56cb47-xtlrc"] Aug 04 10:44:53.233610 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.233581 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7f3a2c5-4a35-4294-b690-2d4456762c08-console-config\") pod \"console-59f56cb47-xtlrc\" (UID: \"c7f3a2c5-4a35-4294-b690-2d4456762c08\") " pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:44:53.233610 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.233612 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7f3a2c5-4a35-4294-b690-2d4456762c08-console-serving-cert\") pod \"console-59f56cb47-xtlrc\" (UID: \"c7f3a2c5-4a35-4294-b690-2d4456762c08\") " pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:44:53.233784 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.233633 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7f3a2c5-4a35-4294-b690-2d4456762c08-trusted-ca-bundle\") pod \"console-59f56cb47-xtlrc\" (UID: \"c7f3a2c5-4a35-4294-b690-2d4456762c08\") " pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:44:53.233784 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.233675 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7f3a2c5-4a35-4294-b690-2d4456762c08-service-ca\") pod \"console-59f56cb47-xtlrc\" (UID: \"c7f3a2c5-4a35-4294-b690-2d4456762c08\") " pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:44:53.233784 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.233717 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxfj6\" (UniqueName: \"kubernetes.io/projected/c7f3a2c5-4a35-4294-b690-2d4456762c08-kube-api-access-nxfj6\") pod \"console-59f56cb47-xtlrc\" (UID: \"c7f3a2c5-4a35-4294-b690-2d4456762c08\") " pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:44:53.233784 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.233732 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7f3a2c5-4a35-4294-b690-2d4456762c08-console-oauth-config\") pod \"console-59f56cb47-xtlrc\" (UID: \"c7f3a2c5-4a35-4294-b690-2d4456762c08\") " pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:44:53.233784 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.233748 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7f3a2c5-4a35-4294-b690-2d4456762c08-oauth-serving-cert\") pod \"console-59f56cb47-xtlrc\" (UID: \"c7f3a2c5-4a35-4294-b690-2d4456762c08\") " pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:44:53.334607 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.334583 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7f3a2c5-4a35-4294-b690-2d4456762c08-console-config\") pod \"console-59f56cb47-xtlrc\" (UID: \"c7f3a2c5-4a35-4294-b690-2d4456762c08\") " pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:44:53.334747 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.334612 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7f3a2c5-4a35-4294-b690-2d4456762c08-console-serving-cert\") pod \"console-59f56cb47-xtlrc\" (UID: \"c7f3a2c5-4a35-4294-b690-2d4456762c08\") " pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:44:53.334747 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.334633 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7f3a2c5-4a35-4294-b690-2d4456762c08-trusted-ca-bundle\") pod \"console-59f56cb47-xtlrc\" (UID: \"c7f3a2c5-4a35-4294-b690-2d4456762c08\") " pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:44:53.334747 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.334654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7f3a2c5-4a35-4294-b690-2d4456762c08-service-ca\") pod \"console-59f56cb47-xtlrc\" (UID: \"c7f3a2c5-4a35-4294-b690-2d4456762c08\") " pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:44:53.334747 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.334678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxfj6\" (UniqueName: \"kubernetes.io/projected/c7f3a2c5-4a35-4294-b690-2d4456762c08-kube-api-access-nxfj6\") pod \"console-59f56cb47-xtlrc\" (UID: \"c7f3a2c5-4a35-4294-b690-2d4456762c08\") " pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:44:53.334747 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.334702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7f3a2c5-4a35-4294-b690-2d4456762c08-console-oauth-config\") pod \"console-59f56cb47-xtlrc\" (UID: \"c7f3a2c5-4a35-4294-b690-2d4456762c08\") " pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:44:53.334747 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.334727 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7f3a2c5-4a35-4294-b690-2d4456762c08-oauth-serving-cert\") pod \"console-59f56cb47-xtlrc\" (UID: \"c7f3a2c5-4a35-4294-b690-2d4456762c08\") " pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:44:53.335434 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.335377 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7f3a2c5-4a35-4294-b690-2d4456762c08-console-config\") pod \"console-59f56cb47-xtlrc\" (UID: \"c7f3a2c5-4a35-4294-b690-2d4456762c08\") " pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:44:53.335607 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.335581 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7f3a2c5-4a35-4294-b690-2d4456762c08-trusted-ca-bundle\") pod \"console-59f56cb47-xtlrc\" (UID: \"c7f3a2c5-4a35-4294-b690-2d4456762c08\") " pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:44:53.335607 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.335496 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7f3a2c5-4a35-4294-b690-2d4456762c08-oauth-serving-cert\") pod \"console-59f56cb47-xtlrc\" (UID: \"c7f3a2c5-4a35-4294-b690-2d4456762c08\") " pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:44:53.335737 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.335459 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7f3a2c5-4a35-4294-b690-2d4456762c08-service-ca\") pod \"console-59f56cb47-xtlrc\" (UID: \"c7f3a2c5-4a35-4294-b690-2d4456762c08\") " pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:44:53.337184 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.337166 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7f3a2c5-4a35-4294-b690-2d4456762c08-console-serving-cert\") pod \"console-59f56cb47-xtlrc\" (UID: \"c7f3a2c5-4a35-4294-b690-2d4456762c08\") " pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:44:53.337239 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.337212 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7f3a2c5-4a35-4294-b690-2d4456762c08-console-oauth-config\") pod \"console-59f56cb47-xtlrc\" (UID: \"c7f3a2c5-4a35-4294-b690-2d4456762c08\") " pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:44:53.343542 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.343519 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxfj6\" (UniqueName: \"kubernetes.io/projected/c7f3a2c5-4a35-4294-b690-2d4456762c08-kube-api-access-nxfj6\") pod \"console-59f56cb47-xtlrc\" (UID: \"c7f3a2c5-4a35-4294-b690-2d4456762c08\") " pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:44:53.486283 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.486228 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:44:53.614639 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.614609 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59f56cb47-xtlrc"] Aug 04 10:44:53.617596 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:44:53.617563 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7f3a2c5_4a35_4294_b690_2d4456762c08.slice/crio-62017a1f5655283efd1536d741ea703eae8afe9d3a3e6f7342275cd8d4370b0f WatchSource:0}: Error finding container 62017a1f5655283efd1536d741ea703eae8afe9d3a3e6f7342275cd8d4370b0f: Status 404 returned error can't find the container with id 62017a1f5655283efd1536d741ea703eae8afe9d3a3e6f7342275cd8d4370b0f Aug 04 10:44:53.718034 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.718000 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f56cb47-xtlrc" event={"ID":"c7f3a2c5-4a35-4294-b690-2d4456762c08","Type":"ContainerStarted","Data":"b1e8b0551eaacd5fc48e653c53c11e17d61c349505787249434579c561f73d1d"} Aug 04 10:44:53.718202 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.718052 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f56cb47-xtlrc" event={"ID":"c7f3a2c5-4a35-4294-b690-2d4456762c08","Type":"ContainerStarted","Data":"62017a1f5655283efd1536d741ea703eae8afe9d3a3e6f7342275cd8d4370b0f"} Aug 04 10:44:53.751920 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:44:53.751868 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59f56cb47-xtlrc" podStartSLOduration=0.751851025 podStartE2EDuration="751.851025ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:44:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:44:53.751369881 +0000 UTC m=+444.350274282" watchObservedRunningTime="2026-08-04 10:44:53.751851025 +0000 UTC m=+444.350755399" Aug 04 10:45:03.486648 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:03.486611 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:45:03.487076 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:03.486675 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:45:03.491630 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:03.491608 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:45:03.759673 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:03.759645 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59f56cb47-xtlrc" Aug 04 10:45:03.806014 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:03.805978 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ffc6d67c5-62stl"] Aug 04 10:45:11.812313 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:11.812280 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6hdcv"] Aug 04 10:45:11.815660 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:11.815645 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-6hdcv" Aug 04 10:45:11.818773 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:11.818749 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Aug 04 10:45:11.819889 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:11.819867 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-mhrcb\"" Aug 04 10:45:11.820004 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:11.819920 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Aug 04 10:45:11.827821 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:11.827800 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6hdcv"] Aug 04 10:45:11.897980 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:11.897951 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3103bf64-e1fc-46a5-96c2-e4090315a50a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6hdcv\" (UID: \"3103bf64-e1fc-46a5-96c2-e4090315a50a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6hdcv" Aug 04 10:45:11.898121 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:11.898000 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqnmt\" (UniqueName: \"kubernetes.io/projected/3103bf64-e1fc-46a5-96c2-e4090315a50a-kube-api-access-hqnmt\") pod \"cert-manager-webhook-6486ffd997-6hdcv\" (UID: \"3103bf64-e1fc-46a5-96c2-e4090315a50a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6hdcv" Aug 04 10:45:11.999069 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:11.999036 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3103bf64-e1fc-46a5-96c2-e4090315a50a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6hdcv\" (UID: \"3103bf64-e1fc-46a5-96c2-e4090315a50a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6hdcv" Aug 04 10:45:11.999209 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:11.999090 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqnmt\" (UniqueName: \"kubernetes.io/projected/3103bf64-e1fc-46a5-96c2-e4090315a50a-kube-api-access-hqnmt\") pod \"cert-manager-webhook-6486ffd997-6hdcv\" (UID: \"3103bf64-e1fc-46a5-96c2-e4090315a50a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6hdcv" Aug 04 10:45:12.014675 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:12.014647 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqnmt\" (UniqueName: \"kubernetes.io/projected/3103bf64-e1fc-46a5-96c2-e4090315a50a-kube-api-access-hqnmt\") pod \"cert-manager-webhook-6486ffd997-6hdcv\" (UID: \"3103bf64-e1fc-46a5-96c2-e4090315a50a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6hdcv" Aug 04 10:45:12.027147 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:12.027124 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3103bf64-e1fc-46a5-96c2-e4090315a50a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6hdcv\" (UID: \"3103bf64-e1fc-46a5-96c2-e4090315a50a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6hdcv" Aug 04 10:45:12.131538 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:12.131475 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-6hdcv" Aug 04 10:45:12.262151 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:12.262123 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6hdcv"] Aug 04 10:45:12.265106 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:45:12.265082 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3103bf64_e1fc_46a5_96c2_e4090315a50a.slice/crio-5b515e097916ae01796a8957a749aec16b2a1b9b2d2653c110dc8b8d2fc326cc WatchSource:0}: Error finding container 5b515e097916ae01796a8957a749aec16b2a1b9b2d2653c110dc8b8d2fc326cc: Status 404 returned error can't find the container with id 5b515e097916ae01796a8957a749aec16b2a1b9b2d2653c110dc8b8d2fc326cc Aug 04 10:45:12.267386 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:12.267370 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 04 10:45:12.792765 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:12.792733 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-6hdcv" event={"ID":"3103bf64-e1fc-46a5-96c2-e4090315a50a","Type":"ContainerStarted","Data":"5b515e097916ae01796a8957a749aec16b2a1b9b2d2653c110dc8b8d2fc326cc"} Aug 04 10:45:15.808141 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:15.808105 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-6hdcv" event={"ID":"3103bf64-e1fc-46a5-96c2-e4090315a50a","Type":"ContainerStarted","Data":"a37243dc6d4049eaafe49c0beecdc82637aad7a4f52102d0544e82356cf1dbcb"} Aug 04 10:45:15.808503 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:15.808226 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-6hdcv" Aug 04 10:45:15.825568 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:15.825525 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-6hdcv" podStartSLOduration=1.436116658 podStartE2EDuration="4.825510288s" totalImagesPullingTime="3.38939363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:45:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:45:15.824827105 +0000 UTC m=+466.423731481" watchObservedRunningTime="2026-08-04 10:45:15.825510288 +0000 UTC m=+466.424414658" Aug 04 10:45:21.813738 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:21.813708 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-6hdcv" Aug 04 10:45:28.826506 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:28.826465 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6ffc6d67c5-62stl" podUID="c9b43b0d-2fb7-4412-9ece-7d41c650967a" containerName="console" containerID="cri-o://a76d6d0a1666ceaec6c5ca1d2b3137bf0420521ec227eae89c608bf2b82fff3e" gracePeriod=15 Aug 04 10:45:29.069493 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.069467 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:45:29.146960 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.146878 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9b43b0d-2fb7-4412-9ece-7d41c650967a-console-serving-cert\") pod \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " Aug 04 10:45:29.146960 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.146921 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9b43b0d-2fb7-4412-9ece-7d41c650967a-oauth-serving-cert\") pod \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " Aug 04 10:45:29.147140 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.146971 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9b43b0d-2fb7-4412-9ece-7d41c650967a-console-config\") pod \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " Aug 04 10:45:29.147140 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.147013 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9b43b0d-2fb7-4412-9ece-7d41c650967a-console-oauth-config\") pod \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " Aug 04 10:45:29.147140 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.147047 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9b43b0d-2fb7-4412-9ece-7d41c650967a-trusted-ca-bundle\") pod \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " Aug 04 10:45:29.147140 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.147079 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rnrg\" (UniqueName: \"kubernetes.io/projected/c9b43b0d-2fb7-4412-9ece-7d41c650967a-kube-api-access-6rnrg\") pod \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " Aug 04 10:45:29.147140 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.147103 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9b43b0d-2fb7-4412-9ece-7d41c650967a-service-ca\") pod \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\" (UID: \"c9b43b0d-2fb7-4412-9ece-7d41c650967a\") " Aug 04 10:45:29.147560 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.147526 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9b43b0d-2fb7-4412-9ece-7d41c650967a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c9b43b0d-2fb7-4412-9ece-7d41c650967a" (UID: "c9b43b0d-2fb7-4412-9ece-7d41c650967a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:45:29.147560 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.147539 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9b43b0d-2fb7-4412-9ece-7d41c650967a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c9b43b0d-2fb7-4412-9ece-7d41c650967a" (UID: "c9b43b0d-2fb7-4412-9ece-7d41c650967a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:45:29.147760 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.147526 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9b43b0d-2fb7-4412-9ece-7d41c650967a-console-config" (OuterVolumeSpecName: "console-config") pod "c9b43b0d-2fb7-4412-9ece-7d41c650967a" (UID: "c9b43b0d-2fb7-4412-9ece-7d41c650967a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:45:29.147760 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.147595 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9b43b0d-2fb7-4412-9ece-7d41c650967a-service-ca" (OuterVolumeSpecName: "service-ca") pod "c9b43b0d-2fb7-4412-9ece-7d41c650967a" (UID: "c9b43b0d-2fb7-4412-9ece-7d41c650967a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 10:45:29.149259 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.149234 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9b43b0d-2fb7-4412-9ece-7d41c650967a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c9b43b0d-2fb7-4412-9ece-7d41c650967a" (UID: "c9b43b0d-2fb7-4412-9ece-7d41c650967a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 10:45:29.149332 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.149274 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9b43b0d-2fb7-4412-9ece-7d41c650967a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c9b43b0d-2fb7-4412-9ece-7d41c650967a" (UID: "c9b43b0d-2fb7-4412-9ece-7d41c650967a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 10:45:29.149387 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.149365 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9b43b0d-2fb7-4412-9ece-7d41c650967a-kube-api-access-6rnrg" (OuterVolumeSpecName: "kube-api-access-6rnrg") pod "c9b43b0d-2fb7-4412-9ece-7d41c650967a" (UID: "c9b43b0d-2fb7-4412-9ece-7d41c650967a"). InnerVolumeSpecName "kube-api-access-6rnrg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 10:45:29.248253 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.248217 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c9b43b0d-2fb7-4412-9ece-7d41c650967a-console-config\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:45:29.248253 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.248244 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c9b43b0d-2fb7-4412-9ece-7d41c650967a-console-oauth-config\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:45:29.248253 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.248255 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9b43b0d-2fb7-4412-9ece-7d41c650967a-trusted-ca-bundle\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:45:29.248498 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.248266 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rnrg\" (UniqueName: \"kubernetes.io/projected/c9b43b0d-2fb7-4412-9ece-7d41c650967a-kube-api-access-6rnrg\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:45:29.248498 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.248274 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c9b43b0d-2fb7-4412-9ece-7d41c650967a-service-ca\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:45:29.248498 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.248282 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c9b43b0d-2fb7-4412-9ece-7d41c650967a-console-serving-cert\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:45:29.248498 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.248289 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c9b43b0d-2fb7-4412-9ece-7d41c650967a-oauth-serving-cert\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 10:45:29.863792 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.863756 2576 generic.go:356] "Generic (PLEG): container finished" podID="c9b43b0d-2fb7-4412-9ece-7d41c650967a" containerID="a76d6d0a1666ceaec6c5ca1d2b3137bf0420521ec227eae89c608bf2b82fff3e" exitCode=0 Aug 04 10:45:29.864200 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.863805 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ffc6d67c5-62stl" Aug 04 10:45:29.864200 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.863846 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ffc6d67c5-62stl" event={"ID":"c9b43b0d-2fb7-4412-9ece-7d41c650967a","Type":"ContainerDied","Data":"a76d6d0a1666ceaec6c5ca1d2b3137bf0420521ec227eae89c608bf2b82fff3e"} Aug 04 10:45:29.864200 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.863897 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ffc6d67c5-62stl" event={"ID":"c9b43b0d-2fb7-4412-9ece-7d41c650967a","Type":"ContainerDied","Data":"525830a9a43af5448aa45b6bbe86105eb3a2763c9baa14958c4ee0cb9fe18dce"} Aug 04 10:45:29.864200 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.863923 2576 scope.go:117] "RemoveContainer" containerID="a76d6d0a1666ceaec6c5ca1d2b3137bf0420521ec227eae89c608bf2b82fff3e" Aug 04 10:45:29.873677 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.873423 2576 scope.go:117] "RemoveContainer" containerID="a76d6d0a1666ceaec6c5ca1d2b3137bf0420521ec227eae89c608bf2b82fff3e" Aug 04 10:45:29.873778 ip-10-0-142-102 kubenswrapper[2576]: E0804 10:45:29.873747 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a76d6d0a1666ceaec6c5ca1d2b3137bf0420521ec227eae89c608bf2b82fff3e\": container with ID starting with a76d6d0a1666ceaec6c5ca1d2b3137bf0420521ec227eae89c608bf2b82fff3e not found: ID does not exist" containerID="a76d6d0a1666ceaec6c5ca1d2b3137bf0420521ec227eae89c608bf2b82fff3e" Aug 04 10:45:29.873894 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.873789 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a76d6d0a1666ceaec6c5ca1d2b3137bf0420521ec227eae89c608bf2b82fff3e"} err="failed to get container status \"a76d6d0a1666ceaec6c5ca1d2b3137bf0420521ec227eae89c608bf2b82fff3e\": rpc error: code = NotFound desc = could not find container \"a76d6d0a1666ceaec6c5ca1d2b3137bf0420521ec227eae89c608bf2b82fff3e\": container with ID starting with a76d6d0a1666ceaec6c5ca1d2b3137bf0420521ec227eae89c608bf2b82fff3e not found: ID does not exist" Aug 04 10:45:29.902338 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.902318 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ffc6d67c5-62stl"] Aug 04 10:45:29.909087 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.909062 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6ffc6d67c5-62stl"] Aug 04 10:45:29.928484 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:29.928461 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9b43b0d-2fb7-4412-9ece-7d41c650967a" path="/var/lib/kubelet/pods/c9b43b0d-2fb7-4412-9ece-7d41c650967a/volumes" Aug 04 10:45:31.975680 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:31.975648 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pqrdv"] Aug 04 10:45:31.976041 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:31.975921 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9b43b0d-2fb7-4412-9ece-7d41c650967a" containerName="console" Aug 04 10:45:31.976041 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:31.975931 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9b43b0d-2fb7-4412-9ece-7d41c650967a" containerName="console" Aug 04 10:45:31.976041 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:31.975993 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9b43b0d-2fb7-4412-9ece-7d41c650967a" containerName="console" Aug 04 10:45:31.980554 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:31.980536 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pqrdv" Aug 04 10:45:31.985093 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:31.985072 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-hj4v2\"" Aug 04 10:45:31.988600 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:31.988578 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pqrdv"] Aug 04 10:45:32.069194 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:32.069161 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq8nn\" (UniqueName: \"kubernetes.io/projected/f18e8063-78ce-4dff-938d-cf774ebb2a3d-kube-api-access-rq8nn\") pod \"cert-manager-55b4d954d5-pqrdv\" (UID: \"f18e8063-78ce-4dff-938d-cf774ebb2a3d\") " pod="cert-manager/cert-manager-55b4d954d5-pqrdv" Aug 04 10:45:32.069361 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:32.069204 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f18e8063-78ce-4dff-938d-cf774ebb2a3d-bound-sa-token\") pod \"cert-manager-55b4d954d5-pqrdv\" (UID: \"f18e8063-78ce-4dff-938d-cf774ebb2a3d\") " pod="cert-manager/cert-manager-55b4d954d5-pqrdv" Aug 04 10:45:32.169823 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:32.169793 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f18e8063-78ce-4dff-938d-cf774ebb2a3d-bound-sa-token\") pod \"cert-manager-55b4d954d5-pqrdv\" (UID: \"f18e8063-78ce-4dff-938d-cf774ebb2a3d\") " pod="cert-manager/cert-manager-55b4d954d5-pqrdv" Aug 04 10:45:32.170038 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:32.169882 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq8nn\" (UniqueName: \"kubernetes.io/projected/f18e8063-78ce-4dff-938d-cf774ebb2a3d-kube-api-access-rq8nn\") pod \"cert-manager-55b4d954d5-pqrdv\" (UID: \"f18e8063-78ce-4dff-938d-cf774ebb2a3d\") " pod="cert-manager/cert-manager-55b4d954d5-pqrdv" Aug 04 10:45:32.178448 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:32.178423 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f18e8063-78ce-4dff-938d-cf774ebb2a3d-bound-sa-token\") pod \"cert-manager-55b4d954d5-pqrdv\" (UID: \"f18e8063-78ce-4dff-938d-cf774ebb2a3d\") " pod="cert-manager/cert-manager-55b4d954d5-pqrdv" Aug 04 10:45:32.178560 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:32.178505 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq8nn\" (UniqueName: \"kubernetes.io/projected/f18e8063-78ce-4dff-938d-cf774ebb2a3d-kube-api-access-rq8nn\") pod \"cert-manager-55b4d954d5-pqrdv\" (UID: \"f18e8063-78ce-4dff-938d-cf774ebb2a3d\") " pod="cert-manager/cert-manager-55b4d954d5-pqrdv" Aug 04 10:45:32.289966 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:32.289922 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pqrdv" Aug 04 10:45:32.421721 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:32.421693 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pqrdv"] Aug 04 10:45:32.424859 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:45:32.424828 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf18e8063_78ce_4dff_938d_cf774ebb2a3d.slice/crio-21996640cdaa7e2404a3d2b65cb650732a4fa6887ce579306edada0e8faf9ed4 WatchSource:0}: Error finding container 21996640cdaa7e2404a3d2b65cb650732a4fa6887ce579306edada0e8faf9ed4: Status 404 returned error can't find the container with id 21996640cdaa7e2404a3d2b65cb650732a4fa6887ce579306edada0e8faf9ed4 Aug 04 10:45:32.879307 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:32.879266 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pqrdv" event={"ID":"f18e8063-78ce-4dff-938d-cf774ebb2a3d","Type":"ContainerStarted","Data":"d235a755808ad740c09a4a6d0902445b4b770b5b3bee5122228934b61019ff08"} Aug 04 10:45:32.879534 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:32.879320 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pqrdv" event={"ID":"f18e8063-78ce-4dff-938d-cf774ebb2a3d","Type":"ContainerStarted","Data":"21996640cdaa7e2404a3d2b65cb650732a4fa6887ce579306edada0e8faf9ed4"} Aug 04 10:45:32.896408 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:32.896352 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-pqrdv" podStartSLOduration=1.896336846 podStartE2EDuration="1.896336846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:45:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:45:32.895163276 +0000 UTC m=+483.494067769" watchObservedRunningTime="2026-08-04 10:45:32.896336846 +0000 UTC m=+483.495241219" Aug 04 10:45:46.915065 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:46.915005 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw"] Aug 04 10:45:46.921193 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:46.921172 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw" Aug 04 10:45:46.925466 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:46.925444 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Aug 04 10:45:46.925961 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:46.925942 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Aug 04 10:45:46.926131 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:46.926111 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Aug 04 10:45:46.927202 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:46.927167 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hzkt2\"" Aug 04 10:45:46.940707 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:46.940690 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Aug 04 10:45:46.953662 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:46.953634 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw"] Aug 04 10:45:46.987062 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:46.987039 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/75f24ebf-ad17-4318-9ed0-dc08955bffd7-manifests\") pod \"opendatahub-operator-controller-manager-79895c7c95-sq8sw\" (UID: \"75f24ebf-ad17-4318-9ed0-dc08955bffd7\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw" Aug 04 10:45:46.987146 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:46.987073 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/75f24ebf-ad17-4318-9ed0-dc08955bffd7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79895c7c95-sq8sw\" (UID: \"75f24ebf-ad17-4318-9ed0-dc08955bffd7\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw" Aug 04 10:45:46.987265 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:46.987249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xknr\" (UniqueName: \"kubernetes.io/projected/75f24ebf-ad17-4318-9ed0-dc08955bffd7-kube-api-access-5xknr\") pod \"opendatahub-operator-controller-manager-79895c7c95-sq8sw\" (UID: \"75f24ebf-ad17-4318-9ed0-dc08955bffd7\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw" Aug 04 10:45:46.987320 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:46.987305 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75f24ebf-ad17-4318-9ed0-dc08955bffd7-tmp\") pod \"opendatahub-operator-controller-manager-79895c7c95-sq8sw\" (UID: \"75f24ebf-ad17-4318-9ed0-dc08955bffd7\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw" Aug 04 10:45:46.987355 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:46.987346 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75f24ebf-ad17-4318-9ed0-dc08955bffd7-webhook-cert\") pod \"opendatahub-operator-controller-manager-79895c7c95-sq8sw\" (UID: \"75f24ebf-ad17-4318-9ed0-dc08955bffd7\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw" Aug 04 10:45:47.088623 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:47.088597 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/75f24ebf-ad17-4318-9ed0-dc08955bffd7-manifests\") pod \"opendatahub-operator-controller-manager-79895c7c95-sq8sw\" (UID: \"75f24ebf-ad17-4318-9ed0-dc08955bffd7\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw" Aug 04 10:45:47.088744 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:47.088637 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/75f24ebf-ad17-4318-9ed0-dc08955bffd7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79895c7c95-sq8sw\" (UID: \"75f24ebf-ad17-4318-9ed0-dc08955bffd7\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw" Aug 04 10:45:47.088744 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:47.088661 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xknr\" (UniqueName: \"kubernetes.io/projected/75f24ebf-ad17-4318-9ed0-dc08955bffd7-kube-api-access-5xknr\") pod \"opendatahub-operator-controller-manager-79895c7c95-sq8sw\" (UID: \"75f24ebf-ad17-4318-9ed0-dc08955bffd7\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw" Aug 04 10:45:47.088744 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:47.088700 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75f24ebf-ad17-4318-9ed0-dc08955bffd7-tmp\") pod \"opendatahub-operator-controller-manager-79895c7c95-sq8sw\" (UID: \"75f24ebf-ad17-4318-9ed0-dc08955bffd7\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw" Aug 04 10:45:47.088744 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:47.088729 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75f24ebf-ad17-4318-9ed0-dc08955bffd7-webhook-cert\") pod \"opendatahub-operator-controller-manager-79895c7c95-sq8sw\" (UID: \"75f24ebf-ad17-4318-9ed0-dc08955bffd7\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw" Aug 04 10:45:47.089035 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:47.089017 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/75f24ebf-ad17-4318-9ed0-dc08955bffd7-manifests\") pod \"opendatahub-operator-controller-manager-79895c7c95-sq8sw\" (UID: \"75f24ebf-ad17-4318-9ed0-dc08955bffd7\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw" Aug 04 10:45:47.090923 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:47.090897 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75f24ebf-ad17-4318-9ed0-dc08955bffd7-tmp\") pod \"opendatahub-operator-controller-manager-79895c7c95-sq8sw\" (UID: \"75f24ebf-ad17-4318-9ed0-dc08955bffd7\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw" Aug 04 10:45:47.091111 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:47.091095 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75f24ebf-ad17-4318-9ed0-dc08955bffd7-webhook-cert\") pod \"opendatahub-operator-controller-manager-79895c7c95-sq8sw\" (UID: \"75f24ebf-ad17-4318-9ed0-dc08955bffd7\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw" Aug 04 10:45:47.091173 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:47.091121 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/75f24ebf-ad17-4318-9ed0-dc08955bffd7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79895c7c95-sq8sw\" (UID: \"75f24ebf-ad17-4318-9ed0-dc08955bffd7\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw" Aug 04 10:45:47.097437 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:47.097380 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xknr\" (UniqueName: \"kubernetes.io/projected/75f24ebf-ad17-4318-9ed0-dc08955bffd7-kube-api-access-5xknr\") pod \"opendatahub-operator-controller-manager-79895c7c95-sq8sw\" (UID: \"75f24ebf-ad17-4318-9ed0-dc08955bffd7\") " pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw" Aug 04 10:45:47.231920 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:47.231863 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw" Aug 04 10:45:47.373423 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:47.373348 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw"] Aug 04 10:45:47.375626 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:45:47.375594 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f24ebf_ad17_4318_9ed0_dc08955bffd7.slice/crio-f907bd46e1b13b5a28736a4f35ed9b449ea5b82ca1736f04fb9dfbf52d84c3fa WatchSource:0}: Error finding container f907bd46e1b13b5a28736a4f35ed9b449ea5b82ca1736f04fb9dfbf52d84c3fa: Status 404 returned error can't find the container with id f907bd46e1b13b5a28736a4f35ed9b449ea5b82ca1736f04fb9dfbf52d84c3fa Aug 04 10:45:47.943914 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:47.943875 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw" event={"ID":"75f24ebf-ad17-4318-9ed0-dc08955bffd7","Type":"ContainerStarted","Data":"f907bd46e1b13b5a28736a4f35ed9b449ea5b82ca1736f04fb9dfbf52d84c3fa"} Aug 04 10:45:50.960236 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:50.960203 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw" event={"ID":"75f24ebf-ad17-4318-9ed0-dc08955bffd7","Type":"ContainerStarted","Data":"c3dceed500a65faf9b2d88e266d6797b28d0afa0d00773d4faa7489d874cc0d3"} Aug 04 10:45:51.965274 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:51.965237 2576 generic.go:356] "Generic (PLEG): container finished" podID="75f24ebf-ad17-4318-9ed0-dc08955bffd7" containerID="c3dceed500a65faf9b2d88e266d6797b28d0afa0d00773d4faa7489d874cc0d3" exitCode=0 Aug 04 10:45:51.965711 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:51.965357 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw" event={"ID":"75f24ebf-ad17-4318-9ed0-dc08955bffd7","Type":"ContainerDied","Data":"c3dceed500a65faf9b2d88e266d6797b28d0afa0d00773d4faa7489d874cc0d3"} Aug 04 10:45:52.973056 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:52.973019 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw" event={"ID":"75f24ebf-ad17-4318-9ed0-dc08955bffd7","Type":"ContainerStarted","Data":"5f451dbf4d7e3ecaf4494d9767d7fd39b5a6fc2fe6b30c09953c62f25c515279"} Aug 04 10:45:52.973541 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:52.973113 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw" Aug 04 10:45:52.999736 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:45:52.999680 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw" podStartSLOduration=2.566979789 podStartE2EDuration="6.999664456s" totalImagesPullingTime="3.347701851s" totalInitContainerRuntime="1.084982816s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:45:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:45:52.997721225 +0000 UTC m=+503.596625616" watchObservedRunningTime="2026-08-04 10:45:52.999664456 +0000 UTC m=+503.598568830" Aug 04 10:46:03.979928 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:03.979900 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79895c7c95-sq8sw" Aug 04 10:46:09.200846 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:09.200811 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b459fcc7c-nrtbd"] Aug 04 10:46:09.209046 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:09.209024 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b459fcc7c-nrtbd" Aug 04 10:46:09.213821 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:09.213801 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Aug 04 10:46:09.214765 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:09.214738 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Aug 04 10:46:09.214871 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:09.214775 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Aug 04 10:46:09.214937 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:09.214884 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Aug 04 10:46:09.215015 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:09.214992 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zlsvd\"" Aug 04 10:46:09.215215 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:09.215192 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Aug 04 10:46:09.216916 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:09.216899 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b459fcc7c-nrtbd"] Aug 04 10:46:09.285505 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:09.285470 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a91e16ea-946c-42c6-9a77-02d3d991d0df-cert\") pod \"lws-controller-manager-5b459fcc7c-nrtbd\" (UID: \"a91e16ea-946c-42c6-9a77-02d3d991d0df\") " pod="openshift-lws-operator/lws-controller-manager-5b459fcc7c-nrtbd" Aug 04 10:46:09.285505 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:09.285503 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a91e16ea-946c-42c6-9a77-02d3d991d0df-metrics-cert\") pod \"lws-controller-manager-5b459fcc7c-nrtbd\" (UID: \"a91e16ea-946c-42c6-9a77-02d3d991d0df\") " pod="openshift-lws-operator/lws-controller-manager-5b459fcc7c-nrtbd" Aug 04 10:46:09.285704 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:09.285532 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a91e16ea-946c-42c6-9a77-02d3d991d0df-manager-config\") pod \"lws-controller-manager-5b459fcc7c-nrtbd\" (UID: \"a91e16ea-946c-42c6-9a77-02d3d991d0df\") " pod="openshift-lws-operator/lws-controller-manager-5b459fcc7c-nrtbd" Aug 04 10:46:09.285704 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:09.285580 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtdlb\" (UniqueName: \"kubernetes.io/projected/a91e16ea-946c-42c6-9a77-02d3d991d0df-kube-api-access-xtdlb\") pod \"lws-controller-manager-5b459fcc7c-nrtbd\" (UID: \"a91e16ea-946c-42c6-9a77-02d3d991d0df\") " pod="openshift-lws-operator/lws-controller-manager-5b459fcc7c-nrtbd" Aug 04 10:46:09.386769 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:09.386731 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a91e16ea-946c-42c6-9a77-02d3d991d0df-cert\") pod \"lws-controller-manager-5b459fcc7c-nrtbd\" (UID: \"a91e16ea-946c-42c6-9a77-02d3d991d0df\") " pod="openshift-lws-operator/lws-controller-manager-5b459fcc7c-nrtbd" Aug 04 10:46:09.386924 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:09.386781 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a91e16ea-946c-42c6-9a77-02d3d991d0df-metrics-cert\") pod \"lws-controller-manager-5b459fcc7c-nrtbd\" (UID: \"a91e16ea-946c-42c6-9a77-02d3d991d0df\") " pod="openshift-lws-operator/lws-controller-manager-5b459fcc7c-nrtbd" Aug 04 10:46:09.386924 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:09.386807 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a91e16ea-946c-42c6-9a77-02d3d991d0df-manager-config\") pod \"lws-controller-manager-5b459fcc7c-nrtbd\" (UID: \"a91e16ea-946c-42c6-9a77-02d3d991d0df\") " pod="openshift-lws-operator/lws-controller-manager-5b459fcc7c-nrtbd" Aug 04 10:46:09.386924 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:09.386849 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtdlb\" (UniqueName: \"kubernetes.io/projected/a91e16ea-946c-42c6-9a77-02d3d991d0df-kube-api-access-xtdlb\") pod \"lws-controller-manager-5b459fcc7c-nrtbd\" (UID: \"a91e16ea-946c-42c6-9a77-02d3d991d0df\") " pod="openshift-lws-operator/lws-controller-manager-5b459fcc7c-nrtbd" Aug 04 10:46:09.387524 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:09.387498 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a91e16ea-946c-42c6-9a77-02d3d991d0df-manager-config\") pod \"lws-controller-manager-5b459fcc7c-nrtbd\" (UID: \"a91e16ea-946c-42c6-9a77-02d3d991d0df\") " pod="openshift-lws-operator/lws-controller-manager-5b459fcc7c-nrtbd" Aug 04 10:46:09.389289 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:09.389267 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a91e16ea-946c-42c6-9a77-02d3d991d0df-cert\") pod \"lws-controller-manager-5b459fcc7c-nrtbd\" (UID: \"a91e16ea-946c-42c6-9a77-02d3d991d0df\") " pod="openshift-lws-operator/lws-controller-manager-5b459fcc7c-nrtbd" Aug 04 10:46:09.389416 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:09.389350 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a91e16ea-946c-42c6-9a77-02d3d991d0df-metrics-cert\") pod \"lws-controller-manager-5b459fcc7c-nrtbd\" (UID: \"a91e16ea-946c-42c6-9a77-02d3d991d0df\") " pod="openshift-lws-operator/lws-controller-manager-5b459fcc7c-nrtbd" Aug 04 10:46:09.416923 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:09.416898 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtdlb\" (UniqueName: \"kubernetes.io/projected/a91e16ea-946c-42c6-9a77-02d3d991d0df-kube-api-access-xtdlb\") pod \"lws-controller-manager-5b459fcc7c-nrtbd\" (UID: \"a91e16ea-946c-42c6-9a77-02d3d991d0df\") " pod="openshift-lws-operator/lws-controller-manager-5b459fcc7c-nrtbd" Aug 04 10:46:09.519609 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:09.519580 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b459fcc7c-nrtbd" Aug 04 10:46:09.671152 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:09.671129 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b459fcc7c-nrtbd"] Aug 04 10:46:09.673375 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:46:09.673346 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda91e16ea_946c_42c6_9a77_02d3d991d0df.slice/crio-a26c8c3b3ada36704ec7eb3905df145ce98ab43a2b0ecfd015a8893d88fa1b10 WatchSource:0}: Error finding container a26c8c3b3ada36704ec7eb3905df145ce98ab43a2b0ecfd015a8893d88fa1b10: Status 404 returned error can't find the container with id a26c8c3b3ada36704ec7eb3905df145ce98ab43a2b0ecfd015a8893d88fa1b10 Aug 04 10:46:10.046959 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:10.046919 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b459fcc7c-nrtbd" event={"ID":"a91e16ea-946c-42c6-9a77-02d3d991d0df","Type":"ContainerStarted","Data":"a26c8c3b3ada36704ec7eb3905df145ce98ab43a2b0ecfd015a8893d88fa1b10"} Aug 04 10:46:14.069466 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:14.069417 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b459fcc7c-nrtbd" event={"ID":"a91e16ea-946c-42c6-9a77-02d3d991d0df","Type":"ContainerStarted","Data":"737bb7b2a3493939b5a5a7a0263e54ec2ce0d945c500673df38bb8873a191852"} Aug 04 10:46:14.069871 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:14.069591 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5b459fcc7c-nrtbd" Aug 04 10:46:14.088339 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:14.088272 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5b459fcc7c-nrtbd" podStartSLOduration=1.370767609 podStartE2EDuration="5.088253116s" totalImagesPullingTime="3.717485507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:46:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:46:14.087964787 +0000 UTC m=+524.686869214" watchObservedRunningTime="2026-08-04 10:46:14.088253116 +0000 UTC m=+524.687157493" Aug 04 10:46:16.191352 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.191321 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh"] Aug 04 10:46:16.194725 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.194700 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" Aug 04 10:46:16.197867 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.197843 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Aug 04 10:46:16.197995 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.197903 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Aug 04 10:46:16.197995 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.197903 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Aug 04 10:46:16.197995 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.197949 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Aug 04 10:46:16.198164 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.198147 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Aug 04 10:46:16.198223 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.198153 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Aug 04 10:46:16.198297 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.198282 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-nlh6b\"" Aug 04 10:46:16.213891 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.213865 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh"] Aug 04 10:46:16.247012 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.246976 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tjpr\" (UniqueName: \"kubernetes.io/projected/79c723e2-11a1-4a2d-8573-45148b1d72bd-kube-api-access-8tjpr\") pod \"istiod-openshift-gateway-5677ccb49b-rsljh\" (UID: \"79c723e2-11a1-4a2d-8573-45148b1d72bd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" Aug 04 10:46:16.247182 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.247028 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79c723e2-11a1-4a2d-8573-45148b1d72bd-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-rsljh\" (UID: \"79c723e2-11a1-4a2d-8573-45148b1d72bd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" Aug 04 10:46:16.247182 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.247095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79c723e2-11a1-4a2d-8573-45148b1d72bd-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-rsljh\" (UID: \"79c723e2-11a1-4a2d-8573-45148b1d72bd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" Aug 04 10:46:16.247182 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.247140 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/79c723e2-11a1-4a2d-8573-45148b1d72bd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-rsljh\" (UID: \"79c723e2-11a1-4a2d-8573-45148b1d72bd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" Aug 04 10:46:16.247318 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.247206 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/79c723e2-11a1-4a2d-8573-45148b1d72bd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-rsljh\" (UID: \"79c723e2-11a1-4a2d-8573-45148b1d72bd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" Aug 04 10:46:16.247318 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.247243 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/79c723e2-11a1-4a2d-8573-45148b1d72bd-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-rsljh\" (UID: \"79c723e2-11a1-4a2d-8573-45148b1d72bd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" Aug 04 10:46:16.247318 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.247270 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/79c723e2-11a1-4a2d-8573-45148b1d72bd-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-rsljh\" (UID: \"79c723e2-11a1-4a2d-8573-45148b1d72bd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" Aug 04 10:46:16.348703 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.348677 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/79c723e2-11a1-4a2d-8573-45148b1d72bd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-rsljh\" (UID: \"79c723e2-11a1-4a2d-8573-45148b1d72bd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" Aug 04 10:46:16.348703 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.348710 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/79c723e2-11a1-4a2d-8573-45148b1d72bd-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-rsljh\" (UID: \"79c723e2-11a1-4a2d-8573-45148b1d72bd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" Aug 04 10:46:16.348939 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.348730 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/79c723e2-11a1-4a2d-8573-45148b1d72bd-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-rsljh\" (UID: \"79c723e2-11a1-4a2d-8573-45148b1d72bd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" Aug 04 10:46:16.348939 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.348773 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tjpr\" (UniqueName: \"kubernetes.io/projected/79c723e2-11a1-4a2d-8573-45148b1d72bd-kube-api-access-8tjpr\") pod \"istiod-openshift-gateway-5677ccb49b-rsljh\" (UID: \"79c723e2-11a1-4a2d-8573-45148b1d72bd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" Aug 04 10:46:16.348939 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.348806 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79c723e2-11a1-4a2d-8573-45148b1d72bd-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-rsljh\" (UID: \"79c723e2-11a1-4a2d-8573-45148b1d72bd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" Aug 04 10:46:16.348939 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.348825 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79c723e2-11a1-4a2d-8573-45148b1d72bd-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-rsljh\" (UID: \"79c723e2-11a1-4a2d-8573-45148b1d72bd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" Aug 04 10:46:16.348939 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.348839 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/79c723e2-11a1-4a2d-8573-45148b1d72bd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-rsljh\" (UID: \"79c723e2-11a1-4a2d-8573-45148b1d72bd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" Aug 04 10:46:16.350119 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.350086 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/79c723e2-11a1-4a2d-8573-45148b1d72bd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-rsljh\" (UID: \"79c723e2-11a1-4a2d-8573-45148b1d72bd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" Aug 04 10:46:16.351307 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.351286 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/79c723e2-11a1-4a2d-8573-45148b1d72bd-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-rsljh\" (UID: \"79c723e2-11a1-4a2d-8573-45148b1d72bd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" Aug 04 10:46:16.351475 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.351457 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79c723e2-11a1-4a2d-8573-45148b1d72bd-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-rsljh\" (UID: \"79c723e2-11a1-4a2d-8573-45148b1d72bd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" Aug 04 10:46:16.351559 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.351540 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/79c723e2-11a1-4a2d-8573-45148b1d72bd-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-rsljh\" (UID: \"79c723e2-11a1-4a2d-8573-45148b1d72bd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" Aug 04 10:46:16.351599 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.351583 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/79c723e2-11a1-4a2d-8573-45148b1d72bd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-rsljh\" (UID: \"79c723e2-11a1-4a2d-8573-45148b1d72bd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" Aug 04 10:46:16.364827 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.364799 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tjpr\" (UniqueName: \"kubernetes.io/projected/79c723e2-11a1-4a2d-8573-45148b1d72bd-kube-api-access-8tjpr\") pod \"istiod-openshift-gateway-5677ccb49b-rsljh\" (UID: \"79c723e2-11a1-4a2d-8573-45148b1d72bd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" Aug 04 10:46:16.366670 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.366650 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79c723e2-11a1-4a2d-8573-45148b1d72bd-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-rsljh\" (UID: \"79c723e2-11a1-4a2d-8573-45148b1d72bd\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" Aug 04 10:46:16.503986 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.503950 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" Aug 04 10:46:16.669484 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:46:16.669453 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79c723e2_11a1_4a2d_8573_45148b1d72bd.slice/crio-71d79c94f96ab1c63639139718f20132f76476f1dbcb4a7ebe830a5bf2792349 WatchSource:0}: Error finding container 71d79c94f96ab1c63639139718f20132f76476f1dbcb4a7ebe830a5bf2792349: Status 404 returned error can't find the container with id 71d79c94f96ab1c63639139718f20132f76476f1dbcb4a7ebe830a5bf2792349 Aug 04 10:46:16.675381 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:16.675290 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh"] Aug 04 10:46:17.082533 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:17.082500 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" event={"ID":"79c723e2-11a1-4a2d-8573-45148b1d72bd","Type":"ContainerStarted","Data":"71d79c94f96ab1c63639139718f20132f76476f1dbcb4a7ebe830a5bf2792349"} Aug 04 10:46:19.198201 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:19.198162 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Aug 04 10:46:19.198512 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:19.198230 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Aug 04 10:46:20.098772 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:20.098736 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" event={"ID":"79c723e2-11a1-4a2d-8573-45148b1d72bd","Type":"ContainerStarted","Data":"e7b8da081922530aac483d4f7f1ac360f71524734ca57516f14855c7836d60d7"} Aug 04 10:46:20.098973 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:20.098950 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" Aug 04 10:46:20.100866 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:20.100842 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" Aug 04 10:46:20.128885 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:20.128840 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsljh" podStartSLOduration=1.60308407 podStartE2EDuration="4.1288276s" totalImagesPullingTime="2.52574353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:46:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:46:20.128672753 +0000 UTC m=+530.727577149" watchObservedRunningTime="2026-08-04 10:46:20.1288276 +0000 UTC m=+530.727731973" Aug 04 10:46:25.075236 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:46:25.075203 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5b459fcc7c-nrtbd" Aug 04 10:47:29.819529 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:47:29.819494 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 10:47:29.820728 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:47:29.820698 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 10:47:48.529941 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:47:48.529904 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g5vf8"] Aug 04 10:47:48.533128 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:47:48.533111 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g5vf8" Aug 04 10:47:48.537200 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:47:48.537172 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Aug 04 10:47:48.537200 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:47:48.537196 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Aug 04 10:47:48.537370 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:47:48.537210 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8gnsq\"" Aug 04 10:47:48.547831 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:47:48.547809 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g5vf8"] Aug 04 10:47:48.616900 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:47:48.616872 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a18f3f6d-5319-4215-a8d2-0cc97934c55a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-g5vf8\" (UID: \"a18f3f6d-5319-4215-a8d2-0cc97934c55a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g5vf8" Aug 04 10:47:48.617034 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:47:48.616919 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdgfw\" (UniqueName: \"kubernetes.io/projected/a18f3f6d-5319-4215-a8d2-0cc97934c55a-kube-api-access-kdgfw\") pod \"kuadrant-operator-controller-manager-68cf589589-g5vf8\" (UID: \"a18f3f6d-5319-4215-a8d2-0cc97934c55a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g5vf8" Aug 04 10:47:48.717842 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:47:48.717812 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a18f3f6d-5319-4215-a8d2-0cc97934c55a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-g5vf8\" (UID: \"a18f3f6d-5319-4215-a8d2-0cc97934c55a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g5vf8" Aug 04 10:47:48.717964 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:47:48.717878 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdgfw\" (UniqueName: \"kubernetes.io/projected/a18f3f6d-5319-4215-a8d2-0cc97934c55a-kube-api-access-kdgfw\") pod \"kuadrant-operator-controller-manager-68cf589589-g5vf8\" (UID: \"a18f3f6d-5319-4215-a8d2-0cc97934c55a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g5vf8" Aug 04 10:47:48.718175 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:47:48.718155 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a18f3f6d-5319-4215-a8d2-0cc97934c55a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-g5vf8\" (UID: \"a18f3f6d-5319-4215-a8d2-0cc97934c55a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g5vf8" Aug 04 10:47:48.729534 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:47:48.729512 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdgfw\" (UniqueName: \"kubernetes.io/projected/a18f3f6d-5319-4215-a8d2-0cc97934c55a-kube-api-access-kdgfw\") pod \"kuadrant-operator-controller-manager-68cf589589-g5vf8\" (UID: \"a18f3f6d-5319-4215-a8d2-0cc97934c55a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g5vf8" Aug 04 10:47:48.842641 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:47:48.842575 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g5vf8" Aug 04 10:47:48.981159 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:47:48.981134 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g5vf8"] Aug 04 10:47:48.983933 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:47:48.983909 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda18f3f6d_5319_4215_a8d2_0cc97934c55a.slice/crio-aead7c760585b629ab7526c985f4b1dc2c7ac985ecb51c4cf1ab24718c5e7859 WatchSource:0}: Error finding container aead7c760585b629ab7526c985f4b1dc2c7ac985ecb51c4cf1ab24718c5e7859: Status 404 returned error can't find the container with id aead7c760585b629ab7526c985f4b1dc2c7ac985ecb51c4cf1ab24718c5e7859 Aug 04 10:47:49.506368 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:47:49.506334 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g5vf8" event={"ID":"a18f3f6d-5319-4215-a8d2-0cc97934c55a","Type":"ContainerStarted","Data":"aead7c760585b629ab7526c985f4b1dc2c7ac985ecb51c4cf1ab24718c5e7859"} Aug 04 10:47:53.529603 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:47:53.529531 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g5vf8" event={"ID":"a18f3f6d-5319-4215-a8d2-0cc97934c55a","Type":"ContainerStarted","Data":"7907f527b22486f347f17bc4021a32719e49144075af27dc8343893727b58183"} Aug 04 10:47:53.530090 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:47:53.529632 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g5vf8" Aug 04 10:47:53.574513 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:47:53.574460 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g5vf8" podStartSLOduration=1.493875402 podStartE2EDuration="5.574441367s" totalImagesPullingTime="4.080565965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:47:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:47:53.568966997 +0000 UTC m=+624.167871375" watchObservedRunningTime="2026-08-04 10:47:53.574441367 +0000 UTC m=+624.173345740" Aug 04 10:48:04.536910 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:48:04.536873 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g5vf8" Aug 04 10:49:36.050610 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:36.050530 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-6xzmd"] Aug 04 10:49:36.052786 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:36.052769 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6xzmd" Aug 04 10:49:36.055658 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:36.055635 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Aug 04 10:49:36.066522 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:36.066497 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-6xzmd"] Aug 04 10:49:36.095726 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:36.095694 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-24r8m"] Aug 04 10:49:36.098057 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:36.098040 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-24r8m" Aug 04 10:49:36.109313 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:36.109291 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-85v8m\"" Aug 04 10:49:36.122495 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:36.122460 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-24r8m"] Aug 04 10:49:36.150517 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:36.150487 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzsxq\" (UniqueName: \"kubernetes.io/projected/781bc05a-2fce-4e6a-a176-bb21ddb116e8-kube-api-access-wzsxq\") pod \"payload-pre-processing-687dbb6cf6-6xzmd\" (UID: \"781bc05a-2fce-4e6a-a176-bb21ddb116e8\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6xzmd" Aug 04 10:49:36.150662 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:36.150524 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/781bc05a-2fce-4e6a-a176-bb21ddb116e8-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-6xzmd\" (UID: \"781bc05a-2fce-4e6a-a176-bb21ddb116e8\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6xzmd" Aug 04 10:49:36.150662 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:36.150561 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqvsn\" (UniqueName: \"kubernetes.io/projected/03a5a1b7-420e-4272-a532-c4e2ec4c91a7-kube-api-access-lqvsn\") pod \"payload-processing-5cc6cd444b-24r8m\" (UID: \"03a5a1b7-420e-4272-a532-c4e2ec4c91a7\") " pod="openshift-ingress/payload-processing-5cc6cd444b-24r8m" Aug 04 10:49:36.150662 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:36.150595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03a5a1b7-420e-4272-a532-c4e2ec4c91a7-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-24r8m\" (UID: \"03a5a1b7-420e-4272-a532-c4e2ec4c91a7\") " pod="openshift-ingress/payload-processing-5cc6cd444b-24r8m" Aug 04 10:49:36.251471 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:36.251430 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqvsn\" (UniqueName: \"kubernetes.io/projected/03a5a1b7-420e-4272-a532-c4e2ec4c91a7-kube-api-access-lqvsn\") pod \"payload-processing-5cc6cd444b-24r8m\" (UID: \"03a5a1b7-420e-4272-a532-c4e2ec4c91a7\") " pod="openshift-ingress/payload-processing-5cc6cd444b-24r8m" Aug 04 10:49:36.251670 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:36.251489 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03a5a1b7-420e-4272-a532-c4e2ec4c91a7-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-24r8m\" (UID: \"03a5a1b7-420e-4272-a532-c4e2ec4c91a7\") " pod="openshift-ingress/payload-processing-5cc6cd444b-24r8m" Aug 04 10:49:36.251670 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:36.251603 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzsxq\" (UniqueName: \"kubernetes.io/projected/781bc05a-2fce-4e6a-a176-bb21ddb116e8-kube-api-access-wzsxq\") pod \"payload-pre-processing-687dbb6cf6-6xzmd\" (UID: \"781bc05a-2fce-4e6a-a176-bb21ddb116e8\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6xzmd" Aug 04 10:49:36.251670 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:36.251639 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/781bc05a-2fce-4e6a-a176-bb21ddb116e8-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-6xzmd\" (UID: \"781bc05a-2fce-4e6a-a176-bb21ddb116e8\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6xzmd" Aug 04 10:49:36.252289 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:36.252262 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03a5a1b7-420e-4272-a532-c4e2ec4c91a7-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-24r8m\" (UID: \"03a5a1b7-420e-4272-a532-c4e2ec4c91a7\") " pod="openshift-ingress/payload-processing-5cc6cd444b-24r8m" Aug 04 10:49:36.252488 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:36.252466 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/781bc05a-2fce-4e6a-a176-bb21ddb116e8-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-6xzmd\" (UID: \"781bc05a-2fce-4e6a-a176-bb21ddb116e8\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6xzmd" Aug 04 10:49:36.268790 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:36.268763 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqvsn\" (UniqueName: \"kubernetes.io/projected/03a5a1b7-420e-4272-a532-c4e2ec4c91a7-kube-api-access-lqvsn\") pod \"payload-processing-5cc6cd444b-24r8m\" (UID: \"03a5a1b7-420e-4272-a532-c4e2ec4c91a7\") " pod="openshift-ingress/payload-processing-5cc6cd444b-24r8m" Aug 04 10:49:36.282159 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:36.282132 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzsxq\" (UniqueName: \"kubernetes.io/projected/781bc05a-2fce-4e6a-a176-bb21ddb116e8-kube-api-access-wzsxq\") pod \"payload-pre-processing-687dbb6cf6-6xzmd\" (UID: \"781bc05a-2fce-4e6a-a176-bb21ddb116e8\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6xzmd" Aug 04 10:49:36.363130 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:36.363049 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6xzmd" Aug 04 10:49:36.408447 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:36.408381 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-24r8m" Aug 04 10:49:36.509252 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:36.509175 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-6xzmd"] Aug 04 10:49:36.511694 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:49:36.511665 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod781bc05a_2fce_4e6a_a176_bb21ddb116e8.slice/crio-8521bd4738f388728245c6070e052cd2519ba1c37ada762471792d09301326e6 WatchSource:0}: Error finding container 8521bd4738f388728245c6070e052cd2519ba1c37ada762471792d09301326e6: Status 404 returned error can't find the container with id 8521bd4738f388728245c6070e052cd2519ba1c37ada762471792d09301326e6 Aug 04 10:49:36.560202 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:36.560169 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-24r8m"] Aug 04 10:49:36.563355 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:49:36.563330 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a5a1b7_420e_4272_a532_c4e2ec4c91a7.slice/crio-10fe4d60658440874ba78561abf00c4f6cc1d403749fb706315c3e8ed8fc8b64 WatchSource:0}: Error finding container 10fe4d60658440874ba78561abf00c4f6cc1d403749fb706315c3e8ed8fc8b64: Status 404 returned error can't find the container with id 10fe4d60658440874ba78561abf00c4f6cc1d403749fb706315c3e8ed8fc8b64 Aug 04 10:49:36.990732 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:36.990694 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-24r8m" event={"ID":"03a5a1b7-420e-4272-a532-c4e2ec4c91a7","Type":"ContainerStarted","Data":"10fe4d60658440874ba78561abf00c4f6cc1d403749fb706315c3e8ed8fc8b64"} Aug 04 10:49:36.991810 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:36.991784 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6xzmd" event={"ID":"781bc05a-2fce-4e6a-a176-bb21ddb116e8","Type":"ContainerStarted","Data":"8521bd4738f388728245c6070e052cd2519ba1c37ada762471792d09301326e6"} Aug 04 10:49:39.003876 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:39.003839 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-24r8m" event={"ID":"03a5a1b7-420e-4272-a532-c4e2ec4c91a7","Type":"ContainerStarted","Data":"a6aaf6d8d07acf068bf459a9cad0f9cd476d1498b371a84b0364af613938dd0d"} Aug 04 10:49:39.004317 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:39.003941 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-24r8m" Aug 04 10:49:39.005360 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:39.005337 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6xzmd" event={"ID":"781bc05a-2fce-4e6a-a176-bb21ddb116e8","Type":"ContainerStarted","Data":"7e0626b863a1fa3e7c8fb93af36c4253a78821000722ababdac329e76bd58140"} Aug 04 10:49:39.005476 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:39.005382 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6xzmd" Aug 04 10:49:39.021201 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:39.021153 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-24r8m" podStartSLOduration=1.362042292 podStartE2EDuration="3.021139465s" totalImagesPullingTime="1.659097173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:49:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:49:39.020158547 +0000 UTC m=+729.619062944" watchObservedRunningTime="2026-08-04 10:49:39.021139465 +0000 UTC m=+729.620043888" Aug 04 10:49:39.037247 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:39.037199 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6xzmd" podStartSLOduration=1.31808726 podStartE2EDuration="3.037186093s" totalImagesPullingTime="1.719098833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:49:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:49:39.035559986 +0000 UTC m=+729.634464377" watchObservedRunningTime="2026-08-04 10:49:39.037186093 +0000 UTC m=+729.636090467" Aug 04 10:49:50.011383 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:50.011350 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-24r8m" Aug 04 10:49:50.011954 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:49:50.011551 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-6xzmd" Aug 04 10:50:07.475339 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.475307 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z"] Aug 04 10:50:07.479491 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.479470 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" Aug 04 10:50:07.482655 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.482634 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Aug 04 10:50:07.483713 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.483696 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Aug 04 10:50:07.483815 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.483734 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Aug 04 10:50:07.483815 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.483700 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-w2zlt\"" Aug 04 10:50:07.493865 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.493805 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z"] Aug 04 10:50:07.627908 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.627883 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edf50396-af17-4b35-9c57-4ee006e7e8b2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-phz6z\" (UID: \"edf50396-af17-4b35-9c57-4ee006e7e8b2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" Aug 04 10:50:07.628051 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.627918 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edf50396-af17-4b35-9c57-4ee006e7e8b2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-phz6z\" (UID: \"edf50396-af17-4b35-9c57-4ee006e7e8b2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" Aug 04 10:50:07.628051 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.627948 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edf50396-af17-4b35-9c57-4ee006e7e8b2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-phz6z\" (UID: \"edf50396-af17-4b35-9c57-4ee006e7e8b2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" Aug 04 10:50:07.628051 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.627999 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edf50396-af17-4b35-9c57-4ee006e7e8b2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-phz6z\" (UID: \"edf50396-af17-4b35-9c57-4ee006e7e8b2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" Aug 04 10:50:07.628051 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.628043 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edf50396-af17-4b35-9c57-4ee006e7e8b2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-phz6z\" (UID: \"edf50396-af17-4b35-9c57-4ee006e7e8b2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" Aug 04 10:50:07.628203 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.628071 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwpst\" (UniqueName: \"kubernetes.io/projected/edf50396-af17-4b35-9c57-4ee006e7e8b2-kube-api-access-jwpst\") pod \"e2e-distinct-simulated-kserve-59975d69f9-phz6z\" (UID: \"edf50396-af17-4b35-9c57-4ee006e7e8b2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" Aug 04 10:50:07.729446 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.729369 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edf50396-af17-4b35-9c57-4ee006e7e8b2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-phz6z\" (UID: \"edf50396-af17-4b35-9c57-4ee006e7e8b2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" Aug 04 10:50:07.729446 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.729436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edf50396-af17-4b35-9c57-4ee006e7e8b2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-phz6z\" (UID: \"edf50396-af17-4b35-9c57-4ee006e7e8b2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" Aug 04 10:50:07.729638 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.729468 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edf50396-af17-4b35-9c57-4ee006e7e8b2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-phz6z\" (UID: \"edf50396-af17-4b35-9c57-4ee006e7e8b2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" Aug 04 10:50:07.729638 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.729490 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwpst\" (UniqueName: \"kubernetes.io/projected/edf50396-af17-4b35-9c57-4ee006e7e8b2-kube-api-access-jwpst\") pod \"e2e-distinct-simulated-kserve-59975d69f9-phz6z\" (UID: \"edf50396-af17-4b35-9c57-4ee006e7e8b2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" Aug 04 10:50:07.729745 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.729631 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edf50396-af17-4b35-9c57-4ee006e7e8b2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-phz6z\" (UID: \"edf50396-af17-4b35-9c57-4ee006e7e8b2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" Aug 04 10:50:07.729745 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.729672 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edf50396-af17-4b35-9c57-4ee006e7e8b2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-phz6z\" (UID: \"edf50396-af17-4b35-9c57-4ee006e7e8b2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" Aug 04 10:50:07.729853 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.729827 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edf50396-af17-4b35-9c57-4ee006e7e8b2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-phz6z\" (UID: \"edf50396-af17-4b35-9c57-4ee006e7e8b2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" Aug 04 10:50:07.729975 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.729946 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edf50396-af17-4b35-9c57-4ee006e7e8b2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-phz6z\" (UID: \"edf50396-af17-4b35-9c57-4ee006e7e8b2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" Aug 04 10:50:07.730100 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.730030 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edf50396-af17-4b35-9c57-4ee006e7e8b2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-phz6z\" (UID: \"edf50396-af17-4b35-9c57-4ee006e7e8b2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" Aug 04 10:50:07.731856 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.731824 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edf50396-af17-4b35-9c57-4ee006e7e8b2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-phz6z\" (UID: \"edf50396-af17-4b35-9c57-4ee006e7e8b2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" Aug 04 10:50:07.732132 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.732114 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edf50396-af17-4b35-9c57-4ee006e7e8b2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-phz6z\" (UID: \"edf50396-af17-4b35-9c57-4ee006e7e8b2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" Aug 04 10:50:07.738590 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.738566 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwpst\" (UniqueName: \"kubernetes.io/projected/edf50396-af17-4b35-9c57-4ee006e7e8b2-kube-api-access-jwpst\") pod \"e2e-distinct-simulated-kserve-59975d69f9-phz6z\" (UID: \"edf50396-af17-4b35-9c57-4ee006e7e8b2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" Aug 04 10:50:07.793229 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.793205 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" Aug 04 10:50:07.926933 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:50:07.926903 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedf50396_af17_4b35_9c57_4ee006e7e8b2.slice/crio-dc377bec04bb5b0f19419f508449eb21691247637cd7290b070f17f53139e030 WatchSource:0}: Error finding container dc377bec04bb5b0f19419f508449eb21691247637cd7290b070f17f53139e030: Status 404 returned error can't find the container with id dc377bec04bb5b0f19419f508449eb21691247637cd7290b070f17f53139e030 Aug 04 10:50:07.954423 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:07.935675 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z"] Aug 04 10:50:08.133040 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:08.133005 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" event={"ID":"edf50396-af17-4b35-9c57-4ee006e7e8b2","Type":"ContainerStarted","Data":"dc377bec04bb5b0f19419f508449eb21691247637cd7290b070f17f53139e030"} Aug 04 10:50:10.145097 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:10.145061 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" event={"ID":"edf50396-af17-4b35-9c57-4ee006e7e8b2","Type":"ContainerStarted","Data":"079bd4df30e873467c70680f9f02d14e5e3e19d964695c4d2e88cba5209d4f1e"} Aug 04 10:50:10.166273 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:10.166226 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" podStartSLOduration=1.940540249 podStartE2EDuration="3.166210549s" totalImagesPullingTime="1.2256703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:50:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:50:10.16436664 +0000 UTC m=+760.763271014" watchObservedRunningTime="2026-08-04 10:50:10.166210549 +0000 UTC m=+760.765114924" Aug 04 10:50:17.793831 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:17.793799 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" Aug 04 10:50:17.794279 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:17.793891 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" Aug 04 10:50:17.806195 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:17.806170 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" Aug 04 10:50:18.189844 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:18.189763 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-phz6z" Aug 04 10:50:41.476143 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:41.476113 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb"] Aug 04 10:50:41.480632 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:41.480608 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" Aug 04 10:50:41.483793 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:41.483771 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Aug 04 10:50:41.489799 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:41.489777 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb"] Aug 04 10:50:41.634211 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:41.634179 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccz2c\" (UniqueName: \"kubernetes.io/projected/5cffc08c-ba5c-4141-bb50-3df093d6896a-kube-api-access-ccz2c\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb\" (UID: \"5cffc08c-ba5c-4141-bb50-3df093d6896a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" Aug 04 10:50:41.634427 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:41.634304 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cffc08c-ba5c-4141-bb50-3df093d6896a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb\" (UID: \"5cffc08c-ba5c-4141-bb50-3df093d6896a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" Aug 04 10:50:41.634427 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:41.634352 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cffc08c-ba5c-4141-bb50-3df093d6896a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb\" (UID: \"5cffc08c-ba5c-4141-bb50-3df093d6896a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" Aug 04 10:50:41.634427 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:41.634377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cffc08c-ba5c-4141-bb50-3df093d6896a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb\" (UID: \"5cffc08c-ba5c-4141-bb50-3df093d6896a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" Aug 04 10:50:41.634427 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:41.634414 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cffc08c-ba5c-4141-bb50-3df093d6896a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb\" (UID: \"5cffc08c-ba5c-4141-bb50-3df093d6896a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" Aug 04 10:50:41.634574 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:41.634464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cffc08c-ba5c-4141-bb50-3df093d6896a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb\" (UID: \"5cffc08c-ba5c-4141-bb50-3df093d6896a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" Aug 04 10:50:41.735723 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:41.735652 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cffc08c-ba5c-4141-bb50-3df093d6896a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb\" (UID: \"5cffc08c-ba5c-4141-bb50-3df093d6896a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" Aug 04 10:50:41.735723 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:41.735701 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cffc08c-ba5c-4141-bb50-3df093d6896a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb\" (UID: \"5cffc08c-ba5c-4141-bb50-3df093d6896a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" Aug 04 10:50:41.735723 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:41.735722 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cffc08c-ba5c-4141-bb50-3df093d6896a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb\" (UID: \"5cffc08c-ba5c-4141-bb50-3df093d6896a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" Aug 04 10:50:41.735940 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:41.735746 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cffc08c-ba5c-4141-bb50-3df093d6896a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb\" (UID: \"5cffc08c-ba5c-4141-bb50-3df093d6896a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" Aug 04 10:50:41.735940 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:41.735782 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cffc08c-ba5c-4141-bb50-3df093d6896a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb\" (UID: \"5cffc08c-ba5c-4141-bb50-3df093d6896a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" Aug 04 10:50:41.735940 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:41.735818 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccz2c\" (UniqueName: \"kubernetes.io/projected/5cffc08c-ba5c-4141-bb50-3df093d6896a-kube-api-access-ccz2c\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb\" (UID: \"5cffc08c-ba5c-4141-bb50-3df093d6896a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" Aug 04 10:50:41.736124 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:41.736099 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cffc08c-ba5c-4141-bb50-3df093d6896a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb\" (UID: \"5cffc08c-ba5c-4141-bb50-3df093d6896a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" Aug 04 10:50:41.736198 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:41.736135 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5cffc08c-ba5c-4141-bb50-3df093d6896a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb\" (UID: \"5cffc08c-ba5c-4141-bb50-3df093d6896a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" Aug 04 10:50:41.736275 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:41.736253 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5cffc08c-ba5c-4141-bb50-3df093d6896a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb\" (UID: \"5cffc08c-ba5c-4141-bb50-3df093d6896a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" Aug 04 10:50:41.738409 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:41.738373 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5cffc08c-ba5c-4141-bb50-3df093d6896a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb\" (UID: \"5cffc08c-ba5c-4141-bb50-3df093d6896a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" Aug 04 10:50:41.738565 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:41.738545 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5cffc08c-ba5c-4141-bb50-3df093d6896a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb\" (UID: \"5cffc08c-ba5c-4141-bb50-3df093d6896a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" Aug 04 10:50:41.745052 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:41.745030 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccz2c\" (UniqueName: \"kubernetes.io/projected/5cffc08c-ba5c-4141-bb50-3df093d6896a-kube-api-access-ccz2c\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb\" (UID: \"5cffc08c-ba5c-4141-bb50-3df093d6896a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" Aug 04 10:50:41.791247 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:41.791227 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" Aug 04 10:50:41.931107 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:41.931072 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb"] Aug 04 10:50:41.932878 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:50:41.932842 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cffc08c_ba5c_4141_bb50_3df093d6896a.slice/crio-c454bd28808e70c7a241790a0805efa2d8f1b374ec34aa0d0ffeb08f697627e5 WatchSource:0}: Error finding container c454bd28808e70c7a241790a0805efa2d8f1b374ec34aa0d0ffeb08f697627e5: Status 404 returned error can't find the container with id c454bd28808e70c7a241790a0805efa2d8f1b374ec34aa0d0ffeb08f697627e5 Aug 04 10:50:41.934301 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:41.934275 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 04 10:50:42.296744 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:42.296706 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" event={"ID":"5cffc08c-ba5c-4141-bb50-3df093d6896a","Type":"ContainerStarted","Data":"706baa4b8849c9b367351c62cb3a981cdb0bf03ebf4f24175372105d0d84ec29"} Aug 04 10:50:42.296916 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:42.296767 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" event={"ID":"5cffc08c-ba5c-4141-bb50-3df093d6896a","Type":"ContainerStarted","Data":"c454bd28808e70c7a241790a0805efa2d8f1b374ec34aa0d0ffeb08f697627e5"} Aug 04 10:50:42.317350 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:42.317303 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" podStartSLOduration=1.079475224 podStartE2EDuration="1.317287901s" totalImagesPullingTime="237.812677ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:50:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:50:42.314849451 +0000 UTC m=+792.913753956" watchObservedRunningTime="2026-08-04 10:50:42.317287901 +0000 UTC m=+792.916192314" Aug 04 10:50:46.957789 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:46.957750 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw"] Aug 04 10:50:46.961626 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:46.961604 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" Aug 04 10:50:46.964473 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:46.964453 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Aug 04 10:50:46.972784 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:46.972746 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw"] Aug 04 10:50:47.087149 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:47.087115 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/013be7a1-8b36-4849-89dd-bd994661aed3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4cfcw\" (UID: \"013be7a1-8b36-4849-89dd-bd994661aed3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" Aug 04 10:50:47.087149 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:47.087150 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/013be7a1-8b36-4849-89dd-bd994661aed3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4cfcw\" (UID: \"013be7a1-8b36-4849-89dd-bd994661aed3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" Aug 04 10:50:47.087360 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:47.087316 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/013be7a1-8b36-4849-89dd-bd994661aed3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4cfcw\" (UID: \"013be7a1-8b36-4849-89dd-bd994661aed3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" Aug 04 10:50:47.087449 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:47.087409 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cswd7\" (UniqueName: \"kubernetes.io/projected/013be7a1-8b36-4849-89dd-bd994661aed3-kube-api-access-cswd7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4cfcw\" (UID: \"013be7a1-8b36-4849-89dd-bd994661aed3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" Aug 04 10:50:47.087518 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:47.087489 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/013be7a1-8b36-4849-89dd-bd994661aed3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4cfcw\" (UID: \"013be7a1-8b36-4849-89dd-bd994661aed3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" Aug 04 10:50:47.087573 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:47.087564 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/013be7a1-8b36-4849-89dd-bd994661aed3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4cfcw\" (UID: \"013be7a1-8b36-4849-89dd-bd994661aed3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" Aug 04 10:50:47.188209 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:47.188173 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/013be7a1-8b36-4849-89dd-bd994661aed3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4cfcw\" (UID: \"013be7a1-8b36-4849-89dd-bd994661aed3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" Aug 04 10:50:47.188367 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:47.188214 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/013be7a1-8b36-4849-89dd-bd994661aed3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4cfcw\" (UID: \"013be7a1-8b36-4849-89dd-bd994661aed3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" Aug 04 10:50:47.188367 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:47.188259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/013be7a1-8b36-4849-89dd-bd994661aed3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4cfcw\" (UID: \"013be7a1-8b36-4849-89dd-bd994661aed3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" Aug 04 10:50:47.188367 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:47.188289 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cswd7\" (UniqueName: \"kubernetes.io/projected/013be7a1-8b36-4849-89dd-bd994661aed3-kube-api-access-cswd7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4cfcw\" (UID: \"013be7a1-8b36-4849-89dd-bd994661aed3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" Aug 04 10:50:47.188598 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:47.188415 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/013be7a1-8b36-4849-89dd-bd994661aed3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4cfcw\" (UID: \"013be7a1-8b36-4849-89dd-bd994661aed3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" Aug 04 10:50:47.188598 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:47.188502 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/013be7a1-8b36-4849-89dd-bd994661aed3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4cfcw\" (UID: \"013be7a1-8b36-4849-89dd-bd994661aed3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" Aug 04 10:50:47.188766 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:47.188719 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/013be7a1-8b36-4849-89dd-bd994661aed3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4cfcw\" (UID: \"013be7a1-8b36-4849-89dd-bd994661aed3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" Aug 04 10:50:47.188913 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:47.188817 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/013be7a1-8b36-4849-89dd-bd994661aed3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4cfcw\" (UID: \"013be7a1-8b36-4849-89dd-bd994661aed3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" Aug 04 10:50:47.188913 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:47.188903 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/013be7a1-8b36-4849-89dd-bd994661aed3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4cfcw\" (UID: \"013be7a1-8b36-4849-89dd-bd994661aed3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" Aug 04 10:50:47.190620 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:47.190603 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/013be7a1-8b36-4849-89dd-bd994661aed3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4cfcw\" (UID: \"013be7a1-8b36-4849-89dd-bd994661aed3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" Aug 04 10:50:47.190899 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:47.190880 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/013be7a1-8b36-4849-89dd-bd994661aed3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4cfcw\" (UID: \"013be7a1-8b36-4849-89dd-bd994661aed3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" Aug 04 10:50:47.198861 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:47.198834 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cswd7\" (UniqueName: \"kubernetes.io/projected/013be7a1-8b36-4849-89dd-bd994661aed3-kube-api-access-cswd7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4cfcw\" (UID: \"013be7a1-8b36-4849-89dd-bd994661aed3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" Aug 04 10:50:47.279658 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:47.279635 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" Aug 04 10:50:47.431016 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:47.430979 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw"] Aug 04 10:50:47.433684 ip-10-0-142-102 kubenswrapper[2576]: W0804 10:50:47.433645 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod013be7a1_8b36_4849_89dd_bd994661aed3.slice/crio-c1fd3d6a1f8e7e02b8a73ba1e9346d413c2e4564bd88c50a88bbfaa6317956c8 WatchSource:0}: Error finding container c1fd3d6a1f8e7e02b8a73ba1e9346d413c2e4564bd88c50a88bbfaa6317956c8: Status 404 returned error can't find the container with id c1fd3d6a1f8e7e02b8a73ba1e9346d413c2e4564bd88c50a88bbfaa6317956c8 Aug 04 10:50:48.326450 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:48.326413 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" event={"ID":"013be7a1-8b36-4849-89dd-bd994661aed3","Type":"ContainerStarted","Data":"ca97c0ddc3accb92971fc34b74210544b87a6796627f4e39ea152ba2b8badbd9"} Aug 04 10:50:48.326889 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:48.326470 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" event={"ID":"013be7a1-8b36-4849-89dd-bd994661aed3","Type":"ContainerStarted","Data":"c1fd3d6a1f8e7e02b8a73ba1e9346d413c2e4564bd88c50a88bbfaa6317956c8"} Aug 04 10:50:48.348430 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:48.348369 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" podStartSLOduration=2.116387649 podStartE2EDuration="2.348352548s" totalImagesPullingTime="231.964899ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 10:50:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 10:50:48.347549139 +0000 UTC m=+798.946453536" watchObservedRunningTime="2026-08-04 10:50:48.348352548 +0000 UTC m=+798.947256922" Aug 04 10:50:51.791886 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:51.791795 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" Aug 04 10:50:51.791886 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:51.791869 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" Aug 04 10:50:51.805896 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:51.805865 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" Aug 04 10:50:52.356977 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:52.356943 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb" Aug 04 10:50:57.280215 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:57.280185 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" Aug 04 10:50:57.280691 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:57.280348 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" Aug 04 10:50:57.293101 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:57.293078 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" Aug 04 10:50:57.380095 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:50:57.380059 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4cfcw" Aug 04 10:52:29.850447 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:52:29.850351 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 10:52:29.851024 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:52:29.850901 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 10:57:29.878068 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:57:29.878039 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 10:57:29.879579 ip-10-0-142-102 kubenswrapper[2576]: I0804 10:57:29.879557 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 11:00:48.162125 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:00:48.162086 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g5vf8"] Aug 04 11:00:48.162690 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:00:48.162345 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g5vf8" podUID="a18f3f6d-5319-4215-a8d2-0cc97934c55a" containerName="manager" containerID="cri-o://7907f527b22486f347f17bc4021a32719e49144075af27dc8343893727b58183" gracePeriod=10 Aug 04 11:00:48.416582 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:00:48.416514 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g5vf8" Aug 04 11:00:48.614794 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:00:48.614763 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a18f3f6d-5319-4215-a8d2-0cc97934c55a-extensions-socket-volume\") pod \"a18f3f6d-5319-4215-a8d2-0cc97934c55a\" (UID: \"a18f3f6d-5319-4215-a8d2-0cc97934c55a\") " Aug 04 11:00:48.614954 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:00:48.614804 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdgfw\" (UniqueName: \"kubernetes.io/projected/a18f3f6d-5319-4215-a8d2-0cc97934c55a-kube-api-access-kdgfw\") pod \"a18f3f6d-5319-4215-a8d2-0cc97934c55a\" (UID: \"a18f3f6d-5319-4215-a8d2-0cc97934c55a\") " Aug 04 11:00:48.615099 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:00:48.615075 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a18f3f6d-5319-4215-a8d2-0cc97934c55a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a18f3f6d-5319-4215-a8d2-0cc97934c55a" (UID: "a18f3f6d-5319-4215-a8d2-0cc97934c55a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 11:00:48.617229 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:00:48.617206 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a18f3f6d-5319-4215-a8d2-0cc97934c55a-kube-api-access-kdgfw" (OuterVolumeSpecName: "kube-api-access-kdgfw") pod "a18f3f6d-5319-4215-a8d2-0cc97934c55a" (UID: "a18f3f6d-5319-4215-a8d2-0cc97934c55a"). InnerVolumeSpecName "kube-api-access-kdgfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:00:48.715616 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:00:48.715551 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a18f3f6d-5319-4215-a8d2-0cc97934c55a-extensions-socket-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:00:48.715616 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:00:48.715583 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdgfw\" (UniqueName: \"kubernetes.io/projected/a18f3f6d-5319-4215-a8d2-0cc97934c55a-kube-api-access-kdgfw\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:00:49.136579 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:00:49.136541 2576 generic.go:356] "Generic (PLEG): container finished" podID="a18f3f6d-5319-4215-a8d2-0cc97934c55a" containerID="7907f527b22486f347f17bc4021a32719e49144075af27dc8343893727b58183" exitCode=0 Aug 04 11:00:49.136783 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:00:49.136588 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g5vf8" Aug 04 11:00:49.136783 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:00:49.136625 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g5vf8" event={"ID":"a18f3f6d-5319-4215-a8d2-0cc97934c55a","Type":"ContainerDied","Data":"7907f527b22486f347f17bc4021a32719e49144075af27dc8343893727b58183"} Aug 04 11:00:49.136783 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:00:49.136692 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g5vf8" event={"ID":"a18f3f6d-5319-4215-a8d2-0cc97934c55a","Type":"ContainerDied","Data":"aead7c760585b629ab7526c985f4b1dc2c7ac985ecb51c4cf1ab24718c5e7859"} Aug 04 11:00:49.136783 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:00:49.136721 2576 scope.go:117] "RemoveContainer" containerID="7907f527b22486f347f17bc4021a32719e49144075af27dc8343893727b58183" Aug 04 11:00:49.146146 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:00:49.146130 2576 scope.go:117] "RemoveContainer" containerID="7907f527b22486f347f17bc4021a32719e49144075af27dc8343893727b58183" Aug 04 11:00:49.146411 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:00:49.146369 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7907f527b22486f347f17bc4021a32719e49144075af27dc8343893727b58183\": container with ID starting with 7907f527b22486f347f17bc4021a32719e49144075af27dc8343893727b58183 not found: ID does not exist" containerID="7907f527b22486f347f17bc4021a32719e49144075af27dc8343893727b58183" Aug 04 11:00:49.146506 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:00:49.146418 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7907f527b22486f347f17bc4021a32719e49144075af27dc8343893727b58183"} err="failed to get container status \"7907f527b22486f347f17bc4021a32719e49144075af27dc8343893727b58183\": rpc error: code = NotFound desc = could not find container \"7907f527b22486f347f17bc4021a32719e49144075af27dc8343893727b58183\": container with ID starting with 7907f527b22486f347f17bc4021a32719e49144075af27dc8343893727b58183 not found: ID does not exist" Aug 04 11:00:49.158656 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:00:49.158637 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g5vf8"] Aug 04 11:00:49.163828 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:00:49.163808 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-g5vf8"] Aug 04 11:00:49.929631 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:00:49.929596 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a18f3f6d-5319-4215-a8d2-0cc97934c55a" path="/var/lib/kubelet/pods/a18f3f6d-5319-4215-a8d2-0cc97934c55a/volumes" Aug 04 11:01:48.846076 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:01:48.846042 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-d8x7t"] Aug 04 11:01:48.846507 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:01:48.846425 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a18f3f6d-5319-4215-a8d2-0cc97934c55a" containerName="manager" Aug 04 11:01:48.846507 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:01:48.846438 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a18f3f6d-5319-4215-a8d2-0cc97934c55a" containerName="manager" Aug 04 11:01:48.846507 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:01:48.846497 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a18f3f6d-5319-4215-a8d2-0cc97934c55a" containerName="manager" Aug 04 11:01:48.850380 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:01:48.850358 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-d8x7t" Aug 04 11:01:48.853246 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:01:48.853226 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Aug 04 11:01:48.853379 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:01:48.853309 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Aug 04 11:01:48.853379 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:01:48.853338 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8gnsq\"" Aug 04 11:01:48.864743 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:01:48.864721 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-d8x7t"] Aug 04 11:01:48.925033 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:01:48.925011 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnphq\" (UniqueName: \"kubernetes.io/projected/4441a44b-f5b5-4ff9-b227-267d98cbec84-kube-api-access-qnphq\") pod \"kuadrant-operator-controller-manager-68cf589589-d8x7t\" (UID: \"4441a44b-f5b5-4ff9-b227-267d98cbec84\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-d8x7t" Aug 04 11:01:48.925151 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:01:48.925060 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4441a44b-f5b5-4ff9-b227-267d98cbec84-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-d8x7t\" (UID: \"4441a44b-f5b5-4ff9-b227-267d98cbec84\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-d8x7t" Aug 04 11:01:49.025998 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:01:49.025968 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnphq\" (UniqueName: \"kubernetes.io/projected/4441a44b-f5b5-4ff9-b227-267d98cbec84-kube-api-access-qnphq\") pod \"kuadrant-operator-controller-manager-68cf589589-d8x7t\" (UID: \"4441a44b-f5b5-4ff9-b227-267d98cbec84\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-d8x7t" Aug 04 11:01:49.026131 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:01:49.026027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4441a44b-f5b5-4ff9-b227-267d98cbec84-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-d8x7t\" (UID: \"4441a44b-f5b5-4ff9-b227-267d98cbec84\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-d8x7t" Aug 04 11:01:49.026335 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:01:49.026319 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4441a44b-f5b5-4ff9-b227-267d98cbec84-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-d8x7t\" (UID: \"4441a44b-f5b5-4ff9-b227-267d98cbec84\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-d8x7t" Aug 04 11:01:49.034938 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:01:49.034913 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnphq\" (UniqueName: \"kubernetes.io/projected/4441a44b-f5b5-4ff9-b227-267d98cbec84-kube-api-access-qnphq\") pod \"kuadrant-operator-controller-manager-68cf589589-d8x7t\" (UID: \"4441a44b-f5b5-4ff9-b227-267d98cbec84\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-d8x7t" Aug 04 11:01:49.160865 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:01:49.160779 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-d8x7t" Aug 04 11:01:49.304452 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:01:49.304422 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-d8x7t"] Aug 04 11:01:49.308187 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:01:49.308161 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4441a44b_f5b5_4ff9_b227_267d98cbec84.slice/crio-3df7d3bfaf5bf97f07a7251421ba6a20129e6e099289dfd82f0327c1af9e0000 WatchSource:0}: Error finding container 3df7d3bfaf5bf97f07a7251421ba6a20129e6e099289dfd82f0327c1af9e0000: Status 404 returned error can't find the container with id 3df7d3bfaf5bf97f07a7251421ba6a20129e6e099289dfd82f0327c1af9e0000 Aug 04 11:01:49.415477 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:01:49.415379 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-d8x7t" event={"ID":"4441a44b-f5b5-4ff9-b227-267d98cbec84","Type":"ContainerStarted","Data":"9a86aaf269b5e94e85e78a77c2e656f48a2412d35829f85ee1aa2dfd6b892588"} Aug 04 11:01:49.415477 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:01:49.415451 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-d8x7t" event={"ID":"4441a44b-f5b5-4ff9-b227-267d98cbec84","Type":"ContainerStarted","Data":"3df7d3bfaf5bf97f07a7251421ba6a20129e6e099289dfd82f0327c1af9e0000"} Aug 04 11:01:49.415671 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:01:49.415539 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-d8x7t" Aug 04 11:01:49.436113 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:01:49.436061 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-d8x7t" podStartSLOduration=1.436039836 podStartE2EDuration="1.436039836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:01:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:01:49.43579642 +0000 UTC m=+1460.034700832" watchObservedRunningTime="2026-08-04 11:01:49.436039836 +0000 UTC m=+1460.034944211" Aug 04 11:02:00.424164 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:02:00.424126 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-d8x7t" Aug 04 11:02:29.905166 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:02:29.905134 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 11:02:29.908045 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:02:29.908022 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 11:07:29.934335 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:07:29.934304 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 11:07:29.937537 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:07:29.937510 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 11:09:35.098261 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:35.098230 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc"] Aug 04 11:09:35.101497 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:35.101476 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc" Aug 04 11:09:35.104087 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:35.104066 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-6279d3cc\"" Aug 04 11:09:35.109442 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:35.108923 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc"] Aug 04 11:09:35.147604 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:35.147575 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc"] Aug 04 11:09:35.150811 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:35.150790 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc" Aug 04 11:09:35.153448 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:35.153428 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-6279d3cc-dockercfg-bsggd\"" Aug 04 11:09:35.154964 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:35.154945 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69f41eb2-bf50-4d6e-a1fd-1c23f80ea747-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc\" (UID: \"69f41eb2-bf50-4d6e-a1fd-1c23f80ea747\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc" Aug 04 11:09:35.155067 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:35.155043 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc2b7\" (UniqueName: \"kubernetes.io/projected/69f41eb2-bf50-4d6e-a1fd-1c23f80ea747-kube-api-access-cc2b7\") pod \"payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc\" (UID: \"69f41eb2-bf50-4d6e-a1fd-1c23f80ea747\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc" Aug 04 11:09:35.159946 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:35.159925 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc"] Aug 04 11:09:35.256157 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:35.256122 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69f41eb2-bf50-4d6e-a1fd-1c23f80ea747-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc\" (UID: \"69f41eb2-bf50-4d6e-a1fd-1c23f80ea747\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc" Aug 04 11:09:35.256368 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:35.256212 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tvsf\" (UniqueName: \"kubernetes.io/projected/183cc78e-fb02-4d86-8eb4-182455266d0d-kube-api-access-2tvsf\") pod \"payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc\" (UID: \"183cc78e-fb02-4d86-8eb4-182455266d0d\") " pod="openshift-ingress/payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc" Aug 04 11:09:35.256368 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:35.256284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/183cc78e-fb02-4d86-8eb4-182455266d0d-plugins-config-volume\") pod \"payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc\" (UID: \"183cc78e-fb02-4d86-8eb4-182455266d0d\") " pod="openshift-ingress/payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc" Aug 04 11:09:35.256368 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:35.256338 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc2b7\" (UniqueName: \"kubernetes.io/projected/69f41eb2-bf50-4d6e-a1fd-1c23f80ea747-kube-api-access-cc2b7\") pod \"payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc\" (UID: \"69f41eb2-bf50-4d6e-a1fd-1c23f80ea747\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc" Aug 04 11:09:35.256942 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:35.256921 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69f41eb2-bf50-4d6e-a1fd-1c23f80ea747-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc\" (UID: \"69f41eb2-bf50-4d6e-a1fd-1c23f80ea747\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc" Aug 04 11:09:35.264827 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:35.264806 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc2b7\" (UniqueName: \"kubernetes.io/projected/69f41eb2-bf50-4d6e-a1fd-1c23f80ea747-kube-api-access-cc2b7\") pod \"payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc\" (UID: \"69f41eb2-bf50-4d6e-a1fd-1c23f80ea747\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc" Aug 04 11:09:35.357708 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:35.357599 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/183cc78e-fb02-4d86-8eb4-182455266d0d-plugins-config-volume\") pod \"payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc\" (UID: \"183cc78e-fb02-4d86-8eb4-182455266d0d\") " pod="openshift-ingress/payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc" Aug 04 11:09:35.357876 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:35.357752 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tvsf\" (UniqueName: \"kubernetes.io/projected/183cc78e-fb02-4d86-8eb4-182455266d0d-kube-api-access-2tvsf\") pod \"payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc\" (UID: \"183cc78e-fb02-4d86-8eb4-182455266d0d\") " pod="openshift-ingress/payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc" Aug 04 11:09:35.358281 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:35.358257 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/183cc78e-fb02-4d86-8eb4-182455266d0d-plugins-config-volume\") pod \"payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc\" (UID: \"183cc78e-fb02-4d86-8eb4-182455266d0d\") " pod="openshift-ingress/payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc" Aug 04 11:09:35.365815 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:35.365789 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tvsf\" (UniqueName: \"kubernetes.io/projected/183cc78e-fb02-4d86-8eb4-182455266d0d-kube-api-access-2tvsf\") pod \"payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc\" (UID: \"183cc78e-fb02-4d86-8eb4-182455266d0d\") " pod="openshift-ingress/payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc" Aug 04 11:09:35.414258 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:35.414223 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc" Aug 04 11:09:35.462427 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:35.462383 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc" Aug 04 11:09:35.586506 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:35.586458 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc"] Aug 04 11:09:35.589010 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:09:35.588978 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69f41eb2_bf50_4d6e_a1fd_1c23f80ea747.slice/crio-9fa4a1295e4f37b1e68e7449549d30abd0f7a8bc4fe40fcfdcb79d81d4758fb3 WatchSource:0}: Error finding container 9fa4a1295e4f37b1e68e7449549d30abd0f7a8bc4fe40fcfdcb79d81d4758fb3: Status 404 returned error can't find the container with id 9fa4a1295e4f37b1e68e7449549d30abd0f7a8bc4fe40fcfdcb79d81d4758fb3 Aug 04 11:09:35.823679 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:35.823613 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc"] Aug 04 11:09:36.594809 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:36.594773 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc" event={"ID":"69f41eb2-bf50-4d6e-a1fd-1c23f80ea747","Type":"ContainerStarted","Data":"fcd8f057c08591d3f733c1ccd150a91905d8b3d42b96b41e1e505261f390a45e"} Aug 04 11:09:36.595227 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:36.594835 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc" event={"ID":"69f41eb2-bf50-4d6e-a1fd-1c23f80ea747","Type":"ContainerStarted","Data":"9fa4a1295e4f37b1e68e7449549d30abd0f7a8bc4fe40fcfdcb79d81d4758fb3"} Aug 04 11:09:36.595227 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:36.594934 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc" Aug 04 11:09:36.596212 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:36.596192 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc" event={"ID":"183cc78e-fb02-4d86-8eb4-182455266d0d","Type":"ContainerStarted","Data":"5919a106ee46b21742f0090a6fe33e80780a68dd52cd0b3f122b7109829e6f54"} Aug 04 11:09:36.596312 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:36.596224 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc" event={"ID":"183cc78e-fb02-4d86-8eb4-182455266d0d","Type":"ContainerStarted","Data":"f7d1dab1d95e0b4e86e141319b629fdb9f72542480fe645dea502cf2ac8e5693"} Aug 04 11:09:36.596312 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:36.596249 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc" Aug 04 11:09:36.613179 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:36.613131 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc" podStartSLOduration=1.613116677 podStartE2EDuration="1.613116677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:09:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:09:36.61276515 +0000 UTC m=+1927.211669537" watchObservedRunningTime="2026-08-04 11:09:36.613116677 +0000 UTC m=+1927.212021054" Aug 04 11:09:36.632559 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:36.632516 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc" podStartSLOduration=1.632503449 podStartE2EDuration="1.632503449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:09:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:09:36.631215896 +0000 UTC m=+1927.230120295" watchObservedRunningTime="2026-08-04 11:09:36.632503449 +0000 UTC m=+1927.231407840" Aug 04 11:09:47.603124 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:47.603092 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc" Aug 04 11:09:47.603528 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:09:47.603173 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc" Aug 04 11:10:04.907009 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:04.906976 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc"] Aug 04 11:10:04.907464 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:04.907183 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc" podUID="183cc78e-fb02-4d86-8eb4-182455266d0d" containerName="payload-processing" containerID="cri-o://5919a106ee46b21742f0090a6fe33e80780a68dd52cd0b3f122b7109829e6f54" gracePeriod=30 Aug 04 11:10:04.911382 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:04.911354 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc"] Aug 04 11:10:04.911672 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:04.911638 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc" podUID="69f41eb2-bf50-4d6e-a1fd-1c23f80ea747" containerName="payload-pre-processing" containerID="cri-o://fcd8f057c08591d3f733c1ccd150a91905d8b3d42b96b41e1e505261f390a45e" gracePeriod=30 Aug 04 11:10:05.199089 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.198831 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc" Aug 04 11:10:05.202789 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.202760 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc" Aug 04 11:10:05.224154 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.224106 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/183cc78e-fb02-4d86-8eb4-182455266d0d-plugins-config-volume\") pod \"183cc78e-fb02-4d86-8eb4-182455266d0d\" (UID: \"183cc78e-fb02-4d86-8eb4-182455266d0d\") " Aug 04 11:10:05.224330 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.224158 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tvsf\" (UniqueName: \"kubernetes.io/projected/183cc78e-fb02-4d86-8eb4-182455266d0d-kube-api-access-2tvsf\") pod \"183cc78e-fb02-4d86-8eb4-182455266d0d\" (UID: \"183cc78e-fb02-4d86-8eb4-182455266d0d\") " Aug 04 11:10:05.224330 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.224238 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69f41eb2-bf50-4d6e-a1fd-1c23f80ea747-plugins-config-volume\") pod \"69f41eb2-bf50-4d6e-a1fd-1c23f80ea747\" (UID: \"69f41eb2-bf50-4d6e-a1fd-1c23f80ea747\") " Aug 04 11:10:05.224330 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.224270 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc2b7\" (UniqueName: \"kubernetes.io/projected/69f41eb2-bf50-4d6e-a1fd-1c23f80ea747-kube-api-access-cc2b7\") pod \"69f41eb2-bf50-4d6e-a1fd-1c23f80ea747\" (UID: \"69f41eb2-bf50-4d6e-a1fd-1c23f80ea747\") " Aug 04 11:10:05.224630 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.224553 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/183cc78e-fb02-4d86-8eb4-182455266d0d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "183cc78e-fb02-4d86-8eb4-182455266d0d" (UID: "183cc78e-fb02-4d86-8eb4-182455266d0d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:10:05.225156 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.225128 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69f41eb2-bf50-4d6e-a1fd-1c23f80ea747-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "69f41eb2-bf50-4d6e-a1fd-1c23f80ea747" (UID: "69f41eb2-bf50-4d6e-a1fd-1c23f80ea747"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:10:05.227278 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.227243 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69f41eb2-bf50-4d6e-a1fd-1c23f80ea747-kube-api-access-cc2b7" (OuterVolumeSpecName: "kube-api-access-cc2b7") pod "69f41eb2-bf50-4d6e-a1fd-1c23f80ea747" (UID: "69f41eb2-bf50-4d6e-a1fd-1c23f80ea747"). InnerVolumeSpecName "kube-api-access-cc2b7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:10:05.227473 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.227453 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/183cc78e-fb02-4d86-8eb4-182455266d0d-kube-api-access-2tvsf" (OuterVolumeSpecName: "kube-api-access-2tvsf") pod "183cc78e-fb02-4d86-8eb4-182455266d0d" (UID: "183cc78e-fb02-4d86-8eb4-182455266d0d"). InnerVolumeSpecName "kube-api-access-2tvsf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:10:05.325248 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.325202 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69f41eb2-bf50-4d6e-a1fd-1c23f80ea747-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:10:05.325248 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.325235 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc2b7\" (UniqueName: \"kubernetes.io/projected/69f41eb2-bf50-4d6e-a1fd-1c23f80ea747-kube-api-access-cc2b7\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:10:05.325248 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.325247 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/183cc78e-fb02-4d86-8eb4-182455266d0d-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:10:05.325248 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.325257 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tvsf\" (UniqueName: \"kubernetes.io/projected/183cc78e-fb02-4d86-8eb4-182455266d0d-kube-api-access-2tvsf\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:10:05.739928 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.739892 2576 generic.go:356] "Generic (PLEG): container finished" podID="69f41eb2-bf50-4d6e-a1fd-1c23f80ea747" containerID="fcd8f057c08591d3f733c1ccd150a91905d8b3d42b96b41e1e505261f390a45e" exitCode=0 Aug 04 11:10:05.740104 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.739931 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc" Aug 04 11:10:05.740104 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.739974 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc" event={"ID":"69f41eb2-bf50-4d6e-a1fd-1c23f80ea747","Type":"ContainerDied","Data":"fcd8f057c08591d3f733c1ccd150a91905d8b3d42b96b41e1e505261f390a45e"} Aug 04 11:10:05.740104 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.740027 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc" event={"ID":"69f41eb2-bf50-4d6e-a1fd-1c23f80ea747","Type":"ContainerDied","Data":"9fa4a1295e4f37b1e68e7449549d30abd0f7a8bc4fe40fcfdcb79d81d4758fb3"} Aug 04 11:10:05.740104 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.740056 2576 scope.go:117] "RemoveContainer" containerID="fcd8f057c08591d3f733c1ccd150a91905d8b3d42b96b41e1e505261f390a45e" Aug 04 11:10:05.741440 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.741415 2576 generic.go:356] "Generic (PLEG): container finished" podID="183cc78e-fb02-4d86-8eb4-182455266d0d" containerID="5919a106ee46b21742f0090a6fe33e80780a68dd52cd0b3f122b7109829e6f54" exitCode=0 Aug 04 11:10:05.741540 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.741453 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc" event={"ID":"183cc78e-fb02-4d86-8eb4-182455266d0d","Type":"ContainerDied","Data":"5919a106ee46b21742f0090a6fe33e80780a68dd52cd0b3f122b7109829e6f54"} Aug 04 11:10:05.741540 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.741484 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc" event={"ID":"183cc78e-fb02-4d86-8eb4-182455266d0d","Type":"ContainerDied","Data":"f7d1dab1d95e0b4e86e141319b629fdb9f72542480fe645dea502cf2ac8e5693"} Aug 04 11:10:05.741540 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.741456 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc" Aug 04 11:10:05.751141 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.751112 2576 scope.go:117] "RemoveContainer" containerID="fcd8f057c08591d3f733c1ccd150a91905d8b3d42b96b41e1e505261f390a45e" Aug 04 11:10:05.751600 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:10:05.751569 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcd8f057c08591d3f733c1ccd150a91905d8b3d42b96b41e1e505261f390a45e\": container with ID starting with fcd8f057c08591d3f733c1ccd150a91905d8b3d42b96b41e1e505261f390a45e not found: ID does not exist" containerID="fcd8f057c08591d3f733c1ccd150a91905d8b3d42b96b41e1e505261f390a45e" Aug 04 11:10:05.751801 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.751746 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcd8f057c08591d3f733c1ccd150a91905d8b3d42b96b41e1e505261f390a45e"} err="failed to get container status \"fcd8f057c08591d3f733c1ccd150a91905d8b3d42b96b41e1e505261f390a45e\": rpc error: code = NotFound desc = could not find container \"fcd8f057c08591d3f733c1ccd150a91905d8b3d42b96b41e1e505261f390a45e\": container with ID starting with fcd8f057c08591d3f733c1ccd150a91905d8b3d42b96b41e1e505261f390a45e not found: ID does not exist" Aug 04 11:10:05.751801 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.751786 2576 scope.go:117] "RemoveContainer" containerID="5919a106ee46b21742f0090a6fe33e80780a68dd52cd0b3f122b7109829e6f54" Aug 04 11:10:05.763127 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.763107 2576 scope.go:117] "RemoveContainer" containerID="5919a106ee46b21742f0090a6fe33e80780a68dd52cd0b3f122b7109829e6f54" Aug 04 11:10:05.763413 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:10:05.763373 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5919a106ee46b21742f0090a6fe33e80780a68dd52cd0b3f122b7109829e6f54\": container with ID starting with 5919a106ee46b21742f0090a6fe33e80780a68dd52cd0b3f122b7109829e6f54 not found: ID does not exist" containerID="5919a106ee46b21742f0090a6fe33e80780a68dd52cd0b3f122b7109829e6f54" Aug 04 11:10:05.763475 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.763415 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5919a106ee46b21742f0090a6fe33e80780a68dd52cd0b3f122b7109829e6f54"} err="failed to get container status \"5919a106ee46b21742f0090a6fe33e80780a68dd52cd0b3f122b7109829e6f54\": rpc error: code = NotFound desc = could not find container \"5919a106ee46b21742f0090a6fe33e80780a68dd52cd0b3f122b7109829e6f54\": container with ID starting with 5919a106ee46b21742f0090a6fe33e80780a68dd52cd0b3f122b7109829e6f54 not found: ID does not exist" Aug 04 11:10:05.783173 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.783150 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc"] Aug 04 11:10:05.788882 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.788862 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-6279d3cc-775cdf84fd-4gdhc"] Aug 04 11:10:05.803239 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.803218 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc"] Aug 04 11:10:05.811316 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.811297 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6279d3cc-765c8cb76-n7bpc"] Aug 04 11:10:05.931749 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.931715 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="183cc78e-fb02-4d86-8eb4-182455266d0d" path="/var/lib/kubelet/pods/183cc78e-fb02-4d86-8eb4-182455266d0d/volumes" Aug 04 11:10:05.932199 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:05.932182 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69f41eb2-bf50-4d6e-a1fd-1c23f80ea747" path="/var/lib/kubelet/pods/69f41eb2-bf50-4d6e-a1fd-1c23f80ea747/volumes" Aug 04 11:10:09.561152 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.561122 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx"] Aug 04 11:10:09.563533 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.561640 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="183cc78e-fb02-4d86-8eb4-182455266d0d" containerName="payload-processing" Aug 04 11:10:09.563533 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.561654 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="183cc78e-fb02-4d86-8eb4-182455266d0d" containerName="payload-processing" Aug 04 11:10:09.563533 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.561671 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69f41eb2-bf50-4d6e-a1fd-1c23f80ea747" containerName="payload-pre-processing" Aug 04 11:10:09.563533 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.561676 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="69f41eb2-bf50-4d6e-a1fd-1c23f80ea747" containerName="payload-pre-processing" Aug 04 11:10:09.563533 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.561743 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="69f41eb2-bf50-4d6e-a1fd-1c23f80ea747" containerName="payload-pre-processing" Aug 04 11:10:09.563533 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.561758 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="183cc78e-fb02-4d86-8eb4-182455266d0d" containerName="payload-processing" Aug 04 11:10:09.564559 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.564544 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx" Aug 04 11:10:09.567110 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.567090 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-93c76061-dockercfg-6hbgj\"" Aug 04 11:10:09.567379 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.567363 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-93c76061\"" Aug 04 11:10:09.573833 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.573812 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx"] Aug 04 11:10:09.596109 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.596084 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22"] Aug 04 11:10:09.599251 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.599234 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22" Aug 04 11:10:09.612277 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.612253 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22"] Aug 04 11:10:09.662855 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.662827 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/908ae6be-3713-4d09-a27e-9ff5938df0a0-plugins-config-volume\") pod \"payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22\" (UID: \"908ae6be-3713-4d09-a27e-9ff5938df0a0\") " pod="openshift-ingress/payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22" Aug 04 11:10:09.662983 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.662870 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npklc\" (UniqueName: \"kubernetes.io/projected/908ae6be-3713-4d09-a27e-9ff5938df0a0-kube-api-access-npklc\") pod \"payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22\" (UID: \"908ae6be-3713-4d09-a27e-9ff5938df0a0\") " pod="openshift-ingress/payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22" Aug 04 11:10:09.662983 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.662892 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/622a6c97-c480-4bdf-ab7a-2442db928cf7-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx\" (UID: \"622a6c97-c480-4bdf-ab7a-2442db928cf7\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx" Aug 04 11:10:09.662983 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.662952 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6vtb\" (UniqueName: \"kubernetes.io/projected/622a6c97-c480-4bdf-ab7a-2442db928cf7-kube-api-access-v6vtb\") pod \"payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx\" (UID: \"622a6c97-c480-4bdf-ab7a-2442db928cf7\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx" Aug 04 11:10:09.763461 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.763430 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npklc\" (UniqueName: \"kubernetes.io/projected/908ae6be-3713-4d09-a27e-9ff5938df0a0-kube-api-access-npklc\") pod \"payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22\" (UID: \"908ae6be-3713-4d09-a27e-9ff5938df0a0\") " pod="openshift-ingress/payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22" Aug 04 11:10:09.763593 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.763464 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/622a6c97-c480-4bdf-ab7a-2442db928cf7-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx\" (UID: \"622a6c97-c480-4bdf-ab7a-2442db928cf7\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx" Aug 04 11:10:09.763593 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.763491 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6vtb\" (UniqueName: \"kubernetes.io/projected/622a6c97-c480-4bdf-ab7a-2442db928cf7-kube-api-access-v6vtb\") pod \"payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx\" (UID: \"622a6c97-c480-4bdf-ab7a-2442db928cf7\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx" Aug 04 11:10:09.763593 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.763563 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/908ae6be-3713-4d09-a27e-9ff5938df0a0-plugins-config-volume\") pod \"payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22\" (UID: \"908ae6be-3713-4d09-a27e-9ff5938df0a0\") " pod="openshift-ingress/payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22" Aug 04 11:10:09.764223 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.764204 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/908ae6be-3713-4d09-a27e-9ff5938df0a0-plugins-config-volume\") pod \"payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22\" (UID: \"908ae6be-3713-4d09-a27e-9ff5938df0a0\") " pod="openshift-ingress/payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22" Aug 04 11:10:09.764260 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.764206 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/622a6c97-c480-4bdf-ab7a-2442db928cf7-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx\" (UID: \"622a6c97-c480-4bdf-ab7a-2442db928cf7\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx" Aug 04 11:10:09.772104 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.772077 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npklc\" (UniqueName: \"kubernetes.io/projected/908ae6be-3713-4d09-a27e-9ff5938df0a0-kube-api-access-npklc\") pod \"payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22\" (UID: \"908ae6be-3713-4d09-a27e-9ff5938df0a0\") " pod="openshift-ingress/payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22" Aug 04 11:10:09.772207 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.772180 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6vtb\" (UniqueName: \"kubernetes.io/projected/622a6c97-c480-4bdf-ab7a-2442db928cf7-kube-api-access-v6vtb\") pod \"payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx\" (UID: \"622a6c97-c480-4bdf-ab7a-2442db928cf7\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx" Aug 04 11:10:09.876224 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.876156 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx" Aug 04 11:10:09.910252 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:09.910228 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22" Aug 04 11:10:10.031996 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:10.031961 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx"] Aug 04 11:10:10.033786 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:10:10.033754 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod622a6c97_c480_4bdf_ab7a_2442db928cf7.slice/crio-383ae677835130380c54b22b248f17e0f2cb54069e6098d15cd2ebc27250fe77 WatchSource:0}: Error finding container 383ae677835130380c54b22b248f17e0f2cb54069e6098d15cd2ebc27250fe77: Status 404 returned error can't find the container with id 383ae677835130380c54b22b248f17e0f2cb54069e6098d15cd2ebc27250fe77 Aug 04 11:10:10.073666 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:10.066581 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22"] Aug 04 11:10:10.770048 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:10.770008 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx" event={"ID":"622a6c97-c480-4bdf-ab7a-2442db928cf7","Type":"ContainerStarted","Data":"559221bbaa913d903003fafa5996cb18790c29d97a39e8fb72f96a68b8a0f10d"} Aug 04 11:10:10.770518 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:10.770060 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx" event={"ID":"622a6c97-c480-4bdf-ab7a-2442db928cf7","Type":"ContainerStarted","Data":"383ae677835130380c54b22b248f17e0f2cb54069e6098d15cd2ebc27250fe77"} Aug 04 11:10:10.770518 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:10.770123 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx" Aug 04 11:10:10.771653 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:10.771629 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22" event={"ID":"908ae6be-3713-4d09-a27e-9ff5938df0a0","Type":"ContainerStarted","Data":"fc0acf6b3c2649b6356532459510cac3997ba550b970ab6104cc7f468b24ae73"} Aug 04 11:10:10.771769 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:10.771665 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22" event={"ID":"908ae6be-3713-4d09-a27e-9ff5938df0a0","Type":"ContainerStarted","Data":"b50475997f130636afbbb7a04d23aca7498aaa167d43f2865d4922a286309559"} Aug 04 11:10:10.771829 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:10.771773 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22" Aug 04 11:10:10.786941 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:10.786899 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx" podStartSLOduration=1.786885922 podStartE2EDuration="1.786885922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:10:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:10:10.785366581 +0000 UTC m=+1961.384271000" watchObservedRunningTime="2026-08-04 11:10:10.786885922 +0000 UTC m=+1961.385790295" Aug 04 11:10:10.803429 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:10.803377 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22" podStartSLOduration=1.80336755 podStartE2EDuration="1.80336755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:10:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:10:10.801495215 +0000 UTC m=+1961.400399589" watchObservedRunningTime="2026-08-04 11:10:10.80336755 +0000 UTC m=+1961.402271924" Aug 04 11:10:21.778702 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:21.778607 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22" Aug 04 11:10:21.779183 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:21.778804 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx" Aug 04 11:10:39.568889 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:39.568854 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22"] Aug 04 11:10:39.569768 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:39.569726 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22" podUID="908ae6be-3713-4d09-a27e-9ff5938df0a0" containerName="payload-processing" containerID="cri-o://fc0acf6b3c2649b6356532459510cac3997ba550b970ab6104cc7f468b24ae73" gracePeriod=30 Aug 04 11:10:39.586002 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:39.585585 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx"] Aug 04 11:10:39.586002 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:39.585847 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx" podUID="622a6c97-c480-4bdf-ab7a-2442db928cf7" containerName="payload-pre-processing" containerID="cri-o://559221bbaa913d903003fafa5996cb18790c29d97a39e8fb72f96a68b8a0f10d" gracePeriod=30 Aug 04 11:10:39.642540 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:10:39.642504 2576 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod622a6c97_c480_4bdf_ab7a_2442db928cf7.slice/crio-conmon-559221bbaa913d903003fafa5996cb18790c29d97a39e8fb72f96a68b8a0f10d.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod908ae6be_3713_4d09_a27e_9ff5938df0a0.slice/crio-conmon-fc0acf6b3c2649b6356532459510cac3997ba550b970ab6104cc7f468b24ae73.scope\": RecentStats: unable to find data in memory cache]" Aug 04 11:10:39.889450 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:39.889423 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22" Aug 04 11:10:39.892568 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:39.892548 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx" Aug 04 11:10:39.911007 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:39.910977 2576 generic.go:356] "Generic (PLEG): container finished" podID="622a6c97-c480-4bdf-ab7a-2442db928cf7" containerID="559221bbaa913d903003fafa5996cb18790c29d97a39e8fb72f96a68b8a0f10d" exitCode=0 Aug 04 11:10:39.911136 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:39.911011 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx" Aug 04 11:10:39.911136 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:39.911037 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx" event={"ID":"622a6c97-c480-4bdf-ab7a-2442db928cf7","Type":"ContainerDied","Data":"559221bbaa913d903003fafa5996cb18790c29d97a39e8fb72f96a68b8a0f10d"} Aug 04 11:10:39.911136 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:39.911096 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx" event={"ID":"622a6c97-c480-4bdf-ab7a-2442db928cf7","Type":"ContainerDied","Data":"383ae677835130380c54b22b248f17e0f2cb54069e6098d15cd2ebc27250fe77"} Aug 04 11:10:39.911136 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:39.911126 2576 scope.go:117] "RemoveContainer" containerID="559221bbaa913d903003fafa5996cb18790c29d97a39e8fb72f96a68b8a0f10d" Aug 04 11:10:39.912961 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:39.912915 2576 generic.go:356] "Generic (PLEG): container finished" podID="908ae6be-3713-4d09-a27e-9ff5938df0a0" containerID="fc0acf6b3c2649b6356532459510cac3997ba550b970ab6104cc7f468b24ae73" exitCode=0 Aug 04 11:10:39.913069 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:39.912978 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22" Aug 04 11:10:39.913069 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:39.913043 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22" event={"ID":"908ae6be-3713-4d09-a27e-9ff5938df0a0","Type":"ContainerDied","Data":"fc0acf6b3c2649b6356532459510cac3997ba550b970ab6104cc7f468b24ae73"} Aug 04 11:10:39.913188 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:39.913077 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22" event={"ID":"908ae6be-3713-4d09-a27e-9ff5938df0a0","Type":"ContainerDied","Data":"b50475997f130636afbbb7a04d23aca7498aaa167d43f2865d4922a286309559"} Aug 04 11:10:39.921532 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:39.921514 2576 scope.go:117] "RemoveContainer" containerID="559221bbaa913d903003fafa5996cb18790c29d97a39e8fb72f96a68b8a0f10d" Aug 04 11:10:39.921802 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:10:39.921783 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"559221bbaa913d903003fafa5996cb18790c29d97a39e8fb72f96a68b8a0f10d\": container with ID starting with 559221bbaa913d903003fafa5996cb18790c29d97a39e8fb72f96a68b8a0f10d not found: ID does not exist" containerID="559221bbaa913d903003fafa5996cb18790c29d97a39e8fb72f96a68b8a0f10d" Aug 04 11:10:39.921866 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:39.921815 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"559221bbaa913d903003fafa5996cb18790c29d97a39e8fb72f96a68b8a0f10d"} err="failed to get container status \"559221bbaa913d903003fafa5996cb18790c29d97a39e8fb72f96a68b8a0f10d\": rpc error: code = NotFound desc = could not find container \"559221bbaa913d903003fafa5996cb18790c29d97a39e8fb72f96a68b8a0f10d\": container with ID starting with 559221bbaa913d903003fafa5996cb18790c29d97a39e8fb72f96a68b8a0f10d not found: ID does not exist" Aug 04 11:10:39.921866 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:39.921835 2576 scope.go:117] "RemoveContainer" containerID="fc0acf6b3c2649b6356532459510cac3997ba550b970ab6104cc7f468b24ae73" Aug 04 11:10:39.935670 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:39.935563 2576 scope.go:117] "RemoveContainer" containerID="fc0acf6b3c2649b6356532459510cac3997ba550b970ab6104cc7f468b24ae73" Aug 04 11:10:39.936081 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:10:39.935974 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc0acf6b3c2649b6356532459510cac3997ba550b970ab6104cc7f468b24ae73\": container with ID starting with fc0acf6b3c2649b6356532459510cac3997ba550b970ab6104cc7f468b24ae73 not found: ID does not exist" containerID="fc0acf6b3c2649b6356532459510cac3997ba550b970ab6104cc7f468b24ae73" Aug 04 11:10:39.936081 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:39.936028 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc0acf6b3c2649b6356532459510cac3997ba550b970ab6104cc7f468b24ae73"} err="failed to get container status \"fc0acf6b3c2649b6356532459510cac3997ba550b970ab6104cc7f468b24ae73\": rpc error: code = NotFound desc = could not find container \"fc0acf6b3c2649b6356532459510cac3997ba550b970ab6104cc7f468b24ae73\": container with ID starting with fc0acf6b3c2649b6356532459510cac3997ba550b970ab6104cc7f468b24ae73 not found: ID does not exist" Aug 04 11:10:40.030956 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:40.030919 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/622a6c97-c480-4bdf-ab7a-2442db928cf7-plugins-config-volume\") pod \"622a6c97-c480-4bdf-ab7a-2442db928cf7\" (UID: \"622a6c97-c480-4bdf-ab7a-2442db928cf7\") " Aug 04 11:10:40.031133 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:40.031040 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/908ae6be-3713-4d09-a27e-9ff5938df0a0-plugins-config-volume\") pod \"908ae6be-3713-4d09-a27e-9ff5938df0a0\" (UID: \"908ae6be-3713-4d09-a27e-9ff5938df0a0\") " Aug 04 11:10:40.031133 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:40.031064 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npklc\" (UniqueName: \"kubernetes.io/projected/908ae6be-3713-4d09-a27e-9ff5938df0a0-kube-api-access-npklc\") pod \"908ae6be-3713-4d09-a27e-9ff5938df0a0\" (UID: \"908ae6be-3713-4d09-a27e-9ff5938df0a0\") " Aug 04 11:10:40.031133 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:40.031104 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6vtb\" (UniqueName: \"kubernetes.io/projected/622a6c97-c480-4bdf-ab7a-2442db928cf7-kube-api-access-v6vtb\") pod \"622a6c97-c480-4bdf-ab7a-2442db928cf7\" (UID: \"622a6c97-c480-4bdf-ab7a-2442db928cf7\") " Aug 04 11:10:40.031383 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:40.031358 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/622a6c97-c480-4bdf-ab7a-2442db928cf7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "622a6c97-c480-4bdf-ab7a-2442db928cf7" (UID: "622a6c97-c480-4bdf-ab7a-2442db928cf7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:10:40.031491 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:40.031469 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/908ae6be-3713-4d09-a27e-9ff5938df0a0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "908ae6be-3713-4d09-a27e-9ff5938df0a0" (UID: "908ae6be-3713-4d09-a27e-9ff5938df0a0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:10:40.033385 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:40.033361 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/908ae6be-3713-4d09-a27e-9ff5938df0a0-kube-api-access-npklc" (OuterVolumeSpecName: "kube-api-access-npklc") pod "908ae6be-3713-4d09-a27e-9ff5938df0a0" (UID: "908ae6be-3713-4d09-a27e-9ff5938df0a0"). InnerVolumeSpecName "kube-api-access-npklc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:10:40.033610 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:40.033582 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/622a6c97-c480-4bdf-ab7a-2442db928cf7-kube-api-access-v6vtb" (OuterVolumeSpecName: "kube-api-access-v6vtb") pod "622a6c97-c480-4bdf-ab7a-2442db928cf7" (UID: "622a6c97-c480-4bdf-ab7a-2442db928cf7"). InnerVolumeSpecName "kube-api-access-v6vtb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:10:40.131949 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:40.131845 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6vtb\" (UniqueName: \"kubernetes.io/projected/622a6c97-c480-4bdf-ab7a-2442db928cf7-kube-api-access-v6vtb\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:10:40.131949 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:40.131880 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/622a6c97-c480-4bdf-ab7a-2442db928cf7-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:10:40.131949 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:40.131893 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/908ae6be-3713-4d09-a27e-9ff5938df0a0-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:10:40.131949 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:40.131903 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npklc\" (UniqueName: \"kubernetes.io/projected/908ae6be-3713-4d09-a27e-9ff5938df0a0-kube-api-access-npklc\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:10:40.236918 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:40.236888 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx"] Aug 04 11:10:40.241292 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:40.241262 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-93c76061-7dd779d6b4-2l2qx"] Aug 04 11:10:40.254639 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:40.254603 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22"] Aug 04 11:10:40.260572 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:40.260533 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-93c76061-8587df9bf-dkb22"] Aug 04 11:10:41.929957 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:41.929915 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="622a6c97-c480-4bdf-ab7a-2442db928cf7" path="/var/lib/kubelet/pods/622a6c97-c480-4bdf-ab7a-2442db928cf7/volumes" Aug 04 11:10:41.930519 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:41.930496 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="908ae6be-3713-4d09-a27e-9ff5938df0a0" path="/var/lib/kubelet/pods/908ae6be-3713-4d09-a27e-9ff5938df0a0/volumes" Aug 04 11:10:44.385011 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.384982 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m"] Aug 04 11:10:44.385369 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.385318 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="622a6c97-c480-4bdf-ab7a-2442db928cf7" containerName="payload-pre-processing" Aug 04 11:10:44.385369 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.385329 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="622a6c97-c480-4bdf-ab7a-2442db928cf7" containerName="payload-pre-processing" Aug 04 11:10:44.385369 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.385351 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="908ae6be-3713-4d09-a27e-9ff5938df0a0" containerName="payload-processing" Aug 04 11:10:44.385369 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.385356 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="908ae6be-3713-4d09-a27e-9ff5938df0a0" containerName="payload-processing" Aug 04 11:10:44.385551 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.385436 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="908ae6be-3713-4d09-a27e-9ff5938df0a0" containerName="payload-processing" Aug 04 11:10:44.385551 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.385445 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="622a6c97-c480-4bdf-ab7a-2442db928cf7" containerName="payload-pre-processing" Aug 04 11:10:44.390752 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.390716 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m" Aug 04 11:10:44.393953 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.393929 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-9269199f-dockercfg-6wr4j\"" Aug 04 11:10:44.394084 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.393980 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-9269199f\"" Aug 04 11:10:44.400689 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.400670 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m"] Aug 04 11:10:44.418182 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.418159 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4"] Aug 04 11:10:44.421288 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.421272 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4" Aug 04 11:10:44.438024 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.438003 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4"] Aug 04 11:10:44.572777 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.572739 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/772f27e5-53df-4719-9754-2501d4e25f70-plugins-config-volume\") pod \"payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4\" (UID: \"772f27e5-53df-4719-9754-2501d4e25f70\") " pod="openshift-ingress/payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4" Aug 04 11:10:44.572966 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.572789 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfdbq\" (UniqueName: \"kubernetes.io/projected/772f27e5-53df-4719-9754-2501d4e25f70-kube-api-access-mfdbq\") pod \"payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4\" (UID: \"772f27e5-53df-4719-9754-2501d4e25f70\") " pod="openshift-ingress/payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4" Aug 04 11:10:44.572966 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.572873 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m\" (UID: \"d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m" Aug 04 11:10:44.572966 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.572931 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9gxf\" (UniqueName: \"kubernetes.io/projected/d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b-kube-api-access-z9gxf\") pod \"payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m\" (UID: \"d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m" Aug 04 11:10:44.673798 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.673725 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9gxf\" (UniqueName: \"kubernetes.io/projected/d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b-kube-api-access-z9gxf\") pod \"payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m\" (UID: \"d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m" Aug 04 11:10:44.673798 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.673773 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/772f27e5-53df-4719-9754-2501d4e25f70-plugins-config-volume\") pod \"payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4\" (UID: \"772f27e5-53df-4719-9754-2501d4e25f70\") " pod="openshift-ingress/payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4" Aug 04 11:10:44.673798 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.673800 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfdbq\" (UniqueName: \"kubernetes.io/projected/772f27e5-53df-4719-9754-2501d4e25f70-kube-api-access-mfdbq\") pod \"payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4\" (UID: \"772f27e5-53df-4719-9754-2501d4e25f70\") " pod="openshift-ingress/payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4" Aug 04 11:10:44.674073 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.673846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m\" (UID: \"d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m" Aug 04 11:10:44.674563 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.674538 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/772f27e5-53df-4719-9754-2501d4e25f70-plugins-config-volume\") pod \"payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4\" (UID: \"772f27e5-53df-4719-9754-2501d4e25f70\") " pod="openshift-ingress/payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4" Aug 04 11:10:44.674662 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.674570 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m\" (UID: \"d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m" Aug 04 11:10:44.683922 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.683898 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9gxf\" (UniqueName: \"kubernetes.io/projected/d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b-kube-api-access-z9gxf\") pod \"payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m\" (UID: \"d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m" Aug 04 11:10:44.684045 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.683899 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfdbq\" (UniqueName: \"kubernetes.io/projected/772f27e5-53df-4719-9754-2501d4e25f70-kube-api-access-mfdbq\") pod \"payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4\" (UID: \"772f27e5-53df-4719-9754-2501d4e25f70\") " pod="openshift-ingress/payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4" Aug 04 11:10:44.702798 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.702775 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m" Aug 04 11:10:44.733577 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.733549 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4" Aug 04 11:10:44.853210 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.853186 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m"] Aug 04 11:10:44.856163 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:10:44.856136 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3877ec0_e2ba_49c3_ae1b_8a26ecedba2b.slice/crio-70ed07a2afd34d94e64f597983bdf5766a3ae3363a7a44192b198984928e2080 WatchSource:0}: Error finding container 70ed07a2afd34d94e64f597983bdf5766a3ae3363a7a44192b198984928e2080: Status 404 returned error can't find the container with id 70ed07a2afd34d94e64f597983bdf5766a3ae3363a7a44192b198984928e2080 Aug 04 11:10:44.888975 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.888950 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4"] Aug 04 11:10:44.892506 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:10:44.892477 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod772f27e5_53df_4719_9754_2501d4e25f70.slice/crio-6a48f0e1dca8b39299cead3557368c3aaabeff748ced4320f3cf5d06839c0e7d WatchSource:0}: Error finding container 6a48f0e1dca8b39299cead3557368c3aaabeff748ced4320f3cf5d06839c0e7d: Status 404 returned error can't find the container with id 6a48f0e1dca8b39299cead3557368c3aaabeff748ced4320f3cf5d06839c0e7d Aug 04 11:10:44.941661 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.941627 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4" event={"ID":"772f27e5-53df-4719-9754-2501d4e25f70","Type":"ContainerStarted","Data":"6a48f0e1dca8b39299cead3557368c3aaabeff748ced4320f3cf5d06839c0e7d"} Aug 04 11:10:44.943343 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.943314 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m" event={"ID":"d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b","Type":"ContainerStarted","Data":"585110b7c8def05d5f49ade4c65027b10a6dc8468e1cdec995abddc9f1f781ce"} Aug 04 11:10:44.943496 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.943356 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m" event={"ID":"d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b","Type":"ContainerStarted","Data":"70ed07a2afd34d94e64f597983bdf5766a3ae3363a7a44192b198984928e2080"} Aug 04 11:10:44.943572 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.943514 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m" Aug 04 11:10:44.971322 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:44.971274 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m" podStartSLOduration=0.971258469 podStartE2EDuration="971.258469ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:10:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:10:44.971088698 +0000 UTC m=+1995.569993074" watchObservedRunningTime="2026-08-04 11:10:44.971258469 +0000 UTC m=+1995.570162843" Aug 04 11:10:45.949104 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:45.949071 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4" event={"ID":"772f27e5-53df-4719-9754-2501d4e25f70","Type":"ContainerStarted","Data":"9c64280a36e05a27ad7e35b6c1d7d1d5e210a7e36f0b6f16d3013aad52fcaa10"} Aug 04 11:10:45.949619 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:45.949315 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4" Aug 04 11:10:45.967474 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:45.967430 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4" podStartSLOduration=1.967414231 podStartE2EDuration="1.967414231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:10:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:10:45.964833507 +0000 UTC m=+1996.563737883" watchObservedRunningTime="2026-08-04 11:10:45.967414231 +0000 UTC m=+1996.566318607" Aug 04 11:10:55.951655 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:55.951620 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m" Aug 04 11:10:56.956042 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:10:56.955937 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4" Aug 04 11:11:24.424088 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:24.424057 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4"] Aug 04 11:11:24.424709 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:24.424293 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4" podUID="772f27e5-53df-4719-9754-2501d4e25f70" containerName="payload-processing" containerID="cri-o://9c64280a36e05a27ad7e35b6c1d7d1d5e210a7e36f0b6f16d3013aad52fcaa10" gracePeriod=30 Aug 04 11:11:24.431200 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:24.431157 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m"] Aug 04 11:11:24.431672 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:24.431640 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m" podUID="d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b" containerName="payload-pre-processing" containerID="cri-o://585110b7c8def05d5f49ade4c65027b10a6dc8468e1cdec995abddc9f1f781ce" gracePeriod=30 Aug 04 11:11:24.741128 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:24.741096 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4" Aug 04 11:11:24.743228 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:24.743208 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m" Aug 04 11:11:24.804189 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:24.804154 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9gxf\" (UniqueName: \"kubernetes.io/projected/d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b-kube-api-access-z9gxf\") pod \"d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b\" (UID: \"d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b\") " Aug 04 11:11:24.804353 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:24.804278 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfdbq\" (UniqueName: \"kubernetes.io/projected/772f27e5-53df-4719-9754-2501d4e25f70-kube-api-access-mfdbq\") pod \"772f27e5-53df-4719-9754-2501d4e25f70\" (UID: \"772f27e5-53df-4719-9754-2501d4e25f70\") " Aug 04 11:11:24.804353 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:24.804336 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/772f27e5-53df-4719-9754-2501d4e25f70-plugins-config-volume\") pod \"772f27e5-53df-4719-9754-2501d4e25f70\" (UID: \"772f27e5-53df-4719-9754-2501d4e25f70\") " Aug 04 11:11:24.804475 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:24.804429 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b-plugins-config-volume\") pod \"d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b\" (UID: \"d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b\") " Aug 04 11:11:24.804777 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:24.804743 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/772f27e5-53df-4719-9754-2501d4e25f70-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "772f27e5-53df-4719-9754-2501d4e25f70" (UID: "772f27e5-53df-4719-9754-2501d4e25f70"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:11:24.804777 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:24.804750 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b" (UID: "d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:11:24.806455 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:24.806431 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/772f27e5-53df-4719-9754-2501d4e25f70-kube-api-access-mfdbq" (OuterVolumeSpecName: "kube-api-access-mfdbq") pod "772f27e5-53df-4719-9754-2501d4e25f70" (UID: "772f27e5-53df-4719-9754-2501d4e25f70"). InnerVolumeSpecName "kube-api-access-mfdbq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:11:24.806583 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:24.806459 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b-kube-api-access-z9gxf" (OuterVolumeSpecName: "kube-api-access-z9gxf") pod "d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b" (UID: "d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b"). InnerVolumeSpecName "kube-api-access-z9gxf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:11:24.905766 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:24.905735 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfdbq\" (UniqueName: \"kubernetes.io/projected/772f27e5-53df-4719-9754-2501d4e25f70-kube-api-access-mfdbq\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:11:24.905766 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:24.905762 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/772f27e5-53df-4719-9754-2501d4e25f70-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:11:24.905766 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:24.905772 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:11:24.905967 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:24.905782 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9gxf\" (UniqueName: \"kubernetes.io/projected/d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b-kube-api-access-z9gxf\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:11:25.138815 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:25.138779 2576 generic.go:356] "Generic (PLEG): container finished" podID="d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b" containerID="585110b7c8def05d5f49ade4c65027b10a6dc8468e1cdec995abddc9f1f781ce" exitCode=0 Aug 04 11:11:25.139027 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:25.138828 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m" Aug 04 11:11:25.139027 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:25.138870 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m" event={"ID":"d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b","Type":"ContainerDied","Data":"585110b7c8def05d5f49ade4c65027b10a6dc8468e1cdec995abddc9f1f781ce"} Aug 04 11:11:25.139027 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:25.138925 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m" event={"ID":"d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b","Type":"ContainerDied","Data":"70ed07a2afd34d94e64f597983bdf5766a3ae3363a7a44192b198984928e2080"} Aug 04 11:11:25.139027 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:25.138951 2576 scope.go:117] "RemoveContainer" containerID="585110b7c8def05d5f49ade4c65027b10a6dc8468e1cdec995abddc9f1f781ce" Aug 04 11:11:25.140351 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:25.140330 2576 generic.go:356] "Generic (PLEG): container finished" podID="772f27e5-53df-4719-9754-2501d4e25f70" containerID="9c64280a36e05a27ad7e35b6c1d7d1d5e210a7e36f0b6f16d3013aad52fcaa10" exitCode=0 Aug 04 11:11:25.140544 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:25.140384 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4" Aug 04 11:11:25.140544 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:25.140388 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4" event={"ID":"772f27e5-53df-4719-9754-2501d4e25f70","Type":"ContainerDied","Data":"9c64280a36e05a27ad7e35b6c1d7d1d5e210a7e36f0b6f16d3013aad52fcaa10"} Aug 04 11:11:25.140544 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:25.140531 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4" event={"ID":"772f27e5-53df-4719-9754-2501d4e25f70","Type":"ContainerDied","Data":"6a48f0e1dca8b39299cead3557368c3aaabeff748ced4320f3cf5d06839c0e7d"} Aug 04 11:11:25.149899 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:25.149881 2576 scope.go:117] "RemoveContainer" containerID="585110b7c8def05d5f49ade4c65027b10a6dc8468e1cdec995abddc9f1f781ce" Aug 04 11:11:25.150210 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:11:25.150164 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"585110b7c8def05d5f49ade4c65027b10a6dc8468e1cdec995abddc9f1f781ce\": container with ID starting with 585110b7c8def05d5f49ade4c65027b10a6dc8468e1cdec995abddc9f1f781ce not found: ID does not exist" containerID="585110b7c8def05d5f49ade4c65027b10a6dc8468e1cdec995abddc9f1f781ce" Aug 04 11:11:25.150320 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:25.150207 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"585110b7c8def05d5f49ade4c65027b10a6dc8468e1cdec995abddc9f1f781ce"} err="failed to get container status \"585110b7c8def05d5f49ade4c65027b10a6dc8468e1cdec995abddc9f1f781ce\": rpc error: code = NotFound desc = could not find container \"585110b7c8def05d5f49ade4c65027b10a6dc8468e1cdec995abddc9f1f781ce\": container with ID starting with 585110b7c8def05d5f49ade4c65027b10a6dc8468e1cdec995abddc9f1f781ce not found: ID does not exist" Aug 04 11:11:25.150320 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:25.150230 2576 scope.go:117] "RemoveContainer" containerID="9c64280a36e05a27ad7e35b6c1d7d1d5e210a7e36f0b6f16d3013aad52fcaa10" Aug 04 11:11:25.158771 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:25.158752 2576 scope.go:117] "RemoveContainer" containerID="9c64280a36e05a27ad7e35b6c1d7d1d5e210a7e36f0b6f16d3013aad52fcaa10" Aug 04 11:11:25.159022 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:11:25.159003 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c64280a36e05a27ad7e35b6c1d7d1d5e210a7e36f0b6f16d3013aad52fcaa10\": container with ID starting with 9c64280a36e05a27ad7e35b6c1d7d1d5e210a7e36f0b6f16d3013aad52fcaa10 not found: ID does not exist" containerID="9c64280a36e05a27ad7e35b6c1d7d1d5e210a7e36f0b6f16d3013aad52fcaa10" Aug 04 11:11:25.159087 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:25.159035 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c64280a36e05a27ad7e35b6c1d7d1d5e210a7e36f0b6f16d3013aad52fcaa10"} err="failed to get container status \"9c64280a36e05a27ad7e35b6c1d7d1d5e210a7e36f0b6f16d3013aad52fcaa10\": rpc error: code = NotFound desc = could not find container \"9c64280a36e05a27ad7e35b6c1d7d1d5e210a7e36f0b6f16d3013aad52fcaa10\": container with ID starting with 9c64280a36e05a27ad7e35b6c1d7d1d5e210a7e36f0b6f16d3013aad52fcaa10 not found: ID does not exist" Aug 04 11:11:25.166381 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:25.166360 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m"] Aug 04 11:11:25.172465 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:25.172440 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9269199f-747d7c6964-gcl7m"] Aug 04 11:11:25.184088 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:25.184063 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4"] Aug 04 11:11:25.186227 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:25.186204 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9269199f-fb5d9bdf8-9kfr4"] Aug 04 11:11:25.928781 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:25.928752 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="772f27e5-53df-4719-9754-2501d4e25f70" path="/var/lib/kubelet/pods/772f27e5-53df-4719-9754-2501d4e25f70/volumes" Aug 04 11:11:25.929145 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:25.929098 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b" path="/var/lib/kubelet/pods/d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b/volumes" Aug 04 11:11:30.737478 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:30.737443 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn"] Aug 04 11:11:30.737832 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:30.737822 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="772f27e5-53df-4719-9754-2501d4e25f70" containerName="payload-processing" Aug 04 11:11:30.737872 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:30.737834 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="772f27e5-53df-4719-9754-2501d4e25f70" containerName="payload-processing" Aug 04 11:11:30.737872 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:30.737845 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b" containerName="payload-pre-processing" Aug 04 11:11:30.737872 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:30.737851 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b" containerName="payload-pre-processing" Aug 04 11:11:30.737971 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:30.737904 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3877ec0-e2ba-49c3-ae1b-8a26ecedba2b" containerName="payload-pre-processing" Aug 04 11:11:30.737971 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:30.737913 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="772f27e5-53df-4719-9754-2501d4e25f70" containerName="payload-processing" Aug 04 11:11:30.742344 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:30.742328 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn" Aug 04 11:11:30.745201 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:30.745182 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-dfeef193\"" Aug 04 11:11:30.745342 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:30.745250 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-dfeef193-dockercfg-6mspn\"" Aug 04 11:11:30.752551 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:30.752527 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn"] Aug 04 11:11:30.771447 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:30.771415 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-dfeef193-7d998d566-zpl68"] Aug 04 11:11:30.774612 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:30.774597 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-dfeef193-7d998d566-zpl68" Aug 04 11:11:30.787417 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:30.787380 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-dfeef193-7d998d566-zpl68"] Aug 04 11:11:30.862884 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:30.862853 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gw2s\" (UniqueName: \"kubernetes.io/projected/a416feec-82f4-4a81-b12e-e93be4b13653-kube-api-access-2gw2s\") pod \"payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn\" (UID: \"a416feec-82f4-4a81-b12e-e93be4b13653\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn" Aug 04 11:11:30.862884 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:30.862891 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tjh4\" (UniqueName: \"kubernetes.io/projected/6fdd68a7-cfbd-4db9-af9b-6edd9d138223-kube-api-access-4tjh4\") pod \"payload-processing-e2e-derive-dfeef193-7d998d566-zpl68\" (UID: \"6fdd68a7-cfbd-4db9-af9b-6edd9d138223\") " pod="openshift-ingress/payload-processing-e2e-derive-dfeef193-7d998d566-zpl68" Aug 04 11:11:30.863074 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:30.863051 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a416feec-82f4-4a81-b12e-e93be4b13653-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn\" (UID: \"a416feec-82f4-4a81-b12e-e93be4b13653\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn" Aug 04 11:11:30.863127 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:30.863093 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fdd68a7-cfbd-4db9-af9b-6edd9d138223-plugins-config-volume\") pod \"payload-processing-e2e-derive-dfeef193-7d998d566-zpl68\" (UID: \"6fdd68a7-cfbd-4db9-af9b-6edd9d138223\") " pod="openshift-ingress/payload-processing-e2e-derive-dfeef193-7d998d566-zpl68" Aug 04 11:11:30.963716 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:30.963688 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a416feec-82f4-4a81-b12e-e93be4b13653-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn\" (UID: \"a416feec-82f4-4a81-b12e-e93be4b13653\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn" Aug 04 11:11:30.963855 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:30.963722 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fdd68a7-cfbd-4db9-af9b-6edd9d138223-plugins-config-volume\") pod \"payload-processing-e2e-derive-dfeef193-7d998d566-zpl68\" (UID: \"6fdd68a7-cfbd-4db9-af9b-6edd9d138223\") " pod="openshift-ingress/payload-processing-e2e-derive-dfeef193-7d998d566-zpl68" Aug 04 11:11:30.963855 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:30.963748 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gw2s\" (UniqueName: \"kubernetes.io/projected/a416feec-82f4-4a81-b12e-e93be4b13653-kube-api-access-2gw2s\") pod \"payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn\" (UID: \"a416feec-82f4-4a81-b12e-e93be4b13653\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn" Aug 04 11:11:30.963855 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:30.963764 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tjh4\" (UniqueName: \"kubernetes.io/projected/6fdd68a7-cfbd-4db9-af9b-6edd9d138223-kube-api-access-4tjh4\") pod \"payload-processing-e2e-derive-dfeef193-7d998d566-zpl68\" (UID: \"6fdd68a7-cfbd-4db9-af9b-6edd9d138223\") " pod="openshift-ingress/payload-processing-e2e-derive-dfeef193-7d998d566-zpl68" Aug 04 11:11:30.964418 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:30.964381 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a416feec-82f4-4a81-b12e-e93be4b13653-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn\" (UID: \"a416feec-82f4-4a81-b12e-e93be4b13653\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn" Aug 04 11:11:30.964465 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:30.964440 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fdd68a7-cfbd-4db9-af9b-6edd9d138223-plugins-config-volume\") pod \"payload-processing-e2e-derive-dfeef193-7d998d566-zpl68\" (UID: \"6fdd68a7-cfbd-4db9-af9b-6edd9d138223\") " pod="openshift-ingress/payload-processing-e2e-derive-dfeef193-7d998d566-zpl68" Aug 04 11:11:30.977583 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:30.977559 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gw2s\" (UniqueName: \"kubernetes.io/projected/a416feec-82f4-4a81-b12e-e93be4b13653-kube-api-access-2gw2s\") pod \"payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn\" (UID: \"a416feec-82f4-4a81-b12e-e93be4b13653\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn" Aug 04 11:11:30.977926 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:30.977907 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tjh4\" (UniqueName: \"kubernetes.io/projected/6fdd68a7-cfbd-4db9-af9b-6edd9d138223-kube-api-access-4tjh4\") pod \"payload-processing-e2e-derive-dfeef193-7d998d566-zpl68\" (UID: \"6fdd68a7-cfbd-4db9-af9b-6edd9d138223\") " pod="openshift-ingress/payload-processing-e2e-derive-dfeef193-7d998d566-zpl68" Aug 04 11:11:31.053802 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:31.053774 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn" Aug 04 11:11:31.084061 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:31.084036 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-dfeef193-7d998d566-zpl68" Aug 04 11:11:31.236901 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:31.236875 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-dfeef193-7d998d566-zpl68"] Aug 04 11:11:31.238690 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:11:31.238668 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fdd68a7_cfbd_4db9_af9b_6edd9d138223.slice/crio-04256a904904ddf72829f937f8878900010a25b35f9252df3ec5d31e124d110c WatchSource:0}: Error finding container 04256a904904ddf72829f937f8878900010a25b35f9252df3ec5d31e124d110c: Status 404 returned error can't find the container with id 04256a904904ddf72829f937f8878900010a25b35f9252df3ec5d31e124d110c Aug 04 11:11:31.415582 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:31.415499 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn"] Aug 04 11:11:31.417721 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:11:31.417694 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda416feec_82f4_4a81_b12e_e93be4b13653.slice/crio-4386c035456ef497bf30bb02346970ccb226f03183613d5586bb969c508461b3 WatchSource:0}: Error finding container 4386c035456ef497bf30bb02346970ccb226f03183613d5586bb969c508461b3: Status 404 returned error can't find the container with id 4386c035456ef497bf30bb02346970ccb226f03183613d5586bb969c508461b3 Aug 04 11:11:32.179247 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:32.179209 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-dfeef193-7d998d566-zpl68" event={"ID":"6fdd68a7-cfbd-4db9-af9b-6edd9d138223","Type":"ContainerStarted","Data":"1103613800d986bf8f5063752c98732eb13c07ea777ca9346b07160ee7e84713"} Aug 04 11:11:32.179715 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:32.179273 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-dfeef193-7d998d566-zpl68" event={"ID":"6fdd68a7-cfbd-4db9-af9b-6edd9d138223","Type":"ContainerStarted","Data":"04256a904904ddf72829f937f8878900010a25b35f9252df3ec5d31e124d110c"} Aug 04 11:11:32.179715 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:32.179305 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-dfeef193-7d998d566-zpl68" Aug 04 11:11:32.180853 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:32.180831 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn" event={"ID":"a416feec-82f4-4a81-b12e-e93be4b13653","Type":"ContainerStarted","Data":"f3e3e8d8f5bad371dfc2c2aeb3c14ac3c963e0bcaf23187b0df16e9c93a52cb8"} Aug 04 11:11:32.180940 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:32.180875 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn" event={"ID":"a416feec-82f4-4a81-b12e-e93be4b13653","Type":"ContainerStarted","Data":"4386c035456ef497bf30bb02346970ccb226f03183613d5586bb969c508461b3"} Aug 04 11:11:32.180940 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:32.180908 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn" Aug 04 11:11:32.197978 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:32.197938 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-dfeef193-7d998d566-zpl68" podStartSLOduration=2.197924368 podStartE2EDuration="2.197924368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:11:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:11:32.196554157 +0000 UTC m=+2042.795458534" watchObservedRunningTime="2026-08-04 11:11:32.197924368 +0000 UTC m=+2042.796828742" Aug 04 11:11:32.214416 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:32.214347 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn" podStartSLOduration=2.214331185 podStartE2EDuration="2.214331185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:11:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:11:32.213994439 +0000 UTC m=+2042.812898835" watchObservedRunningTime="2026-08-04 11:11:32.214331185 +0000 UTC m=+2042.813235561" Aug 04 11:11:43.188315 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:43.188281 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-dfeef193-7d998d566-zpl68" Aug 04 11:11:43.188721 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:11:43.188442 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn" Aug 04 11:12:00.752170 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:00.752134 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-dfeef193-7d998d566-zpl68"] Aug 04 11:12:00.752753 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:00.752438 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-dfeef193-7d998d566-zpl68" podUID="6fdd68a7-cfbd-4db9-af9b-6edd9d138223" containerName="payload-processing" containerID="cri-o://1103613800d986bf8f5063752c98732eb13c07ea777ca9346b07160ee7e84713" gracePeriod=30 Aug 04 11:12:00.758913 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:00.758887 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn"] Aug 04 11:12:00.759150 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:00.759106 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn" podUID="a416feec-82f4-4a81-b12e-e93be4b13653" containerName="payload-pre-processing" containerID="cri-o://f3e3e8d8f5bad371dfc2c2aeb3c14ac3c963e0bcaf23187b0df16e9c93a52cb8" gracePeriod=30 Aug 04 11:12:01.019152 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.019070 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-dfeef193-7d998d566-zpl68" Aug 04 11:12:01.053406 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.053362 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn" Aug 04 11:12:01.134063 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.134026 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a416feec-82f4-4a81-b12e-e93be4b13653-plugins-config-volume\") pod \"a416feec-82f4-4a81-b12e-e93be4b13653\" (UID: \"a416feec-82f4-4a81-b12e-e93be4b13653\") " Aug 04 11:12:01.134265 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.134150 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gw2s\" (UniqueName: \"kubernetes.io/projected/a416feec-82f4-4a81-b12e-e93be4b13653-kube-api-access-2gw2s\") pod \"a416feec-82f4-4a81-b12e-e93be4b13653\" (UID: \"a416feec-82f4-4a81-b12e-e93be4b13653\") " Aug 04 11:12:01.134265 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.134182 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tjh4\" (UniqueName: \"kubernetes.io/projected/6fdd68a7-cfbd-4db9-af9b-6edd9d138223-kube-api-access-4tjh4\") pod \"6fdd68a7-cfbd-4db9-af9b-6edd9d138223\" (UID: \"6fdd68a7-cfbd-4db9-af9b-6edd9d138223\") " Aug 04 11:12:01.134265 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.134223 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fdd68a7-cfbd-4db9-af9b-6edd9d138223-plugins-config-volume\") pod \"6fdd68a7-cfbd-4db9-af9b-6edd9d138223\" (UID: \"6fdd68a7-cfbd-4db9-af9b-6edd9d138223\") " Aug 04 11:12:01.134486 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.134433 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a416feec-82f4-4a81-b12e-e93be4b13653-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a416feec-82f4-4a81-b12e-e93be4b13653" (UID: "a416feec-82f4-4a81-b12e-e93be4b13653"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:12:01.134588 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.134571 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a416feec-82f4-4a81-b12e-e93be4b13653-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:12:01.134654 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.134634 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fdd68a7-cfbd-4db9-af9b-6edd9d138223-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6fdd68a7-cfbd-4db9-af9b-6edd9d138223" (UID: "6fdd68a7-cfbd-4db9-af9b-6edd9d138223"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:12:01.136709 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.136681 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a416feec-82f4-4a81-b12e-e93be4b13653-kube-api-access-2gw2s" (OuterVolumeSpecName: "kube-api-access-2gw2s") pod "a416feec-82f4-4a81-b12e-e93be4b13653" (UID: "a416feec-82f4-4a81-b12e-e93be4b13653"). InnerVolumeSpecName "kube-api-access-2gw2s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:12:01.136709 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.136704 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fdd68a7-cfbd-4db9-af9b-6edd9d138223-kube-api-access-4tjh4" (OuterVolumeSpecName: "kube-api-access-4tjh4") pod "6fdd68a7-cfbd-4db9-af9b-6edd9d138223" (UID: "6fdd68a7-cfbd-4db9-af9b-6edd9d138223"). InnerVolumeSpecName "kube-api-access-4tjh4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:12:01.235572 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.235531 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fdd68a7-cfbd-4db9-af9b-6edd9d138223-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:12:01.235572 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.235564 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gw2s\" (UniqueName: \"kubernetes.io/projected/a416feec-82f4-4a81-b12e-e93be4b13653-kube-api-access-2gw2s\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:12:01.235572 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.235577 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tjh4\" (UniqueName: \"kubernetes.io/projected/6fdd68a7-cfbd-4db9-af9b-6edd9d138223-kube-api-access-4tjh4\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:12:01.324729 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.324631 2576 generic.go:356] "Generic (PLEG): container finished" podID="6fdd68a7-cfbd-4db9-af9b-6edd9d138223" containerID="1103613800d986bf8f5063752c98732eb13c07ea777ca9346b07160ee7e84713" exitCode=0 Aug 04 11:12:01.324729 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.324693 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-dfeef193-7d998d566-zpl68" Aug 04 11:12:01.324729 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.324716 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-dfeef193-7d998d566-zpl68" event={"ID":"6fdd68a7-cfbd-4db9-af9b-6edd9d138223","Type":"ContainerDied","Data":"1103613800d986bf8f5063752c98732eb13c07ea777ca9346b07160ee7e84713"} Aug 04 11:12:01.325008 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.324780 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-dfeef193-7d998d566-zpl68" event={"ID":"6fdd68a7-cfbd-4db9-af9b-6edd9d138223","Type":"ContainerDied","Data":"04256a904904ddf72829f937f8878900010a25b35f9252df3ec5d31e124d110c"} Aug 04 11:12:01.325008 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.324813 2576 scope.go:117] "RemoveContainer" containerID="1103613800d986bf8f5063752c98732eb13c07ea777ca9346b07160ee7e84713" Aug 04 11:12:01.326073 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.326042 2576 generic.go:356] "Generic (PLEG): container finished" podID="a416feec-82f4-4a81-b12e-e93be4b13653" containerID="f3e3e8d8f5bad371dfc2c2aeb3c14ac3c963e0bcaf23187b0df16e9c93a52cb8" exitCode=0 Aug 04 11:12:01.326197 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.326113 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn" event={"ID":"a416feec-82f4-4a81-b12e-e93be4b13653","Type":"ContainerDied","Data":"f3e3e8d8f5bad371dfc2c2aeb3c14ac3c963e0bcaf23187b0df16e9c93a52cb8"} Aug 04 11:12:01.326197 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.326140 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn" Aug 04 11:12:01.326197 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.326152 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn" event={"ID":"a416feec-82f4-4a81-b12e-e93be4b13653","Type":"ContainerDied","Data":"4386c035456ef497bf30bb02346970ccb226f03183613d5586bb969c508461b3"} Aug 04 11:12:01.334632 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.334615 2576 scope.go:117] "RemoveContainer" containerID="1103613800d986bf8f5063752c98732eb13c07ea777ca9346b07160ee7e84713" Aug 04 11:12:01.334889 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:12:01.334868 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1103613800d986bf8f5063752c98732eb13c07ea777ca9346b07160ee7e84713\": container with ID starting with 1103613800d986bf8f5063752c98732eb13c07ea777ca9346b07160ee7e84713 not found: ID does not exist" containerID="1103613800d986bf8f5063752c98732eb13c07ea777ca9346b07160ee7e84713" Aug 04 11:12:01.334983 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.334897 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1103613800d986bf8f5063752c98732eb13c07ea777ca9346b07160ee7e84713"} err="failed to get container status \"1103613800d986bf8f5063752c98732eb13c07ea777ca9346b07160ee7e84713\": rpc error: code = NotFound desc = could not find container \"1103613800d986bf8f5063752c98732eb13c07ea777ca9346b07160ee7e84713\": container with ID starting with 1103613800d986bf8f5063752c98732eb13c07ea777ca9346b07160ee7e84713 not found: ID does not exist" Aug 04 11:12:01.334983 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.334914 2576 scope.go:117] "RemoveContainer" containerID="f3e3e8d8f5bad371dfc2c2aeb3c14ac3c963e0bcaf23187b0df16e9c93a52cb8" Aug 04 11:12:01.345801 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.345780 2576 scope.go:117] "RemoveContainer" containerID="f3e3e8d8f5bad371dfc2c2aeb3c14ac3c963e0bcaf23187b0df16e9c93a52cb8" Aug 04 11:12:01.346088 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:12:01.346059 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3e3e8d8f5bad371dfc2c2aeb3c14ac3c963e0bcaf23187b0df16e9c93a52cb8\": container with ID starting with f3e3e8d8f5bad371dfc2c2aeb3c14ac3c963e0bcaf23187b0df16e9c93a52cb8 not found: ID does not exist" containerID="f3e3e8d8f5bad371dfc2c2aeb3c14ac3c963e0bcaf23187b0df16e9c93a52cb8" Aug 04 11:12:01.346186 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.346098 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3e3e8d8f5bad371dfc2c2aeb3c14ac3c963e0bcaf23187b0df16e9c93a52cb8"} err="failed to get container status \"f3e3e8d8f5bad371dfc2c2aeb3c14ac3c963e0bcaf23187b0df16e9c93a52cb8\": rpc error: code = NotFound desc = could not find container \"f3e3e8d8f5bad371dfc2c2aeb3c14ac3c963e0bcaf23187b0df16e9c93a52cb8\": container with ID starting with f3e3e8d8f5bad371dfc2c2aeb3c14ac3c963e0bcaf23187b0df16e9c93a52cb8 not found: ID does not exist" Aug 04 11:12:01.354244 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.354220 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-dfeef193-7d998d566-zpl68"] Aug 04 11:12:01.358177 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.358150 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-dfeef193-7d998d566-zpl68"] Aug 04 11:12:01.369603 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.369559 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn"] Aug 04 11:12:01.373109 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.373081 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-dfeef193-ff47dc75b-tjsqn"] Aug 04 11:12:01.929550 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.929519 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fdd68a7-cfbd-4db9-af9b-6edd9d138223" path="/var/lib/kubelet/pods/6fdd68a7-cfbd-4db9-af9b-6edd9d138223/volumes" Aug 04 11:12:01.929939 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:01.929916 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a416feec-82f4-4a81-b12e-e93be4b13653" path="/var/lib/kubelet/pods/a416feec-82f4-4a81-b12e-e93be4b13653/volumes" Aug 04 11:12:29.963496 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:29.963461 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 11:12:29.966374 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:12:29.966344 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 11:14:05.994525 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:05.994495 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc"] Aug 04 11:14:05.994983 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:05.994831 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a416feec-82f4-4a81-b12e-e93be4b13653" containerName="payload-pre-processing" Aug 04 11:14:05.994983 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:05.994842 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a416feec-82f4-4a81-b12e-e93be4b13653" containerName="payload-pre-processing" Aug 04 11:14:05.994983 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:05.994851 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fdd68a7-cfbd-4db9-af9b-6edd9d138223" containerName="payload-processing" Aug 04 11:14:05.994983 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:05.994857 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fdd68a7-cfbd-4db9-af9b-6edd9d138223" containerName="payload-processing" Aug 04 11:14:05.994983 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:05.994927 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fdd68a7-cfbd-4db9-af9b-6edd9d138223" containerName="payload-processing" Aug 04 11:14:05.994983 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:05.994937 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a416feec-82f4-4a81-b12e-e93be4b13653" containerName="payload-pre-processing" Aug 04 11:14:05.997899 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:05.997881 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc" Aug 04 11:14:06.000697 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.000677 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-7d02d259-dockercfg-2c2hz\"" Aug 04 11:14:06.001050 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.001035 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-7d02d259\"" Aug 04 11:14:06.010578 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.010553 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc"] Aug 04 11:14:06.050584 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.050555 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5260dc28-73d7-4df4-af19-6c13c564c03f-plugins-config-volume\") pod \"payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc\" (UID: \"5260dc28-73d7-4df4-af19-6c13c564c03f\") " pod="openshift-ingress/payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc" Aug 04 11:14:06.050746 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.050676 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xbcq\" (UniqueName: \"kubernetes.io/projected/5260dc28-73d7-4df4-af19-6c13c564c03f-kube-api-access-4xbcq\") pod \"payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc\" (UID: \"5260dc28-73d7-4df4-af19-6c13c564c03f\") " pod="openshift-ingress/payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc" Aug 04 11:14:06.053285 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.053260 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj"] Aug 04 11:14:06.056632 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.056617 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj" Aug 04 11:14:06.067530 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.067506 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj"] Aug 04 11:14:06.151306 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.151270 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9fbm\" (UniqueName: \"kubernetes.io/projected/bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa-kube-api-access-b9fbm\") pod \"payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj\" (UID: \"bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj" Aug 04 11:14:06.151487 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.151327 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5260dc28-73d7-4df4-af19-6c13c564c03f-plugins-config-volume\") pod \"payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc\" (UID: \"5260dc28-73d7-4df4-af19-6c13c564c03f\") " pod="openshift-ingress/payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc" Aug 04 11:14:06.151487 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.151438 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj\" (UID: \"bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj" Aug 04 11:14:06.151487 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.151465 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xbcq\" (UniqueName: \"kubernetes.io/projected/5260dc28-73d7-4df4-af19-6c13c564c03f-kube-api-access-4xbcq\") pod \"payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc\" (UID: \"5260dc28-73d7-4df4-af19-6c13c564c03f\") " pod="openshift-ingress/payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc" Aug 04 11:14:06.151976 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.151957 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5260dc28-73d7-4df4-af19-6c13c564c03f-plugins-config-volume\") pod \"payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc\" (UID: \"5260dc28-73d7-4df4-af19-6c13c564c03f\") " pod="openshift-ingress/payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc" Aug 04 11:14:06.160196 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.160174 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xbcq\" (UniqueName: \"kubernetes.io/projected/5260dc28-73d7-4df4-af19-6c13c564c03f-kube-api-access-4xbcq\") pod \"payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc\" (UID: \"5260dc28-73d7-4df4-af19-6c13c564c03f\") " pod="openshift-ingress/payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc" Aug 04 11:14:06.252310 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.252229 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj\" (UID: \"bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj" Aug 04 11:14:06.252310 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.252297 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9fbm\" (UniqueName: \"kubernetes.io/projected/bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa-kube-api-access-b9fbm\") pod \"payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj\" (UID: \"bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj" Aug 04 11:14:06.252915 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.252895 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj\" (UID: \"bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj" Aug 04 11:14:06.260564 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.260537 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9fbm\" (UniqueName: \"kubernetes.io/projected/bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa-kube-api-access-b9fbm\") pod \"payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj\" (UID: \"bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj" Aug 04 11:14:06.308349 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.308315 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc" Aug 04 11:14:06.367958 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.367925 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj" Aug 04 11:14:06.513582 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.513551 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj"] Aug 04 11:14:06.515429 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:14:06.515380 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc7aa219_64a9_4cb0_b4c0_97a91f9fe2aa.slice/crio-27a506f6ca6b2b9f6d85d450f68c54cecd4ab6b49e665d567723004737f646ba WatchSource:0}: Error finding container 27a506f6ca6b2b9f6d85d450f68c54cecd4ab6b49e665d567723004737f646ba: Status 404 returned error can't find the container with id 27a506f6ca6b2b9f6d85d450f68c54cecd4ab6b49e665d567723004737f646ba Aug 04 11:14:06.655999 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.655971 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc"] Aug 04 11:14:06.658426 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:14:06.658370 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5260dc28_73d7_4df4_af19_6c13c564c03f.slice/crio-68af5451d9669102baf8e48bdbaed6d1502b821d5671c3599e6cec7d00ecc82b WatchSource:0}: Error finding container 68af5451d9669102baf8e48bdbaed6d1502b821d5671c3599e6cec7d00ecc82b: Status 404 returned error can't find the container with id 68af5451d9669102baf8e48bdbaed6d1502b821d5671c3599e6cec7d00ecc82b Aug 04 11:14:06.917225 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.917132 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc" event={"ID":"5260dc28-73d7-4df4-af19-6c13c564c03f","Type":"ContainerStarted","Data":"a54951d494e1c685909316e49770b53648378338639c13d36dd86f3db2b945ab"} Aug 04 11:14:06.917225 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.917192 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc" event={"ID":"5260dc28-73d7-4df4-af19-6c13c564c03f","Type":"ContainerStarted","Data":"68af5451d9669102baf8e48bdbaed6d1502b821d5671c3599e6cec7d00ecc82b"} Aug 04 11:14:06.917225 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.917226 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc" Aug 04 11:14:06.918565 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.918542 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj" event={"ID":"bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa","Type":"ContainerStarted","Data":"cc67c83dae66f16fcf2bfe1e7d3f2460784e10b5e6b7781beedbf4c6c44ad5eb"} Aug 04 11:14:06.918672 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.918581 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj" event={"ID":"bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa","Type":"ContainerStarted","Data":"27a506f6ca6b2b9f6d85d450f68c54cecd4ab6b49e665d567723004737f646ba"} Aug 04 11:14:06.918672 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.918661 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj" Aug 04 11:14:06.936107 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.936063 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc" podStartSLOduration=1.93604938 podStartE2EDuration="1.93604938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:14:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:14:06.93423603 +0000 UTC m=+2197.533140432" watchObservedRunningTime="2026-08-04 11:14:06.93604938 +0000 UTC m=+2197.534953753" Aug 04 11:14:06.957049 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:06.956994 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj" podStartSLOduration=0.956975532 podStartE2EDuration="956.975532ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:14:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:14:06.954707827 +0000 UTC m=+2197.553612226" watchObservedRunningTime="2026-08-04 11:14:06.956975532 +0000 UTC m=+2197.555879907" Aug 04 11:14:17.929583 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:17.929548 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj" Aug 04 11:14:17.930001 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:17.929626 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc" Aug 04 11:14:47.779188 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:47.779153 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc"] Aug 04 11:14:47.779815 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:47.779411 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc" podUID="5260dc28-73d7-4df4-af19-6c13c564c03f" containerName="payload-processing" containerID="cri-o://a54951d494e1c685909316e49770b53648378338639c13d36dd86f3db2b945ab" gracePeriod=30 Aug 04 11:14:47.786991 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:47.786960 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj"] Aug 04 11:14:47.787267 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:47.787176 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj" podUID="bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa" containerName="payload-pre-processing" containerID="cri-o://cc67c83dae66f16fcf2bfe1e7d3f2460784e10b5e6b7781beedbf4c6c44ad5eb" gracePeriod=30 Aug 04 11:14:47.924206 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:47.924123 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj" podUID="bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.47:9004: connect: connection refused" Aug 04 11:14:47.924503 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:47.924123 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc" podUID="5260dc28-73d7-4df4-af19-6c13c564c03f" containerName="payload-processing" probeResult="failure" output="dial tcp 10.134.0.46:9004: connect: connection refused" Aug 04 11:14:48.064348 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.064325 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc" Aug 04 11:14:48.068474 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.068447 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj" Aug 04 11:14:48.122305 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.122265 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xbcq\" (UniqueName: \"kubernetes.io/projected/5260dc28-73d7-4df4-af19-6c13c564c03f-kube-api-access-4xbcq\") pod \"5260dc28-73d7-4df4-af19-6c13c564c03f\" (UID: \"5260dc28-73d7-4df4-af19-6c13c564c03f\") " Aug 04 11:14:48.122488 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.122321 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9fbm\" (UniqueName: \"kubernetes.io/projected/bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa-kube-api-access-b9fbm\") pod \"bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa\" (UID: \"bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa\") " Aug 04 11:14:48.122488 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.122360 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa-plugins-config-volume\") pod \"bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa\" (UID: \"bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa\") " Aug 04 11:14:48.122488 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.122425 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5260dc28-73d7-4df4-af19-6c13c564c03f-plugins-config-volume\") pod \"5260dc28-73d7-4df4-af19-6c13c564c03f\" (UID: \"5260dc28-73d7-4df4-af19-6c13c564c03f\") " Aug 04 11:14:48.122778 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.122755 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa" (UID: "bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:14:48.122855 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.122831 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5260dc28-73d7-4df4-af19-6c13c564c03f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5260dc28-73d7-4df4-af19-6c13c564c03f" (UID: "5260dc28-73d7-4df4-af19-6c13c564c03f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:14:48.124674 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.124650 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5260dc28-73d7-4df4-af19-6c13c564c03f-kube-api-access-4xbcq" (OuterVolumeSpecName: "kube-api-access-4xbcq") pod "5260dc28-73d7-4df4-af19-6c13c564c03f" (UID: "5260dc28-73d7-4df4-af19-6c13c564c03f"). InnerVolumeSpecName "kube-api-access-4xbcq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:14:48.125030 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.125008 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa-kube-api-access-b9fbm" (OuterVolumeSpecName: "kube-api-access-b9fbm") pod "bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa" (UID: "bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa"). InnerVolumeSpecName "kube-api-access-b9fbm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:14:48.130858 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.130825 2576 generic.go:356] "Generic (PLEG): container finished" podID="5260dc28-73d7-4df4-af19-6c13c564c03f" containerID="a54951d494e1c685909316e49770b53648378338639c13d36dd86f3db2b945ab" exitCode=0 Aug 04 11:14:48.130990 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.130875 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc" Aug 04 11:14:48.130990 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.130903 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc" event={"ID":"5260dc28-73d7-4df4-af19-6c13c564c03f","Type":"ContainerDied","Data":"a54951d494e1c685909316e49770b53648378338639c13d36dd86f3db2b945ab"} Aug 04 11:14:48.130990 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.130960 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc" event={"ID":"5260dc28-73d7-4df4-af19-6c13c564c03f","Type":"ContainerDied","Data":"68af5451d9669102baf8e48bdbaed6d1502b821d5671c3599e6cec7d00ecc82b"} Aug 04 11:14:48.130990 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.130982 2576 scope.go:117] "RemoveContainer" containerID="a54951d494e1c685909316e49770b53648378338639c13d36dd86f3db2b945ab" Aug 04 11:14:48.132235 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.132214 2576 generic.go:356] "Generic (PLEG): container finished" podID="bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa" containerID="cc67c83dae66f16fcf2bfe1e7d3f2460784e10b5e6b7781beedbf4c6c44ad5eb" exitCode=0 Aug 04 11:14:48.132337 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.132249 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj" event={"ID":"bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa","Type":"ContainerDied","Data":"cc67c83dae66f16fcf2bfe1e7d3f2460784e10b5e6b7781beedbf4c6c44ad5eb"} Aug 04 11:14:48.132337 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.132251 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj" Aug 04 11:14:48.132337 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.132289 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj" event={"ID":"bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa","Type":"ContainerDied","Data":"27a506f6ca6b2b9f6d85d450f68c54cecd4ab6b49e665d567723004737f646ba"} Aug 04 11:14:48.141332 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.141314 2576 scope.go:117] "RemoveContainer" containerID="a54951d494e1c685909316e49770b53648378338639c13d36dd86f3db2b945ab" Aug 04 11:14:48.141628 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:14:48.141610 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a54951d494e1c685909316e49770b53648378338639c13d36dd86f3db2b945ab\": container with ID starting with a54951d494e1c685909316e49770b53648378338639c13d36dd86f3db2b945ab not found: ID does not exist" containerID="a54951d494e1c685909316e49770b53648378338639c13d36dd86f3db2b945ab" Aug 04 11:14:48.141685 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.141637 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a54951d494e1c685909316e49770b53648378338639c13d36dd86f3db2b945ab"} err="failed to get container status \"a54951d494e1c685909316e49770b53648378338639c13d36dd86f3db2b945ab\": rpc error: code = NotFound desc = could not find container \"a54951d494e1c685909316e49770b53648378338639c13d36dd86f3db2b945ab\": container with ID starting with a54951d494e1c685909316e49770b53648378338639c13d36dd86f3db2b945ab not found: ID does not exist" Aug 04 11:14:48.141685 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.141654 2576 scope.go:117] "RemoveContainer" containerID="cc67c83dae66f16fcf2bfe1e7d3f2460784e10b5e6b7781beedbf4c6c44ad5eb" Aug 04 11:14:48.149803 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.149782 2576 scope.go:117] "RemoveContainer" containerID="cc67c83dae66f16fcf2bfe1e7d3f2460784e10b5e6b7781beedbf4c6c44ad5eb" Aug 04 11:14:48.150055 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:14:48.150035 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc67c83dae66f16fcf2bfe1e7d3f2460784e10b5e6b7781beedbf4c6c44ad5eb\": container with ID starting with cc67c83dae66f16fcf2bfe1e7d3f2460784e10b5e6b7781beedbf4c6c44ad5eb not found: ID does not exist" containerID="cc67c83dae66f16fcf2bfe1e7d3f2460784e10b5e6b7781beedbf4c6c44ad5eb" Aug 04 11:14:48.150099 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.150063 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc67c83dae66f16fcf2bfe1e7d3f2460784e10b5e6b7781beedbf4c6c44ad5eb"} err="failed to get container status \"cc67c83dae66f16fcf2bfe1e7d3f2460784e10b5e6b7781beedbf4c6c44ad5eb\": rpc error: code = NotFound desc = could not find container \"cc67c83dae66f16fcf2bfe1e7d3f2460784e10b5e6b7781beedbf4c6c44ad5eb\": container with ID starting with cc67c83dae66f16fcf2bfe1e7d3f2460784e10b5e6b7781beedbf4c6c44ad5eb not found: ID does not exist" Aug 04 11:14:48.157683 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.157656 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc"] Aug 04 11:14:48.162093 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.162066 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7d02d259-6bcf978cb6-xx4mc"] Aug 04 11:14:48.173621 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.173599 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj"] Aug 04 11:14:48.177741 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.177718 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7d02d259-86dbbdd4-mstcj"] Aug 04 11:14:48.223628 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.223598 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xbcq\" (UniqueName: \"kubernetes.io/projected/5260dc28-73d7-4df4-af19-6c13c564c03f-kube-api-access-4xbcq\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:14:48.223628 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.223623 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9fbm\" (UniqueName: \"kubernetes.io/projected/bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa-kube-api-access-b9fbm\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:14:48.223793 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.223635 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:14:48.223793 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:48.223645 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5260dc28-73d7-4df4-af19-6c13c564c03f-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:14:49.928721 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:49.928688 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5260dc28-73d7-4df4-af19-6c13c564c03f" path="/var/lib/kubelet/pods/5260dc28-73d7-4df4-af19-6c13c564c03f/volumes" Aug 04 11:14:49.929122 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:14:49.929035 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa" path="/var/lib/kubelet/pods/bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa/volumes" Aug 04 11:15:35.985994 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:15:35.985962 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-d8x7t"] Aug 04 11:15:35.986541 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:15:35.986166 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-d8x7t" podUID="4441a44b-f5b5-4ff9-b227-267d98cbec84" containerName="manager" containerID="cri-o://9a86aaf269b5e94e85e78a77c2e656f48a2412d35829f85ee1aa2dfd6b892588" gracePeriod=10 Aug 04 11:15:36.231195 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:15:36.231170 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-d8x7t" Aug 04 11:15:36.335353 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:15:36.335326 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4441a44b-f5b5-4ff9-b227-267d98cbec84-extensions-socket-volume\") pod \"4441a44b-f5b5-4ff9-b227-267d98cbec84\" (UID: \"4441a44b-f5b5-4ff9-b227-267d98cbec84\") " Aug 04 11:15:36.335527 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:15:36.335423 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnphq\" (UniqueName: \"kubernetes.io/projected/4441a44b-f5b5-4ff9-b227-267d98cbec84-kube-api-access-qnphq\") pod \"4441a44b-f5b5-4ff9-b227-267d98cbec84\" (UID: \"4441a44b-f5b5-4ff9-b227-267d98cbec84\") " Aug 04 11:15:36.335763 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:15:36.335738 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4441a44b-f5b5-4ff9-b227-267d98cbec84-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4441a44b-f5b5-4ff9-b227-267d98cbec84" (UID: "4441a44b-f5b5-4ff9-b227-267d98cbec84"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 11:15:36.337556 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:15:36.337525 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4441a44b-f5b5-4ff9-b227-267d98cbec84-kube-api-access-qnphq" (OuterVolumeSpecName: "kube-api-access-qnphq") pod "4441a44b-f5b5-4ff9-b227-267d98cbec84" (UID: "4441a44b-f5b5-4ff9-b227-267d98cbec84"). InnerVolumeSpecName "kube-api-access-qnphq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:15:36.362190 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:15:36.362158 2576 generic.go:356] "Generic (PLEG): container finished" podID="4441a44b-f5b5-4ff9-b227-267d98cbec84" containerID="9a86aaf269b5e94e85e78a77c2e656f48a2412d35829f85ee1aa2dfd6b892588" exitCode=0 Aug 04 11:15:36.362301 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:15:36.362208 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-d8x7t" Aug 04 11:15:36.362301 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:15:36.362242 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-d8x7t" event={"ID":"4441a44b-f5b5-4ff9-b227-267d98cbec84","Type":"ContainerDied","Data":"9a86aaf269b5e94e85e78a77c2e656f48a2412d35829f85ee1aa2dfd6b892588"} Aug 04 11:15:36.362443 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:15:36.362302 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-d8x7t" event={"ID":"4441a44b-f5b5-4ff9-b227-267d98cbec84","Type":"ContainerDied","Data":"3df7d3bfaf5bf97f07a7251421ba6a20129e6e099289dfd82f0327c1af9e0000"} Aug 04 11:15:36.362443 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:15:36.362332 2576 scope.go:117] "RemoveContainer" containerID="9a86aaf269b5e94e85e78a77c2e656f48a2412d35829f85ee1aa2dfd6b892588" Aug 04 11:15:36.376265 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:15:36.376230 2576 scope.go:117] "RemoveContainer" containerID="9a86aaf269b5e94e85e78a77c2e656f48a2412d35829f85ee1aa2dfd6b892588" Aug 04 11:15:36.376576 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:15:36.376550 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a86aaf269b5e94e85e78a77c2e656f48a2412d35829f85ee1aa2dfd6b892588\": container with ID starting with 9a86aaf269b5e94e85e78a77c2e656f48a2412d35829f85ee1aa2dfd6b892588 not found: ID does not exist" containerID="9a86aaf269b5e94e85e78a77c2e656f48a2412d35829f85ee1aa2dfd6b892588" Aug 04 11:15:36.376647 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:15:36.376588 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a86aaf269b5e94e85e78a77c2e656f48a2412d35829f85ee1aa2dfd6b892588"} err="failed to get container status \"9a86aaf269b5e94e85e78a77c2e656f48a2412d35829f85ee1aa2dfd6b892588\": rpc error: code = NotFound desc = could not find container \"9a86aaf269b5e94e85e78a77c2e656f48a2412d35829f85ee1aa2dfd6b892588\": container with ID starting with 9a86aaf269b5e94e85e78a77c2e656f48a2412d35829f85ee1aa2dfd6b892588 not found: ID does not exist" Aug 04 11:15:36.386954 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:15:36.386930 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-d8x7t"] Aug 04 11:15:36.390608 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:15:36.390581 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-d8x7t"] Aug 04 11:15:36.436914 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:15:36.436896 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnphq\" (UniqueName: \"kubernetes.io/projected/4441a44b-f5b5-4ff9-b227-267d98cbec84-kube-api-access-qnphq\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:15:36.436995 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:15:36.436916 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4441a44b-f5b5-4ff9-b227-267d98cbec84-extensions-socket-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:15:37.929005 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:15:37.928963 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4441a44b-f5b5-4ff9-b227-267d98cbec84" path="/var/lib/kubelet/pods/4441a44b-f5b5-4ff9-b227-267d98cbec84/volumes" Aug 04 11:16:51.639578 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:51.639535 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9w58g"] Aug 04 11:16:51.640089 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:51.639911 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4441a44b-f5b5-4ff9-b227-267d98cbec84" containerName="manager" Aug 04 11:16:51.640089 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:51.639923 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4441a44b-f5b5-4ff9-b227-267d98cbec84" containerName="manager" Aug 04 11:16:51.640089 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:51.639935 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5260dc28-73d7-4df4-af19-6c13c564c03f" containerName="payload-processing" Aug 04 11:16:51.640089 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:51.639941 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5260dc28-73d7-4df4-af19-6c13c564c03f" containerName="payload-processing" Aug 04 11:16:51.640089 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:51.639952 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa" containerName="payload-pre-processing" Aug 04 11:16:51.640089 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:51.639957 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa" containerName="payload-pre-processing" Aug 04 11:16:51.640089 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:51.640016 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc7aa219-64a9-4cb0-b4c0-97a91f9fe2aa" containerName="payload-pre-processing" Aug 04 11:16:51.640089 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:51.640024 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4441a44b-f5b5-4ff9-b227-267d98cbec84" containerName="manager" Aug 04 11:16:51.640089 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:51.640032 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5260dc28-73d7-4df4-af19-6c13c564c03f" containerName="payload-processing" Aug 04 11:16:51.643163 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:51.643141 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9w58g" Aug 04 11:16:51.646184 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:51.646151 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Aug 04 11:16:51.646436 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:51.646198 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8gnsq\"" Aug 04 11:16:51.646436 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:51.646162 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Aug 04 11:16:51.654950 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:51.654919 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9w58g"] Aug 04 11:16:51.778926 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:51.778886 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv2bd\" (UniqueName: \"kubernetes.io/projected/2cacc311-c1cb-4b42-9689-861708dff58a-kube-api-access-nv2bd\") pod \"kuadrant-operator-controller-manager-68cf589589-9w58g\" (UID: \"2cacc311-c1cb-4b42-9689-861708dff58a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9w58g" Aug 04 11:16:51.779110 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:51.778957 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cacc311-c1cb-4b42-9689-861708dff58a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-9w58g\" (UID: \"2cacc311-c1cb-4b42-9689-861708dff58a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9w58g" Aug 04 11:16:51.879642 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:51.879609 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv2bd\" (UniqueName: \"kubernetes.io/projected/2cacc311-c1cb-4b42-9689-861708dff58a-kube-api-access-nv2bd\") pod \"kuadrant-operator-controller-manager-68cf589589-9w58g\" (UID: \"2cacc311-c1cb-4b42-9689-861708dff58a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9w58g" Aug 04 11:16:51.879826 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:51.879686 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cacc311-c1cb-4b42-9689-861708dff58a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-9w58g\" (UID: \"2cacc311-c1cb-4b42-9689-861708dff58a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9w58g" Aug 04 11:16:51.880081 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:51.880059 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cacc311-c1cb-4b42-9689-861708dff58a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-9w58g\" (UID: \"2cacc311-c1cb-4b42-9689-861708dff58a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9w58g" Aug 04 11:16:51.891118 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:51.891056 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv2bd\" (UniqueName: \"kubernetes.io/projected/2cacc311-c1cb-4b42-9689-861708dff58a-kube-api-access-nv2bd\") pod \"kuadrant-operator-controller-manager-68cf589589-9w58g\" (UID: \"2cacc311-c1cb-4b42-9689-861708dff58a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9w58g" Aug 04 11:16:51.955313 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:51.955287 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9w58g" Aug 04 11:16:52.104662 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:52.104636 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9w58g"] Aug 04 11:16:52.107189 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:16:52.107159 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cacc311_c1cb_4b42_9689_861708dff58a.slice/crio-e4f63214ec49dd7f8d5366b16ac3c094ea609186ae110fd9a8a3dd2eda37424f WatchSource:0}: Error finding container e4f63214ec49dd7f8d5366b16ac3c094ea609186ae110fd9a8a3dd2eda37424f: Status 404 returned error can't find the container with id e4f63214ec49dd7f8d5366b16ac3c094ea609186ae110fd9a8a3dd2eda37424f Aug 04 11:16:52.716463 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:52.716420 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9w58g" event={"ID":"2cacc311-c1cb-4b42-9689-861708dff58a","Type":"ContainerStarted","Data":"7814af338201c4d427e47cb6987dc5b4460bde39b9e472d52f4e9c84dae8269a"} Aug 04 11:16:52.716908 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:52.716479 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9w58g" event={"ID":"2cacc311-c1cb-4b42-9689-861708dff58a","Type":"ContainerStarted","Data":"e4f63214ec49dd7f8d5366b16ac3c094ea609186ae110fd9a8a3dd2eda37424f"} Aug 04 11:16:52.716908 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:52.716506 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9w58g" Aug 04 11:16:52.740836 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:16:52.740788 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9w58g" podStartSLOduration=1.740773403 podStartE2EDuration="1.740773403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:16:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:16:52.737550052 +0000 UTC m=+2363.336454475" watchObservedRunningTime="2026-08-04 11:16:52.740773403 +0000 UTC m=+2363.339677781" Aug 04 11:17:03.723797 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:03.723768 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-9w58g" Aug 04 11:17:14.790032 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:14.789990 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n"] Aug 04 11:17:14.793517 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:14.793496 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n" Aug 04 11:17:14.796179 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:14.796158 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-c88ef17b\"" Aug 04 11:17:14.805886 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:14.805867 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n"] Aug 04 11:17:14.837544 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:14.837517 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m"] Aug 04 11:17:14.841072 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:14.841052 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m" Aug 04 11:17:14.844778 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:14.844753 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-c88ef17b-dockercfg-nxt55\"" Aug 04 11:17:14.850925 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:14.850905 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m"] Aug 04 11:17:14.890945 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:14.890921 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd47d7aa-6bf0-4a65-a043-91e490cd3c53-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n\" (UID: \"bd47d7aa-6bf0-4a65-a043-91e490cd3c53\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n" Aug 04 11:17:14.891080 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:14.890993 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhtp5\" (UniqueName: \"kubernetes.io/projected/bd47d7aa-6bf0-4a65-a043-91e490cd3c53-kube-api-access-rhtp5\") pod \"payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n\" (UID: \"bd47d7aa-6bf0-4a65-a043-91e490cd3c53\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n" Aug 04 11:17:14.891080 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:14.891026 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srwvr\" (UniqueName: \"kubernetes.io/projected/7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8-kube-api-access-srwvr\") pod \"payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m\" (UID: \"7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8\") " pod="openshift-ingress/payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m" Aug 04 11:17:14.891080 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:14.891056 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8-plugins-config-volume\") pod \"payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m\" (UID: \"7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8\") " pod="openshift-ingress/payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m" Aug 04 11:17:14.991811 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:14.991774 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhtp5\" (UniqueName: \"kubernetes.io/projected/bd47d7aa-6bf0-4a65-a043-91e490cd3c53-kube-api-access-rhtp5\") pod \"payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n\" (UID: \"bd47d7aa-6bf0-4a65-a043-91e490cd3c53\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n" Aug 04 11:17:14.991989 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:14.991827 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srwvr\" (UniqueName: \"kubernetes.io/projected/7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8-kube-api-access-srwvr\") pod \"payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m\" (UID: \"7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8\") " pod="openshift-ingress/payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m" Aug 04 11:17:14.991989 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:14.991871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8-plugins-config-volume\") pod \"payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m\" (UID: \"7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8\") " pod="openshift-ingress/payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m" Aug 04 11:17:14.991989 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:14.991935 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd47d7aa-6bf0-4a65-a043-91e490cd3c53-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n\" (UID: \"bd47d7aa-6bf0-4a65-a043-91e490cd3c53\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n" Aug 04 11:17:14.992773 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:14.992744 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8-plugins-config-volume\") pod \"payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m\" (UID: \"7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8\") " pod="openshift-ingress/payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m" Aug 04 11:17:14.992915 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:14.992883 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd47d7aa-6bf0-4a65-a043-91e490cd3c53-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n\" (UID: \"bd47d7aa-6bf0-4a65-a043-91e490cd3c53\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n" Aug 04 11:17:15.000573 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:15.000554 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhtp5\" (UniqueName: \"kubernetes.io/projected/bd47d7aa-6bf0-4a65-a043-91e490cd3c53-kube-api-access-rhtp5\") pod \"payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n\" (UID: \"bd47d7aa-6bf0-4a65-a043-91e490cd3c53\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n" Aug 04 11:17:15.000823 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:15.000803 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srwvr\" (UniqueName: \"kubernetes.io/projected/7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8-kube-api-access-srwvr\") pod \"payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m\" (UID: \"7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8\") " pod="openshift-ingress/payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m" Aug 04 11:17:15.103658 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:15.103587 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n" Aug 04 11:17:15.153123 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:15.153080 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m" Aug 04 11:17:15.256499 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:15.255692 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n"] Aug 04 11:17:15.259749 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:17:15.259705 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd47d7aa_6bf0_4a65_a043_91e490cd3c53.slice/crio-55ecb551c6edfecd28483de2c11347b6f74f4b20ce1de33f30503ba783aec62d WatchSource:0}: Error finding container 55ecb551c6edfecd28483de2c11347b6f74f4b20ce1de33f30503ba783aec62d: Status 404 returned error can't find the container with id 55ecb551c6edfecd28483de2c11347b6f74f4b20ce1de33f30503ba783aec62d Aug 04 11:17:15.306858 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:15.306837 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m"] Aug 04 11:17:15.309845 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:17:15.309819 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f5dc4bb_a0eb_4060_9429_7832b4d3f0d8.slice/crio-b6928ef93208025505734efbad4a6775ca9bc0e78957c2dedcef16c5dbfaaab8 WatchSource:0}: Error finding container b6928ef93208025505734efbad4a6775ca9bc0e78957c2dedcef16c5dbfaaab8: Status 404 returned error can't find the container with id b6928ef93208025505734efbad4a6775ca9bc0e78957c2dedcef16c5dbfaaab8 Aug 04 11:17:15.824964 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:15.824911 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n" event={"ID":"bd47d7aa-6bf0-4a65-a043-91e490cd3c53","Type":"ContainerStarted","Data":"c64e13edcf97014f0873a019730c20915a38a45bad4232d56e90c7b8afae460c"} Aug 04 11:17:15.825472 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:15.824977 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n" Aug 04 11:17:15.825472 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:15.825001 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n" event={"ID":"bd47d7aa-6bf0-4a65-a043-91e490cd3c53","Type":"ContainerStarted","Data":"55ecb551c6edfecd28483de2c11347b6f74f4b20ce1de33f30503ba783aec62d"} Aug 04 11:17:15.826671 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:15.826645 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m" event={"ID":"7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8","Type":"ContainerStarted","Data":"233c1dad33c2b75707e062ff0c4bc4a6fc829114a4037e7267fcc4c8d11b6928"} Aug 04 11:17:15.826812 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:15.826686 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m" event={"ID":"7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8","Type":"ContainerStarted","Data":"b6928ef93208025505734efbad4a6775ca9bc0e78957c2dedcef16c5dbfaaab8"} Aug 04 11:17:15.826812 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:15.826773 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m" Aug 04 11:17:15.844669 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:15.844626 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n" podStartSLOduration=1.84461228 podStartE2EDuration="1.84461228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:17:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:17:15.84211268 +0000 UTC m=+2386.441017092" watchObservedRunningTime="2026-08-04 11:17:15.84461228 +0000 UTC m=+2386.443516654" Aug 04 11:17:15.863866 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:15.863816 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m" podStartSLOduration=1.863797819 podStartE2EDuration="1.863797819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:17:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:17:15.861704033 +0000 UTC m=+2386.460608432" watchObservedRunningTime="2026-08-04 11:17:15.863797819 +0000 UTC m=+2386.462702197" Aug 04 11:17:26.835762 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:26.835726 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m" Aug 04 11:17:26.836327 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:26.835811 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n" Aug 04 11:17:29.992827 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:29.992784 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 11:17:29.998884 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:17:29.998855 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 11:18:43.387983 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:43.387942 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m"] Aug 04 11:18:43.388590 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:43.388214 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m" podUID="7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8" containerName="payload-processing" containerID="cri-o://233c1dad33c2b75707e062ff0c4bc4a6fc829114a4037e7267fcc4c8d11b6928" gracePeriod=30 Aug 04 11:18:43.395529 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:43.395411 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n"] Aug 04 11:18:43.395657 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:43.395625 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n" podUID="bd47d7aa-6bf0-4a65-a043-91e490cd3c53" containerName="payload-pre-processing" containerID="cri-o://c64e13edcf97014f0873a019730c20915a38a45bad4232d56e90c7b8afae460c" gracePeriod=30 Aug 04 11:18:43.662360 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:43.662334 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m" Aug 04 11:18:43.684776 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:43.684713 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srwvr\" (UniqueName: \"kubernetes.io/projected/7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8-kube-api-access-srwvr\") pod \"7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8\" (UID: \"7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8\") " Aug 04 11:18:43.684926 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:43.684888 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8-plugins-config-volume\") pod \"7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8\" (UID: \"7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8\") " Aug 04 11:18:43.685484 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:43.685430 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8" (UID: "7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:18:43.687879 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:43.687849 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8-kube-api-access-srwvr" (OuterVolumeSpecName: "kube-api-access-srwvr") pod "7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8" (UID: "7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8"). InnerVolumeSpecName "kube-api-access-srwvr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:18:43.690744 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:43.690721 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n" Aug 04 11:18:43.786015 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:43.785987 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhtp5\" (UniqueName: \"kubernetes.io/projected/bd47d7aa-6bf0-4a65-a043-91e490cd3c53-kube-api-access-rhtp5\") pod \"bd47d7aa-6bf0-4a65-a043-91e490cd3c53\" (UID: \"bd47d7aa-6bf0-4a65-a043-91e490cd3c53\") " Aug 04 11:18:43.786215 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:43.786103 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd47d7aa-6bf0-4a65-a043-91e490cd3c53-plugins-config-volume\") pod \"bd47d7aa-6bf0-4a65-a043-91e490cd3c53\" (UID: \"bd47d7aa-6bf0-4a65-a043-91e490cd3c53\") " Aug 04 11:18:43.786300 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:43.786282 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:18:43.786369 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:43.786306 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srwvr\" (UniqueName: \"kubernetes.io/projected/7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8-kube-api-access-srwvr\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:18:43.786503 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:43.786484 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd47d7aa-6bf0-4a65-a043-91e490cd3c53-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bd47d7aa-6bf0-4a65-a043-91e490cd3c53" (UID: "bd47d7aa-6bf0-4a65-a043-91e490cd3c53"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:18:43.788257 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:43.788233 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd47d7aa-6bf0-4a65-a043-91e490cd3c53-kube-api-access-rhtp5" (OuterVolumeSpecName: "kube-api-access-rhtp5") pod "bd47d7aa-6bf0-4a65-a043-91e490cd3c53" (UID: "bd47d7aa-6bf0-4a65-a043-91e490cd3c53"). InnerVolumeSpecName "kube-api-access-rhtp5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:18:43.887606 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:43.887570 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd47d7aa-6bf0-4a65-a043-91e490cd3c53-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:18:43.887606 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:43.887602 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhtp5\" (UniqueName: \"kubernetes.io/projected/bd47d7aa-6bf0-4a65-a043-91e490cd3c53-kube-api-access-rhtp5\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:18:44.248805 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:44.248765 2576 generic.go:356] "Generic (PLEG): container finished" podID="7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8" containerID="233c1dad33c2b75707e062ff0c4bc4a6fc829114a4037e7267fcc4c8d11b6928" exitCode=0 Aug 04 11:18:44.249016 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:44.248834 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m" Aug 04 11:18:44.249016 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:44.248845 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m" event={"ID":"7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8","Type":"ContainerDied","Data":"233c1dad33c2b75707e062ff0c4bc4a6fc829114a4037e7267fcc4c8d11b6928"} Aug 04 11:18:44.249016 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:44.248946 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m" event={"ID":"7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8","Type":"ContainerDied","Data":"b6928ef93208025505734efbad4a6775ca9bc0e78957c2dedcef16c5dbfaaab8"} Aug 04 11:18:44.249181 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:44.248996 2576 scope.go:117] "RemoveContainer" containerID="233c1dad33c2b75707e062ff0c4bc4a6fc829114a4037e7267fcc4c8d11b6928" Aug 04 11:18:44.250249 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:44.250222 2576 generic.go:356] "Generic (PLEG): container finished" podID="bd47d7aa-6bf0-4a65-a043-91e490cd3c53" containerID="c64e13edcf97014f0873a019730c20915a38a45bad4232d56e90c7b8afae460c" exitCode=0 Aug 04 11:18:44.250350 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:44.250282 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n" Aug 04 11:18:44.250350 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:44.250289 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n" event={"ID":"bd47d7aa-6bf0-4a65-a043-91e490cd3c53","Type":"ContainerDied","Data":"c64e13edcf97014f0873a019730c20915a38a45bad4232d56e90c7b8afae460c"} Aug 04 11:18:44.250350 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:44.250330 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n" event={"ID":"bd47d7aa-6bf0-4a65-a043-91e490cd3c53","Type":"ContainerDied","Data":"55ecb551c6edfecd28483de2c11347b6f74f4b20ce1de33f30503ba783aec62d"} Aug 04 11:18:44.257877 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:44.257857 2576 scope.go:117] "RemoveContainer" containerID="233c1dad33c2b75707e062ff0c4bc4a6fc829114a4037e7267fcc4c8d11b6928" Aug 04 11:18:44.258126 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:18:44.258097 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"233c1dad33c2b75707e062ff0c4bc4a6fc829114a4037e7267fcc4c8d11b6928\": container with ID starting with 233c1dad33c2b75707e062ff0c4bc4a6fc829114a4037e7267fcc4c8d11b6928 not found: ID does not exist" containerID="233c1dad33c2b75707e062ff0c4bc4a6fc829114a4037e7267fcc4c8d11b6928" Aug 04 11:18:44.258174 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:44.258127 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"233c1dad33c2b75707e062ff0c4bc4a6fc829114a4037e7267fcc4c8d11b6928"} err="failed to get container status \"233c1dad33c2b75707e062ff0c4bc4a6fc829114a4037e7267fcc4c8d11b6928\": rpc error: code = NotFound desc = could not find container \"233c1dad33c2b75707e062ff0c4bc4a6fc829114a4037e7267fcc4c8d11b6928\": container with ID starting with 233c1dad33c2b75707e062ff0c4bc4a6fc829114a4037e7267fcc4c8d11b6928 not found: ID does not exist" Aug 04 11:18:44.258174 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:44.258149 2576 scope.go:117] "RemoveContainer" containerID="c64e13edcf97014f0873a019730c20915a38a45bad4232d56e90c7b8afae460c" Aug 04 11:18:44.266910 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:44.266888 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m"] Aug 04 11:18:44.268556 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:44.268537 2576 scope.go:117] "RemoveContainer" containerID="c64e13edcf97014f0873a019730c20915a38a45bad4232d56e90c7b8afae460c" Aug 04 11:18:44.268851 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:18:44.268830 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c64e13edcf97014f0873a019730c20915a38a45bad4232d56e90c7b8afae460c\": container with ID starting with c64e13edcf97014f0873a019730c20915a38a45bad4232d56e90c7b8afae460c not found: ID does not exist" containerID="c64e13edcf97014f0873a019730c20915a38a45bad4232d56e90c7b8afae460c" Aug 04 11:18:44.268914 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:44.268858 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c64e13edcf97014f0873a019730c20915a38a45bad4232d56e90c7b8afae460c"} err="failed to get container status \"c64e13edcf97014f0873a019730c20915a38a45bad4232d56e90c7b8afae460c\": rpc error: code = NotFound desc = could not find container \"c64e13edcf97014f0873a019730c20915a38a45bad4232d56e90c7b8afae460c\": container with ID starting with c64e13edcf97014f0873a019730c20915a38a45bad4232d56e90c7b8afae460c not found: ID does not exist" Aug 04 11:18:44.269984 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:44.269966 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c88ef17b-6c8c98cbf8-tnc5m"] Aug 04 11:18:44.281535 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:44.281511 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n"] Aug 04 11:18:44.285449 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:44.285428 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c88ef17b-654cd4cb56-xfs8n"] Aug 04 11:18:45.929033 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:45.928997 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8" path="/var/lib/kubelet/pods/7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8/volumes" Aug 04 11:18:45.929440 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:18:45.929359 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd47d7aa-6bf0-4a65-a043-91e490cd3c53" path="/var/lib/kubelet/pods/bd47d7aa-6bf0-4a65-a043-91e490cd3c53/volumes" Aug 04 11:20:48.181898 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.181861 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t"] Aug 04 11:20:48.182374 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.182215 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8" containerName="payload-processing" Aug 04 11:20:48.182374 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.182226 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8" containerName="payload-processing" Aug 04 11:20:48.182374 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.182237 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd47d7aa-6bf0-4a65-a043-91e490cd3c53" containerName="payload-pre-processing" Aug 04 11:20:48.182374 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.182243 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd47d7aa-6bf0-4a65-a043-91e490cd3c53" containerName="payload-pre-processing" Aug 04 11:20:48.182374 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.182295 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f5dc4bb-a0eb-4060-9429-7832b4d3f0d8" containerName="payload-processing" Aug 04 11:20:48.182374 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.182308 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd47d7aa-6bf0-4a65-a043-91e490cd3c53" containerName="payload-pre-processing" Aug 04 11:20:48.185302 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.185286 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t" Aug 04 11:20:48.188842 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.188820 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-dc2eb2\"" Aug 04 11:20:48.189094 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.189073 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-dc2eb2-dockercfg-964p8\"" Aug 04 11:20:48.204150 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.204122 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t"] Aug 04 11:20:48.276907 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.276873 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf6sp\" (UniqueName: \"kubernetes.io/projected/a47e41e4-4823-4beb-9394-1478ba42712a-kube-api-access-kf6sp\") pod \"payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t\" (UID: \"a47e41e4-4823-4beb-9394-1478ba42712a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t" Aug 04 11:20:48.277057 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.276994 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a47e41e4-4823-4beb-9394-1478ba42712a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t\" (UID: \"a47e41e4-4823-4beb-9394-1478ba42712a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t" Aug 04 11:20:48.290579 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.290553 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56"] Aug 04 11:20:48.293815 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.293801 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56" Aug 04 11:20:48.305214 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.305194 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56"] Aug 04 11:20:48.377538 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.377512 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf6sp\" (UniqueName: \"kubernetes.io/projected/a47e41e4-4823-4beb-9394-1478ba42712a-kube-api-access-kf6sp\") pod \"payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t\" (UID: \"a47e41e4-4823-4beb-9394-1478ba42712a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t" Aug 04 11:20:48.377662 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.377568 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a47e41e4-4823-4beb-9394-1478ba42712a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t\" (UID: \"a47e41e4-4823-4beb-9394-1478ba42712a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t" Aug 04 11:20:48.377662 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.377615 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5phhg\" (UniqueName: \"kubernetes.io/projected/cbebc7a9-d74c-454e-ab81-db3f2039e06a-kube-api-access-5phhg\") pod \"payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56\" (UID: \"cbebc7a9-d74c-454e-ab81-db3f2039e06a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56" Aug 04 11:20:48.377760 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.377712 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbebc7a9-d74c-454e-ab81-db3f2039e06a-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56\" (UID: \"cbebc7a9-d74c-454e-ab81-db3f2039e06a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56" Aug 04 11:20:48.378268 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.378248 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a47e41e4-4823-4beb-9394-1478ba42712a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t\" (UID: \"a47e41e4-4823-4beb-9394-1478ba42712a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t" Aug 04 11:20:48.391901 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.391878 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf6sp\" (UniqueName: \"kubernetes.io/projected/a47e41e4-4823-4beb-9394-1478ba42712a-kube-api-access-kf6sp\") pod \"payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t\" (UID: \"a47e41e4-4823-4beb-9394-1478ba42712a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t" Aug 04 11:20:48.478592 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.478539 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbebc7a9-d74c-454e-ab81-db3f2039e06a-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56\" (UID: \"cbebc7a9-d74c-454e-ab81-db3f2039e06a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56" Aug 04 11:20:48.478679 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.478596 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5phhg\" (UniqueName: \"kubernetes.io/projected/cbebc7a9-d74c-454e-ab81-db3f2039e06a-kube-api-access-5phhg\") pod \"payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56\" (UID: \"cbebc7a9-d74c-454e-ab81-db3f2039e06a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56" Aug 04 11:20:48.479165 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.479146 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbebc7a9-d74c-454e-ab81-db3f2039e06a-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56\" (UID: \"cbebc7a9-d74c-454e-ab81-db3f2039e06a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56" Aug 04 11:20:48.488509 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.488487 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5phhg\" (UniqueName: \"kubernetes.io/projected/cbebc7a9-d74c-454e-ab81-db3f2039e06a-kube-api-access-5phhg\") pod \"payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56\" (UID: \"cbebc7a9-d74c-454e-ab81-db3f2039e06a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56" Aug 04 11:20:48.496259 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.496241 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t" Aug 04 11:20:48.604831 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.604682 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56" Aug 04 11:20:48.738317 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.738286 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56"] Aug 04 11:20:48.739558 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:20:48.739532 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbebc7a9_d74c_454e_ab81_db3f2039e06a.slice/crio-6d1771b5f03185e7d8fd23a007ffe3d4ee83233828bfad3c5b783b9c79a9ce00 WatchSource:0}: Error finding container 6d1771b5f03185e7d8fd23a007ffe3d4ee83233828bfad3c5b783b9c79a9ce00: Status 404 returned error can't find the container with id 6d1771b5f03185e7d8fd23a007ffe3d4ee83233828bfad3c5b783b9c79a9ce00 Aug 04 11:20:48.820052 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.820020 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56" event={"ID":"cbebc7a9-d74c-454e-ab81-db3f2039e06a","Type":"ContainerStarted","Data":"62e7f06eeebd1677de9ff7c2f4b5fbdfcca2796529303fec16cf6336aaa7a4cb"} Aug 04 11:20:48.820165 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.820075 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56" event={"ID":"cbebc7a9-d74c-454e-ab81-db3f2039e06a","Type":"ContainerStarted","Data":"6d1771b5f03185e7d8fd23a007ffe3d4ee83233828bfad3c5b783b9c79a9ce00"} Aug 04 11:20:48.820165 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.820113 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56" Aug 04 11:20:48.851820 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.851569 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t"] Aug 04 11:20:48.852344 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:48.852297 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56" podStartSLOduration=0.852278889 podStartE2EDuration="852.278889ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:20:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:20:48.852126627 +0000 UTC m=+2599.451031001" watchObservedRunningTime="2026-08-04 11:20:48.852278889 +0000 UTC m=+2599.451183264" Aug 04 11:20:48.853908 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:20:48.853884 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda47e41e4_4823_4beb_9394_1478ba42712a.slice/crio-9202a37cbe67f48d4e29bba1d8009a0186d2cd6855e86807fe5c955d464b7ca1 WatchSource:0}: Error finding container 9202a37cbe67f48d4e29bba1d8009a0186d2cd6855e86807fe5c955d464b7ca1: Status 404 returned error can't find the container with id 9202a37cbe67f48d4e29bba1d8009a0186d2cd6855e86807fe5c955d464b7ca1 Aug 04 11:20:49.826542 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:49.826506 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t" event={"ID":"a47e41e4-4823-4beb-9394-1478ba42712a","Type":"ContainerStarted","Data":"a8eba00466b9c3d1c695b5bfad4efbb0e43f89a9557c7a4ad9ab261e5261a5a3"} Aug 04 11:20:49.827001 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:49.826569 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t" event={"ID":"a47e41e4-4823-4beb-9394-1478ba42712a","Type":"ContainerStarted","Data":"9202a37cbe67f48d4e29bba1d8009a0186d2cd6855e86807fe5c955d464b7ca1"} Aug 04 11:20:49.851024 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:49.850975 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t" podStartSLOduration=1.850959877 podStartE2EDuration="1.850959877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:20:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:20:49.848622637 +0000 UTC m=+2600.447527033" watchObservedRunningTime="2026-08-04 11:20:49.850959877 +0000 UTC m=+2600.449864251" Aug 04 11:20:50.842037 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:50.835339 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t" Aug 04 11:20:59.828590 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:20:59.828562 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56" Aug 04 11:21:01.841275 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:01.841244 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t" Aug 04 11:21:17.088755 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.088714 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7"] Aug 04 11:21:17.093069 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.093047 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7" Aug 04 11:21:17.096017 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.095998 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-1dd437-dockercfg-mrm9q\"" Aug 04 11:21:17.096127 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.096040 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-1dd437\"" Aug 04 11:21:17.102961 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.102939 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p"] Aug 04 11:21:17.106732 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.106711 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7"] Aug 04 11:21:17.106843 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.106826 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p" Aug 04 11:21:17.116861 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.116842 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p"] Aug 04 11:21:17.140823 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.140796 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hbb9\" (UniqueName: \"kubernetes.io/projected/fecd922f-d099-4ed8-aee4-b8aa5e457284-kube-api-access-4hbb9\") pod \"payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7\" (UID: \"fecd922f-d099-4ed8-aee4-b8aa5e457284\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7" Aug 04 11:21:17.140931 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.140866 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fecd922f-d099-4ed8-aee4-b8aa5e457284-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7\" (UID: \"fecd922f-d099-4ed8-aee4-b8aa5e457284\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7" Aug 04 11:21:17.241996 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.241951 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e13fcc54-5168-4412-a90f-8deb46c7b497-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p\" (UID: \"e13fcc54-5168-4412-a90f-8deb46c7b497\") " pod="openshift-ingress/payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p" Aug 04 11:21:17.242138 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.242011 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hbb9\" (UniqueName: \"kubernetes.io/projected/fecd922f-d099-4ed8-aee4-b8aa5e457284-kube-api-access-4hbb9\") pod \"payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7\" (UID: \"fecd922f-d099-4ed8-aee4-b8aa5e457284\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7" Aug 04 11:21:17.242189 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.242142 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fecd922f-d099-4ed8-aee4-b8aa5e457284-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7\" (UID: \"fecd922f-d099-4ed8-aee4-b8aa5e457284\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7" Aug 04 11:21:17.242231 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.242187 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzf94\" (UniqueName: \"kubernetes.io/projected/e13fcc54-5168-4412-a90f-8deb46c7b497-kube-api-access-bzf94\") pod \"payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p\" (UID: \"e13fcc54-5168-4412-a90f-8deb46c7b497\") " pod="openshift-ingress/payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p" Aug 04 11:21:17.242810 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.242795 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fecd922f-d099-4ed8-aee4-b8aa5e457284-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7\" (UID: \"fecd922f-d099-4ed8-aee4-b8aa5e457284\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7" Aug 04 11:21:17.253418 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.253369 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hbb9\" (UniqueName: \"kubernetes.io/projected/fecd922f-d099-4ed8-aee4-b8aa5e457284-kube-api-access-4hbb9\") pod \"payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7\" (UID: \"fecd922f-d099-4ed8-aee4-b8aa5e457284\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7" Aug 04 11:21:17.342751 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.342678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e13fcc54-5168-4412-a90f-8deb46c7b497-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p\" (UID: \"e13fcc54-5168-4412-a90f-8deb46c7b497\") " pod="openshift-ingress/payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p" Aug 04 11:21:17.342900 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.342786 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzf94\" (UniqueName: \"kubernetes.io/projected/e13fcc54-5168-4412-a90f-8deb46c7b497-kube-api-access-bzf94\") pod \"payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p\" (UID: \"e13fcc54-5168-4412-a90f-8deb46c7b497\") " pod="openshift-ingress/payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p" Aug 04 11:21:17.343559 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.343540 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e13fcc54-5168-4412-a90f-8deb46c7b497-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p\" (UID: \"e13fcc54-5168-4412-a90f-8deb46c7b497\") " pod="openshift-ingress/payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p" Aug 04 11:21:17.352464 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.352445 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzf94\" (UniqueName: \"kubernetes.io/projected/e13fcc54-5168-4412-a90f-8deb46c7b497-kube-api-access-bzf94\") pod \"payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p\" (UID: \"e13fcc54-5168-4412-a90f-8deb46c7b497\") " pod="openshift-ingress/payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p" Aug 04 11:21:17.406090 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.406054 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7" Aug 04 11:21:17.417490 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.417450 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p" Aug 04 11:21:17.597830 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.597779 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7"] Aug 04 11:21:17.600655 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:21:17.600620 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfecd922f_d099_4ed8_aee4_b8aa5e457284.slice/crio-a6e3de09cd7b71e0ae4f802cee3aff77e2105454a6155c026237ad080f25b660 WatchSource:0}: Error finding container a6e3de09cd7b71e0ae4f802cee3aff77e2105454a6155c026237ad080f25b660: Status 404 returned error can't find the container with id a6e3de09cd7b71e0ae4f802cee3aff77e2105454a6155c026237ad080f25b660 Aug 04 11:21:17.621036 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.620999 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p"] Aug 04 11:21:17.623227 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:21:17.623195 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode13fcc54_5168_4412_a90f_8deb46c7b497.slice/crio-4f1830fe61a86f26e1a455fcea01c784087389ae3b8a4beac0b33f646595eb30 WatchSource:0}: Error finding container 4f1830fe61a86f26e1a455fcea01c784087389ae3b8a4beac0b33f646595eb30: Status 404 returned error can't find the container with id 4f1830fe61a86f26e1a455fcea01c784087389ae3b8a4beac0b33f646595eb30 Aug 04 11:21:17.966698 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.966605 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7" event={"ID":"fecd922f-d099-4ed8-aee4-b8aa5e457284","Type":"ContainerStarted","Data":"53df90acdba6501b2863cfdbd530f1eb16f8749bce828d2e906564739a43d333"} Aug 04 11:21:17.966853 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.966781 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7" Aug 04 11:21:17.966853 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.966805 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7" event={"ID":"fecd922f-d099-4ed8-aee4-b8aa5e457284","Type":"ContainerStarted","Data":"a6e3de09cd7b71e0ae4f802cee3aff77e2105454a6155c026237ad080f25b660"} Aug 04 11:21:17.968227 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.968197 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p" event={"ID":"e13fcc54-5168-4412-a90f-8deb46c7b497","Type":"ContainerStarted","Data":"c23f2cecd8c6473a95cabf0bd8ab87259545a3dc61a107a37dee9620ead4441a"} Aug 04 11:21:17.968364 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.968243 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p" event={"ID":"e13fcc54-5168-4412-a90f-8deb46c7b497","Type":"ContainerStarted","Data":"4f1830fe61a86f26e1a455fcea01c784087389ae3b8a4beac0b33f646595eb30"} Aug 04 11:21:17.968364 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.968271 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p" Aug 04 11:21:17.985581 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:17.985538 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7" podStartSLOduration=0.985523224 podStartE2EDuration="985.523224ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:21:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:21:17.983652907 +0000 UTC m=+2628.582557301" watchObservedRunningTime="2026-08-04 11:21:17.985523224 +0000 UTC m=+2628.584427597" Aug 04 11:21:18.001695 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:18.001648 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p" podStartSLOduration=1.00163482 podStartE2EDuration="1.00163482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:21:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:21:18.000210332 +0000 UTC m=+2628.599114734" watchObservedRunningTime="2026-08-04 11:21:18.00163482 +0000 UTC m=+2628.600539172" Aug 04 11:21:28.974875 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:28.974835 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p" Aug 04 11:21:28.975427 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:21:28.975048 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7" Aug 04 11:22:30.024223 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:22:30.024138 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 11:22:30.030605 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:22:30.030578 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 11:23:11.178149 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.178115 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56"] Aug 04 11:23:11.178683 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.178416 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56" podUID="cbebc7a9-d74c-454e-ab81-db3f2039e06a" containerName="payload-processing" containerID="cri-o://62e7f06eeebd1677de9ff7c2f4b5fbdfcca2796529303fec16cf6336aaa7a4cb" gracePeriod=30 Aug 04 11:23:11.188308 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.188279 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t"] Aug 04 11:23:11.188790 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.188531 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t" podUID="a47e41e4-4823-4beb-9394-1478ba42712a" containerName="payload-pre-processing" containerID="cri-o://a8eba00466b9c3d1c695b5bfad4efbb0e43f89a9557c7a4ad9ab261e5261a5a3" gracePeriod=30 Aug 04 11:23:11.451931 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.451902 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56" Aug 04 11:23:11.460658 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.460635 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbebc7a9-d74c-454e-ab81-db3f2039e06a-plugins-config-volume\") pod \"cbebc7a9-d74c-454e-ab81-db3f2039e06a\" (UID: \"cbebc7a9-d74c-454e-ab81-db3f2039e06a\") " Aug 04 11:23:11.460774 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.460765 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5phhg\" (UniqueName: \"kubernetes.io/projected/cbebc7a9-d74c-454e-ab81-db3f2039e06a-kube-api-access-5phhg\") pod \"cbebc7a9-d74c-454e-ab81-db3f2039e06a\" (UID: \"cbebc7a9-d74c-454e-ab81-db3f2039e06a\") " Aug 04 11:23:11.461104 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.461076 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbebc7a9-d74c-454e-ab81-db3f2039e06a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cbebc7a9-d74c-454e-ab81-db3f2039e06a" (UID: "cbebc7a9-d74c-454e-ab81-db3f2039e06a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:23:11.463062 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.463036 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbebc7a9-d74c-454e-ab81-db3f2039e06a-kube-api-access-5phhg" (OuterVolumeSpecName: "kube-api-access-5phhg") pod "cbebc7a9-d74c-454e-ab81-db3f2039e06a" (UID: "cbebc7a9-d74c-454e-ab81-db3f2039e06a"). InnerVolumeSpecName "kube-api-access-5phhg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:23:11.478678 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.478656 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t" Aug 04 11:23:11.517565 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.517533 2576 generic.go:356] "Generic (PLEG): container finished" podID="cbebc7a9-d74c-454e-ab81-db3f2039e06a" containerID="62e7f06eeebd1677de9ff7c2f4b5fbdfcca2796529303fec16cf6336aaa7a4cb" exitCode=0 Aug 04 11:23:11.517708 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.517577 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56" Aug 04 11:23:11.517708 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.517623 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56" event={"ID":"cbebc7a9-d74c-454e-ab81-db3f2039e06a","Type":"ContainerDied","Data":"62e7f06eeebd1677de9ff7c2f4b5fbdfcca2796529303fec16cf6336aaa7a4cb"} Aug 04 11:23:11.517708 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.517679 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56" event={"ID":"cbebc7a9-d74c-454e-ab81-db3f2039e06a","Type":"ContainerDied","Data":"6d1771b5f03185e7d8fd23a007ffe3d4ee83233828bfad3c5b783b9c79a9ce00"} Aug 04 11:23:11.517708 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.517707 2576 scope.go:117] "RemoveContainer" containerID="62e7f06eeebd1677de9ff7c2f4b5fbdfcca2796529303fec16cf6336aaa7a4cb" Aug 04 11:23:11.519029 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.519005 2576 generic.go:356] "Generic (PLEG): container finished" podID="a47e41e4-4823-4beb-9394-1478ba42712a" containerID="a8eba00466b9c3d1c695b5bfad4efbb0e43f89a9557c7a4ad9ab261e5261a5a3" exitCode=0 Aug 04 11:23:11.519146 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.519044 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t" Aug 04 11:23:11.519146 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.519050 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t" event={"ID":"a47e41e4-4823-4beb-9394-1478ba42712a","Type":"ContainerDied","Data":"a8eba00466b9c3d1c695b5bfad4efbb0e43f89a9557c7a4ad9ab261e5261a5a3"} Aug 04 11:23:11.519146 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.519088 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t" event={"ID":"a47e41e4-4823-4beb-9394-1478ba42712a","Type":"ContainerDied","Data":"9202a37cbe67f48d4e29bba1d8009a0186d2cd6855e86807fe5c955d464b7ca1"} Aug 04 11:23:11.528122 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.528105 2576 scope.go:117] "RemoveContainer" containerID="62e7f06eeebd1677de9ff7c2f4b5fbdfcca2796529303fec16cf6336aaa7a4cb" Aug 04 11:23:11.528333 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:23:11.528314 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62e7f06eeebd1677de9ff7c2f4b5fbdfcca2796529303fec16cf6336aaa7a4cb\": container with ID starting with 62e7f06eeebd1677de9ff7c2f4b5fbdfcca2796529303fec16cf6336aaa7a4cb not found: ID does not exist" containerID="62e7f06eeebd1677de9ff7c2f4b5fbdfcca2796529303fec16cf6336aaa7a4cb" Aug 04 11:23:11.528425 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.528341 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62e7f06eeebd1677de9ff7c2f4b5fbdfcca2796529303fec16cf6336aaa7a4cb"} err="failed to get container status \"62e7f06eeebd1677de9ff7c2f4b5fbdfcca2796529303fec16cf6336aaa7a4cb\": rpc error: code = NotFound desc = could not find container \"62e7f06eeebd1677de9ff7c2f4b5fbdfcca2796529303fec16cf6336aaa7a4cb\": container with ID starting with 62e7f06eeebd1677de9ff7c2f4b5fbdfcca2796529303fec16cf6336aaa7a4cb not found: ID does not exist" Aug 04 11:23:11.528425 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.528356 2576 scope.go:117] "RemoveContainer" containerID="a8eba00466b9c3d1c695b5bfad4efbb0e43f89a9557c7a4ad9ab261e5261a5a3" Aug 04 11:23:11.536503 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.536486 2576 scope.go:117] "RemoveContainer" containerID="a8eba00466b9c3d1c695b5bfad4efbb0e43f89a9557c7a4ad9ab261e5261a5a3" Aug 04 11:23:11.536771 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:23:11.536754 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8eba00466b9c3d1c695b5bfad4efbb0e43f89a9557c7a4ad9ab261e5261a5a3\": container with ID starting with a8eba00466b9c3d1c695b5bfad4efbb0e43f89a9557c7a4ad9ab261e5261a5a3 not found: ID does not exist" containerID="a8eba00466b9c3d1c695b5bfad4efbb0e43f89a9557c7a4ad9ab261e5261a5a3" Aug 04 11:23:11.536818 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.536777 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8eba00466b9c3d1c695b5bfad4efbb0e43f89a9557c7a4ad9ab261e5261a5a3"} err="failed to get container status \"a8eba00466b9c3d1c695b5bfad4efbb0e43f89a9557c7a4ad9ab261e5261a5a3\": rpc error: code = NotFound desc = could not find container \"a8eba00466b9c3d1c695b5bfad4efbb0e43f89a9557c7a4ad9ab261e5261a5a3\": container with ID starting with a8eba00466b9c3d1c695b5bfad4efbb0e43f89a9557c7a4ad9ab261e5261a5a3 not found: ID does not exist" Aug 04 11:23:11.539852 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.539831 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56"] Aug 04 11:23:11.545677 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.545657 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-dc2eb2-664d65bd66-8mm56"] Aug 04 11:23:11.561827 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.561807 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kf6sp\" (UniqueName: \"kubernetes.io/projected/a47e41e4-4823-4beb-9394-1478ba42712a-kube-api-access-kf6sp\") pod \"a47e41e4-4823-4beb-9394-1478ba42712a\" (UID: \"a47e41e4-4823-4beb-9394-1478ba42712a\") " Aug 04 11:23:11.561918 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.561890 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a47e41e4-4823-4beb-9394-1478ba42712a-plugins-config-volume\") pod \"a47e41e4-4823-4beb-9394-1478ba42712a\" (UID: \"a47e41e4-4823-4beb-9394-1478ba42712a\") " Aug 04 11:23:11.562150 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.562132 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5phhg\" (UniqueName: \"kubernetes.io/projected/cbebc7a9-d74c-454e-ab81-db3f2039e06a-kube-api-access-5phhg\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:23:11.562192 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.562158 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbebc7a9-d74c-454e-ab81-db3f2039e06a-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:23:11.562256 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.562241 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a47e41e4-4823-4beb-9394-1478ba42712a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a47e41e4-4823-4beb-9394-1478ba42712a" (UID: "a47e41e4-4823-4beb-9394-1478ba42712a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:23:11.563878 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.563860 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a47e41e4-4823-4beb-9394-1478ba42712a-kube-api-access-kf6sp" (OuterVolumeSpecName: "kube-api-access-kf6sp") pod "a47e41e4-4823-4beb-9394-1478ba42712a" (UID: "a47e41e4-4823-4beb-9394-1478ba42712a"). InnerVolumeSpecName "kube-api-access-kf6sp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:23:11.663464 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.663436 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a47e41e4-4823-4beb-9394-1478ba42712a-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:23:11.663464 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.663459 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kf6sp\" (UniqueName: \"kubernetes.io/projected/a47e41e4-4823-4beb-9394-1478ba42712a-kube-api-access-kf6sp\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:23:11.843498 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.843467 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t"] Aug 04 11:23:11.848206 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.848180 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-dc2eb2-8c9c8c44-ndd9t"] Aug 04 11:23:11.933280 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.933224 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a47e41e4-4823-4beb-9394-1478ba42712a" path="/var/lib/kubelet/pods/a47e41e4-4823-4beb-9394-1478ba42712a/volumes" Aug 04 11:23:11.933860 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:11.933834 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbebc7a9-d74c-454e-ab81-db3f2039e06a" path="/var/lib/kubelet/pods/cbebc7a9-d74c-454e-ab81-db3f2039e06a/volumes" Aug 04 11:23:28.568417 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:28.568364 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p"] Aug 04 11:23:28.568873 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:28.568626 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p" podUID="e13fcc54-5168-4412-a90f-8deb46c7b497" containerName="payload-processing" containerID="cri-o://c23f2cecd8c6473a95cabf0bd8ab87259545a3dc61a107a37dee9620ead4441a" gracePeriod=30 Aug 04 11:23:28.576630 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:28.576600 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7"] Aug 04 11:23:28.576848 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:28.576827 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7" podUID="fecd922f-d099-4ed8-aee4-b8aa5e457284" containerName="payload-pre-processing" containerID="cri-o://53df90acdba6501b2863cfdbd530f1eb16f8749bce828d2e906564739a43d333" gracePeriod=30 Aug 04 11:23:28.855516 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:28.855483 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p" Aug 04 11:23:28.858515 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:28.858494 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7" Aug 04 11:23:28.912949 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:28.912923 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fecd922f-d099-4ed8-aee4-b8aa5e457284-plugins-config-volume\") pod \"fecd922f-d099-4ed8-aee4-b8aa5e457284\" (UID: \"fecd922f-d099-4ed8-aee4-b8aa5e457284\") " Aug 04 11:23:28.913085 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:28.913019 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e13fcc54-5168-4412-a90f-8deb46c7b497-plugins-config-volume\") pod \"e13fcc54-5168-4412-a90f-8deb46c7b497\" (UID: \"e13fcc54-5168-4412-a90f-8deb46c7b497\") " Aug 04 11:23:28.913085 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:28.913051 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzf94\" (UniqueName: \"kubernetes.io/projected/e13fcc54-5168-4412-a90f-8deb46c7b497-kube-api-access-bzf94\") pod \"e13fcc54-5168-4412-a90f-8deb46c7b497\" (UID: \"e13fcc54-5168-4412-a90f-8deb46c7b497\") " Aug 04 11:23:28.913158 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:28.913107 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hbb9\" (UniqueName: \"kubernetes.io/projected/fecd922f-d099-4ed8-aee4-b8aa5e457284-kube-api-access-4hbb9\") pod \"fecd922f-d099-4ed8-aee4-b8aa5e457284\" (UID: \"fecd922f-d099-4ed8-aee4-b8aa5e457284\") " Aug 04 11:23:28.913355 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:28.913335 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fecd922f-d099-4ed8-aee4-b8aa5e457284-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fecd922f-d099-4ed8-aee4-b8aa5e457284" (UID: "fecd922f-d099-4ed8-aee4-b8aa5e457284"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:23:28.913477 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:28.913460 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fecd922f-d099-4ed8-aee4-b8aa5e457284-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:23:28.913540 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:28.913493 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e13fcc54-5168-4412-a90f-8deb46c7b497-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e13fcc54-5168-4412-a90f-8deb46c7b497" (UID: "e13fcc54-5168-4412-a90f-8deb46c7b497"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:23:28.915470 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:28.915447 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fecd922f-d099-4ed8-aee4-b8aa5e457284-kube-api-access-4hbb9" (OuterVolumeSpecName: "kube-api-access-4hbb9") pod "fecd922f-d099-4ed8-aee4-b8aa5e457284" (UID: "fecd922f-d099-4ed8-aee4-b8aa5e457284"). InnerVolumeSpecName "kube-api-access-4hbb9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:23:28.915470 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:28.915457 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e13fcc54-5168-4412-a90f-8deb46c7b497-kube-api-access-bzf94" (OuterVolumeSpecName: "kube-api-access-bzf94") pod "e13fcc54-5168-4412-a90f-8deb46c7b497" (UID: "e13fcc54-5168-4412-a90f-8deb46c7b497"). InnerVolumeSpecName "kube-api-access-bzf94". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:23:29.014767 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:29.014728 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e13fcc54-5168-4412-a90f-8deb46c7b497-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:23:29.015070 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:29.015044 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzf94\" (UniqueName: \"kubernetes.io/projected/e13fcc54-5168-4412-a90f-8deb46c7b497-kube-api-access-bzf94\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:23:29.015170 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:29.015073 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hbb9\" (UniqueName: \"kubernetes.io/projected/fecd922f-d099-4ed8-aee4-b8aa5e457284-kube-api-access-4hbb9\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:23:29.616980 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:29.616934 2576 generic.go:356] "Generic (PLEG): container finished" podID="fecd922f-d099-4ed8-aee4-b8aa5e457284" containerID="53df90acdba6501b2863cfdbd530f1eb16f8749bce828d2e906564739a43d333" exitCode=0 Aug 04 11:23:29.616980 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:29.616976 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7" Aug 04 11:23:29.617455 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:29.617019 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7" event={"ID":"fecd922f-d099-4ed8-aee4-b8aa5e457284","Type":"ContainerDied","Data":"53df90acdba6501b2863cfdbd530f1eb16f8749bce828d2e906564739a43d333"} Aug 04 11:23:29.617455 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:29.617083 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7" event={"ID":"fecd922f-d099-4ed8-aee4-b8aa5e457284","Type":"ContainerDied","Data":"a6e3de09cd7b71e0ae4f802cee3aff77e2105454a6155c026237ad080f25b660"} Aug 04 11:23:29.617455 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:29.617105 2576 scope.go:117] "RemoveContainer" containerID="53df90acdba6501b2863cfdbd530f1eb16f8749bce828d2e906564739a43d333" Aug 04 11:23:29.618387 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:29.618338 2576 generic.go:356] "Generic (PLEG): container finished" podID="e13fcc54-5168-4412-a90f-8deb46c7b497" containerID="c23f2cecd8c6473a95cabf0bd8ab87259545a3dc61a107a37dee9620ead4441a" exitCode=0 Aug 04 11:23:29.618387 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:29.618373 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p" Aug 04 11:23:29.618508 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:29.618381 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p" event={"ID":"e13fcc54-5168-4412-a90f-8deb46c7b497","Type":"ContainerDied","Data":"c23f2cecd8c6473a95cabf0bd8ab87259545a3dc61a107a37dee9620ead4441a"} Aug 04 11:23:29.618508 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:29.618448 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p" event={"ID":"e13fcc54-5168-4412-a90f-8deb46c7b497","Type":"ContainerDied","Data":"4f1830fe61a86f26e1a455fcea01c784087389ae3b8a4beac0b33f646595eb30"} Aug 04 11:23:29.626358 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:29.626250 2576 scope.go:117] "RemoveContainer" containerID="53df90acdba6501b2863cfdbd530f1eb16f8749bce828d2e906564739a43d333" Aug 04 11:23:29.626727 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:23:29.626701 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53df90acdba6501b2863cfdbd530f1eb16f8749bce828d2e906564739a43d333\": container with ID starting with 53df90acdba6501b2863cfdbd530f1eb16f8749bce828d2e906564739a43d333 not found: ID does not exist" containerID="53df90acdba6501b2863cfdbd530f1eb16f8749bce828d2e906564739a43d333" Aug 04 11:23:29.626823 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:29.626738 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53df90acdba6501b2863cfdbd530f1eb16f8749bce828d2e906564739a43d333"} err="failed to get container status \"53df90acdba6501b2863cfdbd530f1eb16f8749bce828d2e906564739a43d333\": rpc error: code = NotFound desc = could not find container \"53df90acdba6501b2863cfdbd530f1eb16f8749bce828d2e906564739a43d333\": container with ID starting with 53df90acdba6501b2863cfdbd530f1eb16f8749bce828d2e906564739a43d333 not found: ID does not exist" Aug 04 11:23:29.626823 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:29.626761 2576 scope.go:117] "RemoveContainer" containerID="c23f2cecd8c6473a95cabf0bd8ab87259545a3dc61a107a37dee9620ead4441a" Aug 04 11:23:29.634976 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:29.634960 2576 scope.go:117] "RemoveContainer" containerID="c23f2cecd8c6473a95cabf0bd8ab87259545a3dc61a107a37dee9620ead4441a" Aug 04 11:23:29.635243 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:23:29.635226 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c23f2cecd8c6473a95cabf0bd8ab87259545a3dc61a107a37dee9620ead4441a\": container with ID starting with c23f2cecd8c6473a95cabf0bd8ab87259545a3dc61a107a37dee9620ead4441a not found: ID does not exist" containerID="c23f2cecd8c6473a95cabf0bd8ab87259545a3dc61a107a37dee9620ead4441a" Aug 04 11:23:29.635291 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:29.635249 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c23f2cecd8c6473a95cabf0bd8ab87259545a3dc61a107a37dee9620ead4441a"} err="failed to get container status \"c23f2cecd8c6473a95cabf0bd8ab87259545a3dc61a107a37dee9620ead4441a\": rpc error: code = NotFound desc = could not find container \"c23f2cecd8c6473a95cabf0bd8ab87259545a3dc61a107a37dee9620ead4441a\": container with ID starting with c23f2cecd8c6473a95cabf0bd8ab87259545a3dc61a107a37dee9620ead4441a not found: ID does not exist" Aug 04 11:23:29.642007 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:29.641986 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p"] Aug 04 11:23:29.646621 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:29.646600 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-1dd437-558d458778-wvw4p"] Aug 04 11:23:29.663275 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:29.663251 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7"] Aug 04 11:23:29.667854 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:29.667833 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1dd437-7dc8c85bf6-pfqd7"] Aug 04 11:23:29.930587 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:29.930511 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e13fcc54-5168-4412-a90f-8deb46c7b497" path="/var/lib/kubelet/pods/e13fcc54-5168-4412-a90f-8deb46c7b497/volumes" Aug 04 11:23:29.930870 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:29.930856 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fecd922f-d099-4ed8-aee4-b8aa5e457284" path="/var/lib/kubelet/pods/fecd922f-d099-4ed8-aee4-b8aa5e457284/volumes" Aug 04 11:23:40.684496 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.684456 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts"] Aug 04 11:23:40.685003 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.684981 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fecd922f-d099-4ed8-aee4-b8aa5e457284" containerName="payload-pre-processing" Aug 04 11:23:40.685094 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.685008 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fecd922f-d099-4ed8-aee4-b8aa5e457284" containerName="payload-pre-processing" Aug 04 11:23:40.685094 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.685043 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a47e41e4-4823-4beb-9394-1478ba42712a" containerName="payload-pre-processing" Aug 04 11:23:40.685094 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.685053 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a47e41e4-4823-4beb-9394-1478ba42712a" containerName="payload-pre-processing" Aug 04 11:23:40.685094 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.685064 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e13fcc54-5168-4412-a90f-8deb46c7b497" containerName="payload-processing" Aug 04 11:23:40.685094 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.685073 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e13fcc54-5168-4412-a90f-8deb46c7b497" containerName="payload-processing" Aug 04 11:23:40.685094 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.685087 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbebc7a9-d74c-454e-ab81-db3f2039e06a" containerName="payload-processing" Aug 04 11:23:40.685094 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.685095 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbebc7a9-d74c-454e-ab81-db3f2039e06a" containerName="payload-processing" Aug 04 11:23:40.685475 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.685190 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a47e41e4-4823-4beb-9394-1478ba42712a" containerName="payload-pre-processing" Aug 04 11:23:40.685475 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.685201 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fecd922f-d099-4ed8-aee4-b8aa5e457284" containerName="payload-pre-processing" Aug 04 11:23:40.685475 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.685214 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbebc7a9-d74c-454e-ab81-db3f2039e06a" containerName="payload-processing" Aug 04 11:23:40.685475 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.685226 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e13fcc54-5168-4412-a90f-8deb46c7b497" containerName="payload-processing" Aug 04 11:23:40.688940 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.688918 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts" Aug 04 11:23:40.692223 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.692201 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-ba3f3c-dockercfg-b7sn4\"" Aug 04 11:23:40.692634 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.692619 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-ba3f3c\"" Aug 04 11:23:40.701039 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.701017 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts"] Aug 04 11:23:40.715660 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.715608 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd"] Aug 04 11:23:40.719172 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.719151 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd" Aug 04 11:23:40.740520 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.740478 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd"] Aug 04 11:23:40.828697 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.828638 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dbzf\" (UniqueName: \"kubernetes.io/projected/c04aa25f-7b5f-4868-975e-90dc2208d189-kube-api-access-6dbzf\") pod \"payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd\" (UID: \"c04aa25f-7b5f-4868-975e-90dc2208d189\") " pod="openshift-ingress/payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd" Aug 04 11:23:40.828697 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.828692 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/345106bb-71a0-4c5d-a78c-1c24d4c5e2fb-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts\" (UID: \"345106bb-71a0-4c5d-a78c-1c24d4c5e2fb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts" Aug 04 11:23:40.828971 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.828784 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzvws\" (UniqueName: \"kubernetes.io/projected/345106bb-71a0-4c5d-a78c-1c24d4c5e2fb-kube-api-access-kzvws\") pod \"payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts\" (UID: \"345106bb-71a0-4c5d-a78c-1c24d4c5e2fb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts" Aug 04 11:23:40.828971 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.828815 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c04aa25f-7b5f-4868-975e-90dc2208d189-plugins-config-volume\") pod \"payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd\" (UID: \"c04aa25f-7b5f-4868-975e-90dc2208d189\") " pod="openshift-ingress/payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd" Aug 04 11:23:40.929804 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.929759 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dbzf\" (UniqueName: \"kubernetes.io/projected/c04aa25f-7b5f-4868-975e-90dc2208d189-kube-api-access-6dbzf\") pod \"payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd\" (UID: \"c04aa25f-7b5f-4868-975e-90dc2208d189\") " pod="openshift-ingress/payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd" Aug 04 11:23:40.929804 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.929798 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/345106bb-71a0-4c5d-a78c-1c24d4c5e2fb-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts\" (UID: \"345106bb-71a0-4c5d-a78c-1c24d4c5e2fb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts" Aug 04 11:23:40.930071 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.929855 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzvws\" (UniqueName: \"kubernetes.io/projected/345106bb-71a0-4c5d-a78c-1c24d4c5e2fb-kube-api-access-kzvws\") pod \"payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts\" (UID: \"345106bb-71a0-4c5d-a78c-1c24d4c5e2fb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts" Aug 04 11:23:40.930071 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.929876 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c04aa25f-7b5f-4868-975e-90dc2208d189-plugins-config-volume\") pod \"payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd\" (UID: \"c04aa25f-7b5f-4868-975e-90dc2208d189\") " pod="openshift-ingress/payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd" Aug 04 11:23:40.930736 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.930714 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c04aa25f-7b5f-4868-975e-90dc2208d189-plugins-config-volume\") pod \"payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd\" (UID: \"c04aa25f-7b5f-4868-975e-90dc2208d189\") " pod="openshift-ingress/payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd" Aug 04 11:23:40.930825 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.930758 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/345106bb-71a0-4c5d-a78c-1c24d4c5e2fb-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts\" (UID: \"345106bb-71a0-4c5d-a78c-1c24d4c5e2fb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts" Aug 04 11:23:40.938748 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.938688 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzvws\" (UniqueName: \"kubernetes.io/projected/345106bb-71a0-4c5d-a78c-1c24d4c5e2fb-kube-api-access-kzvws\") pod \"payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts\" (UID: \"345106bb-71a0-4c5d-a78c-1c24d4c5e2fb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts" Aug 04 11:23:40.938748 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:40.938688 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dbzf\" (UniqueName: \"kubernetes.io/projected/c04aa25f-7b5f-4868-975e-90dc2208d189-kube-api-access-6dbzf\") pod \"payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd\" (UID: \"c04aa25f-7b5f-4868-975e-90dc2208d189\") " pod="openshift-ingress/payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd" Aug 04 11:23:41.000319 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:41.000280 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts" Aug 04 11:23:41.033045 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:41.033012 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd" Aug 04 11:23:41.158765 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:41.158724 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts"] Aug 04 11:23:41.162542 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:23:41.162514 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod345106bb_71a0_4c5d_a78c_1c24d4c5e2fb.slice/crio-46863d33006d9c5830908ab61a5ce106d826e75c5ddf96c43a965bf2d11b94d1 WatchSource:0}: Error finding container 46863d33006d9c5830908ab61a5ce106d826e75c5ddf96c43a965bf2d11b94d1: Status 404 returned error can't find the container with id 46863d33006d9c5830908ab61a5ce106d826e75c5ddf96c43a965bf2d11b94d1 Aug 04 11:23:41.182360 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:41.182325 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd"] Aug 04 11:23:41.186861 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:23:41.186810 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc04aa25f_7b5f_4868_975e_90dc2208d189.slice/crio-841b634f87d678bf1e3e31ecc68b8f64d1f0d5137a573c19584db481189c40c4 WatchSource:0}: Error finding container 841b634f87d678bf1e3e31ecc68b8f64d1f0d5137a573c19584db481189c40c4: Status 404 returned error can't find the container with id 841b634f87d678bf1e3e31ecc68b8f64d1f0d5137a573c19584db481189c40c4 Aug 04 11:23:41.677781 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:41.677746 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd" event={"ID":"c04aa25f-7b5f-4868-975e-90dc2208d189","Type":"ContainerStarted","Data":"1b484335cd8daf17e02f52c534f6e1db7e56ad8cc8a5bc71946e2f191a50b7b3"} Aug 04 11:23:41.677962 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:41.677808 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd" event={"ID":"c04aa25f-7b5f-4868-975e-90dc2208d189","Type":"ContainerStarted","Data":"841b634f87d678bf1e3e31ecc68b8f64d1f0d5137a573c19584db481189c40c4"} Aug 04 11:23:41.677962 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:41.677842 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd" Aug 04 11:23:41.679175 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:41.679150 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts" event={"ID":"345106bb-71a0-4c5d-a78c-1c24d4c5e2fb","Type":"ContainerStarted","Data":"15fadfaac5c5be90023a78bfa617001776b78319f26b3fbe28d0ecb83a7031b0"} Aug 04 11:23:41.679263 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:41.679192 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts" Aug 04 11:23:41.679263 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:41.679208 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts" event={"ID":"345106bb-71a0-4c5d-a78c-1c24d4c5e2fb","Type":"ContainerStarted","Data":"46863d33006d9c5830908ab61a5ce106d826e75c5ddf96c43a965bf2d11b94d1"} Aug 04 11:23:41.698108 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:41.698068 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd" podStartSLOduration=1.698056374 podStartE2EDuration="1.698056374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:23:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:23:41.696068781 +0000 UTC m=+2772.294973178" watchObservedRunningTime="2026-08-04 11:23:41.698056374 +0000 UTC m=+2772.296960747" Aug 04 11:23:41.713313 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:41.713272 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts" podStartSLOduration=1.713259312 podStartE2EDuration="1.713259312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:23:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:23:41.712615135 +0000 UTC m=+2772.311519535" watchObservedRunningTime="2026-08-04 11:23:41.713259312 +0000 UTC m=+2772.312163686" Aug 04 11:23:52.687132 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:52.687050 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd" Aug 04 11:23:52.687628 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:23:52.687139 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts" Aug 04 11:24:09.779361 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:09.779328 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8"] Aug 04 11:24:09.782678 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:09.782652 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8" Aug 04 11:24:09.785649 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:09.785618 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-46695b\"" Aug 04 11:24:09.785779 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:09.785670 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-46695b-dockercfg-bnqs6\"" Aug 04 11:24:09.791372 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:09.791344 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8"] Aug 04 11:24:09.820998 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:09.820970 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d"] Aug 04 11:24:09.824264 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:09.824243 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d" Aug 04 11:24:09.836186 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:09.836164 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d"] Aug 04 11:24:09.867763 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:09.867736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqzjq\" (UniqueName: \"kubernetes.io/projected/40841185-c2db-4563-8f8d-701ea12672cc-kube-api-access-gqzjq\") pod \"payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8\" (UID: \"40841185-c2db-4563-8f8d-701ea12672cc\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8" Aug 04 11:24:09.867877 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:09.867775 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40841185-c2db-4563-8f8d-701ea12672cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8\" (UID: \"40841185-c2db-4563-8f8d-701ea12672cc\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8" Aug 04 11:24:09.867932 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:09.867889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea8e09c6-2d93-4534-99a7-91e046d633f7-plugins-config-volume\") pod \"payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d\" (UID: \"ea8e09c6-2d93-4534-99a7-91e046d633f7\") " pod="openshift-ingress/payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d" Aug 04 11:24:09.867977 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:09.867936 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzt44\" (UniqueName: \"kubernetes.io/projected/ea8e09c6-2d93-4534-99a7-91e046d633f7-kube-api-access-pzt44\") pod \"payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d\" (UID: \"ea8e09c6-2d93-4534-99a7-91e046d633f7\") " pod="openshift-ingress/payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d" Aug 04 11:24:09.968766 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:09.968729 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqzjq\" (UniqueName: \"kubernetes.io/projected/40841185-c2db-4563-8f8d-701ea12672cc-kube-api-access-gqzjq\") pod \"payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8\" (UID: \"40841185-c2db-4563-8f8d-701ea12672cc\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8" Aug 04 11:24:09.968914 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:09.968794 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40841185-c2db-4563-8f8d-701ea12672cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8\" (UID: \"40841185-c2db-4563-8f8d-701ea12672cc\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8" Aug 04 11:24:09.968914 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:09.968862 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea8e09c6-2d93-4534-99a7-91e046d633f7-plugins-config-volume\") pod \"payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d\" (UID: \"ea8e09c6-2d93-4534-99a7-91e046d633f7\") " pod="openshift-ingress/payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d" Aug 04 11:24:09.969008 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:09.968914 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzt44\" (UniqueName: \"kubernetes.io/projected/ea8e09c6-2d93-4534-99a7-91e046d633f7-kube-api-access-pzt44\") pod \"payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d\" (UID: \"ea8e09c6-2d93-4534-99a7-91e046d633f7\") " pod="openshift-ingress/payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d" Aug 04 11:24:09.969467 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:09.969446 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40841185-c2db-4563-8f8d-701ea12672cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8\" (UID: \"40841185-c2db-4563-8f8d-701ea12672cc\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8" Aug 04 11:24:09.969548 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:09.969530 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea8e09c6-2d93-4534-99a7-91e046d633f7-plugins-config-volume\") pod \"payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d\" (UID: \"ea8e09c6-2d93-4534-99a7-91e046d633f7\") " pod="openshift-ingress/payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d" Aug 04 11:24:09.977121 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:09.977102 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqzjq\" (UniqueName: \"kubernetes.io/projected/40841185-c2db-4563-8f8d-701ea12672cc-kube-api-access-gqzjq\") pod \"payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8\" (UID: \"40841185-c2db-4563-8f8d-701ea12672cc\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8" Aug 04 11:24:09.977220 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:09.977199 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzt44\" (UniqueName: \"kubernetes.io/projected/ea8e09c6-2d93-4534-99a7-91e046d633f7-kube-api-access-pzt44\") pod \"payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d\" (UID: \"ea8e09c6-2d93-4534-99a7-91e046d633f7\") " pod="openshift-ingress/payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d" Aug 04 11:24:10.095034 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:10.094970 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8" Aug 04 11:24:10.134833 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:10.134806 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d" Aug 04 11:24:10.251954 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:10.251923 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8"] Aug 04 11:24:10.254083 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:24:10.254053 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40841185_c2db_4563_8f8d_701ea12672cc.slice/crio-491316d306e676a36b90414ebd9181ad89437e934f94264dbb923a3ef55f3945 WatchSource:0}: Error finding container 491316d306e676a36b90414ebd9181ad89437e934f94264dbb923a3ef55f3945: Status 404 returned error can't find the container with id 491316d306e676a36b90414ebd9181ad89437e934f94264dbb923a3ef55f3945 Aug 04 11:24:10.294438 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:10.294409 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d"] Aug 04 11:24:10.295995 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:24:10.295969 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea8e09c6_2d93_4534_99a7_91e046d633f7.slice/crio-a3936442a61ac2a08f23353b07d00839b59f6410d1965baf076b50123086af83 WatchSource:0}: Error finding container a3936442a61ac2a08f23353b07d00839b59f6410d1965baf076b50123086af83: Status 404 returned error can't find the container with id a3936442a61ac2a08f23353b07d00839b59f6410d1965baf076b50123086af83 Aug 04 11:24:10.821367 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:10.821324 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8" event={"ID":"40841185-c2db-4563-8f8d-701ea12672cc","Type":"ContainerStarted","Data":"d6291a884a658db1ddddf75e2ac51849111f4c76a571fbc43ed806decbff4441"} Aug 04 11:24:10.821837 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:10.821444 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8" event={"ID":"40841185-c2db-4563-8f8d-701ea12672cc","Type":"ContainerStarted","Data":"491316d306e676a36b90414ebd9181ad89437e934f94264dbb923a3ef55f3945"} Aug 04 11:24:10.821837 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:10.821478 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8" Aug 04 11:24:10.822759 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:10.822738 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d" event={"ID":"ea8e09c6-2d93-4534-99a7-91e046d633f7","Type":"ContainerStarted","Data":"0accb8f37148479e3325f81c51515f725a1cc86d688ed262101413c4c213038d"} Aug 04 11:24:10.822890 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:10.822772 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d" event={"ID":"ea8e09c6-2d93-4534-99a7-91e046d633f7","Type":"ContainerStarted","Data":"a3936442a61ac2a08f23353b07d00839b59f6410d1965baf076b50123086af83"} Aug 04 11:24:10.822890 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:10.822815 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d" Aug 04 11:24:10.840530 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:10.840485 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8" podStartSLOduration=1.84047149 podStartE2EDuration="1.84047149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:24:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:24:10.838675085 +0000 UTC m=+2801.437579490" watchObservedRunningTime="2026-08-04 11:24:10.84047149 +0000 UTC m=+2801.439375864" Aug 04 11:24:10.855701 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:10.855662 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d" podStartSLOduration=1.8556486460000001 podStartE2EDuration="1.855648646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:24:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:24:10.854258513 +0000 UTC m=+2801.453162913" watchObservedRunningTime="2026-08-04 11:24:10.855648646 +0000 UTC m=+2801.454553025" Aug 04 11:24:21.830581 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:21.830542 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d" Aug 04 11:24:21.831060 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:21.830611 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8" Aug 04 11:24:51.215853 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:51.215814 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd"] Aug 04 11:24:51.216476 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:51.216064 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd" podUID="c04aa25f-7b5f-4868-975e-90dc2208d189" containerName="payload-processing" containerID="cri-o://1b484335cd8daf17e02f52c534f6e1db7e56ad8cc8a5bc71946e2f191a50b7b3" gracePeriod=30 Aug 04 11:24:51.221993 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:51.221960 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts"] Aug 04 11:24:51.223095 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:51.223009 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts" podUID="345106bb-71a0-4c5d-a78c-1c24d4c5e2fb" containerName="payload-pre-processing" containerID="cri-o://15fadfaac5c5be90023a78bfa617001776b78319f26b3fbe28d0ecb83a7031b0" gracePeriod=30 Aug 04 11:24:51.481849 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:51.481824 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd" Aug 04 11:24:51.518054 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:51.518032 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts" Aug 04 11:24:51.561442 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:51.560654 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/345106bb-71a0-4c5d-a78c-1c24d4c5e2fb-plugins-config-volume\") pod \"345106bb-71a0-4c5d-a78c-1c24d4c5e2fb\" (UID: \"345106bb-71a0-4c5d-a78c-1c24d4c5e2fb\") " Aug 04 11:24:51.561442 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:51.560789 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dbzf\" (UniqueName: \"kubernetes.io/projected/c04aa25f-7b5f-4868-975e-90dc2208d189-kube-api-access-6dbzf\") pod \"c04aa25f-7b5f-4868-975e-90dc2208d189\" (UID: \"c04aa25f-7b5f-4868-975e-90dc2208d189\") " Aug 04 11:24:51.561442 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:51.560837 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzvws\" (UniqueName: \"kubernetes.io/projected/345106bb-71a0-4c5d-a78c-1c24d4c5e2fb-kube-api-access-kzvws\") pod \"345106bb-71a0-4c5d-a78c-1c24d4c5e2fb\" (UID: \"345106bb-71a0-4c5d-a78c-1c24d4c5e2fb\") " Aug 04 11:24:51.561442 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:51.560869 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c04aa25f-7b5f-4868-975e-90dc2208d189-plugins-config-volume\") pod \"c04aa25f-7b5f-4868-975e-90dc2208d189\" (UID: \"c04aa25f-7b5f-4868-975e-90dc2208d189\") " Aug 04 11:24:51.562313 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:51.562006 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c04aa25f-7b5f-4868-975e-90dc2208d189-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c04aa25f-7b5f-4868-975e-90dc2208d189" (UID: "c04aa25f-7b5f-4868-975e-90dc2208d189"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:24:51.563148 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:51.562608 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/345106bb-71a0-4c5d-a78c-1c24d4c5e2fb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "345106bb-71a0-4c5d-a78c-1c24d4c5e2fb" (UID: "345106bb-71a0-4c5d-a78c-1c24d4c5e2fb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:24:51.565963 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:51.565935 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c04aa25f-7b5f-4868-975e-90dc2208d189-kube-api-access-6dbzf" (OuterVolumeSpecName: "kube-api-access-6dbzf") pod "c04aa25f-7b5f-4868-975e-90dc2208d189" (UID: "c04aa25f-7b5f-4868-975e-90dc2208d189"). InnerVolumeSpecName "kube-api-access-6dbzf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:24:51.566677 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:51.566657 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/345106bb-71a0-4c5d-a78c-1c24d4c5e2fb-kube-api-access-kzvws" (OuterVolumeSpecName: "kube-api-access-kzvws") pod "345106bb-71a0-4c5d-a78c-1c24d4c5e2fb" (UID: "345106bb-71a0-4c5d-a78c-1c24d4c5e2fb"). InnerVolumeSpecName "kube-api-access-kzvws". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:24:51.662244 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:51.662219 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dbzf\" (UniqueName: \"kubernetes.io/projected/c04aa25f-7b5f-4868-975e-90dc2208d189-kube-api-access-6dbzf\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:24:51.662244 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:51.662243 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzvws\" (UniqueName: \"kubernetes.io/projected/345106bb-71a0-4c5d-a78c-1c24d4c5e2fb-kube-api-access-kzvws\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:24:51.662418 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:51.662260 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c04aa25f-7b5f-4868-975e-90dc2208d189-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:24:51.662418 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:51.662274 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/345106bb-71a0-4c5d-a78c-1c24d4c5e2fb-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:24:52.029335 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:52.029304 2576 generic.go:356] "Generic (PLEG): container finished" podID="345106bb-71a0-4c5d-a78c-1c24d4c5e2fb" containerID="15fadfaac5c5be90023a78bfa617001776b78319f26b3fbe28d0ecb83a7031b0" exitCode=0 Aug 04 11:24:52.029540 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:52.029349 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts" Aug 04 11:24:52.029540 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:52.029404 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts" event={"ID":"345106bb-71a0-4c5d-a78c-1c24d4c5e2fb","Type":"ContainerDied","Data":"15fadfaac5c5be90023a78bfa617001776b78319f26b3fbe28d0ecb83a7031b0"} Aug 04 11:24:52.029540 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:52.029462 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts" event={"ID":"345106bb-71a0-4c5d-a78c-1c24d4c5e2fb","Type":"ContainerDied","Data":"46863d33006d9c5830908ab61a5ce106d826e75c5ddf96c43a965bf2d11b94d1"} Aug 04 11:24:52.029540 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:52.029497 2576 scope.go:117] "RemoveContainer" containerID="15fadfaac5c5be90023a78bfa617001776b78319f26b3fbe28d0ecb83a7031b0" Aug 04 11:24:52.030759 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:52.030736 2576 generic.go:356] "Generic (PLEG): container finished" podID="c04aa25f-7b5f-4868-975e-90dc2208d189" containerID="1b484335cd8daf17e02f52c534f6e1db7e56ad8cc8a5bc71946e2f191a50b7b3" exitCode=0 Aug 04 11:24:52.030862 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:52.030770 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd" event={"ID":"c04aa25f-7b5f-4868-975e-90dc2208d189","Type":"ContainerDied","Data":"1b484335cd8daf17e02f52c534f6e1db7e56ad8cc8a5bc71946e2f191a50b7b3"} Aug 04 11:24:52.030862 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:52.030790 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd" Aug 04 11:24:52.030862 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:52.030801 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd" event={"ID":"c04aa25f-7b5f-4868-975e-90dc2208d189","Type":"ContainerDied","Data":"841b634f87d678bf1e3e31ecc68b8f64d1f0d5137a573c19584db481189c40c4"} Aug 04 11:24:52.038218 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:52.038203 2576 scope.go:117] "RemoveContainer" containerID="15fadfaac5c5be90023a78bfa617001776b78319f26b3fbe28d0ecb83a7031b0" Aug 04 11:24:52.038510 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:24:52.038487 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15fadfaac5c5be90023a78bfa617001776b78319f26b3fbe28d0ecb83a7031b0\": container with ID starting with 15fadfaac5c5be90023a78bfa617001776b78319f26b3fbe28d0ecb83a7031b0 not found: ID does not exist" containerID="15fadfaac5c5be90023a78bfa617001776b78319f26b3fbe28d0ecb83a7031b0" Aug 04 11:24:52.038600 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:52.038517 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15fadfaac5c5be90023a78bfa617001776b78319f26b3fbe28d0ecb83a7031b0"} err="failed to get container status \"15fadfaac5c5be90023a78bfa617001776b78319f26b3fbe28d0ecb83a7031b0\": rpc error: code = NotFound desc = could not find container \"15fadfaac5c5be90023a78bfa617001776b78319f26b3fbe28d0ecb83a7031b0\": container with ID starting with 15fadfaac5c5be90023a78bfa617001776b78319f26b3fbe28d0ecb83a7031b0 not found: ID does not exist" Aug 04 11:24:52.038600 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:52.038536 2576 scope.go:117] "RemoveContainer" containerID="1b484335cd8daf17e02f52c534f6e1db7e56ad8cc8a5bc71946e2f191a50b7b3" Aug 04 11:24:52.046427 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:52.046408 2576 scope.go:117] "RemoveContainer" containerID="1b484335cd8daf17e02f52c534f6e1db7e56ad8cc8a5bc71946e2f191a50b7b3" Aug 04 11:24:52.046697 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:24:52.046679 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b484335cd8daf17e02f52c534f6e1db7e56ad8cc8a5bc71946e2f191a50b7b3\": container with ID starting with 1b484335cd8daf17e02f52c534f6e1db7e56ad8cc8a5bc71946e2f191a50b7b3 not found: ID does not exist" containerID="1b484335cd8daf17e02f52c534f6e1db7e56ad8cc8a5bc71946e2f191a50b7b3" Aug 04 11:24:52.046747 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:52.046704 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b484335cd8daf17e02f52c534f6e1db7e56ad8cc8a5bc71946e2f191a50b7b3"} err="failed to get container status \"1b484335cd8daf17e02f52c534f6e1db7e56ad8cc8a5bc71946e2f191a50b7b3\": rpc error: code = NotFound desc = could not find container \"1b484335cd8daf17e02f52c534f6e1db7e56ad8cc8a5bc71946e2f191a50b7b3\": container with ID starting with 1b484335cd8daf17e02f52c534f6e1db7e56ad8cc8a5bc71946e2f191a50b7b3 not found: ID does not exist" Aug 04 11:24:52.050666 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:52.050646 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts"] Aug 04 11:24:52.055258 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:52.055238 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-ba3f3c-5ff959db68-5n9ts"] Aug 04 11:24:52.066751 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:52.066732 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd"] Aug 04 11:24:52.076847 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:52.076774 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-ba3f3c-d68c44d5b-kr9xd"] Aug 04 11:24:53.929387 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:53.929350 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="345106bb-71a0-4c5d-a78c-1c24d4c5e2fb" path="/var/lib/kubelet/pods/345106bb-71a0-4c5d-a78c-1c24d4c5e2fb/volumes" Aug 04 11:24:53.929808 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:24:53.929723 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c04aa25f-7b5f-4868-975e-90dc2208d189" path="/var/lib/kubelet/pods/c04aa25f-7b5f-4868-975e-90dc2208d189/volumes" Aug 04 11:25:13.682310 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:13.682277 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d"] Aug 04 11:25:13.684679 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:13.682565 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d" podUID="ea8e09c6-2d93-4534-99a7-91e046d633f7" containerName="payload-processing" containerID="cri-o://0accb8f37148479e3325f81c51515f725a1cc86d688ed262101413c4c213038d" gracePeriod=30 Aug 04 11:25:13.695424 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:13.695377 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8"] Aug 04 11:25:13.695868 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:13.695820 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8" podUID="40841185-c2db-4563-8f8d-701ea12672cc" containerName="payload-pre-processing" containerID="cri-o://d6291a884a658db1ddddf75e2ac51849111f4c76a571fbc43ed806decbff4441" gracePeriod=30 Aug 04 11:25:13.973264 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:13.973243 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d" Aug 04 11:25:13.976063 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:13.976042 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8" Aug 04 11:25:14.051484 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.051448 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea8e09c6-2d93-4534-99a7-91e046d633f7-plugins-config-volume\") pod \"ea8e09c6-2d93-4534-99a7-91e046d633f7\" (UID: \"ea8e09c6-2d93-4534-99a7-91e046d633f7\") " Aug 04 11:25:14.051658 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.051506 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqzjq\" (UniqueName: \"kubernetes.io/projected/40841185-c2db-4563-8f8d-701ea12672cc-kube-api-access-gqzjq\") pod \"40841185-c2db-4563-8f8d-701ea12672cc\" (UID: \"40841185-c2db-4563-8f8d-701ea12672cc\") " Aug 04 11:25:14.051658 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.051536 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40841185-c2db-4563-8f8d-701ea12672cc-plugins-config-volume\") pod \"40841185-c2db-4563-8f8d-701ea12672cc\" (UID: \"40841185-c2db-4563-8f8d-701ea12672cc\") " Aug 04 11:25:14.051658 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.051584 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzt44\" (UniqueName: \"kubernetes.io/projected/ea8e09c6-2d93-4534-99a7-91e046d633f7-kube-api-access-pzt44\") pod \"ea8e09c6-2d93-4534-99a7-91e046d633f7\" (UID: \"ea8e09c6-2d93-4534-99a7-91e046d633f7\") " Aug 04 11:25:14.051900 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.051879 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea8e09c6-2d93-4534-99a7-91e046d633f7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ea8e09c6-2d93-4534-99a7-91e046d633f7" (UID: "ea8e09c6-2d93-4534-99a7-91e046d633f7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:25:14.051900 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.051889 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40841185-c2db-4563-8f8d-701ea12672cc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "40841185-c2db-4563-8f8d-701ea12672cc" (UID: "40841185-c2db-4563-8f8d-701ea12672cc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:25:14.053783 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.053757 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea8e09c6-2d93-4534-99a7-91e046d633f7-kube-api-access-pzt44" (OuterVolumeSpecName: "kube-api-access-pzt44") pod "ea8e09c6-2d93-4534-99a7-91e046d633f7" (UID: "ea8e09c6-2d93-4534-99a7-91e046d633f7"). InnerVolumeSpecName "kube-api-access-pzt44". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:25:14.053870 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.053816 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40841185-c2db-4563-8f8d-701ea12672cc-kube-api-access-gqzjq" (OuterVolumeSpecName: "kube-api-access-gqzjq") pod "40841185-c2db-4563-8f8d-701ea12672cc" (UID: "40841185-c2db-4563-8f8d-701ea12672cc"). InnerVolumeSpecName "kube-api-access-gqzjq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:25:14.139202 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.139161 2576 generic.go:356] "Generic (PLEG): container finished" podID="40841185-c2db-4563-8f8d-701ea12672cc" containerID="d6291a884a658db1ddddf75e2ac51849111f4c76a571fbc43ed806decbff4441" exitCode=0 Aug 04 11:25:14.139412 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.139226 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8" Aug 04 11:25:14.139412 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.139246 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8" event={"ID":"40841185-c2db-4563-8f8d-701ea12672cc","Type":"ContainerDied","Data":"d6291a884a658db1ddddf75e2ac51849111f4c76a571fbc43ed806decbff4441"} Aug 04 11:25:14.139412 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.139341 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8" event={"ID":"40841185-c2db-4563-8f8d-701ea12672cc","Type":"ContainerDied","Data":"491316d306e676a36b90414ebd9181ad89437e934f94264dbb923a3ef55f3945"} Aug 04 11:25:14.139412 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.139370 2576 scope.go:117] "RemoveContainer" containerID="d6291a884a658db1ddddf75e2ac51849111f4c76a571fbc43ed806decbff4441" Aug 04 11:25:14.140716 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.140689 2576 generic.go:356] "Generic (PLEG): container finished" podID="ea8e09c6-2d93-4534-99a7-91e046d633f7" containerID="0accb8f37148479e3325f81c51515f725a1cc86d688ed262101413c4c213038d" exitCode=0 Aug 04 11:25:14.140871 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.140747 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d" Aug 04 11:25:14.140871 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.140739 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d" event={"ID":"ea8e09c6-2d93-4534-99a7-91e046d633f7","Type":"ContainerDied","Data":"0accb8f37148479e3325f81c51515f725a1cc86d688ed262101413c4c213038d"} Aug 04 11:25:14.140995 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.140878 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d" event={"ID":"ea8e09c6-2d93-4534-99a7-91e046d633f7","Type":"ContainerDied","Data":"a3936442a61ac2a08f23353b07d00839b59f6410d1965baf076b50123086af83"} Aug 04 11:25:14.149868 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.149848 2576 scope.go:117] "RemoveContainer" containerID="d6291a884a658db1ddddf75e2ac51849111f4c76a571fbc43ed806decbff4441" Aug 04 11:25:14.150155 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:25:14.150121 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6291a884a658db1ddddf75e2ac51849111f4c76a571fbc43ed806decbff4441\": container with ID starting with d6291a884a658db1ddddf75e2ac51849111f4c76a571fbc43ed806decbff4441 not found: ID does not exist" containerID="d6291a884a658db1ddddf75e2ac51849111f4c76a571fbc43ed806decbff4441" Aug 04 11:25:14.150252 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.150162 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6291a884a658db1ddddf75e2ac51849111f4c76a571fbc43ed806decbff4441"} err="failed to get container status \"d6291a884a658db1ddddf75e2ac51849111f4c76a571fbc43ed806decbff4441\": rpc error: code = NotFound desc = could not find container \"d6291a884a658db1ddddf75e2ac51849111f4c76a571fbc43ed806decbff4441\": container with ID starting with d6291a884a658db1ddddf75e2ac51849111f4c76a571fbc43ed806decbff4441 not found: ID does not exist" Aug 04 11:25:14.150252 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.150180 2576 scope.go:117] "RemoveContainer" containerID="0accb8f37148479e3325f81c51515f725a1cc86d688ed262101413c4c213038d" Aug 04 11:25:14.152676 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.152656 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea8e09c6-2d93-4534-99a7-91e046d633f7-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:25:14.152759 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.152681 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqzjq\" (UniqueName: \"kubernetes.io/projected/40841185-c2db-4563-8f8d-701ea12672cc-kube-api-access-gqzjq\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:25:14.152759 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.152698 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40841185-c2db-4563-8f8d-701ea12672cc-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:25:14.152759 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.152708 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzt44\" (UniqueName: \"kubernetes.io/projected/ea8e09c6-2d93-4534-99a7-91e046d633f7-kube-api-access-pzt44\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:25:14.158294 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.158237 2576 scope.go:117] "RemoveContainer" containerID="0accb8f37148479e3325f81c51515f725a1cc86d688ed262101413c4c213038d" Aug 04 11:25:14.158506 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:25:14.158489 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0accb8f37148479e3325f81c51515f725a1cc86d688ed262101413c4c213038d\": container with ID starting with 0accb8f37148479e3325f81c51515f725a1cc86d688ed262101413c4c213038d not found: ID does not exist" containerID="0accb8f37148479e3325f81c51515f725a1cc86d688ed262101413c4c213038d" Aug 04 11:25:14.158550 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.158513 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0accb8f37148479e3325f81c51515f725a1cc86d688ed262101413c4c213038d"} err="failed to get container status \"0accb8f37148479e3325f81c51515f725a1cc86d688ed262101413c4c213038d\": rpc error: code = NotFound desc = could not find container \"0accb8f37148479e3325f81c51515f725a1cc86d688ed262101413c4c213038d\": container with ID starting with 0accb8f37148479e3325f81c51515f725a1cc86d688ed262101413c4c213038d not found: ID does not exist" Aug 04 11:25:14.167128 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.167106 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8"] Aug 04 11:25:14.173581 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.173556 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-46695b-78c985bcbd-4qpt8"] Aug 04 11:25:14.184937 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.184914 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d"] Aug 04 11:25:14.189257 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:14.189231 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-46695b-5d576d76d6-2qz2d"] Aug 04 11:25:15.931086 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:15.931050 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40841185-c2db-4563-8f8d-701ea12672cc" path="/var/lib/kubelet/pods/40841185-c2db-4563-8f8d-701ea12672cc/volumes" Aug 04 11:25:15.931479 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:15.931421 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea8e09c6-2d93-4534-99a7-91e046d633f7" path="/var/lib/kubelet/pods/ea8e09c6-2d93-4534-99a7-91e046d633f7/volumes" Aug 04 11:25:26.111380 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.111305 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh"] Aug 04 11:25:26.111838 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.111713 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40841185-c2db-4563-8f8d-701ea12672cc" containerName="payload-pre-processing" Aug 04 11:25:26.111838 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.111728 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="40841185-c2db-4563-8f8d-701ea12672cc" containerName="payload-pre-processing" Aug 04 11:25:26.111838 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.111738 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea8e09c6-2d93-4534-99a7-91e046d633f7" containerName="payload-processing" Aug 04 11:25:26.111838 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.111744 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea8e09c6-2d93-4534-99a7-91e046d633f7" containerName="payload-processing" Aug 04 11:25:26.111838 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.111760 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c04aa25f-7b5f-4868-975e-90dc2208d189" containerName="payload-processing" Aug 04 11:25:26.111838 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.111766 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c04aa25f-7b5f-4868-975e-90dc2208d189" containerName="payload-processing" Aug 04 11:25:26.111838 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.111773 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="345106bb-71a0-4c5d-a78c-1c24d4c5e2fb" containerName="payload-pre-processing" Aug 04 11:25:26.111838 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.111778 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="345106bb-71a0-4c5d-a78c-1c24d4c5e2fb" containerName="payload-pre-processing" Aug 04 11:25:26.112082 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.111846 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea8e09c6-2d93-4534-99a7-91e046d633f7" containerName="payload-processing" Aug 04 11:25:26.112082 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.111857 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c04aa25f-7b5f-4868-975e-90dc2208d189" containerName="payload-processing" Aug 04 11:25:26.112082 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.111862 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="40841185-c2db-4563-8f8d-701ea12672cc" containerName="payload-pre-processing" Aug 04 11:25:26.112082 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.111869 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="345106bb-71a0-4c5d-a78c-1c24d4c5e2fb" containerName="payload-pre-processing" Aug 04 11:25:26.116207 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.116191 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh" Aug 04 11:25:26.119635 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.119612 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-ed8ca8\"" Aug 04 11:25:26.119990 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.119975 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-ed8ca8-dockercfg-jq64b\"" Aug 04 11:25:26.128313 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.128294 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh"] Aug 04 11:25:26.156576 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.156553 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b"] Aug 04 11:25:26.159783 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.159767 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b" Aug 04 11:25:26.176764 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.176734 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b"] Aug 04 11:25:26.261522 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.261493 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d42519a-f38b-46d2-87d5-10040992c021-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh\" (UID: \"2d42519a-f38b-46d2-87d5-10040992c021\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh" Aug 04 11:25:26.261704 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.261561 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkj8l\" (UniqueName: \"kubernetes.io/projected/9cfa69f6-38a8-4b44-bfb9-c0f97efc4362-kube-api-access-bkj8l\") pod \"payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b\" (UID: \"9cfa69f6-38a8-4b44-bfb9-c0f97efc4362\") " pod="openshift-ingress/payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b" Aug 04 11:25:26.261704 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.261601 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7xkl\" (UniqueName: \"kubernetes.io/projected/2d42519a-f38b-46d2-87d5-10040992c021-kube-api-access-g7xkl\") pod \"payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh\" (UID: \"2d42519a-f38b-46d2-87d5-10040992c021\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh" Aug 04 11:25:26.261704 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.261644 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cfa69f6-38a8-4b44-bfb9-c0f97efc4362-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b\" (UID: \"9cfa69f6-38a8-4b44-bfb9-c0f97efc4362\") " pod="openshift-ingress/payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b" Aug 04 11:25:26.362934 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.362824 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cfa69f6-38a8-4b44-bfb9-c0f97efc4362-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b\" (UID: \"9cfa69f6-38a8-4b44-bfb9-c0f97efc4362\") " pod="openshift-ingress/payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b" Aug 04 11:25:26.362934 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.362905 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d42519a-f38b-46d2-87d5-10040992c021-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh\" (UID: \"2d42519a-f38b-46d2-87d5-10040992c021\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh" Aug 04 11:25:26.363135 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.362964 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkj8l\" (UniqueName: \"kubernetes.io/projected/9cfa69f6-38a8-4b44-bfb9-c0f97efc4362-kube-api-access-bkj8l\") pod \"payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b\" (UID: \"9cfa69f6-38a8-4b44-bfb9-c0f97efc4362\") " pod="openshift-ingress/payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b" Aug 04 11:25:26.363135 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.362998 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7xkl\" (UniqueName: \"kubernetes.io/projected/2d42519a-f38b-46d2-87d5-10040992c021-kube-api-access-g7xkl\") pod \"payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh\" (UID: \"2d42519a-f38b-46d2-87d5-10040992c021\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh" Aug 04 11:25:26.363655 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.363627 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cfa69f6-38a8-4b44-bfb9-c0f97efc4362-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b\" (UID: \"9cfa69f6-38a8-4b44-bfb9-c0f97efc4362\") " pod="openshift-ingress/payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b" Aug 04 11:25:26.363768 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.363670 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d42519a-f38b-46d2-87d5-10040992c021-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh\" (UID: \"2d42519a-f38b-46d2-87d5-10040992c021\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh" Aug 04 11:25:26.372532 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.372512 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkj8l\" (UniqueName: \"kubernetes.io/projected/9cfa69f6-38a8-4b44-bfb9-c0f97efc4362-kube-api-access-bkj8l\") pod \"payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b\" (UID: \"9cfa69f6-38a8-4b44-bfb9-c0f97efc4362\") " pod="openshift-ingress/payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b" Aug 04 11:25:26.372634 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.372509 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7xkl\" (UniqueName: \"kubernetes.io/projected/2d42519a-f38b-46d2-87d5-10040992c021-kube-api-access-g7xkl\") pod \"payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh\" (UID: \"2d42519a-f38b-46d2-87d5-10040992c021\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh" Aug 04 11:25:26.428295 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.428273 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh" Aug 04 11:25:26.469889 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.469861 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b" Aug 04 11:25:26.581621 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.580823 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh"] Aug 04 11:25:26.584914 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:25:26.584877 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d42519a_f38b_46d2_87d5_10040992c021.slice/crio-080711ef98a182e468978ea2b190b22c2c679fb0feb9257abb0eee82be383ddd WatchSource:0}: Error finding container 080711ef98a182e468978ea2b190b22c2c679fb0feb9257abb0eee82be383ddd: Status 404 returned error can't find the container with id 080711ef98a182e468978ea2b190b22c2c679fb0feb9257abb0eee82be383ddd Aug 04 11:25:26.621359 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:26.621339 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b"] Aug 04 11:25:26.623562 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:25:26.623524 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cfa69f6_38a8_4b44_bfb9_c0f97efc4362.slice/crio-c57ad3054533e75e89d3dc7a40157302f4dc19a39aefc4dc73337934895e1c4e WatchSource:0}: Error finding container c57ad3054533e75e89d3dc7a40157302f4dc19a39aefc4dc73337934895e1c4e: Status 404 returned error can't find the container with id c57ad3054533e75e89d3dc7a40157302f4dc19a39aefc4dc73337934895e1c4e Aug 04 11:25:27.206900 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:27.206863 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b" event={"ID":"9cfa69f6-38a8-4b44-bfb9-c0f97efc4362","Type":"ContainerStarted","Data":"f8fe2a10408d6e2ed52279a79d8e6e331988db1248409fa27b17bc674f878334"} Aug 04 11:25:27.207371 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:27.206918 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b" event={"ID":"9cfa69f6-38a8-4b44-bfb9-c0f97efc4362","Type":"ContainerStarted","Data":"c57ad3054533e75e89d3dc7a40157302f4dc19a39aefc4dc73337934895e1c4e"} Aug 04 11:25:27.207371 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:27.206961 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b" Aug 04 11:25:27.208449 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:27.208421 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh" event={"ID":"2d42519a-f38b-46d2-87d5-10040992c021","Type":"ContainerStarted","Data":"f3867edba9202210f2a67ff9610f00cd6b539cdef7493c23f53e1f781141b983"} Aug 04 11:25:27.208556 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:27.208462 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh" event={"ID":"2d42519a-f38b-46d2-87d5-10040992c021","Type":"ContainerStarted","Data":"080711ef98a182e468978ea2b190b22c2c679fb0feb9257abb0eee82be383ddd"} Aug 04 11:25:27.208556 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:27.208531 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh" Aug 04 11:25:27.250557 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:27.250510 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh" podStartSLOduration=1.2504954750000001 podStartE2EDuration="1.250495475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:25:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:25:27.249790084 +0000 UTC m=+2877.848694468" watchObservedRunningTime="2026-08-04 11:25:27.250495475 +0000 UTC m=+2877.849399848" Aug 04 11:25:27.250735 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:27.250587 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b" podStartSLOduration=1.250584274 podStartE2EDuration="1.250584274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:25:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:25:27.226462424 +0000 UTC m=+2877.825366850" watchObservedRunningTime="2026-08-04 11:25:27.250584274 +0000 UTC m=+2877.849488649" Aug 04 11:25:38.216570 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:38.216541 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b" Aug 04 11:25:38.217100 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:38.216616 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh" Aug 04 11:25:54.477588 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:54.477556 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg"] Aug 04 11:25:54.481029 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:54.481009 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg" Aug 04 11:25:54.487963 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:54.487945 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-c74755\"" Aug 04 11:25:54.494435 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:54.494407 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg"] Aug 04 11:25:54.505713 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:54.505683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e8d5722-20b4-4440-acf7-27ee1352535f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg\" (UID: \"6e8d5722-20b4-4440-acf7-27ee1352535f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg" Aug 04 11:25:54.505840 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:54.505783 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59zlh\" (UniqueName: \"kubernetes.io/projected/6e8d5722-20b4-4440-acf7-27ee1352535f-kube-api-access-59zlh\") pod \"payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg\" (UID: \"6e8d5722-20b4-4440-acf7-27ee1352535f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg" Aug 04 11:25:54.542401 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:54.542358 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv"] Aug 04 11:25:54.546206 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:54.546191 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv" Aug 04 11:25:54.549467 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:54.549429 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-c74755-dockercfg-hwngs\"" Aug 04 11:25:54.557229 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:54.557208 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv"] Aug 04 11:25:54.606310 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:54.606274 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59zlh\" (UniqueName: \"kubernetes.io/projected/6e8d5722-20b4-4440-acf7-27ee1352535f-kube-api-access-59zlh\") pod \"payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg\" (UID: \"6e8d5722-20b4-4440-acf7-27ee1352535f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg" Aug 04 11:25:54.606500 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:54.606360 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e8d5722-20b4-4440-acf7-27ee1352535f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg\" (UID: \"6e8d5722-20b4-4440-acf7-27ee1352535f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg" Aug 04 11:25:54.606500 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:54.606426 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c8eb492-39af-4d5a-839a-d2f310f8fbc4-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv\" (UID: \"9c8eb492-39af-4d5a-839a-d2f310f8fbc4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv" Aug 04 11:25:54.606500 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:54.606447 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5s7s\" (UniqueName: \"kubernetes.io/projected/9c8eb492-39af-4d5a-839a-d2f310f8fbc4-kube-api-access-w5s7s\") pod \"payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv\" (UID: \"9c8eb492-39af-4d5a-839a-d2f310f8fbc4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv" Aug 04 11:25:54.607044 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:54.607020 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e8d5722-20b4-4440-acf7-27ee1352535f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg\" (UID: \"6e8d5722-20b4-4440-acf7-27ee1352535f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg" Aug 04 11:25:54.630944 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:54.630912 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59zlh\" (UniqueName: \"kubernetes.io/projected/6e8d5722-20b4-4440-acf7-27ee1352535f-kube-api-access-59zlh\") pod \"payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg\" (UID: \"6e8d5722-20b4-4440-acf7-27ee1352535f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg" Aug 04 11:25:54.707421 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:54.707363 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c8eb492-39af-4d5a-839a-d2f310f8fbc4-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv\" (UID: \"9c8eb492-39af-4d5a-839a-d2f310f8fbc4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv" Aug 04 11:25:54.707614 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:54.707438 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5s7s\" (UniqueName: \"kubernetes.io/projected/9c8eb492-39af-4d5a-839a-d2f310f8fbc4-kube-api-access-w5s7s\") pod \"payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv\" (UID: \"9c8eb492-39af-4d5a-839a-d2f310f8fbc4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv" Aug 04 11:25:54.708101 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:54.708079 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c8eb492-39af-4d5a-839a-d2f310f8fbc4-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv\" (UID: \"9c8eb492-39af-4d5a-839a-d2f310f8fbc4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv" Aug 04 11:25:54.716239 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:54.716211 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5s7s\" (UniqueName: \"kubernetes.io/projected/9c8eb492-39af-4d5a-839a-d2f310f8fbc4-kube-api-access-w5s7s\") pod \"payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv\" (UID: \"9c8eb492-39af-4d5a-839a-d2f310f8fbc4\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv" Aug 04 11:25:54.791270 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:54.791230 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg" Aug 04 11:25:54.858425 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:54.857849 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv" Aug 04 11:25:54.956805 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:54.956446 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg"] Aug 04 11:25:54.960221 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:25:54.960191 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e8d5722_20b4_4440_acf7_27ee1352535f.slice/crio-2bc6e2213de90dcc91d2a8c972999e454faad7a2e7c7335f13cd41428a863734 WatchSource:0}: Error finding container 2bc6e2213de90dcc91d2a8c972999e454faad7a2e7c7335f13cd41428a863734: Status 404 returned error can't find the container with id 2bc6e2213de90dcc91d2a8c972999e454faad7a2e7c7335f13cd41428a863734 Aug 04 11:25:55.020075 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:55.020053 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv"] Aug 04 11:25:55.022226 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:25:55.022118 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c8eb492_39af_4d5a_839a_d2f310f8fbc4.slice/crio-8cc841beb255b9087699583c5a0df555b4bb2e402569b41d3dd1471c1b2c168d WatchSource:0}: Error finding container 8cc841beb255b9087699583c5a0df555b4bb2e402569b41d3dd1471c1b2c168d: Status 404 returned error can't find the container with id 8cc841beb255b9087699583c5a0df555b4bb2e402569b41d3dd1471c1b2c168d Aug 04 11:25:55.345544 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:55.345435 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv" event={"ID":"9c8eb492-39af-4d5a-839a-d2f310f8fbc4","Type":"ContainerStarted","Data":"01f10b81f268046972f4ae44620f98f3f3aed0573890cba5374497dd7d342752"} Aug 04 11:25:55.345544 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:55.345532 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv" Aug 04 11:25:55.345779 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:55.345559 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv" event={"ID":"9c8eb492-39af-4d5a-839a-d2f310f8fbc4","Type":"ContainerStarted","Data":"8cc841beb255b9087699583c5a0df555b4bb2e402569b41d3dd1471c1b2c168d"} Aug 04 11:25:55.347314 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:55.347286 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg" event={"ID":"6e8d5722-20b4-4440-acf7-27ee1352535f","Type":"ContainerStarted","Data":"81c6e66d2ff8d34b652b7d34be4afb7ba2edbf2bf0b6f9f9761a9cc964b5b39a"} Aug 04 11:25:55.347476 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:55.347325 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg" event={"ID":"6e8d5722-20b4-4440-acf7-27ee1352535f","Type":"ContainerStarted","Data":"2bc6e2213de90dcc91d2a8c972999e454faad7a2e7c7335f13cd41428a863734"} Aug 04 11:25:55.347476 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:55.347353 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg" Aug 04 11:25:55.364645 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:55.364599 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv" podStartSLOduration=1.364584646 podStartE2EDuration="1.364584646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:25:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:25:55.362092965 +0000 UTC m=+2905.960997383" watchObservedRunningTime="2026-08-04 11:25:55.364584646 +0000 UTC m=+2905.963489020" Aug 04 11:25:55.385958 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:25:55.385905 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg" podStartSLOduration=1.385886904 podStartE2EDuration="1.385886904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:25:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:25:55.382863449 +0000 UTC m=+2905.981767842" watchObservedRunningTime="2026-08-04 11:25:55.385886904 +0000 UTC m=+2905.984791277" Aug 04 11:26:06.354283 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:26:06.354252 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv" Aug 04 11:26:06.354827 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:26:06.354329 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg" Aug 04 11:27:30.053891 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:27:30.053863 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 11:27:30.060621 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:27:30.060602 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 11:32:30.103038 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:32:30.103009 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 11:32:30.105407 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:32:30.105364 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 11:35:46.978845 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:46.978811 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd"] Aug 04 11:35:46.982259 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:46.982241 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd" Aug 04 11:35:46.985990 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:46.985956 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-e44431\"" Aug 04 11:35:46.986119 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:46.985999 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-e44431-dockercfg-l2scb\"" Aug 04 11:35:46.991903 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:46.991877 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd"] Aug 04 11:35:47.011207 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:47.011181 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf"] Aug 04 11:35:47.015019 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:47.015001 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf" Aug 04 11:35:47.029094 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:47.029040 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf"] Aug 04 11:35:47.043592 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:47.043562 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j45x\" (UniqueName: \"kubernetes.io/projected/4b82998a-ec4b-446d-a793-7b3f4bf56622-kube-api-access-8j45x\") pod \"payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd\" (UID: \"4b82998a-ec4b-446d-a793-7b3f4bf56622\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd" Aug 04 11:35:47.043720 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:47.043698 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b82998a-ec4b-446d-a793-7b3f4bf56622-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd\" (UID: \"4b82998a-ec4b-446d-a793-7b3f4bf56622\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd" Aug 04 11:35:47.043794 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:47.043778 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jfwz\" (UniqueName: \"kubernetes.io/projected/8850f85a-07cb-4ac4-a9c2-25c96303f20a-kube-api-access-7jfwz\") pod \"payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf\" (UID: \"8850f85a-07cb-4ac4-a9c2-25c96303f20a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf" Aug 04 11:35:47.043838 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:47.043824 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8850f85a-07cb-4ac4-a9c2-25c96303f20a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf\" (UID: \"8850f85a-07cb-4ac4-a9c2-25c96303f20a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf" Aug 04 11:35:47.144687 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:47.144646 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b82998a-ec4b-446d-a793-7b3f4bf56622-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd\" (UID: \"4b82998a-ec4b-446d-a793-7b3f4bf56622\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd" Aug 04 11:35:47.144894 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:47.144712 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jfwz\" (UniqueName: \"kubernetes.io/projected/8850f85a-07cb-4ac4-a9c2-25c96303f20a-kube-api-access-7jfwz\") pod \"payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf\" (UID: \"8850f85a-07cb-4ac4-a9c2-25c96303f20a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf" Aug 04 11:35:47.144894 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:47.144749 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8850f85a-07cb-4ac4-a9c2-25c96303f20a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf\" (UID: \"8850f85a-07cb-4ac4-a9c2-25c96303f20a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf" Aug 04 11:35:47.144894 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:47.144781 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j45x\" (UniqueName: \"kubernetes.io/projected/4b82998a-ec4b-446d-a793-7b3f4bf56622-kube-api-access-8j45x\") pod \"payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd\" (UID: \"4b82998a-ec4b-446d-a793-7b3f4bf56622\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd" Aug 04 11:35:47.145479 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:47.145455 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b82998a-ec4b-446d-a793-7b3f4bf56622-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd\" (UID: \"4b82998a-ec4b-446d-a793-7b3f4bf56622\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd" Aug 04 11:35:47.145595 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:47.145465 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8850f85a-07cb-4ac4-a9c2-25c96303f20a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf\" (UID: \"8850f85a-07cb-4ac4-a9c2-25c96303f20a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf" Aug 04 11:35:47.154647 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:47.154621 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jfwz\" (UniqueName: \"kubernetes.io/projected/8850f85a-07cb-4ac4-a9c2-25c96303f20a-kube-api-access-7jfwz\") pod \"payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf\" (UID: \"8850f85a-07cb-4ac4-a9c2-25c96303f20a\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf" Aug 04 11:35:47.155587 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:47.155564 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j45x\" (UniqueName: \"kubernetes.io/projected/4b82998a-ec4b-446d-a793-7b3f4bf56622-kube-api-access-8j45x\") pod \"payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd\" (UID: \"4b82998a-ec4b-446d-a793-7b3f4bf56622\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd" Aug 04 11:35:47.293639 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:47.293612 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd" Aug 04 11:35:47.324221 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:47.324196 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf" Aug 04 11:35:47.482520 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:47.482495 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf"] Aug 04 11:35:47.485516 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:35:47.485468 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8850f85a_07cb_4ac4_a9c2_25c96303f20a.slice/crio-3cbf9854b492d8e508e6ad46f0eb0c624648628aba0962e0733a726fd87530f9 WatchSource:0}: Error finding container 3cbf9854b492d8e508e6ad46f0eb0c624648628aba0962e0733a726fd87530f9: Status 404 returned error can't find the container with id 3cbf9854b492d8e508e6ad46f0eb0c624648628aba0962e0733a726fd87530f9 Aug 04 11:35:47.661156 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:47.661132 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd"] Aug 04 11:35:47.663115 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:35:47.663092 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b82998a_ec4b_446d_a793_7b3f4bf56622.slice/crio-9b679e946334844dd795467a3be35974f0a77d7932ec031354cb0617d805c8e3 WatchSource:0}: Error finding container 9b679e946334844dd795467a3be35974f0a77d7932ec031354cb0617d805c8e3: Status 404 returned error can't find the container with id 9b679e946334844dd795467a3be35974f0a77d7932ec031354cb0617d805c8e3 Aug 04 11:35:48.224218 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:48.224166 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf" event={"ID":"8850f85a-07cb-4ac4-a9c2-25c96303f20a","Type":"ContainerStarted","Data":"639744b908c40da2d0903d04f61f8683fb51481082cf5db53717604c3f9b7026"} Aug 04 11:35:48.224758 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:48.224231 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf" event={"ID":"8850f85a-07cb-4ac4-a9c2-25c96303f20a","Type":"ContainerStarted","Data":"3cbf9854b492d8e508e6ad46f0eb0c624648628aba0962e0733a726fd87530f9"} Aug 04 11:35:48.224758 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:48.224380 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf" Aug 04 11:35:48.226115 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:48.226086 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd" event={"ID":"4b82998a-ec4b-446d-a793-7b3f4bf56622","Type":"ContainerStarted","Data":"b80bbe0151b0c0d7d3684d25c1c7010746e4fad80844ffb704afadb35f82d9b4"} Aug 04 11:35:48.226309 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:48.226134 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd" event={"ID":"4b82998a-ec4b-446d-a793-7b3f4bf56622","Type":"ContainerStarted","Data":"9b679e946334844dd795467a3be35974f0a77d7932ec031354cb0617d805c8e3"} Aug 04 11:35:48.226309 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:48.226162 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd" Aug 04 11:35:48.245018 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:48.244960 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf" podStartSLOduration=2.244939592 podStartE2EDuration="2.244939592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:35:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:35:48.243531045 +0000 UTC m=+3498.842435449" watchObservedRunningTime="2026-08-04 11:35:48.244939592 +0000 UTC m=+3498.843843969" Aug 04 11:35:48.259610 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:48.259551 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd" podStartSLOduration=2.259531637 podStartE2EDuration="2.259531637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:35:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:35:48.259180533 +0000 UTC m=+3498.858085130" watchObservedRunningTime="2026-08-04 11:35:48.259531637 +0000 UTC m=+3498.858436027" Aug 04 11:35:59.234064 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:59.233979 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd" Aug 04 11:35:59.234064 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:35:59.234058 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf" Aug 04 11:36:07.058826 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:07.058786 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt"] Aug 04 11:36:07.063880 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:07.063843 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt" Aug 04 11:36:07.068087 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:07.068062 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-29b2ff-dockercfg-h4psb\"" Aug 04 11:36:07.068241 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:07.068222 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-29b2ff\"" Aug 04 11:36:07.078460 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:07.078380 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt"] Aug 04 11:36:07.084649 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:07.084626 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd"] Aug 04 11:36:07.088590 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:07.088566 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd" Aug 04 11:36:07.100280 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:07.100249 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd"] Aug 04 11:36:07.225082 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:07.225049 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f5110dd-8748-41e4-ba81-e42b1ffbcbb6-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd\" (UID: \"9f5110dd-8748-41e4-ba81-e42b1ffbcbb6\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd" Aug 04 11:36:07.225257 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:07.225116 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79vjt\" (UniqueName: \"kubernetes.io/projected/9f5110dd-8748-41e4-ba81-e42b1ffbcbb6-kube-api-access-79vjt\") pod \"payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd\" (UID: \"9f5110dd-8748-41e4-ba81-e42b1ffbcbb6\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd" Aug 04 11:36:07.225257 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:07.225150 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1174be8f-4ebf-46bb-a0fe-acfb6a646ae4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt\" (UID: \"1174be8f-4ebf-46bb-a0fe-acfb6a646ae4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt" Aug 04 11:36:07.225257 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:07.225237 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt957\" (UniqueName: \"kubernetes.io/projected/1174be8f-4ebf-46bb-a0fe-acfb6a646ae4-kube-api-access-tt957\") pod \"payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt\" (UID: \"1174be8f-4ebf-46bb-a0fe-acfb6a646ae4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt" Aug 04 11:36:07.326220 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:07.326131 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79vjt\" (UniqueName: \"kubernetes.io/projected/9f5110dd-8748-41e4-ba81-e42b1ffbcbb6-kube-api-access-79vjt\") pod \"payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd\" (UID: \"9f5110dd-8748-41e4-ba81-e42b1ffbcbb6\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd" Aug 04 11:36:07.326220 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:07.326172 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1174be8f-4ebf-46bb-a0fe-acfb6a646ae4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt\" (UID: \"1174be8f-4ebf-46bb-a0fe-acfb6a646ae4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt" Aug 04 11:36:07.326493 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:07.326269 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt957\" (UniqueName: \"kubernetes.io/projected/1174be8f-4ebf-46bb-a0fe-acfb6a646ae4-kube-api-access-tt957\") pod \"payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt\" (UID: \"1174be8f-4ebf-46bb-a0fe-acfb6a646ae4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt" Aug 04 11:36:07.326493 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:07.326444 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f5110dd-8748-41e4-ba81-e42b1ffbcbb6-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd\" (UID: \"9f5110dd-8748-41e4-ba81-e42b1ffbcbb6\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd" Aug 04 11:36:07.326960 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:07.326938 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1174be8f-4ebf-46bb-a0fe-acfb6a646ae4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt\" (UID: \"1174be8f-4ebf-46bb-a0fe-acfb6a646ae4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt" Aug 04 11:36:07.327144 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:07.327125 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f5110dd-8748-41e4-ba81-e42b1ffbcbb6-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd\" (UID: \"9f5110dd-8748-41e4-ba81-e42b1ffbcbb6\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd" Aug 04 11:36:07.335539 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:07.335518 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79vjt\" (UniqueName: \"kubernetes.io/projected/9f5110dd-8748-41e4-ba81-e42b1ffbcbb6-kube-api-access-79vjt\") pod \"payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd\" (UID: \"9f5110dd-8748-41e4-ba81-e42b1ffbcbb6\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd" Aug 04 11:36:07.335650 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:07.335629 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt957\" (UniqueName: \"kubernetes.io/projected/1174be8f-4ebf-46bb-a0fe-acfb6a646ae4-kube-api-access-tt957\") pod \"payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt\" (UID: \"1174be8f-4ebf-46bb-a0fe-acfb6a646ae4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt" Aug 04 11:36:07.378843 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:07.378813 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt" Aug 04 11:36:07.401099 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:07.401072 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd" Aug 04 11:36:07.544436 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:07.544406 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt"] Aug 04 11:36:07.544654 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:36:07.544629 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1174be8f_4ebf_46bb_a0fe_acfb6a646ae4.slice/crio-f948dae1cf14582f76cda23a622ae8dd3ca2d5884f2ef21e4fda115581a5518b WatchSource:0}: Error finding container f948dae1cf14582f76cda23a622ae8dd3ca2d5884f2ef21e4fda115581a5518b: Status 404 returned error can't find the container with id f948dae1cf14582f76cda23a622ae8dd3ca2d5884f2ef21e4fda115581a5518b Aug 04 11:36:07.576772 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:07.576736 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd"] Aug 04 11:36:07.584576 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:36:07.584551 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f5110dd_8748_41e4_ba81_e42b1ffbcbb6.slice/crio-504c7e1a9f6fb6f97853f06258284fa27e42d0f84dc422423b2b73dfd7748103 WatchSource:0}: Error finding container 504c7e1a9f6fb6f97853f06258284fa27e42d0f84dc422423b2b73dfd7748103: Status 404 returned error can't find the container with id 504c7e1a9f6fb6f97853f06258284fa27e42d0f84dc422423b2b73dfd7748103 Aug 04 11:36:08.328279 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:08.328235 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt" event={"ID":"1174be8f-4ebf-46bb-a0fe-acfb6a646ae4","Type":"ContainerStarted","Data":"73a7e3f3cbe58dde55ec1e61779b2a3dd20fa52e9a1e1c8ecfbd06f7888db1c6"} Aug 04 11:36:08.328792 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:08.328300 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt" event={"ID":"1174be8f-4ebf-46bb-a0fe-acfb6a646ae4","Type":"ContainerStarted","Data":"f948dae1cf14582f76cda23a622ae8dd3ca2d5884f2ef21e4fda115581a5518b"} Aug 04 11:36:08.328792 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:08.328386 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt" Aug 04 11:36:08.330061 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:08.330037 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd" event={"ID":"9f5110dd-8748-41e4-ba81-e42b1ffbcbb6","Type":"ContainerStarted","Data":"2aa454faeb56443775466065a2ae330cefd04de4e642c890e1658696a967dc0f"} Aug 04 11:36:08.330201 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:08.330082 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd" event={"ID":"9f5110dd-8748-41e4-ba81-e42b1ffbcbb6","Type":"ContainerStarted","Data":"504c7e1a9f6fb6f97853f06258284fa27e42d0f84dc422423b2b73dfd7748103"} Aug 04 11:36:08.330201 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:08.330109 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd" Aug 04 11:36:08.350300 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:08.350242 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt" podStartSLOduration=1.350221588 podStartE2EDuration="1.350221588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:36:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:36:08.347117908 +0000 UTC m=+3518.946022283" watchObservedRunningTime="2026-08-04 11:36:08.350221588 +0000 UTC m=+3518.949125962" Aug 04 11:36:08.367935 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:08.367858 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd" podStartSLOduration=1.367838602 podStartE2EDuration="1.367838602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:36:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:36:08.365002509 +0000 UTC m=+3518.963906947" watchObservedRunningTime="2026-08-04 11:36:08.367838602 +0000 UTC m=+3518.966742977" Aug 04 11:36:19.338476 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:19.338448 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt" Aug 04 11:36:19.341048 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:19.338520 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd" Aug 04 11:36:30.957727 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:30.957692 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-24r8m_03a5a1b7-420e-4272-a532-c4e2ec4c91a7/payload-processing/0.log" Aug 04 11:36:31.073790 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:36:31.073752 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd_9f5110dd-8748-41e4-ba81-e42b1ffbcbb6/payload-processing/0.log" Aug 04 11:37:15.894688 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:15.894655 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf_8850f85a-07cb-4ac4-a9c2-25c96303f20a/payload-processing/0.log" Aug 04 11:37:16.050570 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:16.050532 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-24r8m_03a5a1b7-420e-4272-a532-c4e2ec4c91a7/payload-processing/0.log" Aug 04 11:37:16.174812 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:16.174747 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd_9f5110dd-8748-41e4-ba81-e42b1ffbcbb6/payload-processing/0.log" Aug 04 11:37:22.492405 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:22.492324 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f"] Aug 04 11:37:22.496047 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:22.496028 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f" Aug 04 11:37:22.498872 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:22.498854 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-20aab6\"" Aug 04 11:37:22.505498 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:22.505476 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f"] Aug 04 11:37:22.529496 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:22.529459 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf"] Aug 04 11:37:22.533051 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:22.533031 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf" Aug 04 11:37:22.535899 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:22.535874 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-20aab6-dockercfg-jsnqm\"" Aug 04 11:37:22.550909 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:22.550884 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf"] Aug 04 11:37:22.611631 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:22.611589 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm5c8\" (UniqueName: \"kubernetes.io/projected/58a625aa-2048-4e7d-9442-dba54c0183a2-kube-api-access-zm5c8\") pod \"payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf\" (UID: \"58a625aa-2048-4e7d-9442-dba54c0183a2\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf" Aug 04 11:37:22.611773 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:22.611736 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7522238a-73ff-4da5-a162-4f37aa5a5f16-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f\" (UID: \"7522238a-73ff-4da5-a162-4f37aa5a5f16\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f" Aug 04 11:37:22.611839 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:22.611821 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n9rm\" (UniqueName: \"kubernetes.io/projected/7522238a-73ff-4da5-a162-4f37aa5a5f16-kube-api-access-9n9rm\") pod \"payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f\" (UID: \"7522238a-73ff-4da5-a162-4f37aa5a5f16\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f" Aug 04 11:37:22.611926 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:22.611905 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58a625aa-2048-4e7d-9442-dba54c0183a2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf\" (UID: \"58a625aa-2048-4e7d-9442-dba54c0183a2\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf" Aug 04 11:37:22.713082 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:22.713046 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7522238a-73ff-4da5-a162-4f37aa5a5f16-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f\" (UID: \"7522238a-73ff-4da5-a162-4f37aa5a5f16\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f" Aug 04 11:37:22.713274 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:22.713103 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n9rm\" (UniqueName: \"kubernetes.io/projected/7522238a-73ff-4da5-a162-4f37aa5a5f16-kube-api-access-9n9rm\") pod \"payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f\" (UID: \"7522238a-73ff-4da5-a162-4f37aa5a5f16\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f" Aug 04 11:37:22.713274 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:22.713144 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58a625aa-2048-4e7d-9442-dba54c0183a2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf\" (UID: \"58a625aa-2048-4e7d-9442-dba54c0183a2\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf" Aug 04 11:37:22.713274 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:22.713175 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm5c8\" (UniqueName: \"kubernetes.io/projected/58a625aa-2048-4e7d-9442-dba54c0183a2-kube-api-access-zm5c8\") pod \"payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf\" (UID: \"58a625aa-2048-4e7d-9442-dba54c0183a2\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf" Aug 04 11:37:22.713862 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:22.713837 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7522238a-73ff-4da5-a162-4f37aa5a5f16-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f\" (UID: \"7522238a-73ff-4da5-a162-4f37aa5a5f16\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f" Aug 04 11:37:22.713960 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:22.713925 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58a625aa-2048-4e7d-9442-dba54c0183a2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf\" (UID: \"58a625aa-2048-4e7d-9442-dba54c0183a2\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf" Aug 04 11:37:22.722449 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:22.722424 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n9rm\" (UniqueName: \"kubernetes.io/projected/7522238a-73ff-4da5-a162-4f37aa5a5f16-kube-api-access-9n9rm\") pod \"payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f\" (UID: \"7522238a-73ff-4da5-a162-4f37aa5a5f16\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f" Aug 04 11:37:22.724555 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:22.724528 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm5c8\" (UniqueName: \"kubernetes.io/projected/58a625aa-2048-4e7d-9442-dba54c0183a2-kube-api-access-zm5c8\") pod \"payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf\" (UID: \"58a625aa-2048-4e7d-9442-dba54c0183a2\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf" Aug 04 11:37:22.808295 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:22.808226 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f" Aug 04 11:37:22.842864 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:22.842820 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf" Aug 04 11:37:23.000700 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:23.000667 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf"] Aug 04 11:37:23.004635 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:37:23.004598 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58a625aa_2048_4e7d_9442_dba54c0183a2.slice/crio-eeb59a9722855a03cde281239db625ab2ba045b696526a4256856c1cf281ba82 WatchSource:0}: Error finding container eeb59a9722855a03cde281239db625ab2ba045b696526a4256856c1cf281ba82: Status 404 returned error can't find the container with id eeb59a9722855a03cde281239db625ab2ba045b696526a4256856c1cf281ba82 Aug 04 11:37:23.162734 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:23.162700 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f"] Aug 04 11:37:23.164691 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:37:23.164663 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7522238a_73ff_4da5_a162_4f37aa5a5f16.slice/crio-bcfdd26e07d04e9a5f40420f10f2a819e3fe7c65a152a4da609f2945c6eba5ba WatchSource:0}: Error finding container bcfdd26e07d04e9a5f40420f10f2a819e3fe7c65a152a4da609f2945c6eba5ba: Status 404 returned error can't find the container with id bcfdd26e07d04e9a5f40420f10f2a819e3fe7c65a152a4da609f2945c6eba5ba Aug 04 11:37:23.736231 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:23.736196 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf" event={"ID":"58a625aa-2048-4e7d-9442-dba54c0183a2","Type":"ContainerStarted","Data":"9c852548e2b8ddc4dbc4af9de834183624fe19318076bb587256a1ef0bda3af6"} Aug 04 11:37:23.736707 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:23.736257 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf" event={"ID":"58a625aa-2048-4e7d-9442-dba54c0183a2","Type":"ContainerStarted","Data":"eeb59a9722855a03cde281239db625ab2ba045b696526a4256856c1cf281ba82"} Aug 04 11:37:23.736707 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:23.736320 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf" Aug 04 11:37:23.737919 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:23.737892 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f" event={"ID":"7522238a-73ff-4da5-a162-4f37aa5a5f16","Type":"ContainerStarted","Data":"92437b639bf0e57dcae2590b0335fd193639e565dbdfc9542b1853400d552251"} Aug 04 11:37:23.738048 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:23.737940 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f" Aug 04 11:37:23.738048 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:23.737958 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f" event={"ID":"7522238a-73ff-4da5-a162-4f37aa5a5f16","Type":"ContainerStarted","Data":"bcfdd26e07d04e9a5f40420f10f2a819e3fe7c65a152a4da609f2945c6eba5ba"} Aug 04 11:37:23.755658 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:23.755606 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf" podStartSLOduration=1.7555873800000001 podStartE2EDuration="1.75558738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:37:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:37:23.755206136 +0000 UTC m=+3594.354110512" watchObservedRunningTime="2026-08-04 11:37:23.75558738 +0000 UTC m=+3594.354491736" Aug 04 11:37:23.773615 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:23.773560 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f" podStartSLOduration=1.773545382 podStartE2EDuration="1.773545382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 11:37:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:37:23.77196019 +0000 UTC m=+3594.370864584" watchObservedRunningTime="2026-08-04 11:37:23.773545382 +0000 UTC m=+3594.372449755" Aug 04 11:37:30.136338 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:30.136312 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 11:37:30.138567 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:30.138541 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 11:37:34.746076 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:34.746046 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf" Aug 04 11:37:34.746588 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:34.746124 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f" Aug 04 11:37:49.539219 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.539181 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf"] Aug 04 11:37:49.540230 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.540175 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf" podUID="58a625aa-2048-4e7d-9442-dba54c0183a2" containerName="payload-processing" containerID="cri-o://9c852548e2b8ddc4dbc4af9de834183624fe19318076bb587256a1ef0bda3af6" gracePeriod=30 Aug 04 11:37:49.543878 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.543850 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f"] Aug 04 11:37:49.544113 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.544064 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f" podUID="7522238a-73ff-4da5-a162-4f37aa5a5f16" containerName="payload-pre-processing" containerID="cri-o://92437b639bf0e57dcae2590b0335fd193639e565dbdfc9542b1853400d552251" gracePeriod=30 Aug 04 11:37:49.830877 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.830853 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f" Aug 04 11:37:49.833988 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.833966 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf" Aug 04 11:37:49.883893 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.883857 2576 generic.go:356] "Generic (PLEG): container finished" podID="7522238a-73ff-4da5-a162-4f37aa5a5f16" containerID="92437b639bf0e57dcae2590b0335fd193639e565dbdfc9542b1853400d552251" exitCode=0 Aug 04 11:37:49.884088 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.883919 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f" Aug 04 11:37:49.884088 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.883953 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f" event={"ID":"7522238a-73ff-4da5-a162-4f37aa5a5f16","Type":"ContainerDied","Data":"92437b639bf0e57dcae2590b0335fd193639e565dbdfc9542b1853400d552251"} Aug 04 11:37:49.884088 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.884011 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f" event={"ID":"7522238a-73ff-4da5-a162-4f37aa5a5f16","Type":"ContainerDied","Data":"bcfdd26e07d04e9a5f40420f10f2a819e3fe7c65a152a4da609f2945c6eba5ba"} Aug 04 11:37:49.884088 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.884042 2576 scope.go:117] "RemoveContainer" containerID="92437b639bf0e57dcae2590b0335fd193639e565dbdfc9542b1853400d552251" Aug 04 11:37:49.885509 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.885485 2576 generic.go:356] "Generic (PLEG): container finished" podID="58a625aa-2048-4e7d-9442-dba54c0183a2" containerID="9c852548e2b8ddc4dbc4af9de834183624fe19318076bb587256a1ef0bda3af6" exitCode=0 Aug 04 11:37:49.885629 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.885524 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf" event={"ID":"58a625aa-2048-4e7d-9442-dba54c0183a2","Type":"ContainerDied","Data":"9c852548e2b8ddc4dbc4af9de834183624fe19318076bb587256a1ef0bda3af6"} Aug 04 11:37:49.885629 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.885536 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf" Aug 04 11:37:49.885629 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.885575 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf" event={"ID":"58a625aa-2048-4e7d-9442-dba54c0183a2","Type":"ContainerDied","Data":"eeb59a9722855a03cde281239db625ab2ba045b696526a4256856c1cf281ba82"} Aug 04 11:37:49.893246 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.893223 2576 scope.go:117] "RemoveContainer" containerID="92437b639bf0e57dcae2590b0335fd193639e565dbdfc9542b1853400d552251" Aug 04 11:37:49.893610 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:37:49.893586 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92437b639bf0e57dcae2590b0335fd193639e565dbdfc9542b1853400d552251\": container with ID starting with 92437b639bf0e57dcae2590b0335fd193639e565dbdfc9542b1853400d552251 not found: ID does not exist" containerID="92437b639bf0e57dcae2590b0335fd193639e565dbdfc9542b1853400d552251" Aug 04 11:37:49.893691 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.893622 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92437b639bf0e57dcae2590b0335fd193639e565dbdfc9542b1853400d552251"} err="failed to get container status \"92437b639bf0e57dcae2590b0335fd193639e565dbdfc9542b1853400d552251\": rpc error: code = NotFound desc = could not find container \"92437b639bf0e57dcae2590b0335fd193639e565dbdfc9542b1853400d552251\": container with ID starting with 92437b639bf0e57dcae2590b0335fd193639e565dbdfc9542b1853400d552251 not found: ID does not exist" Aug 04 11:37:49.893691 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.893645 2576 scope.go:117] "RemoveContainer" containerID="9c852548e2b8ddc4dbc4af9de834183624fe19318076bb587256a1ef0bda3af6" Aug 04 11:37:49.901845 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.901829 2576 scope.go:117] "RemoveContainer" containerID="9c852548e2b8ddc4dbc4af9de834183624fe19318076bb587256a1ef0bda3af6" Aug 04 11:37:49.902132 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:37:49.902112 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c852548e2b8ddc4dbc4af9de834183624fe19318076bb587256a1ef0bda3af6\": container with ID starting with 9c852548e2b8ddc4dbc4af9de834183624fe19318076bb587256a1ef0bda3af6 not found: ID does not exist" containerID="9c852548e2b8ddc4dbc4af9de834183624fe19318076bb587256a1ef0bda3af6" Aug 04 11:37:49.902205 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.902138 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c852548e2b8ddc4dbc4af9de834183624fe19318076bb587256a1ef0bda3af6"} err="failed to get container status \"9c852548e2b8ddc4dbc4af9de834183624fe19318076bb587256a1ef0bda3af6\": rpc error: code = NotFound desc = could not find container \"9c852548e2b8ddc4dbc4af9de834183624fe19318076bb587256a1ef0bda3af6\": container with ID starting with 9c852548e2b8ddc4dbc4af9de834183624fe19318076bb587256a1ef0bda3af6 not found: ID does not exist" Aug 04 11:37:49.973456 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.973420 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9n9rm\" (UniqueName: \"kubernetes.io/projected/7522238a-73ff-4da5-a162-4f37aa5a5f16-kube-api-access-9n9rm\") pod \"7522238a-73ff-4da5-a162-4f37aa5a5f16\" (UID: \"7522238a-73ff-4da5-a162-4f37aa5a5f16\") " Aug 04 11:37:49.973651 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.973468 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zm5c8\" (UniqueName: \"kubernetes.io/projected/58a625aa-2048-4e7d-9442-dba54c0183a2-kube-api-access-zm5c8\") pod \"58a625aa-2048-4e7d-9442-dba54c0183a2\" (UID: \"58a625aa-2048-4e7d-9442-dba54c0183a2\") " Aug 04 11:37:49.973651 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.973516 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58a625aa-2048-4e7d-9442-dba54c0183a2-plugins-config-volume\") pod \"58a625aa-2048-4e7d-9442-dba54c0183a2\" (UID: \"58a625aa-2048-4e7d-9442-dba54c0183a2\") " Aug 04 11:37:49.973651 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.973541 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7522238a-73ff-4da5-a162-4f37aa5a5f16-plugins-config-volume\") pod \"7522238a-73ff-4da5-a162-4f37aa5a5f16\" (UID: \"7522238a-73ff-4da5-a162-4f37aa5a5f16\") " Aug 04 11:37:49.973925 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.973901 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58a625aa-2048-4e7d-9442-dba54c0183a2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "58a625aa-2048-4e7d-9442-dba54c0183a2" (UID: "58a625aa-2048-4e7d-9442-dba54c0183a2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:37:49.974016 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.973933 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7522238a-73ff-4da5-a162-4f37aa5a5f16-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7522238a-73ff-4da5-a162-4f37aa5a5f16" (UID: "7522238a-73ff-4da5-a162-4f37aa5a5f16"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:37:49.975793 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.975765 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7522238a-73ff-4da5-a162-4f37aa5a5f16-kube-api-access-9n9rm" (OuterVolumeSpecName: "kube-api-access-9n9rm") pod "7522238a-73ff-4da5-a162-4f37aa5a5f16" (UID: "7522238a-73ff-4da5-a162-4f37aa5a5f16"). InnerVolumeSpecName "kube-api-access-9n9rm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:37:49.975793 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:49.975776 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58a625aa-2048-4e7d-9442-dba54c0183a2-kube-api-access-zm5c8" (OuterVolumeSpecName: "kube-api-access-zm5c8") pod "58a625aa-2048-4e7d-9442-dba54c0183a2" (UID: "58a625aa-2048-4e7d-9442-dba54c0183a2"). InnerVolumeSpecName "kube-api-access-zm5c8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:37:50.075338 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:50.075252 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58a625aa-2048-4e7d-9442-dba54c0183a2-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:37:50.075338 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:50.075280 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7522238a-73ff-4da5-a162-4f37aa5a5f16-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:37:50.075338 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:50.075291 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9n9rm\" (UniqueName: \"kubernetes.io/projected/7522238a-73ff-4da5-a162-4f37aa5a5f16-kube-api-access-9n9rm\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:37:50.075338 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:50.075301 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zm5c8\" (UniqueName: \"kubernetes.io/projected/58a625aa-2048-4e7d-9442-dba54c0183a2-kube-api-access-zm5c8\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:37:50.214732 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:50.214697 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f"] Aug 04 11:37:50.222848 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:50.222818 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-20aab6-5bb4ddcffb-l2v9f"] Aug 04 11:37:50.235213 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:50.235182 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf"] Aug 04 11:37:50.244666 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:50.244632 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-20aab6-595777dd44-b8qxf"] Aug 04 11:37:51.929851 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:51.929813 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58a625aa-2048-4e7d-9442-dba54c0183a2" path="/var/lib/kubelet/pods/58a625aa-2048-4e7d-9442-dba54c0183a2/volumes" Aug 04 11:37:51.930323 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:37:51.930307 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7522238a-73ff-4da5-a162-4f37aa5a5f16" path="/var/lib/kubelet/pods/7522238a-73ff-4da5-a162-4f37aa5a5f16/volumes" Aug 04 11:38:14.883086 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:14.883028 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf"] Aug 04 11:38:14.883610 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:14.883308 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf" podUID="8850f85a-07cb-4ac4-a9c2-25c96303f20a" containerName="payload-processing" containerID="cri-o://639744b908c40da2d0903d04f61f8683fb51481082cf5db53717604c3f9b7026" gracePeriod=30 Aug 04 11:38:14.896474 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:14.896436 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd"] Aug 04 11:38:14.896895 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:14.896843 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd" podUID="4b82998a-ec4b-446d-a793-7b3f4bf56622" containerName="payload-pre-processing" containerID="cri-o://b80bbe0151b0c0d7d3684d25c1c7010746e4fad80844ffb704afadb35f82d9b4" gracePeriod=30 Aug 04 11:38:15.014694 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:15.014648 2576 generic.go:356] "Generic (PLEG): container finished" podID="8850f85a-07cb-4ac4-a9c2-25c96303f20a" containerID="639744b908c40da2d0903d04f61f8683fb51481082cf5db53717604c3f9b7026" exitCode=0 Aug 04 11:38:15.014887 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:15.014728 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf" event={"ID":"8850f85a-07cb-4ac4-a9c2-25c96303f20a","Type":"ContainerDied","Data":"639744b908c40da2d0903d04f61f8683fb51481082cf5db53717604c3f9b7026"} Aug 04 11:38:15.193849 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:15.193822 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf" Aug 04 11:38:15.196536 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:15.196518 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd" Aug 04 11:38:15.301448 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:15.301383 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8850f85a-07cb-4ac4-a9c2-25c96303f20a-plugins-config-volume\") pod \"8850f85a-07cb-4ac4-a9c2-25c96303f20a\" (UID: \"8850f85a-07cb-4ac4-a9c2-25c96303f20a\") " Aug 04 11:38:15.301653 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:15.301455 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b82998a-ec4b-446d-a793-7b3f4bf56622-plugins-config-volume\") pod \"4b82998a-ec4b-446d-a793-7b3f4bf56622\" (UID: \"4b82998a-ec4b-446d-a793-7b3f4bf56622\") " Aug 04 11:38:15.301653 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:15.301488 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jfwz\" (UniqueName: \"kubernetes.io/projected/8850f85a-07cb-4ac4-a9c2-25c96303f20a-kube-api-access-7jfwz\") pod \"8850f85a-07cb-4ac4-a9c2-25c96303f20a\" (UID: \"8850f85a-07cb-4ac4-a9c2-25c96303f20a\") " Aug 04 11:38:15.301653 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:15.301563 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8j45x\" (UniqueName: \"kubernetes.io/projected/4b82998a-ec4b-446d-a793-7b3f4bf56622-kube-api-access-8j45x\") pod \"4b82998a-ec4b-446d-a793-7b3f4bf56622\" (UID: \"4b82998a-ec4b-446d-a793-7b3f4bf56622\") " Aug 04 11:38:15.301839 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:15.301806 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8850f85a-07cb-4ac4-a9c2-25c96303f20a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8850f85a-07cb-4ac4-a9c2-25c96303f20a" (UID: "8850f85a-07cb-4ac4-a9c2-25c96303f20a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:38:15.301839 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:15.301825 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b82998a-ec4b-446d-a793-7b3f4bf56622-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4b82998a-ec4b-446d-a793-7b3f4bf56622" (UID: "4b82998a-ec4b-446d-a793-7b3f4bf56622"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:38:15.301944 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:15.301895 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8850f85a-07cb-4ac4-a9c2-25c96303f20a-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:38:15.301944 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:15.301914 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b82998a-ec4b-446d-a793-7b3f4bf56622-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:38:15.303815 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:15.303795 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b82998a-ec4b-446d-a793-7b3f4bf56622-kube-api-access-8j45x" (OuterVolumeSpecName: "kube-api-access-8j45x") pod "4b82998a-ec4b-446d-a793-7b3f4bf56622" (UID: "4b82998a-ec4b-446d-a793-7b3f4bf56622"). InnerVolumeSpecName "kube-api-access-8j45x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:38:15.303939 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:15.303919 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8850f85a-07cb-4ac4-a9c2-25c96303f20a-kube-api-access-7jfwz" (OuterVolumeSpecName: "kube-api-access-7jfwz") pod "8850f85a-07cb-4ac4-a9c2-25c96303f20a" (UID: "8850f85a-07cb-4ac4-a9c2-25c96303f20a"). InnerVolumeSpecName "kube-api-access-7jfwz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:38:15.403174 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:15.403137 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8j45x\" (UniqueName: \"kubernetes.io/projected/4b82998a-ec4b-446d-a793-7b3f4bf56622-kube-api-access-8j45x\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:38:15.403174 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:15.403164 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jfwz\" (UniqueName: \"kubernetes.io/projected/8850f85a-07cb-4ac4-a9c2-25c96303f20a-kube-api-access-7jfwz\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:38:16.021087 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:16.021059 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf" Aug 04 11:38:16.021577 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:16.021061 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf" event={"ID":"8850f85a-07cb-4ac4-a9c2-25c96303f20a","Type":"ContainerDied","Data":"3cbf9854b492d8e508e6ad46f0eb0c624648628aba0962e0733a726fd87530f9"} Aug 04 11:38:16.021577 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:16.021222 2576 scope.go:117] "RemoveContainer" containerID="639744b908c40da2d0903d04f61f8683fb51481082cf5db53717604c3f9b7026" Aug 04 11:38:16.022684 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:16.022540 2576 generic.go:356] "Generic (PLEG): container finished" podID="4b82998a-ec4b-446d-a793-7b3f4bf56622" containerID="b80bbe0151b0c0d7d3684d25c1c7010746e4fad80844ffb704afadb35f82d9b4" exitCode=0 Aug 04 11:38:16.022684 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:16.022600 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd" Aug 04 11:38:16.022684 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:16.022634 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd" event={"ID":"4b82998a-ec4b-446d-a793-7b3f4bf56622","Type":"ContainerDied","Data":"b80bbe0151b0c0d7d3684d25c1c7010746e4fad80844ffb704afadb35f82d9b4"} Aug 04 11:38:16.022868 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:16.022684 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd" event={"ID":"4b82998a-ec4b-446d-a793-7b3f4bf56622","Type":"ContainerDied","Data":"9b679e946334844dd795467a3be35974f0a77d7932ec031354cb0617d805c8e3"} Aug 04 11:38:16.033962 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:16.033940 2576 scope.go:117] "RemoveContainer" containerID="b80bbe0151b0c0d7d3684d25c1c7010746e4fad80844ffb704afadb35f82d9b4" Aug 04 11:38:16.041563 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:16.041529 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd"] Aug 04 11:38:16.042543 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:16.042523 2576 scope.go:117] "RemoveContainer" containerID="b80bbe0151b0c0d7d3684d25c1c7010746e4fad80844ffb704afadb35f82d9b4" Aug 04 11:38:16.042817 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:38:16.042800 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b80bbe0151b0c0d7d3684d25c1c7010746e4fad80844ffb704afadb35f82d9b4\": container with ID starting with b80bbe0151b0c0d7d3684d25c1c7010746e4fad80844ffb704afadb35f82d9b4 not found: ID does not exist" containerID="b80bbe0151b0c0d7d3684d25c1c7010746e4fad80844ffb704afadb35f82d9b4" Aug 04 11:38:16.042878 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:16.042827 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b80bbe0151b0c0d7d3684d25c1c7010746e4fad80844ffb704afadb35f82d9b4"} err="failed to get container status \"b80bbe0151b0c0d7d3684d25c1c7010746e4fad80844ffb704afadb35f82d9b4\": rpc error: code = NotFound desc = could not find container \"b80bbe0151b0c0d7d3684d25c1c7010746e4fad80844ffb704afadb35f82d9b4\": container with ID starting with b80bbe0151b0c0d7d3684d25c1c7010746e4fad80844ffb704afadb35f82d9b4 not found: ID does not exist" Aug 04 11:38:16.051162 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:16.051134 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e44431-697f7ffd6d-vjssd"] Aug 04 11:38:16.067132 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:16.067104 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf"] Aug 04 11:38:16.074924 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:16.074901 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e44431-6cd876bfd4-2rcjf"] Aug 04 11:38:17.929590 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:17.929548 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b82998a-ec4b-446d-a793-7b3f4bf56622" path="/var/lib/kubelet/pods/4b82998a-ec4b-446d-a793-7b3f4bf56622/volumes" Aug 04 11:38:17.930087 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:38:17.930067 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8850f85a-07cb-4ac4-a9c2-25c96303f20a" path="/var/lib/kubelet/pods/8850f85a-07cb-4ac4-a9c2-25c96303f20a/volumes" Aug 04 11:39:17.643576 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:17.643540 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd"] Aug 04 11:39:17.644468 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:17.644377 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd" podUID="9f5110dd-8748-41e4-ba81-e42b1ffbcbb6" containerName="payload-processing" containerID="cri-o://2aa454faeb56443775466065a2ae330cefd04de4e642c890e1658696a967dc0f" gracePeriod=30 Aug 04 11:39:17.655653 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:17.655626 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt"] Aug 04 11:39:17.655913 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:17.655867 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt" podUID="1174be8f-4ebf-46bb-a0fe-acfb6a646ae4" containerName="payload-pre-processing" containerID="cri-o://73a7e3f3cbe58dde55ec1e61779b2a3dd20fa52e9a1e1c8ecfbd06f7888db1c6" gracePeriod=30 Aug 04 11:39:17.911840 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:17.911815 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd" Aug 04 11:39:17.947695 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:17.947670 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt" Aug 04 11:39:18.060676 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.060646 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79vjt\" (UniqueName: \"kubernetes.io/projected/9f5110dd-8748-41e4-ba81-e42b1ffbcbb6-kube-api-access-79vjt\") pod \"9f5110dd-8748-41e4-ba81-e42b1ffbcbb6\" (UID: \"9f5110dd-8748-41e4-ba81-e42b1ffbcbb6\") " Aug 04 11:39:18.060838 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.060755 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f5110dd-8748-41e4-ba81-e42b1ffbcbb6-plugins-config-volume\") pod \"9f5110dd-8748-41e4-ba81-e42b1ffbcbb6\" (UID: \"9f5110dd-8748-41e4-ba81-e42b1ffbcbb6\") " Aug 04 11:39:18.060838 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.060813 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1174be8f-4ebf-46bb-a0fe-acfb6a646ae4-plugins-config-volume\") pod \"1174be8f-4ebf-46bb-a0fe-acfb6a646ae4\" (UID: \"1174be8f-4ebf-46bb-a0fe-acfb6a646ae4\") " Aug 04 11:39:18.060954 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.060839 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt957\" (UniqueName: \"kubernetes.io/projected/1174be8f-4ebf-46bb-a0fe-acfb6a646ae4-kube-api-access-tt957\") pod \"1174be8f-4ebf-46bb-a0fe-acfb6a646ae4\" (UID: \"1174be8f-4ebf-46bb-a0fe-acfb6a646ae4\") " Aug 04 11:39:18.061139 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.061114 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f5110dd-8748-41e4-ba81-e42b1ffbcbb6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9f5110dd-8748-41e4-ba81-e42b1ffbcbb6" (UID: "9f5110dd-8748-41e4-ba81-e42b1ffbcbb6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:39:18.061204 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.061148 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1174be8f-4ebf-46bb-a0fe-acfb6a646ae4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1174be8f-4ebf-46bb-a0fe-acfb6a646ae4" (UID: "1174be8f-4ebf-46bb-a0fe-acfb6a646ae4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:39:18.062899 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.062879 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1174be8f-4ebf-46bb-a0fe-acfb6a646ae4-kube-api-access-tt957" (OuterVolumeSpecName: "kube-api-access-tt957") pod "1174be8f-4ebf-46bb-a0fe-acfb6a646ae4" (UID: "1174be8f-4ebf-46bb-a0fe-acfb6a646ae4"). InnerVolumeSpecName "kube-api-access-tt957". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:39:18.062970 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.062952 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f5110dd-8748-41e4-ba81-e42b1ffbcbb6-kube-api-access-79vjt" (OuterVolumeSpecName: "kube-api-access-79vjt") pod "9f5110dd-8748-41e4-ba81-e42b1ffbcbb6" (UID: "9f5110dd-8748-41e4-ba81-e42b1ffbcbb6"). InnerVolumeSpecName "kube-api-access-79vjt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:39:18.162447 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.162329 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79vjt\" (UniqueName: \"kubernetes.io/projected/9f5110dd-8748-41e4-ba81-e42b1ffbcbb6-kube-api-access-79vjt\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:39:18.162447 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.162365 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f5110dd-8748-41e4-ba81-e42b1ffbcbb6-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:39:18.162447 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.162378 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1174be8f-4ebf-46bb-a0fe-acfb6a646ae4-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:39:18.162447 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.162421 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt957\" (UniqueName: \"kubernetes.io/projected/1174be8f-4ebf-46bb-a0fe-acfb6a646ae4-kube-api-access-tt957\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:39:18.336136 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.336099 2576 generic.go:356] "Generic (PLEG): container finished" podID="1174be8f-4ebf-46bb-a0fe-acfb6a646ae4" containerID="73a7e3f3cbe58dde55ec1e61779b2a3dd20fa52e9a1e1c8ecfbd06f7888db1c6" exitCode=0 Aug 04 11:39:18.336331 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.336145 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt" Aug 04 11:39:18.336331 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.336184 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt" event={"ID":"1174be8f-4ebf-46bb-a0fe-acfb6a646ae4","Type":"ContainerDied","Data":"73a7e3f3cbe58dde55ec1e61779b2a3dd20fa52e9a1e1c8ecfbd06f7888db1c6"} Aug 04 11:39:18.336331 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.336244 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt" event={"ID":"1174be8f-4ebf-46bb-a0fe-acfb6a646ae4","Type":"ContainerDied","Data":"f948dae1cf14582f76cda23a622ae8dd3ca2d5884f2ef21e4fda115581a5518b"} Aug 04 11:39:18.336331 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.336283 2576 scope.go:117] "RemoveContainer" containerID="73a7e3f3cbe58dde55ec1e61779b2a3dd20fa52e9a1e1c8ecfbd06f7888db1c6" Aug 04 11:39:18.337699 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.337648 2576 generic.go:356] "Generic (PLEG): container finished" podID="9f5110dd-8748-41e4-ba81-e42b1ffbcbb6" containerID="2aa454faeb56443775466065a2ae330cefd04de4e642c890e1658696a967dc0f" exitCode=0 Aug 04 11:39:18.337783 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.337727 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd" event={"ID":"9f5110dd-8748-41e4-ba81-e42b1ffbcbb6","Type":"ContainerDied","Data":"2aa454faeb56443775466065a2ae330cefd04de4e642c890e1658696a967dc0f"} Aug 04 11:39:18.337783 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.337767 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd" event={"ID":"9f5110dd-8748-41e4-ba81-e42b1ffbcbb6","Type":"ContainerDied","Data":"504c7e1a9f6fb6f97853f06258284fa27e42d0f84dc422423b2b73dfd7748103"} Aug 04 11:39:18.337876 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.337858 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd" Aug 04 11:39:18.348004 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.347980 2576 scope.go:117] "RemoveContainer" containerID="73a7e3f3cbe58dde55ec1e61779b2a3dd20fa52e9a1e1c8ecfbd06f7888db1c6" Aug 04 11:39:18.348282 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:39:18.348261 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73a7e3f3cbe58dde55ec1e61779b2a3dd20fa52e9a1e1c8ecfbd06f7888db1c6\": container with ID starting with 73a7e3f3cbe58dde55ec1e61779b2a3dd20fa52e9a1e1c8ecfbd06f7888db1c6 not found: ID does not exist" containerID="73a7e3f3cbe58dde55ec1e61779b2a3dd20fa52e9a1e1c8ecfbd06f7888db1c6" Aug 04 11:39:18.348354 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.348290 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73a7e3f3cbe58dde55ec1e61779b2a3dd20fa52e9a1e1c8ecfbd06f7888db1c6"} err="failed to get container status \"73a7e3f3cbe58dde55ec1e61779b2a3dd20fa52e9a1e1c8ecfbd06f7888db1c6\": rpc error: code = NotFound desc = could not find container \"73a7e3f3cbe58dde55ec1e61779b2a3dd20fa52e9a1e1c8ecfbd06f7888db1c6\": container with ID starting with 73a7e3f3cbe58dde55ec1e61779b2a3dd20fa52e9a1e1c8ecfbd06f7888db1c6 not found: ID does not exist" Aug 04 11:39:18.348354 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.348307 2576 scope.go:117] "RemoveContainer" containerID="2aa454faeb56443775466065a2ae330cefd04de4e642c890e1658696a967dc0f" Aug 04 11:39:18.356264 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.356250 2576 scope.go:117] "RemoveContainer" containerID="2aa454faeb56443775466065a2ae330cefd04de4e642c890e1658696a967dc0f" Aug 04 11:39:18.356502 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:39:18.356481 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2aa454faeb56443775466065a2ae330cefd04de4e642c890e1658696a967dc0f\": container with ID starting with 2aa454faeb56443775466065a2ae330cefd04de4e642c890e1658696a967dc0f not found: ID does not exist" containerID="2aa454faeb56443775466065a2ae330cefd04de4e642c890e1658696a967dc0f" Aug 04 11:39:18.356591 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.356508 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2aa454faeb56443775466065a2ae330cefd04de4e642c890e1658696a967dc0f"} err="failed to get container status \"2aa454faeb56443775466065a2ae330cefd04de4e642c890e1658696a967dc0f\": rpc error: code = NotFound desc = could not find container \"2aa454faeb56443775466065a2ae330cefd04de4e642c890e1658696a967dc0f\": container with ID starting with 2aa454faeb56443775466065a2ae330cefd04de4e642c890e1658696a967dc0f not found: ID does not exist" Aug 04 11:39:18.370292 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.370263 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt"] Aug 04 11:39:18.382188 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.382164 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-29b2ff-7f5fdbfcf6-4jwgt"] Aug 04 11:39:18.393222 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.393202 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd"] Aug 04 11:39:18.394894 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:18.394875 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-29b2ff-7d5d679c74-vlzfd"] Aug 04 11:39:19.930165 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:19.930131 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1174be8f-4ebf-46bb-a0fe-acfb6a646ae4" path="/var/lib/kubelet/pods/1174be8f-4ebf-46bb-a0fe-acfb6a646ae4/volumes" Aug 04 11:39:19.930557 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:19.930493 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f5110dd-8748-41e4-ba81-e42b1ffbcbb6" path="/var/lib/kubelet/pods/9f5110dd-8748-41e4-ba81-e42b1ffbcbb6/volumes" Aug 04 11:39:30.998607 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:30.998572 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b"] Aug 04 11:39:30.999409 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:30.999356 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b" podUID="9cfa69f6-38a8-4b44-bfb9-c0f97efc4362" containerName="payload-processing" containerID="cri-o://f8fe2a10408d6e2ed52279a79d8e6e331988db1248409fa27b17bc674f878334" gracePeriod=30 Aug 04 11:39:31.002821 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.002791 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh"] Aug 04 11:39:31.003047 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.003017 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh" podUID="2d42519a-f38b-46d2-87d5-10040992c021" containerName="payload-pre-processing" containerID="cri-o://f3867edba9202210f2a67ff9610f00cd6b539cdef7493c23f53e1f781141b983" gracePeriod=30 Aug 04 11:39:31.291543 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.291519 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b" Aug 04 11:39:31.294536 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.294516 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh" Aug 04 11:39:31.379205 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.379177 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d42519a-f38b-46d2-87d5-10040992c021-plugins-config-volume\") pod \"2d42519a-f38b-46d2-87d5-10040992c021\" (UID: \"2d42519a-f38b-46d2-87d5-10040992c021\") " Aug 04 11:39:31.379422 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.379211 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cfa69f6-38a8-4b44-bfb9-c0f97efc4362-plugins-config-volume\") pod \"9cfa69f6-38a8-4b44-bfb9-c0f97efc4362\" (UID: \"9cfa69f6-38a8-4b44-bfb9-c0f97efc4362\") " Aug 04 11:39:31.379422 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.379339 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkj8l\" (UniqueName: \"kubernetes.io/projected/9cfa69f6-38a8-4b44-bfb9-c0f97efc4362-kube-api-access-bkj8l\") pod \"9cfa69f6-38a8-4b44-bfb9-c0f97efc4362\" (UID: \"9cfa69f6-38a8-4b44-bfb9-c0f97efc4362\") " Aug 04 11:39:31.379560 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.379424 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7xkl\" (UniqueName: \"kubernetes.io/projected/2d42519a-f38b-46d2-87d5-10040992c021-kube-api-access-g7xkl\") pod \"2d42519a-f38b-46d2-87d5-10040992c021\" (UID: \"2d42519a-f38b-46d2-87d5-10040992c021\") " Aug 04 11:39:31.379657 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.379636 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d42519a-f38b-46d2-87d5-10040992c021-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2d42519a-f38b-46d2-87d5-10040992c021" (UID: "2d42519a-f38b-46d2-87d5-10040992c021"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:39:31.379657 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.379640 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cfa69f6-38a8-4b44-bfb9-c0f97efc4362-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9cfa69f6-38a8-4b44-bfb9-c0f97efc4362" (UID: "9cfa69f6-38a8-4b44-bfb9-c0f97efc4362"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:39:31.379744 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.379732 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d42519a-f38b-46d2-87d5-10040992c021-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:39:31.379780 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.379746 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9cfa69f6-38a8-4b44-bfb9-c0f97efc4362-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:39:31.381621 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.381599 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cfa69f6-38a8-4b44-bfb9-c0f97efc4362-kube-api-access-bkj8l" (OuterVolumeSpecName: "kube-api-access-bkj8l") pod "9cfa69f6-38a8-4b44-bfb9-c0f97efc4362" (UID: "9cfa69f6-38a8-4b44-bfb9-c0f97efc4362"). InnerVolumeSpecName "kube-api-access-bkj8l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:39:31.381683 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.381630 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d42519a-f38b-46d2-87d5-10040992c021-kube-api-access-g7xkl" (OuterVolumeSpecName: "kube-api-access-g7xkl") pod "2d42519a-f38b-46d2-87d5-10040992c021" (UID: "2d42519a-f38b-46d2-87d5-10040992c021"). InnerVolumeSpecName "kube-api-access-g7xkl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:39:31.405439 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.405412 2576 generic.go:356] "Generic (PLEG): container finished" podID="9cfa69f6-38a8-4b44-bfb9-c0f97efc4362" containerID="f8fe2a10408d6e2ed52279a79d8e6e331988db1248409fa27b17bc674f878334" exitCode=0 Aug 04 11:39:31.405560 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.405448 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b" Aug 04 11:39:31.405560 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.405477 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b" event={"ID":"9cfa69f6-38a8-4b44-bfb9-c0f97efc4362","Type":"ContainerDied","Data":"f8fe2a10408d6e2ed52279a79d8e6e331988db1248409fa27b17bc674f878334"} Aug 04 11:39:31.405560 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.405524 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b" event={"ID":"9cfa69f6-38a8-4b44-bfb9-c0f97efc4362","Type":"ContainerDied","Data":"c57ad3054533e75e89d3dc7a40157302f4dc19a39aefc4dc73337934895e1c4e"} Aug 04 11:39:31.405560 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.405550 2576 scope.go:117] "RemoveContainer" containerID="f8fe2a10408d6e2ed52279a79d8e6e331988db1248409fa27b17bc674f878334" Aug 04 11:39:31.406889 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.406759 2576 generic.go:356] "Generic (PLEG): container finished" podID="2d42519a-f38b-46d2-87d5-10040992c021" containerID="f3867edba9202210f2a67ff9610f00cd6b539cdef7493c23f53e1f781141b983" exitCode=0 Aug 04 11:39:31.406889 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.406787 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh" event={"ID":"2d42519a-f38b-46d2-87d5-10040992c021","Type":"ContainerDied","Data":"f3867edba9202210f2a67ff9610f00cd6b539cdef7493c23f53e1f781141b983"} Aug 04 11:39:31.406889 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.406810 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh" Aug 04 11:39:31.406889 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.406843 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh" event={"ID":"2d42519a-f38b-46d2-87d5-10040992c021","Type":"ContainerDied","Data":"080711ef98a182e468978ea2b190b22c2c679fb0feb9257abb0eee82be383ddd"} Aug 04 11:39:31.415460 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.415426 2576 scope.go:117] "RemoveContainer" containerID="f8fe2a10408d6e2ed52279a79d8e6e331988db1248409fa27b17bc674f878334" Aug 04 11:39:31.415758 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:39:31.415741 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8fe2a10408d6e2ed52279a79d8e6e331988db1248409fa27b17bc674f878334\": container with ID starting with f8fe2a10408d6e2ed52279a79d8e6e331988db1248409fa27b17bc674f878334 not found: ID does not exist" containerID="f8fe2a10408d6e2ed52279a79d8e6e331988db1248409fa27b17bc674f878334" Aug 04 11:39:31.415814 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.415767 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8fe2a10408d6e2ed52279a79d8e6e331988db1248409fa27b17bc674f878334"} err="failed to get container status \"f8fe2a10408d6e2ed52279a79d8e6e331988db1248409fa27b17bc674f878334\": rpc error: code = NotFound desc = could not find container \"f8fe2a10408d6e2ed52279a79d8e6e331988db1248409fa27b17bc674f878334\": container with ID starting with f8fe2a10408d6e2ed52279a79d8e6e331988db1248409fa27b17bc674f878334 not found: ID does not exist" Aug 04 11:39:31.415814 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.415784 2576 scope.go:117] "RemoveContainer" containerID="f3867edba9202210f2a67ff9610f00cd6b539cdef7493c23f53e1f781141b983" Aug 04 11:39:31.423601 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.423586 2576 scope.go:117] "RemoveContainer" containerID="f3867edba9202210f2a67ff9610f00cd6b539cdef7493c23f53e1f781141b983" Aug 04 11:39:31.423835 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:39:31.423818 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3867edba9202210f2a67ff9610f00cd6b539cdef7493c23f53e1f781141b983\": container with ID starting with f3867edba9202210f2a67ff9610f00cd6b539cdef7493c23f53e1f781141b983 not found: ID does not exist" containerID="f3867edba9202210f2a67ff9610f00cd6b539cdef7493c23f53e1f781141b983" Aug 04 11:39:31.423895 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.423843 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3867edba9202210f2a67ff9610f00cd6b539cdef7493c23f53e1f781141b983"} err="failed to get container status \"f3867edba9202210f2a67ff9610f00cd6b539cdef7493c23f53e1f781141b983\": rpc error: code = NotFound desc = could not find container \"f3867edba9202210f2a67ff9610f00cd6b539cdef7493c23f53e1f781141b983\": container with ID starting with f3867edba9202210f2a67ff9610f00cd6b539cdef7493c23f53e1f781141b983 not found: ID does not exist" Aug 04 11:39:31.432332 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.432313 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh"] Aug 04 11:39:31.439533 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.439512 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-ed8ca8-d5f96bb6d-s4sjh"] Aug 04 11:39:31.450290 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.450266 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b"] Aug 04 11:39:31.457562 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.457544 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-ed8ca8-f9845c4bb-9pn9b"] Aug 04 11:39:31.480970 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.480947 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkj8l\" (UniqueName: \"kubernetes.io/projected/9cfa69f6-38a8-4b44-bfb9-c0f97efc4362-kube-api-access-bkj8l\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:39:31.480970 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.480967 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7xkl\" (UniqueName: \"kubernetes.io/projected/2d42519a-f38b-46d2-87d5-10040992c021-kube-api-access-g7xkl\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:39:31.929233 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.929197 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d42519a-f38b-46d2-87d5-10040992c021" path="/var/lib/kubelet/pods/2d42519a-f38b-46d2-87d5-10040992c021/volumes" Aug 04 11:39:31.929688 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:31.929668 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cfa69f6-38a8-4b44-bfb9-c0f97efc4362" path="/var/lib/kubelet/pods/9cfa69f6-38a8-4b44-bfb9-c0f97efc4362/volumes" Aug 04 11:39:49.123108 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.123066 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg"] Aug 04 11:39:49.123760 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.123361 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg" podUID="6e8d5722-20b4-4440-acf7-27ee1352535f" containerName="payload-processing" containerID="cri-o://81c6e66d2ff8d34b652b7d34be4afb7ba2edbf2bf0b6f9f9761a9cc964b5b39a" gracePeriod=30 Aug 04 11:39:49.130627 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.130587 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv"] Aug 04 11:39:49.131101 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.131067 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv" podUID="9c8eb492-39af-4d5a-839a-d2f310f8fbc4" containerName="payload-pre-processing" containerID="cri-o://01f10b81f268046972f4ae44620f98f3f3aed0573890cba5374497dd7d342752" gracePeriod=30 Aug 04 11:39:49.433988 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.433952 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg" Aug 04 11:39:49.458053 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.458024 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv" Aug 04 11:39:49.498958 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.498925 2576 generic.go:356] "Generic (PLEG): container finished" podID="9c8eb492-39af-4d5a-839a-d2f310f8fbc4" containerID="01f10b81f268046972f4ae44620f98f3f3aed0573890cba5374497dd7d342752" exitCode=0 Aug 04 11:39:49.499140 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.498970 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv" Aug 04 11:39:49.499140 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.498974 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv" event={"ID":"9c8eb492-39af-4d5a-839a-d2f310f8fbc4","Type":"ContainerDied","Data":"01f10b81f268046972f4ae44620f98f3f3aed0573890cba5374497dd7d342752"} Aug 04 11:39:49.499140 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.499032 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv" event={"ID":"9c8eb492-39af-4d5a-839a-d2f310f8fbc4","Type":"ContainerDied","Data":"8cc841beb255b9087699583c5a0df555b4bb2e402569b41d3dd1471c1b2c168d"} Aug 04 11:39:49.499140 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.499057 2576 scope.go:117] "RemoveContainer" containerID="01f10b81f268046972f4ae44620f98f3f3aed0573890cba5374497dd7d342752" Aug 04 11:39:49.500354 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.500331 2576 generic.go:356] "Generic (PLEG): container finished" podID="6e8d5722-20b4-4440-acf7-27ee1352535f" containerID="81c6e66d2ff8d34b652b7d34be4afb7ba2edbf2bf0b6f9f9761a9cc964b5b39a" exitCode=0 Aug 04 11:39:49.500494 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.500378 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg" Aug 04 11:39:49.500494 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.500431 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg" event={"ID":"6e8d5722-20b4-4440-acf7-27ee1352535f","Type":"ContainerDied","Data":"81c6e66d2ff8d34b652b7d34be4afb7ba2edbf2bf0b6f9f9761a9cc964b5b39a"} Aug 04 11:39:49.500494 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.500488 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg" event={"ID":"6e8d5722-20b4-4440-acf7-27ee1352535f","Type":"ContainerDied","Data":"2bc6e2213de90dcc91d2a8c972999e454faad7a2e7c7335f13cd41428a863734"} Aug 04 11:39:49.508133 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.508117 2576 scope.go:117] "RemoveContainer" containerID="01f10b81f268046972f4ae44620f98f3f3aed0573890cba5374497dd7d342752" Aug 04 11:39:49.508401 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:39:49.508372 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01f10b81f268046972f4ae44620f98f3f3aed0573890cba5374497dd7d342752\": container with ID starting with 01f10b81f268046972f4ae44620f98f3f3aed0573890cba5374497dd7d342752 not found: ID does not exist" containerID="01f10b81f268046972f4ae44620f98f3f3aed0573890cba5374497dd7d342752" Aug 04 11:39:49.508467 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.508416 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01f10b81f268046972f4ae44620f98f3f3aed0573890cba5374497dd7d342752"} err="failed to get container status \"01f10b81f268046972f4ae44620f98f3f3aed0573890cba5374497dd7d342752\": rpc error: code = NotFound desc = could not find container \"01f10b81f268046972f4ae44620f98f3f3aed0573890cba5374497dd7d342752\": container with ID starting with 01f10b81f268046972f4ae44620f98f3f3aed0573890cba5374497dd7d342752 not found: ID does not exist" Aug 04 11:39:49.508467 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.508432 2576 scope.go:117] "RemoveContainer" containerID="81c6e66d2ff8d34b652b7d34be4afb7ba2edbf2bf0b6f9f9761a9cc964b5b39a" Aug 04 11:39:49.516584 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.516565 2576 scope.go:117] "RemoveContainer" containerID="81c6e66d2ff8d34b652b7d34be4afb7ba2edbf2bf0b6f9f9761a9cc964b5b39a" Aug 04 11:39:49.516847 ip-10-0-142-102 kubenswrapper[2576]: E0804 11:39:49.516828 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81c6e66d2ff8d34b652b7d34be4afb7ba2edbf2bf0b6f9f9761a9cc964b5b39a\": container with ID starting with 81c6e66d2ff8d34b652b7d34be4afb7ba2edbf2bf0b6f9f9761a9cc964b5b39a not found: ID does not exist" containerID="81c6e66d2ff8d34b652b7d34be4afb7ba2edbf2bf0b6f9f9761a9cc964b5b39a" Aug 04 11:39:49.516911 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.516855 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81c6e66d2ff8d34b652b7d34be4afb7ba2edbf2bf0b6f9f9761a9cc964b5b39a"} err="failed to get container status \"81c6e66d2ff8d34b652b7d34be4afb7ba2edbf2bf0b6f9f9761a9cc964b5b39a\": rpc error: code = NotFound desc = could not find container \"81c6e66d2ff8d34b652b7d34be4afb7ba2edbf2bf0b6f9f9761a9cc964b5b39a\": container with ID starting with 81c6e66d2ff8d34b652b7d34be4afb7ba2edbf2bf0b6f9f9761a9cc964b5b39a not found: ID does not exist" Aug 04 11:39:49.560609 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.560572 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e8d5722-20b4-4440-acf7-27ee1352535f-plugins-config-volume\") pod \"6e8d5722-20b4-4440-acf7-27ee1352535f\" (UID: \"6e8d5722-20b4-4440-acf7-27ee1352535f\") " Aug 04 11:39:49.560815 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.560643 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c8eb492-39af-4d5a-839a-d2f310f8fbc4-plugins-config-volume\") pod \"9c8eb492-39af-4d5a-839a-d2f310f8fbc4\" (UID: \"9c8eb492-39af-4d5a-839a-d2f310f8fbc4\") " Aug 04 11:39:49.560815 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.560686 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5s7s\" (UniqueName: \"kubernetes.io/projected/9c8eb492-39af-4d5a-839a-d2f310f8fbc4-kube-api-access-w5s7s\") pod \"9c8eb492-39af-4d5a-839a-d2f310f8fbc4\" (UID: \"9c8eb492-39af-4d5a-839a-d2f310f8fbc4\") " Aug 04 11:39:49.560815 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.560731 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59zlh\" (UniqueName: \"kubernetes.io/projected/6e8d5722-20b4-4440-acf7-27ee1352535f-kube-api-access-59zlh\") pod \"6e8d5722-20b4-4440-acf7-27ee1352535f\" (UID: \"6e8d5722-20b4-4440-acf7-27ee1352535f\") " Aug 04 11:39:49.561074 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.561047 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e8d5722-20b4-4440-acf7-27ee1352535f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6e8d5722-20b4-4440-acf7-27ee1352535f" (UID: "6e8d5722-20b4-4440-acf7-27ee1352535f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:39:49.561074 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.561065 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c8eb492-39af-4d5a-839a-d2f310f8fbc4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9c8eb492-39af-4d5a-839a-d2f310f8fbc4" (UID: "9c8eb492-39af-4d5a-839a-d2f310f8fbc4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 11:39:49.562941 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.562919 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e8d5722-20b4-4440-acf7-27ee1352535f-kube-api-access-59zlh" (OuterVolumeSpecName: "kube-api-access-59zlh") pod "6e8d5722-20b4-4440-acf7-27ee1352535f" (UID: "6e8d5722-20b4-4440-acf7-27ee1352535f"). InnerVolumeSpecName "kube-api-access-59zlh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:39:49.563093 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.563069 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c8eb492-39af-4d5a-839a-d2f310f8fbc4-kube-api-access-w5s7s" (OuterVolumeSpecName: "kube-api-access-w5s7s") pod "9c8eb492-39af-4d5a-839a-d2f310f8fbc4" (UID: "9c8eb492-39af-4d5a-839a-d2f310f8fbc4"). InnerVolumeSpecName "kube-api-access-w5s7s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 11:39:49.662464 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.662350 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e8d5722-20b4-4440-acf7-27ee1352535f-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:39:49.662464 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.662382 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c8eb492-39af-4d5a-839a-d2f310f8fbc4-plugins-config-volume\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:39:49.662464 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.662419 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5s7s\" (UniqueName: \"kubernetes.io/projected/9c8eb492-39af-4d5a-839a-d2f310f8fbc4-kube-api-access-w5s7s\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:39:49.662464 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.662430 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59zlh\" (UniqueName: \"kubernetes.io/projected/6e8d5722-20b4-4440-acf7-27ee1352535f-kube-api-access-59zlh\") on node \"ip-10-0-142-102.ec2.internal\" DevicePath \"\"" Aug 04 11:39:49.828291 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.828259 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg"] Aug 04 11:39:49.832907 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.832884 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-c74755-8b8bcddc4-l9bhg"] Aug 04 11:39:49.844651 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.844627 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv"] Aug 04 11:39:49.854823 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.850511 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-c74755-dd88dbdb4-b65sv"] Aug 04 11:39:49.929529 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.929451 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e8d5722-20b4-4440-acf7-27ee1352535f" path="/var/lib/kubelet/pods/6e8d5722-20b4-4440-acf7-27ee1352535f/volumes" Aug 04 11:39:49.929833 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:39:49.929819 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c8eb492-39af-4d5a-839a-d2f310f8fbc4" path="/var/lib/kubelet/pods/9c8eb492-39af-4d5a-839a-d2f310f8fbc4/volumes" Aug 04 11:40:02.844730 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:02.844703 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79895c7c95-sq8sw_75f24ebf-ad17-4318-9ed0-dc08955bffd7/copy-manifests/0.log" Aug 04 11:40:02.863542 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:02.863504 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79895c7c95-sq8sw_75f24ebf-ad17-4318-9ed0-dc08955bffd7/manager/0.log" Aug 04 11:40:04.935704 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:04.935671 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-9w58g_2cacc311-c1cb-4b42-9689-861708dff58a/manager/0.log" Aug 04 11:40:05.615055 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:05.615024 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rsljh_79c723e2-11a1-4a2d-8573-45148b1d72bd/discovery/0.log" Aug 04 11:40:06.061134 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:06.061095 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-6xzmd_781bc05a-2fce-4e6a-a176-bb21ddb116e8/payload-pre-processing/0.log" Aug 04 11:40:06.181030 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:06.180994 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-24r8m_03a5a1b7-420e-4272-a532-c4e2ec4c91a7/payload-processing/0.log" Aug 04 11:40:06.726210 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:06.726172 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-phz6z_edf50396-af17-4b35-9c57-4ee006e7e8b2/main/0.log" Aug 04 11:40:06.944812 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:06.944781 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8bdwb_5cffc08c-ba5c-4141-bb50-3df093d6896a/main/0.log" Aug 04 11:40:07.054947 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:07.054917 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-4cfcw_013be7a1-8b36-4849-89dd-bd994661aed3/main/0.log" Aug 04 11:40:15.720190 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:15.720159 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-98bfx_9f33312d-b1fd-4589-8066-42a262738f91/global-pull-secret-syncer/0.log" Aug 04 11:40:15.919566 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:15.919520 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ctwz9_364a423a-fde5-4ab7-bc63-dd73aee4e6b2/konnectivity-agent/0.log" Aug 04 11:40:16.037801 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:16.037767 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-102.ec2.internal_d977d9685f76e65bd3916a0635d4beb4/haproxy/0.log" Aug 04 11:40:20.708787 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:20.708758 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-9w58g_2cacc311-c1cb-4b42-9689-861708dff58a/manager/0.log" Aug 04 11:40:22.576208 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:22.576116 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-4dp97_199a78c5-6901-40a8-b8d4-ba3ab6659acf/kube-state-metrics/0.log" Aug 04 11:40:22.598948 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:22.598921 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-4dp97_199a78c5-6901-40a8-b8d4-ba3ab6659acf/kube-rbac-proxy-main/0.log" Aug 04 11:40:22.630979 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:22.630949 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-4dp97_199a78c5-6901-40a8-b8d4-ba3ab6659acf/kube-rbac-proxy-self/0.log" Aug 04 11:40:22.662060 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:22.662028 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7b67f6577d-pjfdx_bca2e9d9-198a-47c6-958f-c5304771bc5a/metrics-server/0.log" Aug 04 11:40:22.922942 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:22.922864 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mjqkb_158e7fb9-5766-47b4-962c-2f48f4887ffa/node-exporter/0.log" Aug 04 11:40:22.945991 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:22.945961 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mjqkb_158e7fb9-5766-47b4-962c-2f48f4887ffa/kube-rbac-proxy/0.log" Aug 04 11:40:22.972786 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:22.972764 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mjqkb_158e7fb9-5766-47b4-962c-2f48f4887ffa/init-textfile/0.log" Aug 04 11:40:23.016322 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:23.016293 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-gfr84_b2e98470-aaf1-4af9-bd6a-9e6f735e80db/kube-rbac-proxy-main/0.log" Aug 04 11:40:23.039360 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:23.039335 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-gfr84_b2e98470-aaf1-4af9-bd6a-9e6f735e80db/kube-rbac-proxy-self/0.log" Aug 04 11:40:23.075671 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:23.075641 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-gfr84_b2e98470-aaf1-4af9-bd6a-9e6f735e80db/openshift-state-metrics/0.log" Aug 04 11:40:23.177998 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:23.177969 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_65d3b68a-6b0b-473e-9ad2-f0aebca496b4/prometheus/0.log" Aug 04 11:40:23.207654 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:23.207621 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_65d3b68a-6b0b-473e-9ad2-f0aebca496b4/config-reloader/0.log" Aug 04 11:40:23.232691 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:23.232665 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_65d3b68a-6b0b-473e-9ad2-f0aebca496b4/thanos-sidecar/0.log" Aug 04 11:40:23.260109 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:23.260081 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_65d3b68a-6b0b-473e-9ad2-f0aebca496b4/kube-rbac-proxy-web/0.log" Aug 04 11:40:23.285776 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:23.285750 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_65d3b68a-6b0b-473e-9ad2-f0aebca496b4/kube-rbac-proxy/0.log" Aug 04 11:40:23.312185 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:23.312159 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_65d3b68a-6b0b-473e-9ad2-f0aebca496b4/kube-rbac-proxy-thanos/0.log" Aug 04 11:40:23.338615 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:23.338589 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_65d3b68a-6b0b-473e-9ad2-f0aebca496b4/init-config-reloader/0.log" Aug 04 11:40:25.751208 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.751177 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/1.log" Aug 04 11:40:25.758679 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.758652 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-qm7p8_db761abf-6fd4-438a-89ce-d7c2eae67bae/console-operator/2.log" Aug 04 11:40:25.971305 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971272 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lm9vx/perf-node-gather-daemonset-fl7tk"] Aug 04 11:40:25.971722 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971706 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8850f85a-07cb-4ac4-a9c2-25c96303f20a" containerName="payload-processing" Aug 04 11:40:25.971779 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971725 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8850f85a-07cb-4ac4-a9c2-25c96303f20a" containerName="payload-processing" Aug 04 11:40:25.971779 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971734 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58a625aa-2048-4e7d-9442-dba54c0183a2" containerName="payload-processing" Aug 04 11:40:25.971779 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971740 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="58a625aa-2048-4e7d-9442-dba54c0183a2" containerName="payload-processing" Aug 04 11:40:25.971779 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971751 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7522238a-73ff-4da5-a162-4f37aa5a5f16" containerName="payload-pre-processing" Aug 04 11:40:25.971779 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971756 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7522238a-73ff-4da5-a162-4f37aa5a5f16" containerName="payload-pre-processing" Aug 04 11:40:25.971779 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971765 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d42519a-f38b-46d2-87d5-10040992c021" containerName="payload-pre-processing" Aug 04 11:40:25.971779 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971770 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d42519a-f38b-46d2-87d5-10040992c021" containerName="payload-pre-processing" Aug 04 11:40:25.971779 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971776 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c8eb492-39af-4d5a-839a-d2f310f8fbc4" containerName="payload-pre-processing" Aug 04 11:40:25.971779 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971781 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c8eb492-39af-4d5a-839a-d2f310f8fbc4" containerName="payload-pre-processing" Aug 04 11:40:25.972210 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971789 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b82998a-ec4b-446d-a793-7b3f4bf56622" containerName="payload-pre-processing" Aug 04 11:40:25.972210 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971794 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b82998a-ec4b-446d-a793-7b3f4bf56622" containerName="payload-pre-processing" Aug 04 11:40:25.972210 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971803 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1174be8f-4ebf-46bb-a0fe-acfb6a646ae4" containerName="payload-pre-processing" Aug 04 11:40:25.972210 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971809 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1174be8f-4ebf-46bb-a0fe-acfb6a646ae4" containerName="payload-pre-processing" Aug 04 11:40:25.972210 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971820 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cfa69f6-38a8-4b44-bfb9-c0f97efc4362" containerName="payload-processing" Aug 04 11:40:25.972210 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971825 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cfa69f6-38a8-4b44-bfb9-c0f97efc4362" containerName="payload-processing" Aug 04 11:40:25.972210 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971833 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e8d5722-20b4-4440-acf7-27ee1352535f" containerName="payload-processing" Aug 04 11:40:25.972210 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971838 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e8d5722-20b4-4440-acf7-27ee1352535f" containerName="payload-processing" Aug 04 11:40:25.972210 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971845 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f5110dd-8748-41e4-ba81-e42b1ffbcbb6" containerName="payload-processing" Aug 04 11:40:25.972210 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971850 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f5110dd-8748-41e4-ba81-e42b1ffbcbb6" containerName="payload-processing" Aug 04 11:40:25.972210 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971909 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cfa69f6-38a8-4b44-bfb9-c0f97efc4362" containerName="payload-processing" Aug 04 11:40:25.972210 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971916 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e8d5722-20b4-4440-acf7-27ee1352535f" containerName="payload-processing" Aug 04 11:40:25.972210 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971922 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8850f85a-07cb-4ac4-a9c2-25c96303f20a" containerName="payload-processing" Aug 04 11:40:25.972210 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971928 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b82998a-ec4b-446d-a793-7b3f4bf56622" containerName="payload-pre-processing" Aug 04 11:40:25.972210 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971934 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1174be8f-4ebf-46bb-a0fe-acfb6a646ae4" containerName="payload-pre-processing" Aug 04 11:40:25.972210 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971939 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f5110dd-8748-41e4-ba81-e42b1ffbcbb6" containerName="payload-processing" Aug 04 11:40:25.972210 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971945 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d42519a-f38b-46d2-87d5-10040992c021" containerName="payload-pre-processing" Aug 04 11:40:25.972210 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971950 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7522238a-73ff-4da5-a162-4f37aa5a5f16" containerName="payload-pre-processing" Aug 04 11:40:25.972210 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971957 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c8eb492-39af-4d5a-839a-d2f310f8fbc4" containerName="payload-pre-processing" Aug 04 11:40:25.972210 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.971962 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="58a625aa-2048-4e7d-9442-dba54c0183a2" containerName="payload-processing" Aug 04 11:40:25.974897 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.974881 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-fl7tk" Aug 04 11:40:25.977733 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.977709 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lm9vx\"/\"kube-root-ca.crt\"" Aug 04 11:40:25.977858 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.977733 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lm9vx\"/\"openshift-service-ca.crt\"" Aug 04 11:40:25.978983 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.978961 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lm9vx\"/\"default-dockercfg-jmtxh\"" Aug 04 11:40:25.984846 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:25.984824 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lm9vx/perf-node-gather-daemonset-fl7tk"] Aug 04 11:40:26.103458 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:26.103336 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e52528c1-484b-4591-b079-027bfaa16d3e-sys\") pod \"perf-node-gather-daemonset-fl7tk\" (UID: \"e52528c1-484b-4591-b079-027bfaa16d3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-fl7tk" Aug 04 11:40:26.103458 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:26.103423 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e52528c1-484b-4591-b079-027bfaa16d3e-lib-modules\") pod \"perf-node-gather-daemonset-fl7tk\" (UID: \"e52528c1-484b-4591-b079-027bfaa16d3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-fl7tk" Aug 04 11:40:26.103654 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:26.103534 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e52528c1-484b-4591-b079-027bfaa16d3e-proc\") pod \"perf-node-gather-daemonset-fl7tk\" (UID: \"e52528c1-484b-4591-b079-027bfaa16d3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-fl7tk" Aug 04 11:40:26.103654 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:26.103564 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6klm\" (UniqueName: \"kubernetes.io/projected/e52528c1-484b-4591-b079-027bfaa16d3e-kube-api-access-b6klm\") pod \"perf-node-gather-daemonset-fl7tk\" (UID: \"e52528c1-484b-4591-b079-027bfaa16d3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-fl7tk" Aug 04 11:40:26.103654 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:26.103591 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e52528c1-484b-4591-b079-027bfaa16d3e-podres\") pod \"perf-node-gather-daemonset-fl7tk\" (UID: \"e52528c1-484b-4591-b079-027bfaa16d3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-fl7tk" Aug 04 11:40:26.204434 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:26.204367 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e52528c1-484b-4591-b079-027bfaa16d3e-lib-modules\") pod \"perf-node-gather-daemonset-fl7tk\" (UID: \"e52528c1-484b-4591-b079-027bfaa16d3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-fl7tk" Aug 04 11:40:26.204588 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:26.204468 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e52528c1-484b-4591-b079-027bfaa16d3e-proc\") pod \"perf-node-gather-daemonset-fl7tk\" (UID: \"e52528c1-484b-4591-b079-027bfaa16d3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-fl7tk" Aug 04 11:40:26.204588 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:26.204485 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6klm\" (UniqueName: \"kubernetes.io/projected/e52528c1-484b-4591-b079-027bfaa16d3e-kube-api-access-b6klm\") pod \"perf-node-gather-daemonset-fl7tk\" (UID: \"e52528c1-484b-4591-b079-027bfaa16d3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-fl7tk" Aug 04 11:40:26.204588 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:26.204508 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e52528c1-484b-4591-b079-027bfaa16d3e-podres\") pod \"perf-node-gather-daemonset-fl7tk\" (UID: \"e52528c1-484b-4591-b079-027bfaa16d3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-fl7tk" Aug 04 11:40:26.204588 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:26.204554 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e52528c1-484b-4591-b079-027bfaa16d3e-sys\") pod \"perf-node-gather-daemonset-fl7tk\" (UID: \"e52528c1-484b-4591-b079-027bfaa16d3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-fl7tk" Aug 04 11:40:26.204588 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:26.204567 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e52528c1-484b-4591-b079-027bfaa16d3e-lib-modules\") pod \"perf-node-gather-daemonset-fl7tk\" (UID: \"e52528c1-484b-4591-b079-027bfaa16d3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-fl7tk" Aug 04 11:40:26.204751 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:26.204601 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e52528c1-484b-4591-b079-027bfaa16d3e-proc\") pod \"perf-node-gather-daemonset-fl7tk\" (UID: \"e52528c1-484b-4591-b079-027bfaa16d3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-fl7tk" Aug 04 11:40:26.204751 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:26.204640 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e52528c1-484b-4591-b079-027bfaa16d3e-sys\") pod \"perf-node-gather-daemonset-fl7tk\" (UID: \"e52528c1-484b-4591-b079-027bfaa16d3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-fl7tk" Aug 04 11:40:26.204751 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:26.204645 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e52528c1-484b-4591-b079-027bfaa16d3e-podres\") pod \"perf-node-gather-daemonset-fl7tk\" (UID: \"e52528c1-484b-4591-b079-027bfaa16d3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-fl7tk" Aug 04 11:40:26.214370 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:26.214344 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6klm\" (UniqueName: \"kubernetes.io/projected/e52528c1-484b-4591-b079-027bfaa16d3e-kube-api-access-b6klm\") pod \"perf-node-gather-daemonset-fl7tk\" (UID: \"e52528c1-484b-4591-b079-027bfaa16d3e\") " pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-fl7tk" Aug 04 11:40:26.286625 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:26.286589 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-fl7tk" Aug 04 11:40:26.393067 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:26.393025 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59f56cb47-xtlrc_c7f3a2c5-4a35-4294-b690-2d4456762c08/console/0.log" Aug 04 11:40:26.419059 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:26.419037 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lm9vx/perf-node-gather-daemonset-fl7tk"] Aug 04 11:40:26.421894 ip-10-0-142-102 kubenswrapper[2576]: W0804 11:40:26.421873 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode52528c1_484b_4591_b079_027bfaa16d3e.slice/crio-863af8f7ea88a0688ef9aaccba1d7e9fc37dcedf869b65606bfa9ffb22484484 WatchSource:0}: Error finding container 863af8f7ea88a0688ef9aaccba1d7e9fc37dcedf869b65606bfa9ffb22484484: Status 404 returned error can't find the container with id 863af8f7ea88a0688ef9aaccba1d7e9fc37dcedf869b65606bfa9ffb22484484 Aug 04 11:40:26.462073 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:26.462048 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-kz55f_872a0621-2d81-485a-b3ac-ed1319cd8f09/download-server/0.log" Aug 04 11:40:26.677672 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:26.677568 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-fl7tk" event={"ID":"e52528c1-484b-4591-b079-027bfaa16d3e","Type":"ContainerStarted","Data":"d2128a1386ba36e9b29604bdecc7564f395a0a55c00cb0f0fa948e6cd002fa62"} Aug 04 11:40:26.677672 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:26.677637 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-fl7tk" event={"ID":"e52528c1-484b-4591-b079-027bfaa16d3e","Type":"ContainerStarted","Data":"863af8f7ea88a0688ef9aaccba1d7e9fc37dcedf869b65606bfa9ffb22484484"} Aug 04 11:40:26.677925 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:26.677709 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-fl7tk" Aug 04 11:40:26.697308 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:26.697244 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-fl7tk" podStartSLOduration=1.697227914 podStartE2EDuration="1.697227914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 11:40:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 11:40:26.695351694 +0000 UTC m=+3777.294256103" watchObservedRunningTime="2026-08-04 11:40:26.697227914 +0000 UTC m=+3777.296132337" Aug 04 11:40:27.168565 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:27.168529 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-pkgdb_ddedd35f-550d-4a9b-8856-162289a087e1/volume-data-source-validator/0.log" Aug 04 11:40:28.346676 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:28.346644 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tvksr_6cebbba9-957c-4011-9ba2-9d5255894e51/dns/0.log" Aug 04 11:40:28.371386 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:28.371353 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tvksr_6cebbba9-957c-4011-9ba2-9d5255894e51/kube-rbac-proxy/0.log" Aug 04 11:40:28.453644 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:28.453616 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dz4jf_bf0c1197-51b3-4912-8503-9d06553abdc0/dns-node-resolver/0.log" Aug 04 11:40:29.183979 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:29.183951 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xq5bm_e20c225e-bf93-46af-a2d3-f3ddaadc3bbd/node-ca/0.log" Aug 04 11:40:30.511369 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:30.511333 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rsljh_79c723e2-11a1-4a2d-8573-45148b1d72bd/discovery/0.log" Aug 04 11:40:30.657907 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:30.657829 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-6xzmd_781bc05a-2fce-4e6a-a176-bb21ddb116e8/payload-pre-processing/0.log" Aug 04 11:40:30.699067 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:30.699037 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-24r8m_03a5a1b7-420e-4272-a532-c4e2ec4c91a7/payload-processing/0.log" Aug 04 11:40:31.610039 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:31.609958 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ssnvq_4756e1b9-37a8-46e2-a62d-7eb3c0a56f99/serve-healthcheck-canary/0.log" Aug 04 11:40:32.163086 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:32.163056 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-bl62w_f93ae815-8c4c-4b43-987b-5bf70573393d/insights-operator/0.log" Aug 04 11:40:32.166700 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:32.166680 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-bl62w_f93ae815-8c4c-4b43-987b-5bf70573393d/insights-operator/1.log" Aug 04 11:40:32.190256 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:32.190232 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bfwzl_d5215ef8-edac-48ef-ad97-7a2a0de5cd79/kube-rbac-proxy/0.log" Aug 04 11:40:32.216015 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:32.215992 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bfwzl_d5215ef8-edac-48ef-ad97-7a2a0de5cd79/exporter/0.log" Aug 04 11:40:32.242033 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:32.242011 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bfwzl_d5215ef8-edac-48ef-ad97-7a2a0de5cd79/extractor/0.log" Aug 04 11:40:32.693791 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:32.693763 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lm9vx/perf-node-gather-daemonset-fl7tk" Aug 04 11:40:35.695667 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:35.695627 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79895c7c95-sq8sw_75f24ebf-ad17-4318-9ed0-dc08955bffd7/manager/0.log" Aug 04 11:40:35.717600 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:35.717563 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79895c7c95-sq8sw_75f24ebf-ad17-4318-9ed0-dc08955bffd7/copy-manifests/0.log" Aug 04 11:40:37.057147 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:37.057096 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5b459fcc7c-nrtbd_a91e16ea-946c-42c6-9a77-02d3d991d0df/manager/0.log" Aug 04 11:40:37.263374 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:37.263339 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rsljh_79c723e2-11a1-4a2d-8573-45148b1d72bd/discovery/0.log" Aug 04 11:40:37.397682 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:37.397605 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-6xzmd_781bc05a-2fce-4e6a-a176-bb21ddb116e8/payload-pre-processing/0.log" Aug 04 11:40:37.432608 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:37.432563 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-24r8m_03a5a1b7-420e-4272-a532-c4e2ec4c91a7/payload-processing/0.log" Aug 04 11:40:39.183260 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:39.183227 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rsljh_79c723e2-11a1-4a2d-8573-45148b1d72bd/discovery/0.log" Aug 04 11:40:39.318630 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:39.318596 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-6xzmd_781bc05a-2fce-4e6a-a176-bb21ddb116e8/payload-pre-processing/0.log" Aug 04 11:40:39.353627 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:39.353599 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-24r8m_03a5a1b7-420e-4272-a532-c4e2ec4c91a7/payload-processing/0.log" Aug 04 11:40:42.382064 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:42.382032 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-hrxqd_e230df0e-f556-47ef-95f8-d693104f4a54/migrator/0.log" Aug 04 11:40:42.407303 ip-10-0-142-102 kubenswrapper[2576]: I0804 11:40:42.407284 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-hrxqd_e230df0e-f556-47ef-95f8-d693104f4a54/graceful-termination/0.log"