Jul 12 08:06:52.185196 ip-10-0-128-184 systemd[1]: Starting Kubernetes Kubelet... Jul 12 08:06:52.744207 ip-10-0-128-184 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 12 08:06:52.744207 ip-10-0-128-184 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 12 08:06:52.744207 ip-10-0-128-184 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 12 08:06:52.744207 ip-10-0-128-184 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 12 08:06:52.744207 ip-10-0-128-184 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 12 08:06:52.744207 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.642656 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 12 08:06:52.744207 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648205 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 08:06:52.744207 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648216 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 08:06:52.744207 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648220 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 08:06:52.744207 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648223 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 08:06:52.744207 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648226 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 08:06:52.744207 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648229 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 08:06:52.744207 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648237 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 08:06:52.744207 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648240 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 08:06:52.722014 ip-10-0-128-184 systemd[1]: Started Kubernetes Kubelet. Jul 12 08:06:52.982194 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648244 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 08:06:52.982194 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648247 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 08:06:52.982194 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648250 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 08:06:52.982194 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648252 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 08:06:52.982194 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648255 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 08:06:52.982194 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648258 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 08:06:52.982194 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648261 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 08:06:52.982194 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648263 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 08:06:52.982194 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648266 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 08:06:52.982194 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648269 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 08:06:52.982194 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648271 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 08:06:52.982194 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648274 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 12 08:06:52.982194 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648276 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 08:06:52.982194 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648279 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 08:06:52.982194 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648282 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 08:06:52.982194 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648284 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 08:06:52.982194 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648287 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 08:06:52.982194 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648289 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 08:06:52.982194 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648291 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 08:06:52.982194 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648294 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 08:06:52.984820 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648297 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 08:06:52.984820 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648299 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 08:06:52.984820 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648302 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 08:06:52.984820 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648305 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 08:06:52.984820 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648307 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 08:06:52.984820 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648310 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 08:06:52.984820 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648313 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 08:06:52.984820 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648315 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 08:06:52.984820 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648318 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 08:06:52.984820 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648324 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 08:06:52.984820 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648327 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 08:06:52.984820 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648332 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 08:06:52.984820 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648336 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 08:06:52.984820 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648338 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 08:06:52.984820 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648341 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 08:06:52.984820 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648344 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 08:06:52.984820 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648346 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 08:06:52.984820 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648349 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 08:06:52.984820 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648352 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 08:06:52.984820 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648354 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 08:06:52.987261 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648357 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 08:06:52.987261 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648360 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 08:06:52.987261 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648363 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 08:06:52.987261 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648365 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 08:06:52.987261 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648368 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 08:06:52.987261 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648370 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 08:06:52.987261 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648373 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 08:06:52.987261 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648375 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 08:06:52.987261 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648378 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 08:06:52.987261 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648380 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 08:06:52.987261 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648383 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 08:06:52.987261 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648386 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 08:06:52.987261 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648389 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 08:06:52.987261 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648392 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 08:06:52.987261 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648395 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 08:06:52.987261 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648397 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 08:06:52.987261 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648401 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 08:06:52.987261 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648405 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 08:06:52.987261 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648408 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 08:06:52.988117 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648411 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 08:06:52.988117 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648413 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 08:06:52.988117 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648416 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 08:06:52.988117 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648423 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 08:06:52.988117 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648426 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 08:06:52.988117 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648428 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 08:06:52.988117 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648430 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 08:06:52.988117 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648433 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 08:06:52.988117 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648435 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 08:06:52.988117 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648438 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 08:06:52.988117 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648440 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 08:06:52.988117 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648443 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 08:06:52.988117 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648446 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 08:06:52.988117 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648448 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 08:06:52.988117 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648451 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 08:06:52.988117 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648453 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 08:06:52.988117 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648456 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 08:06:52.988117 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648458 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 08:06:52.988117 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648461 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 08:06:52.988117 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648463 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 08:06:52.989014 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648465 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 08:06:52.989014 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648468 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 08:06:52.989014 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648470 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 08:06:52.989014 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648473 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 08:06:52.989014 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648475 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 08:06:52.989014 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648478 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 08:06:52.989014 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648481 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 08:06:52.989014 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648485 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 08:06:52.989014 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648488 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 08:06:52.989014 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648491 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 08:06:52.989014 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648493 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 08:06:52.989014 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.648496 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 08:06:52.989014 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650217 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 08:06:52.989014 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650225 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 08:06:52.989014 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650228 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 08:06:52.989014 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650231 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 08:06:52.989014 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650235 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 08:06:52.989014 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650238 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 08:06:52.989014 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650241 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 08:06:52.990356 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650245 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 08:06:52.990356 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650248 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 08:06:52.990356 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650252 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 08:06:52.990356 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650256 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 08:06:52.990356 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650259 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 08:06:52.990356 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650262 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 08:06:52.990356 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650265 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 08:06:52.990356 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650267 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 08:06:52.990356 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650270 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 08:06:52.990356 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650272 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 08:06:52.990356 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650275 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 08:06:52.990356 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650277 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 08:06:52.990356 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650280 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 08:06:52.990356 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650283 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 08:06:52.990356 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650285 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 08:06:52.990356 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650288 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 08:06:52.990356 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650291 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 08:06:52.990356 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650293 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 08:06:52.990356 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650296 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 08:06:52.990356 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650298 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 08:06:52.991441 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650300 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 08:06:52.991441 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650303 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 08:06:52.991441 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650306 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 08:06:52.991441 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650309 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 08:06:52.991441 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650312 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 08:06:52.991441 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650314 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 08:06:52.991441 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650317 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 08:06:52.991441 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650320 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 12 08:06:52.991441 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650323 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 08:06:52.991441 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650326 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 08:06:52.991441 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650329 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 08:06:52.991441 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650331 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 08:06:52.991441 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650334 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 08:06:52.991441 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650336 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 08:06:52.991441 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650339 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 08:06:52.991441 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650343 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 08:06:52.991441 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650346 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 08:06:52.991441 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650350 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 08:06:52.991441 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650352 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 08:06:52.991441 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650355 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 08:06:52.992526 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650357 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 08:06:52.992526 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650360 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 08:06:52.992526 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650362 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 08:06:52.992526 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650364 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 08:06:52.992526 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650367 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 08:06:52.992526 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650369 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 08:06:52.992526 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650372 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 08:06:52.992526 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650374 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 08:06:52.992526 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650377 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 08:06:52.992526 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650379 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 08:06:52.992526 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650382 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 08:06:52.992526 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650384 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 08:06:52.992526 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650387 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 08:06:52.992526 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650389 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 08:06:52.992526 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650392 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 08:06:52.992526 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650394 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 08:06:52.992526 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650396 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 08:06:52.992526 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650399 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 08:06:52.992526 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650401 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 08:06:52.993399 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650404 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 08:06:52.993399 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650407 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 08:06:52.993399 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650410 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 08:06:52.993399 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650412 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 08:06:52.993399 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650415 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 08:06:52.993399 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650418 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 08:06:52.993399 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650420 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 08:06:52.993399 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650423 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 08:06:52.993399 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650425 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 08:06:52.993399 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650430 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 08:06:52.993399 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650436 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 08:06:52.993399 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650439 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 08:06:52.993399 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650442 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 08:06:52.993399 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650445 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 08:06:52.993399 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650447 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 08:06:52.993399 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650450 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 08:06:52.993399 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650453 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 08:06:52.993399 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650456 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 08:06:52.993399 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650458 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 08:06:52.994494 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650461 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 08:06:52.994494 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650464 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 08:06:52.994494 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650466 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 08:06:52.994494 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650469 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 08:06:52.994494 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650472 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 08:06:52.994494 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650475 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 08:06:52.994494 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650477 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 08:06:52.994494 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650480 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 08:06:52.994494 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650482 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 08:06:52.994494 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650485 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 08:06:52.994494 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650487 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 08:06:52.994494 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650489 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 08:06:52.994494 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650492 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 08:06:52.994494 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650494 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 08:06:52.994494 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650856 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 08:06:52.994494 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650862 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 08:06:52.994494 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650864 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 08:06:52.994494 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650868 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 08:06:52.994494 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650870 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 08:06:52.994494 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650873 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 08:06:52.995591 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650875 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 08:06:52.995591 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650878 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 08:06:52.995591 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650881 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 08:06:52.995591 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650885 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 08:06:52.995591 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650888 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 08:06:52.995591 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650890 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 08:06:52.995591 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650894 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 08:06:52.995591 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650896 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 08:06:52.995591 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650899 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 08:06:52.995591 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650902 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 08:06:52.995591 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650904 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 08:06:52.995591 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650907 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 08:06:52.995591 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650910 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 08:06:52.995591 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650912 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 08:06:52.995591 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650916 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 08:06:52.995591 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650919 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 08:06:52.995591 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650922 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 08:06:52.995591 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650925 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 08:06:52.995591 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650947 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 08:06:52.995591 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650950 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 08:06:52.996684 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650952 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 08:06:52.996684 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650955 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 08:06:52.996684 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650958 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 08:06:52.996684 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650961 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 08:06:52.996684 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650964 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 08:06:52.996684 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650966 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 08:06:52.996684 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650969 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 08:06:52.996684 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650971 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 08:06:52.996684 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650974 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 08:06:52.996684 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650976 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 08:06:52.996684 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650979 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 08:06:52.996684 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650984 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 08:06:52.996684 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650986 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 08:06:52.996684 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650989 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 08:06:52.996684 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650992 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 08:06:52.996684 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650996 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 08:06:52.996684 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.650998 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 08:06:52.996684 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651001 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 08:06:52.996684 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651004 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 08:06:52.996684 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651007 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 08:06:52.997975 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651010 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 08:06:52.997975 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651012 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 12 08:06:52.997975 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651015 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 08:06:52.997975 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651017 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 08:06:52.997975 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651020 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 08:06:52.997975 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651022 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 08:06:52.997975 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651025 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 08:06:52.997975 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651028 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 08:06:52.997975 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651030 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 08:06:52.997975 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651033 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 08:06:52.997975 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651035 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 08:06:52.997975 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651038 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 08:06:52.997975 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651040 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 08:06:52.997975 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651043 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 08:06:52.997975 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651046 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 08:06:52.997975 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651048 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 08:06:52.997975 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651050 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 08:06:52.997975 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651053 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 08:06:52.997975 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651056 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 08:06:52.997975 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651058 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 08:06:52.999297 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651061 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 08:06:52.999297 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651063 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 08:06:52.999297 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651065 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 08:06:52.999297 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651071 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 08:06:52.999297 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651073 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 08:06:52.999297 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651076 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 08:06:52.999297 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651078 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 08:06:52.999297 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651082 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 08:06:52.999297 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651086 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 08:06:52.999297 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651089 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 08:06:52.999297 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651092 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 08:06:52.999297 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651095 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 08:06:52.999297 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651098 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 08:06:52.999297 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651101 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 08:06:52.999297 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651104 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 08:06:52.999297 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651106 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 08:06:52.999297 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651109 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 08:06:52.999297 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651112 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 08:06:52.999297 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651114 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 08:06:52.999297 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651116 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 08:06:53.000289 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651119 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 08:06:53.000289 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651122 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 08:06:53.000289 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651124 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 08:06:53.000289 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651127 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 08:06:53.000289 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651129 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 08:06:53.000289 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651132 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 08:06:53.000289 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651134 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 08:06:53.000289 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651137 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 08:06:53.000289 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651139 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 08:06:53.000289 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651141 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 08:06:53.000289 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651144 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 08:06:53.000289 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651147 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 08:06:53.000289 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651151 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 08:06:53.000289 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651215 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 12 08:06:53.000289 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651221 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 12 08:06:53.000289 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651230 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 12 08:06:53.000289 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651235 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 12 08:06:53.000289 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651239 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 12 08:06:53.000289 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651242 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 12 08:06:53.000289 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651247 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 12 08:06:53.000289 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651251 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 12 08:06:53.001378 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651255 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 12 08:06:53.001378 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651258 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 12 08:06:53.001378 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651261 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 12 08:06:53.001378 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651265 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 12 08:06:53.001378 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651268 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 12 08:06:53.001378 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651271 2576 flags.go:64] FLAG: --cgroup-root="" Jul 12 08:06:53.001378 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651273 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 12 08:06:53.001378 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651276 2576 flags.go:64] FLAG: --client-ca-file="" Jul 12 08:06:53.001378 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651279 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 12 08:06:53.001378 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651282 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 12 08:06:53.001378 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651287 2576 flags.go:64] FLAG: --cluster-domain="" Jul 12 08:06:53.001378 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651290 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 12 08:06:53.001378 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651293 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 12 08:06:53.001378 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651296 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 12 08:06:53.001378 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651299 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 12 08:06:53.001378 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651303 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 12 08:06:53.001378 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651306 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 12 08:06:53.001378 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651309 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 12 08:06:53.001378 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651312 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 12 08:06:53.001378 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651315 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 12 08:06:53.001378 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651318 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 12 08:06:53.001378 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651321 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 12 08:06:53.001378 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651324 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 12 08:06:53.001378 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651327 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 12 08:06:53.002464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651331 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 12 08:06:53.002464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651334 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 12 08:06:53.002464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651338 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 12 08:06:53.002464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651341 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 12 08:06:53.002464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651345 2576 flags.go:64] FLAG: --enable-server="true" Jul 12 08:06:53.002464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651348 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 12 08:06:53.002464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651354 2576 flags.go:64] FLAG: --event-burst="100" Jul 12 08:06:53.002464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651357 2576 flags.go:64] FLAG: --event-qps="50" Jul 12 08:06:53.002464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651360 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 12 08:06:53.002464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651363 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 12 08:06:53.002464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651366 2576 flags.go:64] FLAG: --eviction-hard="" Jul 12 08:06:53.002464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651369 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 12 08:06:53.002464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651372 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 12 08:06:53.002464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651375 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 12 08:06:53.002464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651378 2576 flags.go:64] FLAG: --eviction-soft="" Jul 12 08:06:53.002464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651381 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 12 08:06:53.002464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651384 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 12 08:06:53.002464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651387 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 12 08:06:53.002464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651390 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 12 08:06:53.002464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651392 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 12 08:06:53.002464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651395 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 12 08:06:53.002464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651398 2576 flags.go:64] FLAG: --feature-gates="" Jul 12 08:06:53.002464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651402 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 12 08:06:53.002464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651405 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 12 08:06:53.002464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651408 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 12 08:06:53.003807 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651411 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 12 08:06:53.003807 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651414 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 12 08:06:53.003807 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651417 2576 flags.go:64] FLAG: --help="false" Jul 12 08:06:53.003807 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651420 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-128-184.ec2.internal" Jul 12 08:06:53.003807 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651423 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 12 08:06:53.003807 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651426 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 12 08:06:53.003807 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651429 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 12 08:06:53.003807 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651432 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 12 08:06:53.003807 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651436 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 12 08:06:53.003807 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651440 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 12 08:06:53.003807 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651443 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 12 08:06:53.003807 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651445 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 12 08:06:53.003807 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651448 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 12 08:06:53.003807 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651452 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 12 08:06:53.003807 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651456 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 12 08:06:53.003807 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651458 2576 flags.go:64] FLAG: --kube-reserved="" Jul 12 08:06:53.003807 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651461 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 12 08:06:53.003807 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651464 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 12 08:06:53.003807 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651467 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 12 08:06:53.003807 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651470 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 12 08:06:53.003807 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651473 2576 flags.go:64] FLAG: --lock-file="" Jul 12 08:06:53.003807 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651476 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 12 08:06:53.003807 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651479 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 12 08:06:53.003807 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651481 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 12 08:06:53.004945 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651487 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 12 08:06:53.004945 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651490 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 12 08:06:53.004945 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651492 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 12 08:06:53.004945 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651495 2576 flags.go:64] FLAG: --logging-format="text" Jul 12 08:06:53.004945 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651498 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 12 08:06:53.004945 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651501 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 12 08:06:53.004945 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651504 2576 flags.go:64] FLAG: --manifest-url="" Jul 12 08:06:53.004945 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651506 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 12 08:06:53.004945 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651511 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 12 08:06:53.004945 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651514 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 12 08:06:53.004945 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651517 2576 flags.go:64] FLAG: --max-pods="110" Jul 12 08:06:53.004945 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651520 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 12 08:06:53.004945 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651523 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 12 08:06:53.004945 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651526 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 12 08:06:53.004945 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651529 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 12 08:06:53.004945 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651532 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 12 08:06:53.004945 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651535 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 12 08:06:53.004945 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651539 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 12 08:06:53.004945 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651545 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 12 08:06:53.004945 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651548 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 12 08:06:53.004945 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651551 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 12 08:06:53.004945 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651556 2576 flags.go:64] FLAG: --pod-cidr="" Jul 12 08:06:53.004945 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651559 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 12 08:06:53.006247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651564 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 12 08:06:53.006247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651567 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 12 08:06:53.006247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651571 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 12 08:06:53.006247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651574 2576 flags.go:64] FLAG: --port="10250" Jul 12 08:06:53.006247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651576 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 12 08:06:53.006247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651579 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-087c44aab531f9a23" Jul 12 08:06:53.006247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651582 2576 flags.go:64] FLAG: --qos-reserved="" Jul 12 08:06:53.006247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651585 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 12 08:06:53.006247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651589 2576 flags.go:64] FLAG: --register-node="true" Jul 12 08:06:53.006247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651592 2576 flags.go:64] FLAG: --register-with-taints="" Jul 12 08:06:53.006247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651596 2576 flags.go:64] FLAG: --registry-burst="10" Jul 12 08:06:53.006247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651598 2576 flags.go:64] FLAG: --registry-qps="5" Jul 12 08:06:53.006247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651601 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 12 08:06:53.006247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651604 2576 flags.go:64] FLAG: --reserved-memory="" Jul 12 08:06:53.006247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651607 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 12 08:06:53.006247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651610 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 12 08:06:53.006247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651613 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 12 08:06:53.006247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651616 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 12 08:06:53.006247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651619 2576 flags.go:64] FLAG: --runonce="false" Jul 12 08:06:53.006247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651622 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 12 08:06:53.006247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651625 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 12 08:06:53.006247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651628 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 12 08:06:53.006247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651630 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 12 08:06:53.006247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651633 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 12 08:06:53.006247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651636 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 12 08:06:53.006247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651639 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 12 08:06:53.009648 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651642 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 12 08:06:53.009648 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651647 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 12 08:06:53.009648 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651650 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 12 08:06:53.009648 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651653 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 12 08:06:53.009648 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651657 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 12 08:06:53.009648 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651661 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 12 08:06:53.009648 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651663 2576 flags.go:64] FLAG: --system-cgroups="" Jul 12 08:06:53.009648 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651666 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 12 08:06:53.009648 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651671 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 12 08:06:53.009648 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651674 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 12 08:06:53.009648 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651677 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 12 08:06:53.009648 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651681 2576 flags.go:64] FLAG: --tls-min-version="" Jul 12 08:06:53.009648 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651684 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 12 08:06:53.009648 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651687 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 12 08:06:53.009648 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651690 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 12 08:06:53.009648 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651693 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 12 08:06:53.009648 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651696 2576 flags.go:64] FLAG: --v="2" Jul 12 08:06:53.009648 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651699 2576 flags.go:64] FLAG: --version="false" Jul 12 08:06:53.009648 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651703 2576 flags.go:64] FLAG: --vmodule="" Jul 12 08:06:53.009648 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651706 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 12 08:06:53.009648 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.651710 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 12 08:06:53.009648 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651816 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 08:06:53.009648 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651820 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 08:06:53.009648 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651824 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 08:06:53.010758 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651828 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 08:06:53.010758 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651831 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 08:06:53.010758 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651834 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 08:06:53.010758 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651837 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 08:06:53.010758 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651839 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 08:06:53.010758 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651842 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 08:06:53.010758 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651845 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 08:06:53.010758 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651848 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 08:06:53.010758 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651850 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 08:06:53.010758 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651854 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 08:06:53.010758 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651856 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 08:06:53.010758 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651859 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 08:06:53.010758 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651863 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 08:06:53.010758 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651865 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 08:06:53.010758 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651868 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 08:06:53.010758 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651871 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 08:06:53.010758 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651874 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 08:06:53.010758 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651876 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 08:06:53.010758 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651879 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 08:06:53.010758 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651881 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 08:06:53.017728 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651884 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 08:06:53.017728 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651886 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 08:06:53.017728 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651889 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 08:06:53.017728 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651891 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 08:06:53.017728 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651894 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 08:06:53.017728 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651898 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 08:06:53.017728 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651901 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 08:06:53.017728 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651904 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 08:06:53.017728 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651907 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 08:06:53.017728 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651909 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 08:06:53.017728 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651912 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 08:06:53.017728 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651915 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 08:06:53.017728 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651917 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 08:06:53.017728 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651920 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 08:06:53.017728 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651922 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 08:06:53.017728 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651925 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 08:06:53.017728 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651940 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 08:06:53.017728 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651943 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 08:06:53.017728 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651945 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 08:06:53.017728 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651947 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 08:06:53.018421 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651950 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 08:06:53.018421 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651954 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 08:06:53.018421 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651957 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 08:06:53.018421 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651959 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 08:06:53.018421 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651963 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 08:06:53.018421 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651966 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 08:06:53.018421 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651968 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 08:06:53.018421 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651971 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 08:06:53.018421 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651974 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 08:06:53.018421 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651978 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 08:06:53.018421 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651980 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 08:06:53.018421 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651983 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 08:06:53.018421 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651985 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 08:06:53.018421 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651988 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 08:06:53.018421 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651990 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 08:06:53.018421 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651993 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 08:06:53.018421 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651996 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 08:06:53.018421 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.651998 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 08:06:53.018421 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652001 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 08:06:53.018421 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652003 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 08:06:53.021074 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652006 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 08:06:53.021074 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652008 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 08:06:53.021074 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652011 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 12 08:06:53.021074 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652013 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 08:06:53.021074 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652015 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 08:06:53.021074 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652019 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 08:06:53.021074 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652022 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 08:06:53.021074 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652025 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 08:06:53.021074 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652027 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 08:06:53.021074 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652030 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 08:06:53.021074 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652032 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 08:06:53.021074 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652034 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 08:06:53.021074 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652037 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 08:06:53.021074 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652041 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 08:06:53.021074 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652043 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 08:06:53.021074 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652046 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 08:06:53.021074 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652050 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 08:06:53.021074 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652052 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 08:06:53.021074 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652055 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 08:06:53.021074 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652058 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 08:06:53.021685 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652061 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 08:06:53.021685 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652063 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 08:06:53.021685 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652066 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 08:06:53.021685 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652069 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 08:06:53.021685 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652071 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 08:06:53.021685 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652074 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 08:06:53.021685 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652076 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 08:06:53.021685 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652079 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 08:06:53.021685 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652082 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 08:06:53.021685 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652085 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 08:06:53.021685 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652087 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 08:06:53.021685 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652090 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 08:06:53.021685 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652092 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 08:06:53.021685 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652095 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 08:06:53.021685 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652097 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 08:06:53.021685 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.652100 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 08:06:53.022301 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.652940 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 12 08:06:53.022301 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.662883 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 12 08:06:53.022301 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.662904 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 12 08:06:53.022301 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.663848 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 12 08:06:53.022301 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.663856 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 12 08:06:53.022301 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.663922 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 08:06:53.022301 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.663941 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 08:06:53.022301 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.663944 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 08:06:53.022301 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.663948 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 08:06:53.022301 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.663951 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 08:06:53.022301 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.663954 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 08:06:53.022301 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.663958 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 08:06:53.022301 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.663962 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 08:06:53.022301 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.663965 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 08:06:53.022924 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.663968 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 08:06:53.022924 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.663971 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 08:06:53.022924 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.663974 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 08:06:53.022924 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.663976 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 08:06:53.022924 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.663979 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 08:06:53.022924 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.663981 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 08:06:53.022924 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.663984 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 08:06:53.022924 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.663987 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 08:06:53.022924 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.663989 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 08:06:53.022924 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.663992 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 08:06:53.022924 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.663995 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 08:06:53.022924 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.663998 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 08:06:53.022924 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664001 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 08:06:53.022924 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664004 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 08:06:53.022924 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664007 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 08:06:53.022924 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664010 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 08:06:53.022924 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664013 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 08:06:53.022924 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664015 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 08:06:53.022924 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664021 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 08:06:53.022924 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664024 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 08:06:53.023537 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664027 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 08:06:53.023537 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664030 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 08:06:53.023537 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664032 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 08:06:53.023537 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664035 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 12 08:06:53.023537 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664037 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 08:06:53.023537 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664040 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 08:06:53.023537 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664043 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 08:06:53.023537 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664046 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 08:06:53.023537 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664048 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 08:06:53.023537 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664051 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 08:06:53.023537 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664054 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 08:06:53.023537 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664057 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 08:06:53.023537 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664060 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 08:06:53.023537 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664062 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 08:06:53.023537 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664065 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 08:06:53.023537 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664067 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 08:06:53.023537 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664070 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 08:06:53.023537 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664072 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 08:06:53.023537 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664075 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 08:06:53.023537 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664078 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 08:06:53.024169 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664080 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 08:06:53.024169 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664083 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 08:06:53.024169 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664086 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 08:06:53.024169 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664088 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 08:06:53.024169 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664091 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 08:06:53.024169 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664093 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 08:06:53.024169 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664096 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 08:06:53.024169 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664098 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 08:06:53.024169 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664101 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 08:06:53.024169 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664105 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 08:06:53.024169 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664110 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 08:06:53.024169 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664113 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 08:06:53.024169 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664116 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 08:06:53.024169 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664119 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 08:06:53.024169 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664122 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 08:06:53.024169 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664125 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 08:06:53.024169 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664129 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 08:06:53.024169 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664132 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 08:06:53.024169 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664136 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 08:06:53.024689 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664139 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 08:06:53.024689 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664142 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 08:06:53.024689 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664144 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 08:06:53.024689 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664147 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 08:06:53.024689 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664149 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 08:06:53.024689 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664152 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 08:06:53.024689 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664154 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 08:06:53.024689 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664157 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 08:06:53.024689 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664160 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 08:06:53.024689 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664162 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 08:06:53.024689 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664165 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 08:06:53.024689 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664174 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 08:06:53.024689 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664177 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 08:06:53.024689 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664180 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 08:06:53.024689 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664182 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 08:06:53.024689 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664185 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 08:06:53.024689 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664187 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 08:06:53.024689 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664189 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 08:06:53.024689 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664192 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 08:06:53.025238 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664194 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 08:06:53.025238 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664197 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 08:06:53.025238 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664200 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 08:06:53.025238 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664202 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 08:06:53.025238 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664206 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 08:06:53.025238 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664209 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 08:06:53.025238 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664212 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 08:06:53.025238 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664214 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 08:06:53.025238 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664217 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 08:06:53.025238 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664219 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 08:06:53.025238 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664223 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 08:06:53.025238 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664225 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 08:06:53.025238 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.664231 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 12 08:06:53.025238 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664357 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 08:06:53.025238 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664362 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 08:06:53.025644 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664365 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 08:06:53.025644 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664368 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 08:06:53.025644 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664372 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 08:06:53.025644 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664375 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 08:06:53.025644 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664378 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 08:06:53.025644 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664381 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 08:06:53.025644 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664383 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 08:06:53.025644 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664386 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 08:06:53.025644 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664388 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 08:06:53.025644 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664393 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 08:06:53.025644 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664402 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 08:06:53.025644 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664405 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 08:06:53.025644 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664407 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 08:06:53.025644 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664410 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 08:06:53.025644 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664414 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 08:06:53.025644 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664417 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 08:06:53.025644 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664420 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 08:06:53.025644 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664423 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 08:06:53.025644 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664426 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 08:06:53.026184 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664429 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 08:06:53.026184 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664432 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 08:06:53.026184 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664434 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 08:06:53.026184 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664438 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 12 08:06:53.026184 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664441 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 08:06:53.026184 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664444 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 08:06:53.026184 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664446 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 08:06:53.026184 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664449 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 08:06:53.026184 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664452 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 08:06:53.026184 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664454 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 08:06:53.026184 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664457 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 08:06:53.026184 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664459 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 08:06:53.026184 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664462 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 08:06:53.026184 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664465 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 08:06:53.026184 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664468 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 08:06:53.026184 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664470 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 08:06:53.026184 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664473 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 08:06:53.026184 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664475 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 08:06:53.026184 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664478 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 08:06:53.026184 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664481 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 08:06:53.203015 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664483 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 08:06:53.203015 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664486 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 08:06:53.203015 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664490 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 08:06:53.203015 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664493 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 08:06:53.203015 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664496 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 08:06:53.203015 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664499 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 08:06:53.203015 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664501 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 08:06:53.203015 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664504 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 08:06:53.203015 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664507 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 08:06:53.203015 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664509 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 08:06:53.203015 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664512 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 08:06:53.203015 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664514 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 08:06:53.203015 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664517 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 08:06:53.203015 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664520 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 08:06:53.203015 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664522 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 08:06:53.203015 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664527 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 08:06:53.203015 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664529 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 08:06:53.203015 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664532 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 08:06:53.203015 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664535 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 08:06:53.203015 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664538 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 08:06:53.203683 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664542 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 08:06:53.203683 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664545 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 08:06:53.203683 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664548 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 08:06:53.203683 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664551 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 08:06:53.203683 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664554 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 08:06:53.203683 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664556 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 08:06:53.203683 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664559 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 08:06:53.203683 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664562 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 08:06:53.203683 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664564 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 08:06:53.203683 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664567 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 08:06:53.203683 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664570 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 08:06:53.203683 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664573 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 08:06:53.203683 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664575 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 08:06:53.203683 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664578 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 08:06:53.203683 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664582 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 08:06:53.203683 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664584 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 08:06:53.203683 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664587 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 08:06:53.203683 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664590 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 08:06:53.203683 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664592 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 08:06:53.203683 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664595 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 08:06:53.204229 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664598 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 08:06:53.204229 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664600 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 08:06:53.204229 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664603 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 08:06:53.204229 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664605 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 08:06:53.204229 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664608 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 08:06:53.204229 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664610 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 08:06:53.204229 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664613 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 08:06:53.204229 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664617 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 08:06:53.204229 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664619 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 08:06:53.204229 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664622 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 08:06:53.204229 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664625 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 08:06:53.204229 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664627 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 08:06:53.204229 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664630 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 08:06:53.204229 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664632 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 08:06:53.204229 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664635 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 08:06:53.204229 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664638 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 08:06:53.204229 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664640 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 08:06:53.204229 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:52.664642 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 08:06:53.204749 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.664648 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 12 08:06:53.204749 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.664755 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 12 08:06:53.204749 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.667952 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 12 08:06:53.204749 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.669572 2576 server.go:1019] "Starting client certificate rotation" Jul 12 08:06:53.204749 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.669674 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 12 08:06:53.204749 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.669707 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 12 08:06:53.204749 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.672366 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 12 08:06:53.204749 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.677047 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 12 08:06:53.204749 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.690394 2576 log.go:25] "Validated CRI v1 runtime API" Jul 12 08:06:53.204749 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.693017 2576 log.go:25] "Validated CRI v1 image API" Jul 12 08:06:53.204749 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.693783 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 12 08:06:53.204749 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.695353 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 12 08:06:53.205113 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.696447 2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 87e0954d-2042-43e0-8895-05fe236c4593:/dev/nvme0n1p4 c6bd0be7-8667-4f66-92a9-d9e0c06fd066:/dev/nvme0n1p3] Jul 12 08:06:53.205113 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.696462 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 12 08:06:53.205282 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.701395 2576 manager.go:216] Machine: {Timestamp:2026-07-12 08:06:52.700914563 +0000 UTC m=+0.385725417 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102933 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2973832e547df05c93bde58ca771e8 SystemUUID:ec297383-2e54-7df0-5c93-bde58ca771e8 BootID:bc685cd7-c594-48cd-ac36-44eadb826fbf Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ef:9c:db:51:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ef:9c:db:51:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:31:9b:c5:37:2f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 12 08:06:53.205282 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.701485 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 12 08:06:53.205282 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.701553 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 12 08:06:53.205282 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.705139 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 12 08:06:53.205282 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.705340 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-184.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 12 08:06:53.205282 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.706901 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 12 08:06:53.205282 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.706923 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 12 08:06:53.205282 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.706950 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 12 08:06:53.205282 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.707568 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 12 08:06:53.205282 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.708778 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 12 08:06:53.205282 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.712162 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 12 08:06:53.205282 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.712276 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 12 08:06:53.205282 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.712303 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 12 08:06:53.205282 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.712312 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 12 08:06:53.205282 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.712323 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 12 08:06:53.205282 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.712332 2576 kubelet.go:398] "Adding apiserver pod source" Jul 12 08:06:53.205282 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.712340 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 12 08:06:53.205282 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.712680 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.712698 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.714653 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nfrjw" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.715074 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.717087 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.717116 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.717870 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.717883 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.717889 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.717894 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.717901 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.717909 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.717970 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.717977 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.717983 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.717989 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.718003 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.718015 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.718042 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.718048 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.721237 2576 server.go:1268] "Started kubelet" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.721366 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.721975 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.722093 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.722695 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nfrjw" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.723550 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.723725 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.724890 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-184.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:52.725187 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-184.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:52.725187 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.729635 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.730212 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:52.730309 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-184.ec2.internal\" not found" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.730920 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.730920 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.730963 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.731055 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.731064 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.735316 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.736809 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.736822 2576 factory.go:55] Registering systemd factory Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.736830 2576 factory.go:223] Registration of the systemd container factory successfully Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:52.736889 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.737016 2576 factory.go:153] Registering CRI-O factory Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.737025 2576 factory.go:223] Registration of the crio container factory successfully Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.737041 2576 factory.go:103] Registering Raw factory Jul 12 08:06:53.205827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.737049 2576 manager.go:1196] Started watching for new ooms in manager Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:52.737356 2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-184.ec2.internal\" not found" node="ip-10-0-128-184.ec2.internal" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.737453 2576 manager.go:349] Starting recovery of all containers Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.748124 2576 manager.go:354] Recovery completed Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.752226 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.754135 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-184.ec2.internal" event="NodeHasSufficientMemory" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.754161 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-184.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.754172 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-184.ec2.internal" event="NodeHasSufficientPID" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.755593 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.755601 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.755611 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.755615 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.756620 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-184.ec2.internal" event="NodeHasSufficientMemory" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.756647 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-184.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.756660 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-184.ec2.internal" event="NodeHasSufficientPID" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.756860 2576 policy_none.go:49] "None policy: Start" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.756873 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.756885 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.757878 2576 policy_none.go:47] "Start" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.820513 2576 manager.go:337] "Starting Device Plugin manager" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:52.820548 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.820561 2576 server.go:87] "Starting device plugin registration server" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.820795 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.820806 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.820903 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.820992 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.821001 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:52.822848 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:52.822900 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-184.ec2.internal\" not found" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.842656 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.843743 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.843792 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.844254 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:52.844294 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.846230 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.920878 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.921807 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-184.ec2.internal" event="NodeHasSufficientMemory" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.921836 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-184.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.921847 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-184.ec2.internal" event="NodeHasSufficientPID" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.921875 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-184.ec2.internal" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.928966 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-184.ec2.internal" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:52.928985 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-184.ec2.internal\": node \"ip-10-0-128-184.ec2.internal\" not found" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:52.943742 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-184.ec2.internal\" not found" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.944766 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-184.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-184.ec2.internal"] Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.944819 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.945512 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-184.ec2.internal" event="NodeHasSufficientMemory" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.945533 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-184.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 08:06:53.211978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.945542 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-184.ec2.internal" event="NodeHasSufficientPID" Jul 12 08:06:53.213298 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.946664 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 08:06:53.213298 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.946771 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-184.ec2.internal" Jul 12 08:06:53.213298 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.946813 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 08:06:53.213298 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.947318 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-184.ec2.internal" event="NodeHasSufficientMemory" Jul 12 08:06:53.213298 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.947333 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-184.ec2.internal" event="NodeHasSufficientMemory" Jul 12 08:06:53.213298 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.947352 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-184.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 08:06:53.213298 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.947357 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-184.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 08:06:53.213298 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.947363 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-184.ec2.internal" event="NodeHasSufficientPID" Jul 12 08:06:53.213298 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.947374 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-184.ec2.internal" event="NodeHasSufficientPID" Jul 12 08:06:53.213298 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.949421 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-184.ec2.internal" Jul 12 08:06:53.213298 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.949445 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 08:06:53.213298 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.950050 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-184.ec2.internal" event="NodeHasSufficientMemory" Jul 12 08:06:53.213298 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.950076 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-184.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 08:06:53.213298 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:52.950096 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-184.ec2.internal" event="NodeHasSufficientPID" Jul 12 08:06:53.213298 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:52.981719 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-184.ec2.internal\" not found" node="ip-10-0-128-184.ec2.internal" Jul 12 08:06:53.213298 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:52.987324 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-184.ec2.internal\" not found" node="ip-10-0-128-184.ec2.internal" Jul 12 08:06:53.213298 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:53.032594 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc1402ad85e5eed66f92bb7fbc1b0c6b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-184.ec2.internal\" (UID: \"fc1402ad85e5eed66f92bb7fbc1b0c6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-184.ec2.internal" Jul 12 08:06:53.213298 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:53.032755 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc1402ad85e5eed66f92bb7fbc1b0c6b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-184.ec2.internal\" (UID: \"fc1402ad85e5eed66f92bb7fbc1b0c6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-184.ec2.internal" Jul 12 08:06:53.213298 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:53.032773 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c389db2de5a159deb11c2765258ec9e-config\") pod \"kube-apiserver-proxy-ip-10-0-128-184.ec2.internal\" (UID: \"9c389db2de5a159deb11c2765258ec9e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-184.ec2.internal" Jul 12 08:06:53.213298 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:53.044037 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-184.ec2.internal\" not found" Jul 12 08:06:53.213298 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:53.133808 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc1402ad85e5eed66f92bb7fbc1b0c6b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-184.ec2.internal\" (UID: \"fc1402ad85e5eed66f92bb7fbc1b0c6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-184.ec2.internal" Jul 12 08:06:53.213298 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:53.133836 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc1402ad85e5eed66f92bb7fbc1b0c6b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-184.ec2.internal\" (UID: \"fc1402ad85e5eed66f92bb7fbc1b0c6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-184.ec2.internal" Jul 12 08:06:53.213298 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:53.133856 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c389db2de5a159deb11c2765258ec9e-config\") pod \"kube-apiserver-proxy-ip-10-0-128-184.ec2.internal\" (UID: \"9c389db2de5a159deb11c2765258ec9e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-184.ec2.internal" Jul 12 08:06:53.213298 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:53.133902 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fc1402ad85e5eed66f92bb7fbc1b0c6b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-184.ec2.internal\" (UID: \"fc1402ad85e5eed66f92bb7fbc1b0c6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-184.ec2.internal" Jul 12 08:06:53.213298 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:53.133917 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c389db2de5a159deb11c2765258ec9e-config\") pod \"kube-apiserver-proxy-ip-10-0-128-184.ec2.internal\" (UID: \"9c389db2de5a159deb11c2765258ec9e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-184.ec2.internal" Jul 12 08:06:53.374766 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:53.133922 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc1402ad85e5eed66f92bb7fbc1b0c6b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-184.ec2.internal\" (UID: \"fc1402ad85e5eed66f92bb7fbc1b0c6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-184.ec2.internal" Jul 12 08:06:53.374766 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:53.144891 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-184.ec2.internal\" not found" Jul 12 08:06:53.374766 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:53.245601 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-184.ec2.internal\" not found" Jul 12 08:06:53.374766 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:53.284776 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-184.ec2.internal" Jul 12 08:06:53.374766 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:53.291276 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-184.ec2.internal" Jul 12 08:06:53.374766 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:53.346007 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-184.ec2.internal\" not found" Jul 12 08:06:53.558062 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:53.446489 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-184.ec2.internal\" not found" Jul 12 08:06:53.558062 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:53.547075 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-184.ec2.internal\" not found" Jul 12 08:06:53.736729 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:53.647643 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-184.ec2.internal\" not found" Jul 12 08:06:53.736729 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:53.668915 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 12 08:06:53.736729 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:53.669059 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 12 08:06:53.736729 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:53.669100 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 12 08:06:53.736729 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:53.727688 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-11 08:01:53 +0000 UTC" deadline="2028-02-05 18:11:55.43766966 +0000 UTC" Jul 12 08:06:53.736729 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:53.727715 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13762h5m1.709958277s" Jul 12 08:06:53.892744 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:53.748481 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-184.ec2.internal\" not found" Jul 12 08:06:53.892744 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:53.812766 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 08:06:53.892744 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:53.831068 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-184.ec2.internal" Jul 12 08:06:53.892744 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:53.842409 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 12 08:06:53.892744 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:53.844240 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-184.ec2.internal" Jul 12 08:06:53.892744 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:53.850568 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 12 08:06:53.892744 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:53.868341 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc1402ad85e5eed66f92bb7fbc1b0c6b.slice/crio-9ef021cf4b18510ea900d4cf20041be6e2e67bbea17f7ccfea4cb0dd6d9b027f WatchSource:0}: Error finding container 9ef021cf4b18510ea900d4cf20041be6e2e67bbea17f7ccfea4cb0dd6d9b027f: Status 404 returned error can't find the container with id 9ef021cf4b18510ea900d4cf20041be6e2e67bbea17f7ccfea4cb0dd6d9b027f Jul 12 08:06:53.892744 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:53.868970 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c389db2de5a159deb11c2765258ec9e.slice/crio-3051f0bdd5d3371323e3afa8a8aa0cb88f72752150c9b2c1ecef69495fe96013 WatchSource:0}: Error finding container 3051f0bdd5d3371323e3afa8a8aa0cb88f72752150c9b2c1ecef69495fe96013: Status 404 returned error can't find the container with id 3051f0bdd5d3371323e3afa8a8aa0cb88f72752150c9b2c1ecef69495fe96013 Jul 12 08:06:53.892744 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:53.878428 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 08:06:54.057630 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:53.962732 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 08:06:54.585503 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.534421 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 08:06:54.743804 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.713600 2576 apiserver.go:52] "Watching apiserver" Jul 12 08:06:54.743804 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.731166 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.772849 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.775147 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.775619 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-rvmp5","openshift-image-registry/node-ca-wz95w","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-184.ec2.internal","openshift-multus/multus-2bshp","openshift-multus/network-metrics-daemon-bnfwz","openshift-network-diagnostics/network-check-target-j4nh6","openshift-network-operator/iptables-alerter-d98gf","kube-system/global-pull-secret-syncer-hl94f","kube-system/konnectivity-agent-rccbv","kube-system/kube-apiserver-proxy-ip-10-0-128-184.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq","openshift-multus/multus-additional-cni-plugins-6fjqb","openshift-ovn-kubernetes/ovnkube-node-kd8ct","openshift-cluster-node-tuning-operator/tuned-kt97t"] Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.776105 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.776238 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v5fzh" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.777390 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d98gf" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.778663 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.780270 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.780380 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xx94t\"" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.780274 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.781166 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.781552 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.781988 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2bshp" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.783661 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:54.783728 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnfwz" podUID="fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.787779 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:54.787841 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4nh6" podUID="6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.792985 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rccbv" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.795624 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.795748 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.795991 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.795997 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ngfpj\"" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.796179 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.796234 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.796305 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rvmp5" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.797185 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.797433 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.797448 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.797987 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.798190 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 12 08:06:54.845560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.798251 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.798709 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.798953 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wz95w" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.804365 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f2w5d\"" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.804418 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.804491 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rnq6p\"" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.805812 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:54.805899 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hl94f" podUID="353ad383-9095-4c48-b3c8-5011b5519c48" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.806518 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.806997 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vvfz4\"" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.807650 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.807869 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.808746 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6h94b\"" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.809623 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.809641 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-q5qlv\"" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.809652 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.809792 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.810141 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.811711 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6fjqb" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.812557 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.812564 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.812738 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9lbgh\"" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.813391 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.813938 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.814050 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vgbsg\"" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.814327 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.832801 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844077 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/628c1d5e-923c-4cb5-bccb-3aa5dab35940-os-release\") pod \"multus-additional-cni-plugins-6fjqb\" (UID: \"628c1d5e-923c-4cb5-bccb-3aa5dab35940\") " pod="openshift-multus/multus-additional-cni-plugins-6fjqb" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844114 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/628c1d5e-923c-4cb5-bccb-3aa5dab35940-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6fjqb\" (UID: \"628c1d5e-923c-4cb5-bccb-3aa5dab35940\") " pod="openshift-multus/multus-additional-cni-plugins-6fjqb" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844148 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxs5v\" (UniqueName: \"kubernetes.io/projected/6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c-kube-api-access-nxs5v\") pod \"network-check-target-j4nh6\" (UID: \"6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c\") " pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:06:54.849858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844176 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-etc-modprobe-d\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:54.851450 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844205 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ba18abe7-7175-41f7-9ba6-719d288e39c2-konnectivity-ca\") pod \"konnectivity-agent-rccbv\" (UID: \"ba18abe7-7175-41f7-9ba6-719d288e39c2\") " pod="kube-system/konnectivity-agent-rccbv" Jul 12 08:06:54.851450 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844231 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b886eaf-a1aa-4e73-bf66-d8d0464561dc-host\") pod \"node-ca-wz95w\" (UID: \"3b886eaf-a1aa-4e73-bf66-d8d0464561dc\") " pod="openshift-image-registry/node-ca-wz95w" Jul 12 08:06:54.851450 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844255 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zl78\" (UniqueName: \"kubernetes.io/projected/00af3b5b-04d5-49be-8505-4116f740ae52-kube-api-access-4zl78\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:54.851450 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844280 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-cni-binary-copy\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:54.851450 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844306 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-etc-kubernetes\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:54.851450 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844331 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/778713dd-51aa-4f02-a6bd-2b3c26d176fc-hosts-file\") pod \"node-resolver-rvmp5\" (UID: \"778713dd-51aa-4f02-a6bd-2b3c26d176fc\") " pod="openshift-dns/node-resolver-rvmp5" Jul 12 08:06:54.851450 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844364 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-etc-sysctl-d\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:54.851450 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844388 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-multus-socket-dir-parent\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:54.851450 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844412 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-host-run-k8s-cni-cncf-io\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:54.851450 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844435 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a727b8e-f7fa-464e-88d2-4023165fc773-host-slash\") pod \"iptables-alerter-d98gf\" (UID: \"7a727b8e-f7fa-464e-88d2-4023165fc773\") " pod="openshift-network-operator/iptables-alerter-d98gf" Jul 12 08:06:54.851450 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844462 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sscjq\" (UniqueName: \"kubernetes.io/projected/7a727b8e-f7fa-464e-88d2-4023165fc773-kube-api-access-sscjq\") pod \"iptables-alerter-d98gf\" (UID: \"7a727b8e-f7fa-464e-88d2-4023165fc773\") " pod="openshift-network-operator/iptables-alerter-d98gf" Jul 12 08:06:54.851450 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844498 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:54.851450 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844525 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-host-run-multus-certs\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:54.851450 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844549 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b886eaf-a1aa-4e73-bf66-d8d0464561dc-serviceca\") pod \"node-ca-wz95w\" (UID: \"3b886eaf-a1aa-4e73-bf66-d8d0464561dc\") " pod="openshift-image-registry/node-ca-wz95w" Jul 12 08:06:54.851450 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844574 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-run-openvswitch\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:54.851450 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844598 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/97320e27-e583-48a5-a9e1-037fe39253d8-registration-dir\") pod \"aws-ebs-csi-driver-node-58jhq\" (UID: \"97320e27-e583-48a5-a9e1-037fe39253d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" Jul 12 08:06:54.854039 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844622 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c49f1eec-fc56-4413-8033-f54ed7214323-etc-tuned\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:54.854039 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844658 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-host-var-lib-cni-multus\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:54.854039 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844695 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/353ad383-9095-4c48-b3c8-5011b5519c48-kubelet-config\") pod \"global-pull-secret-syncer-hl94f\" (UID: \"353ad383-9095-4c48-b3c8-5011b5519c48\") " pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:06:54.854039 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844720 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/353ad383-9095-4c48-b3c8-5011b5519c48-dbus\") pod \"global-pull-secret-syncer-hl94f\" (UID: \"353ad383-9095-4c48-b3c8-5011b5519c48\") " pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:06:54.854039 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844747 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/97320e27-e583-48a5-a9e1-037fe39253d8-sys-fs\") pod \"aws-ebs-csi-driver-node-58jhq\" (UID: \"97320e27-e583-48a5-a9e1-037fe39253d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" Jul 12 08:06:54.854039 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844779 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69vdl\" (UniqueName: \"kubernetes.io/projected/97320e27-e583-48a5-a9e1-037fe39253d8-kube-api-access-69vdl\") pod \"aws-ebs-csi-driver-node-58jhq\" (UID: \"97320e27-e583-48a5-a9e1-037fe39253d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" Jul 12 08:06:54.854039 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844805 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/628c1d5e-923c-4cb5-bccb-3aa5dab35940-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6fjqb\" (UID: \"628c1d5e-923c-4cb5-bccb-3aa5dab35940\") " pod="openshift-multus/multus-additional-cni-plugins-6fjqb" Jul 12 08:06:54.854039 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844837 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-multus-cni-dir\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:54.854039 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844877 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/00af3b5b-04d5-49be-8505-4116f740ae52-ovnkube-config\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:54.854039 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844904 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-etc-kubernetes\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:54.854039 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844929 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-run\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:54.854039 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844954 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-sys\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:54.854039 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.844982 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-run-ovn\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:54.854039 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845023 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/00af3b5b-04d5-49be-8505-4116f740ae52-env-overrides\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:54.854039 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845054 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/97320e27-e583-48a5-a9e1-037fe39253d8-socket-dir\") pod \"aws-ebs-csi-driver-node-58jhq\" (UID: \"97320e27-e583-48a5-a9e1-037fe39253d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" Jul 12 08:06:54.854039 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845083 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69nsf\" (UniqueName: \"kubernetes.io/projected/628c1d5e-923c-4cb5-bccb-3aa5dab35940-kube-api-access-69nsf\") pod \"multus-additional-cni-plugins-6fjqb\" (UID: \"628c1d5e-923c-4cb5-bccb-3aa5dab35940\") " pod="openshift-multus/multus-additional-cni-plugins-6fjqb" Jul 12 08:06:54.854920 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845108 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c49f1eec-fc56-4413-8033-f54ed7214323-tmp\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:54.854920 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845135 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-system-cni-dir\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:54.854920 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845161 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-host-slash\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:54.854920 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845186 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-var-lib-openvswitch\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:54.854920 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845211 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-host-cni-bin\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:54.854920 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845236 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/778713dd-51aa-4f02-a6bd-2b3c26d176fc-tmp-dir\") pod \"node-resolver-rvmp5\" (UID: \"778713dd-51aa-4f02-a6bd-2b3c26d176fc\") " pod="openshift-dns/node-resolver-rvmp5" Jul 12 08:06:54.854920 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845260 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/97320e27-e583-48a5-a9e1-037fe39253d8-device-dir\") pod \"aws-ebs-csi-driver-node-58jhq\" (UID: \"97320e27-e583-48a5-a9e1-037fe39253d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" Jul 12 08:06:54.854920 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845285 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-var-lib-kubelet\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:54.854920 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845318 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-cnibin\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:54.854920 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845344 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-os-release\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:54.854920 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845372 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-host-run-ovn-kubernetes\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:54.854920 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845416 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcswh\" (UniqueName: \"kubernetes.io/projected/778713dd-51aa-4f02-a6bd-2b3c26d176fc-kube-api-access-dcswh\") pod \"node-resolver-rvmp5\" (UID: \"778713dd-51aa-4f02-a6bd-2b3c26d176fc\") " pod="openshift-dns/node-resolver-rvmp5" Jul 12 08:06:54.854920 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845445 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-host-var-lib-cni-bin\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:54.854920 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845473 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwjxk\" (UniqueName: \"kubernetes.io/projected/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-kube-api-access-mwjxk\") pod \"network-metrics-daemon-bnfwz\" (UID: \"fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f\") " pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:06:54.854920 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845503 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2pkh\" (UniqueName: \"kubernetes.io/projected/3b886eaf-a1aa-4e73-bf66-d8d0464561dc-kube-api-access-q2pkh\") pod \"node-ca-wz95w\" (UID: \"3b886eaf-a1aa-4e73-bf66-d8d0464561dc\") " pod="openshift-image-registry/node-ca-wz95w" Jul 12 08:06:54.854920 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845534 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-host-kubelet\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:54.854920 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845565 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-host-run-netns\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:54.857399 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-etc-openvswitch\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:54.857399 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845631 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-log-socket\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:54.857399 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845663 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/628c1d5e-923c-4cb5-bccb-3aa5dab35940-system-cni-dir\") pod \"multus-additional-cni-plugins-6fjqb\" (UID: \"628c1d5e-923c-4cb5-bccb-3aa5dab35940\") " pod="openshift-multus/multus-additional-cni-plugins-6fjqb" Jul 12 08:06:54.857399 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845704 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/628c1d5e-923c-4cb5-bccb-3aa5dab35940-cni-binary-copy\") pod \"multus-additional-cni-plugins-6fjqb\" (UID: \"628c1d5e-923c-4cb5-bccb-3aa5dab35940\") " pod="openshift-multus/multus-additional-cni-plugins-6fjqb" Jul 12 08:06:54.857399 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845724 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-etc-systemd\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:54.857399 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845739 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-host-run-netns\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:54.857399 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845758 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-run-systemd\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:54.857399 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/00af3b5b-04d5-49be-8505-4116f740ae52-ovnkube-script-lib\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:54.857399 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845806 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-lib-modules\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:54.857399 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845832 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt27k\" (UniqueName: \"kubernetes.io/projected/c49f1eec-fc56-4413-8033-f54ed7214323-kube-api-access-tt27k\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:54.857399 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845862 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z87fl\" (UniqueName: \"kubernetes.io/projected/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-kube-api-access-z87fl\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:54.857399 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-metrics-certs\") pod \"network-metrics-daemon-bnfwz\" (UID: \"fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f\") " pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:06:54.857399 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845915 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/97320e27-e583-48a5-a9e1-037fe39253d8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-58jhq\" (UID: \"97320e27-e583-48a5-a9e1-037fe39253d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" Jul 12 08:06:54.857399 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845942 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/628c1d5e-923c-4cb5-bccb-3aa5dab35940-cnibin\") pod \"multus-additional-cni-plugins-6fjqb\" (UID: \"628c1d5e-923c-4cb5-bccb-3aa5dab35940\") " pod="openshift-multus/multus-additional-cni-plugins-6fjqb" Jul 12 08:06:54.857399 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845968 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/628c1d5e-923c-4cb5-bccb-3aa5dab35940-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6fjqb\" (UID: \"628c1d5e-923c-4cb5-bccb-3aa5dab35940\") " pod="openshift-multus/multus-additional-cni-plugins-6fjqb" Jul 12 08:06:54.857399 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.845990 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-hostroot\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:54.858361 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.846023 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-multus-daemon-config\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:54.858361 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.846041 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-systemd-units\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:54.858361 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.846070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/97320e27-e583-48a5-a9e1-037fe39253d8-etc-selinux\") pod \"aws-ebs-csi-driver-node-58jhq\" (UID: \"97320e27-e583-48a5-a9e1-037fe39253d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" Jul 12 08:06:54.858361 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.846095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-host\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:54.858361 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.846120 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-host-var-lib-kubelet\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:54.858361 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.846140 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-multus-conf-dir\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:54.858361 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.846158 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/353ad383-9095-4c48-b3c8-5011b5519c48-original-pull-secret\") pod \"global-pull-secret-syncer-hl94f\" (UID: \"353ad383-9095-4c48-b3c8-5011b5519c48\") " pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:06:54.858361 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.846174 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7a727b8e-f7fa-464e-88d2-4023165fc773-iptables-alerter-script\") pod \"iptables-alerter-d98gf\" (UID: \"7a727b8e-f7fa-464e-88d2-4023165fc773\") " pod="openshift-network-operator/iptables-alerter-d98gf" Jul 12 08:06:54.858361 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.846195 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-host-cni-netd\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:54.858361 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.846218 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ba18abe7-7175-41f7-9ba6-719d288e39c2-agent-certs\") pod \"konnectivity-agent-rccbv\" (UID: \"ba18abe7-7175-41f7-9ba6-719d288e39c2\") " pod="kube-system/konnectivity-agent-rccbv" Jul 12 08:06:54.858361 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.846246 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-etc-sysconfig\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:54.858361 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.846272 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-etc-sysctl-conf\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:54.858361 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.846302 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-node-log\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:54.858361 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.846328 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/00af3b5b-04d5-49be-8505-4116f740ae52-ovn-node-metrics-cert\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:54.858361 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.851485 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-184.ec2.internal" event={"ID":"9c389db2de5a159deb11c2765258ec9e","Type":"ContainerStarted","Data":"3051f0bdd5d3371323e3afa8a8aa0cb88f72752150c9b2c1ecef69495fe96013"} Jul 12 08:06:54.858361 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.852731 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-184.ec2.internal" event={"ID":"fc1402ad85e5eed66f92bb7fbc1b0c6b","Type":"ContainerStarted","Data":"9ef021cf4b18510ea900d4cf20041be6e2e67bbea17f7ccfea4cb0dd6d9b027f"} Jul 12 08:06:54.948763 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.946798 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-var-lib-openvswitch\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:54.948763 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.946834 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-host-cni-bin\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:54.948763 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.946860 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/778713dd-51aa-4f02-a6bd-2b3c26d176fc-tmp-dir\") pod \"node-resolver-rvmp5\" (UID: \"778713dd-51aa-4f02-a6bd-2b3c26d176fc\") " pod="openshift-dns/node-resolver-rvmp5" Jul 12 08:06:54.948763 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.946880 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/97320e27-e583-48a5-a9e1-037fe39253d8-device-dir\") pod \"aws-ebs-csi-driver-node-58jhq\" (UID: \"97320e27-e583-48a5-a9e1-037fe39253d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" Jul 12 08:06:54.948763 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.946899 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-var-lib-kubelet\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:54.948763 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.946923 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-cnibin\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:54.948763 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.946951 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-var-lib-openvswitch\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:54.948763 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947026 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/97320e27-e583-48a5-a9e1-037fe39253d8-device-dir\") pod \"aws-ebs-csi-driver-node-58jhq\" (UID: \"97320e27-e583-48a5-a9e1-037fe39253d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" Jul 12 08:06:54.948763 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947044 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-os-release\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:54.948763 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.946945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-os-release\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:54.948763 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947086 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-var-lib-kubelet\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:54.948763 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947110 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-host-run-ovn-kubernetes\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:54.948763 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947137 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcswh\" (UniqueName: \"kubernetes.io/projected/778713dd-51aa-4f02-a6bd-2b3c26d176fc-kube-api-access-dcswh\") pod \"node-resolver-rvmp5\" (UID: \"778713dd-51aa-4f02-a6bd-2b3c26d176fc\") " pod="openshift-dns/node-resolver-rvmp5" Jul 12 08:06:54.948763 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947144 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-cnibin\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:54.948763 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947163 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-host-var-lib-cni-bin\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:54.948763 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947186 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-host-run-ovn-kubernetes\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:54.948763 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947191 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwjxk\" (UniqueName: \"kubernetes.io/projected/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-kube-api-access-mwjxk\") pod \"network-metrics-daemon-bnfwz\" (UID: \"fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f\") " pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:06:54.948763 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947224 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2pkh\" (UniqueName: \"kubernetes.io/projected/3b886eaf-a1aa-4e73-bf66-d8d0464561dc-kube-api-access-q2pkh\") pod \"node-ca-wz95w\" (UID: \"3b886eaf-a1aa-4e73-bf66-d8d0464561dc\") " pod="openshift-image-registry/node-ca-wz95w" Jul 12 08:06:55.034559 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947251 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-host-kubelet\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.034559 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947285 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-host-run-netns\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.034559 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947290 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/778713dd-51aa-4f02-a6bd-2b3c26d176fc-tmp-dir\") pod \"node-resolver-rvmp5\" (UID: \"778713dd-51aa-4f02-a6bd-2b3c26d176fc\") " pod="openshift-dns/node-resolver-rvmp5" Jul 12 08:06:55.034559 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947311 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-etc-openvswitch\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.034559 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947341 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-log-socket\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.034559 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947376 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/628c1d5e-923c-4cb5-bccb-3aa5dab35940-system-cni-dir\") pod \"multus-additional-cni-plugins-6fjqb\" (UID: \"628c1d5e-923c-4cb5-bccb-3aa5dab35940\") " pod="openshift-multus/multus-additional-cni-plugins-6fjqb" Jul 12 08:06:55.034559 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947429 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/628c1d5e-923c-4cb5-bccb-3aa5dab35940-system-cni-dir\") pod \"multus-additional-cni-plugins-6fjqb\" (UID: \"628c1d5e-923c-4cb5-bccb-3aa5dab35940\") " pod="openshift-multus/multus-additional-cni-plugins-6fjqb" Jul 12 08:06:55.034559 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947417 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-host-cni-bin\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.034559 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947466 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/628c1d5e-923c-4cb5-bccb-3aa5dab35940-cni-binary-copy\") pod \"multus-additional-cni-plugins-6fjqb\" (UID: \"628c1d5e-923c-4cb5-bccb-3aa5dab35940\") " pod="openshift-multus/multus-additional-cni-plugins-6fjqb" Jul 12 08:06:55.034559 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947477 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-host-kubelet\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.034559 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947494 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-etc-systemd\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.034559 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947515 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-host-run-netns\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.034559 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947520 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-host-run-netns\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.034559 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947547 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-run-systemd\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.034559 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947561 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-log-socket\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.034559 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947560 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-host-var-lib-cni-bin\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.034559 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947573 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/00af3b5b-04d5-49be-8505-4116f740ae52-ovnkube-script-lib\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.034559 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947608 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-lib-modules\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.035337 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947611 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-etc-systemd\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.035337 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947636 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt27k\" (UniqueName: \"kubernetes.io/projected/c49f1eec-fc56-4413-8033-f54ed7214323-kube-api-access-tt27k\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.035337 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947694 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z87fl\" (UniqueName: \"kubernetes.io/projected/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-kube-api-access-z87fl\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.035337 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947735 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-metrics-certs\") pod \"network-metrics-daemon-bnfwz\" (UID: \"fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f\") " pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:06:55.035337 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947762 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/97320e27-e583-48a5-a9e1-037fe39253d8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-58jhq\" (UID: \"97320e27-e583-48a5-a9e1-037fe39253d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" Jul 12 08:06:55.035337 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947789 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/628c1d5e-923c-4cb5-bccb-3aa5dab35940-cnibin\") pod \"multus-additional-cni-plugins-6fjqb\" (UID: \"628c1d5e-923c-4cb5-bccb-3aa5dab35940\") " pod="openshift-multus/multus-additional-cni-plugins-6fjqb" Jul 12 08:06:55.035337 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947820 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/628c1d5e-923c-4cb5-bccb-3aa5dab35940-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6fjqb\" (UID: \"628c1d5e-923c-4cb5-bccb-3aa5dab35940\") " pod="openshift-multus/multus-additional-cni-plugins-6fjqb" Jul 12 08:06:55.035337 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947847 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-hostroot\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.035337 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947873 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-multus-daemon-config\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.035337 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947900 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-systemd-units\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.035337 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947925 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/97320e27-e583-48a5-a9e1-037fe39253d8-etc-selinux\") pod \"aws-ebs-csi-driver-node-58jhq\" (UID: \"97320e27-e583-48a5-a9e1-037fe39253d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" Jul 12 08:06:55.035337 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947948 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-host\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.035337 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.947974 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-host-var-lib-kubelet\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.035337 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948000 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-multus-conf-dir\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.035337 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948043 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/353ad383-9095-4c48-b3c8-5011b5519c48-original-pull-secret\") pod \"global-pull-secret-syncer-hl94f\" (UID: \"353ad383-9095-4c48-b3c8-5011b5519c48\") " pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:06:55.035337 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948071 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7a727b8e-f7fa-464e-88d2-4023165fc773-iptables-alerter-script\") pod \"iptables-alerter-d98gf\" (UID: \"7a727b8e-f7fa-464e-88d2-4023165fc773\") " pod="openshift-network-operator/iptables-alerter-d98gf" Jul 12 08:06:55.035337 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948099 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-host-cni-netd\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.036953 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948125 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ba18abe7-7175-41f7-9ba6-719d288e39c2-agent-certs\") pod \"konnectivity-agent-rccbv\" (UID: \"ba18abe7-7175-41f7-9ba6-719d288e39c2\") " pod="kube-system/konnectivity-agent-rccbv" Jul 12 08:06:55.036953 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948162 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-etc-sysconfig\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.036953 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948189 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-etc-sysctl-conf\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.036953 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948219 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-node-log\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.036953 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948221 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-etc-openvswitch\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.036953 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948247 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/00af3b5b-04d5-49be-8505-4116f740ae52-ovn-node-metrics-cert\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.036953 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948252 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-host-run-netns\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.036953 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948257 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-systemd-units\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.036953 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948276 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/628c1d5e-923c-4cb5-bccb-3aa5dab35940-os-release\") pod \"multus-additional-cni-plugins-6fjqb\" (UID: \"628c1d5e-923c-4cb5-bccb-3aa5dab35940\") " pod="openshift-multus/multus-additional-cni-plugins-6fjqb" Jul 12 08:06:55.036953 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948293 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-run-systemd\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.036953 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948322 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/628c1d5e-923c-4cb5-bccb-3aa5dab35940-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6fjqb\" (UID: \"628c1d5e-923c-4cb5-bccb-3aa5dab35940\") " pod="openshift-multus/multus-additional-cni-plugins-6fjqb" Jul 12 08:06:55.036953 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948323 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-host-var-lib-kubelet\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.036953 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948338 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/628c1d5e-923c-4cb5-bccb-3aa5dab35940-os-release\") pod \"multus-additional-cni-plugins-6fjqb\" (UID: \"628c1d5e-923c-4cb5-bccb-3aa5dab35940\") " pod="openshift-multus/multus-additional-cni-plugins-6fjqb" Jul 12 08:06:55.036953 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948351 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-host\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.036953 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948361 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/97320e27-e583-48a5-a9e1-037fe39253d8-etc-selinux\") pod \"aws-ebs-csi-driver-node-58jhq\" (UID: \"97320e27-e583-48a5-a9e1-037fe39253d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" Jul 12 08:06:55.036953 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948387 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-host-cni-netd\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.036953 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948391 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/97320e27-e583-48a5-a9e1-037fe39253d8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-58jhq\" (UID: \"97320e27-e583-48a5-a9e1-037fe39253d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" Jul 12 08:06:55.036953 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:54.948410 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 08:06:55.037677 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948426 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/628c1d5e-923c-4cb5-bccb-3aa5dab35940-cnibin\") pod \"multus-additional-cni-plugins-6fjqb\" (UID: \"628c1d5e-923c-4cb5-bccb-3aa5dab35940\") " pod="openshift-multus/multus-additional-cni-plugins-6fjqb" Jul 12 08:06:55.037677 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948418 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-multus-conf-dir\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.037677 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948453 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-lib-modules\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.037677 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:54.948477 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-metrics-certs podName:fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f nodeName:}" failed. No retries permitted until 2026-07-12 08:06:55.448455573 +0000 UTC m=+3.133266425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-metrics-certs") pod "network-metrics-daemon-bnfwz" (UID: "fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 08:06:55.037677 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948777 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-etc-sysctl-conf\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.037677 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948787 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 12 08:06:55.037677 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948945 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/628c1d5e-923c-4cb5-bccb-3aa5dab35940-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6fjqb\" (UID: \"628c1d5e-923c-4cb5-bccb-3aa5dab35940\") " pod="openshift-multus/multus-additional-cni-plugins-6fjqb" Jul 12 08:06:55.037677 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948961 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxs5v\" (UniqueName: \"kubernetes.io/projected/6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c-kube-api-access-nxs5v\") pod \"network-check-target-j4nh6\" (UID: \"6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c\") " pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:06:55.037677 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948246 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/00af3b5b-04d5-49be-8505-4116f740ae52-ovnkube-script-lib\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.037677 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948610 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/628c1d5e-923c-4cb5-bccb-3aa5dab35940-cni-binary-copy\") pod \"multus-additional-cni-plugins-6fjqb\" (UID: \"628c1d5e-923c-4cb5-bccb-3aa5dab35940\") " pod="openshift-multus/multus-additional-cni-plugins-6fjqb" Jul 12 08:06:55.037677 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949016 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-etc-modprobe-d\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.037677 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949050 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ba18abe7-7175-41f7-9ba6-719d288e39c2-konnectivity-ca\") pod \"konnectivity-agent-rccbv\" (UID: \"ba18abe7-7175-41f7-9ba6-719d288e39c2\") " pod="kube-system/konnectivity-agent-rccbv" Jul 12 08:06:55.037677 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949094 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b886eaf-a1aa-4e73-bf66-d8d0464561dc-host\") pod \"node-ca-wz95w\" (UID: \"3b886eaf-a1aa-4e73-bf66-d8d0464561dc\") " pod="openshift-image-registry/node-ca-wz95w" Jul 12 08:06:55.037677 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949102 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-etc-modprobe-d\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.037677 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949115 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-multus-daemon-config\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.037677 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949121 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zl78\" (UniqueName: \"kubernetes.io/projected/00af3b5b-04d5-49be-8505-4116f740ae52-kube-api-access-4zl78\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.037677 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949172 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-cni-binary-copy\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.038417 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949176 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-etc-sysconfig\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.038417 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948651 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-node-log\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.038417 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949243 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b886eaf-a1aa-4e73-bf66-d8d0464561dc-host\") pod \"node-ca-wz95w\" (UID: \"3b886eaf-a1aa-4e73-bf66-d8d0464561dc\") " pod="openshift-image-registry/node-ca-wz95w" Jul 12 08:06:55.038417 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948478 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-hostroot\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.038417 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:54.948492 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 08:06:55.038417 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:54.949360 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/353ad383-9095-4c48-b3c8-5011b5519c48-original-pull-secret podName:353ad383-9095-4c48-b3c8-5011b5519c48 nodeName:}" failed. No retries permitted until 2026-07-12 08:06:55.449340472 +0000 UTC m=+3.134151331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/353ad383-9095-4c48-b3c8-5011b5519c48-original-pull-secret") pod "global-pull-secret-syncer-hl94f" (UID: "353ad383-9095-4c48-b3c8-5011b5519c48") : object "kube-system"/"original-pull-secret" not registered Jul 12 08:06:55.038417 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949351 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-etc-kubernetes\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.038417 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.948641 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/628c1d5e-923c-4cb5-bccb-3aa5dab35940-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6fjqb\" (UID: \"628c1d5e-923c-4cb5-bccb-3aa5dab35940\") " pod="openshift-multus/multus-additional-cni-plugins-6fjqb" Jul 12 08:06:55.038417 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949395 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/778713dd-51aa-4f02-a6bd-2b3c26d176fc-hosts-file\") pod \"node-resolver-rvmp5\" (UID: \"778713dd-51aa-4f02-a6bd-2b3c26d176fc\") " pod="openshift-dns/node-resolver-rvmp5" Jul 12 08:06:55.038417 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949427 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-etc-kubernetes\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.038417 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949448 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-etc-sysctl-d\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.038417 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-multus-socket-dir-parent\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.038417 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949480 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/778713dd-51aa-4f02-a6bd-2b3c26d176fc-hosts-file\") pod \"node-resolver-rvmp5\" (UID: \"778713dd-51aa-4f02-a6bd-2b3c26d176fc\") " pod="openshift-dns/node-resolver-rvmp5" Jul 12 08:06:55.038417 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949514 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-host-run-k8s-cni-cncf-io\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.038417 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949547 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a727b8e-f7fa-464e-88d2-4023165fc773-host-slash\") pod \"iptables-alerter-d98gf\" (UID: \"7a727b8e-f7fa-464e-88d2-4023165fc773\") " pod="openshift-network-operator/iptables-alerter-d98gf" Jul 12 08:06:55.038417 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949580 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sscjq\" (UniqueName: \"kubernetes.io/projected/7a727b8e-f7fa-464e-88d2-4023165fc773-kube-api-access-sscjq\") pod \"iptables-alerter-d98gf\" (UID: \"7a727b8e-f7fa-464e-88d2-4023165fc773\") " pod="openshift-network-operator/iptables-alerter-d98gf" Jul 12 08:06:55.038417 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949599 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-multus-socket-dir-parent\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.039295 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949615 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.039295 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949650 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-host-run-multus-certs\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.039295 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949650 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7a727b8e-f7fa-464e-88d2-4023165fc773-host-slash\") pod \"iptables-alerter-d98gf\" (UID: \"7a727b8e-f7fa-464e-88d2-4023165fc773\") " pod="openshift-network-operator/iptables-alerter-d98gf" Jul 12 08:06:55.039295 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949681 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b886eaf-a1aa-4e73-bf66-d8d0464561dc-serviceca\") pod \"node-ca-wz95w\" (UID: \"3b886eaf-a1aa-4e73-bf66-d8d0464561dc\") " pod="openshift-image-registry/node-ca-wz95w" Jul 12 08:06:55.039295 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949712 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-run-openvswitch\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.039295 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949712 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-host-run-k8s-cni-cncf-io\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.039295 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949752 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/97320e27-e583-48a5-a9e1-037fe39253d8-registration-dir\") pod \"aws-ebs-csi-driver-node-58jhq\" (UID: \"97320e27-e583-48a5-a9e1-037fe39253d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" Jul 12 08:06:55.039295 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949775 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-host-run-multus-certs\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.039295 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949770 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-cni-binary-copy\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.039295 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949783 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c49f1eec-fc56-4413-8033-f54ed7214323-etc-tuned\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.039295 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949838 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-host-var-lib-cni-multus\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.039295 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949870 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/353ad383-9095-4c48-b3c8-5011b5519c48-kubelet-config\") pod \"global-pull-secret-syncer-hl94f\" (UID: \"353ad383-9095-4c48-b3c8-5011b5519c48\") " pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:06:55.039295 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949900 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/353ad383-9095-4c48-b3c8-5011b5519c48-dbus\") pod \"global-pull-secret-syncer-hl94f\" (UID: \"353ad383-9095-4c48-b3c8-5011b5519c48\") " pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:06:55.039295 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949977 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/97320e27-e583-48a5-a9e1-037fe39253d8-sys-fs\") pod \"aws-ebs-csi-driver-node-58jhq\" (UID: \"97320e27-e583-48a5-a9e1-037fe39253d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" Jul 12 08:06:55.039295 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950025 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69vdl\" (UniqueName: \"kubernetes.io/projected/97320e27-e583-48a5-a9e1-037fe39253d8-kube-api-access-69vdl\") pod \"aws-ebs-csi-driver-node-58jhq\" (UID: \"97320e27-e583-48a5-a9e1-037fe39253d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" Jul 12 08:06:55.039295 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950052 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/628c1d5e-923c-4cb5-bccb-3aa5dab35940-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6fjqb\" (UID: \"628c1d5e-923c-4cb5-bccb-3aa5dab35940\") " pod="openshift-multus/multus-additional-cni-plugins-6fjqb" Jul 12 08:06:55.039295 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950076 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-multus-cni-dir\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.039928 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950100 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-etc-sysctl-d\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.039928 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950132 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/00af3b5b-04d5-49be-8505-4116f740ae52-ovnkube-config\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.039928 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950161 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-etc-kubernetes\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.039928 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950187 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-run\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.039928 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950190 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/353ad383-9095-4c48-b3c8-5011b5519c48-kubelet-config\") pod \"global-pull-secret-syncer-hl94f\" (UID: \"353ad383-9095-4c48-b3c8-5011b5519c48\") " pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:06:55.039928 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950228 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-sys\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.039928 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950247 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b886eaf-a1aa-4e73-bf66-d8d0464561dc-serviceca\") pod \"node-ca-wz95w\" (UID: \"3b886eaf-a1aa-4e73-bf66-d8d0464561dc\") " pod="openshift-image-registry/node-ca-wz95w" Jul 12 08:06:55.039928 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-run-ovn\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.039928 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950280 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/00af3b5b-04d5-49be-8505-4116f740ae52-env-overrides\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.039928 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950307 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/97320e27-e583-48a5-a9e1-037fe39253d8-socket-dir\") pod \"aws-ebs-csi-driver-node-58jhq\" (UID: \"97320e27-e583-48a5-a9e1-037fe39253d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" Jul 12 08:06:55.039928 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950310 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/353ad383-9095-4c48-b3c8-5011b5519c48-dbus\") pod \"global-pull-secret-syncer-hl94f\" (UID: \"353ad383-9095-4c48-b3c8-5011b5519c48\") " pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:06:55.039928 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950347 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69nsf\" (UniqueName: \"kubernetes.io/projected/628c1d5e-923c-4cb5-bccb-3aa5dab35940-kube-api-access-69nsf\") pod \"multus-additional-cni-plugins-6fjqb\" (UID: \"628c1d5e-923c-4cb5-bccb-3aa5dab35940\") " pod="openshift-multus/multus-additional-cni-plugins-6fjqb" Jul 12 08:06:55.039928 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950376 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c49f1eec-fc56-4413-8033-f54ed7214323-tmp\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.039928 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950400 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-system-cni-dir\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.039928 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950415 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/97320e27-e583-48a5-a9e1-037fe39253d8-socket-dir\") pod \"aws-ebs-csi-driver-node-58jhq\" (UID: \"97320e27-e583-48a5-a9e1-037fe39253d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" Jul 12 08:06:55.039928 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950428 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-host-slash\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.039928 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950431 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.040738 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950467 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/97320e27-e583-48a5-a9e1-037fe39253d8-registration-dir\") pod \"aws-ebs-csi-driver-node-58jhq\" (UID: \"97320e27-e583-48a5-a9e1-037fe39253d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" Jul 12 08:06:55.040738 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950502 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-sys\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.040738 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950509 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-host-slash\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.040738 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950536 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-run\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.040738 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950540 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-run-ovn\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.040738 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950580 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-multus-cni-dir\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.040738 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950745 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/97320e27-e583-48a5-a9e1-037fe39253d8-sys-fs\") pod \"aws-ebs-csi-driver-node-58jhq\" (UID: \"97320e27-e583-48a5-a9e1-037fe39253d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" Jul 12 08:06:55.040738 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950750 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/628c1d5e-923c-4cb5-bccb-3aa5dab35940-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6fjqb\" (UID: \"628c1d5e-923c-4cb5-bccb-3aa5dab35940\") " pod="openshift-multus/multus-additional-cni-plugins-6fjqb" Jul 12 08:06:55.040738 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950928 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/00af3b5b-04d5-49be-8505-4116f740ae52-env-overrides\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.040738 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.950935 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ba18abe7-7175-41f7-9ba6-719d288e39c2-konnectivity-ca\") pod \"konnectivity-agent-rccbv\" (UID: \"ba18abe7-7175-41f7-9ba6-719d288e39c2\") " pod="kube-system/konnectivity-agent-rccbv" Jul 12 08:06:55.040738 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.949839 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00af3b5b-04d5-49be-8505-4116f740ae52-run-openvswitch\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.040738 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.951005 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-host-var-lib-cni-multus\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.040738 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.951071 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c49f1eec-fc56-4413-8033-f54ed7214323-etc-kubernetes\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.040738 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.951082 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-system-cni-dir\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.040738 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.951248 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/00af3b5b-04d5-49be-8505-4116f740ae52-ovnkube-config\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.040738 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.951745 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7a727b8e-f7fa-464e-88d2-4023165fc773-iptables-alerter-script\") pod \"iptables-alerter-d98gf\" (UID: \"7a727b8e-f7fa-464e-88d2-4023165fc773\") " pod="openshift-network-operator/iptables-alerter-d98gf" Jul 12 08:06:55.040738 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.954839 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/00af3b5b-04d5-49be-8505-4116f740ae52-ovn-node-metrics-cert\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.040738 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.954976 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c49f1eec-fc56-4413-8033-f54ed7214323-etc-tuned\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.041626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.955170 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ba18abe7-7175-41f7-9ba6-719d288e39c2-agent-certs\") pod \"konnectivity-agent-rccbv\" (UID: \"ba18abe7-7175-41f7-9ba6-719d288e39c2\") " pod="kube-system/konnectivity-agent-rccbv" Jul 12 08:06:55.041626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.956547 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c49f1eec-fc56-4413-8033-f54ed7214323-tmp\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.041626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.969308 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zl78\" (UniqueName: \"kubernetes.io/projected/00af3b5b-04d5-49be-8505-4116f740ae52-kube-api-access-4zl78\") pod \"ovnkube-node-kd8ct\" (UID: \"00af3b5b-04d5-49be-8505-4116f740ae52\") " pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.041626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.969320 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2pkh\" (UniqueName: \"kubernetes.io/projected/3b886eaf-a1aa-4e73-bf66-d8d0464561dc-kube-api-access-q2pkh\") pod \"node-ca-wz95w\" (UID: \"3b886eaf-a1aa-4e73-bf66-d8d0464561dc\") " pod="openshift-image-registry/node-ca-wz95w" Jul 12 08:06:55.041626 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:54.969503 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 08:06:55.041626 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:54.969524 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 08:06:55.041626 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:54.969538 2576 projected.go:196] Error preparing data for projected volume kube-api-access-nxs5v for pod openshift-network-diagnostics/network-check-target-j4nh6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 08:06:55.041626 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:54.969610 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c-kube-api-access-nxs5v podName:6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c nodeName:}" failed. No retries permitted until 2026-07-12 08:06:55.469593003 +0000 UTC m=+3.154403844 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nxs5v" (UniqueName: "kubernetes.io/projected/6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c-kube-api-access-nxs5v") pod "network-check-target-j4nh6" (UID: "6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 08:06:55.041626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.974153 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt27k\" (UniqueName: \"kubernetes.io/projected/c49f1eec-fc56-4413-8033-f54ed7214323-kube-api-access-tt27k\") pod \"tuned-kt97t\" (UID: \"c49f1eec-fc56-4413-8033-f54ed7214323\") " pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.041626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.975229 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sscjq\" (UniqueName: \"kubernetes.io/projected/7a727b8e-f7fa-464e-88d2-4023165fc773-kube-api-access-sscjq\") pod \"iptables-alerter-d98gf\" (UID: \"7a727b8e-f7fa-464e-88d2-4023165fc773\") " pod="openshift-network-operator/iptables-alerter-d98gf" Jul 12 08:06:55.041626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.976096 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z87fl\" (UniqueName: \"kubernetes.io/projected/a16f6071-4750-4de3-9b3b-4d9c559fcd8c-kube-api-access-z87fl\") pod \"multus-2bshp\" (UID: \"a16f6071-4750-4de3-9b3b-4d9c559fcd8c\") " pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.041626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.976172 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwjxk\" (UniqueName: \"kubernetes.io/projected/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-kube-api-access-mwjxk\") pod \"network-metrics-daemon-bnfwz\" (UID: \"fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f\") " pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:06:55.041626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.976922 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69vdl\" (UniqueName: \"kubernetes.io/projected/97320e27-e583-48a5-a9e1-037fe39253d8-kube-api-access-69vdl\") pod \"aws-ebs-csi-driver-node-58jhq\" (UID: \"97320e27-e583-48a5-a9e1-037fe39253d8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" Jul 12 08:06:55.041626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.980195 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69nsf\" (UniqueName: \"kubernetes.io/projected/628c1d5e-923c-4cb5-bccb-3aa5dab35940-kube-api-access-69nsf\") pod \"multus-additional-cni-plugins-6fjqb\" (UID: \"628c1d5e-923c-4cb5-bccb-3aa5dab35940\") " pod="openshift-multus/multus-additional-cni-plugins-6fjqb" Jul 12 08:06:55.041626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:54.995174 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcswh\" (UniqueName: \"kubernetes.io/projected/778713dd-51aa-4f02-a6bd-2b3c26d176fc-kube-api-access-dcswh\") pod \"node-resolver-rvmp5\" (UID: \"778713dd-51aa-4f02-a6bd-2b3c26d176fc\") " pod="openshift-dns/node-resolver-rvmp5" Jul 12 08:06:55.170926 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:55.098271 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d98gf" Jul 12 08:06:55.170926 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:55.114678 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:06:55.170926 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:55.125777 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kt97t" Jul 12 08:06:55.170926 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:55.130681 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2bshp" Jul 12 08:06:55.170926 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:55.141416 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rccbv" Jul 12 08:06:55.170926 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:55.152890 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rvmp5" Jul 12 08:06:55.170926 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:55.161077 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wz95w" Jul 12 08:06:55.171214 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:55.171088 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" Jul 12 08:06:55.176889 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:55.176860 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6fjqb" Jul 12 08:06:55.454776 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:55.454741 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/353ad383-9095-4c48-b3c8-5011b5519c48-original-pull-secret\") pod \"global-pull-secret-syncer-hl94f\" (UID: \"353ad383-9095-4c48-b3c8-5011b5519c48\") " pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:06:55.454975 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:55.454816 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-metrics-certs\") pod \"network-metrics-daemon-bnfwz\" (UID: \"fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f\") " pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:06:55.454975 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:55.454922 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 08:06:55.454975 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:55.454924 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 08:06:55.455158 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:55.455012 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/353ad383-9095-4c48-b3c8-5011b5519c48-original-pull-secret podName:353ad383-9095-4c48-b3c8-5011b5519c48 nodeName:}" failed. No retries permitted until 2026-07-12 08:06:56.454994514 +0000 UTC m=+4.139805356 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/353ad383-9095-4c48-b3c8-5011b5519c48-original-pull-secret") pod "global-pull-secret-syncer-hl94f" (UID: "353ad383-9095-4c48-b3c8-5011b5519c48") : object "kube-system"/"original-pull-secret" not registered Jul 12 08:06:55.455158 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:55.455035 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-metrics-certs podName:fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f nodeName:}" failed. No retries permitted until 2026-07-12 08:06:56.455024419 +0000 UTC m=+4.139835263 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-metrics-certs") pod "network-metrics-daemon-bnfwz" (UID: "fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 08:06:55.555507 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:55.555472 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxs5v\" (UniqueName: \"kubernetes.io/projected/6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c-kube-api-access-nxs5v\") pod \"network-check-target-j4nh6\" (UID: \"6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c\") " pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:06:55.555709 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:55.555686 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 08:06:55.555756 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:55.555717 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 08:06:55.555756 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:55.555733 2576 projected.go:196] Error preparing data for projected volume kube-api-access-nxs5v for pod openshift-network-diagnostics/network-check-target-j4nh6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 08:06:55.555839 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:55.555803 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c-kube-api-access-nxs5v podName:6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c nodeName:}" failed. No retries permitted until 2026-07-12 08:06:56.555780678 +0000 UTC m=+4.240591522 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nxs5v" (UniqueName: "kubernetes.io/projected/6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c-kube-api-access-nxs5v") pod "network-check-target-j4nh6" (UID: "6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 08:06:55.781719 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:55.781605 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 08:01:55 +0000 UTC" deadline="2028-01-16 22:38:15.007861148 +0000 UTC" Jul 12 08:06:55.781719 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:55.781662 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13286h31m19.226202486s" Jul 12 08:06:55.844734 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:55.844694 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:06:55.844905 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:55.844807 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4nh6" podUID="6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c" Jul 12 08:06:56.112642 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:56.112577 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00af3b5b_04d5_49be_8505_4116f740ae52.slice/crio-869d1b055ffd3809ab16588155c26472557e9cad467146019f477aff29ce5f5b WatchSource:0}: Error finding container 869d1b055ffd3809ab16588155c26472557e9cad467146019f477aff29ce5f5b: Status 404 returned error can't find the container with id 869d1b055ffd3809ab16588155c26472557e9cad467146019f477aff29ce5f5b Jul 12 08:06:56.113726 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:56.113698 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc49f1eec_fc56_4413_8033_f54ed7214323.slice/crio-7d847d4dcb3303d4419d194930e22e39c3733aed2c86f8b6b44307708b7f11b7 WatchSource:0}: Error finding container 7d847d4dcb3303d4419d194930e22e39c3733aed2c86f8b6b44307708b7f11b7: Status 404 returned error can't find the container with id 7d847d4dcb3303d4419d194930e22e39c3733aed2c86f8b6b44307708b7f11b7 Jul 12 08:06:56.118579 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:56.118441 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b886eaf_a1aa_4e73_bf66_d8d0464561dc.slice/crio-2367912a2c9278dd2e60462ffaef18f4da8fa2d18fcc0b43dc3fc6ead03d9172 WatchSource:0}: Error finding container 2367912a2c9278dd2e60462ffaef18f4da8fa2d18fcc0b43dc3fc6ead03d9172: Status 404 returned error can't find the container with id 2367912a2c9278dd2e60462ffaef18f4da8fa2d18fcc0b43dc3fc6ead03d9172 Jul 12 08:06:56.120160 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:56.120084 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97320e27_e583_48a5_a9e1_037fe39253d8.slice/crio-54f8d649f85499754e51acdd91d0a80a9b13be9e77c71cf47d3561e76890ef98 WatchSource:0}: Error finding container 54f8d649f85499754e51acdd91d0a80a9b13be9e77c71cf47d3561e76890ef98: Status 404 returned error can't find the container with id 54f8d649f85499754e51acdd91d0a80a9b13be9e77c71cf47d3561e76890ef98 Jul 12 08:06:56.120551 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:56.120474 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba18abe7_7175_41f7_9ba6_719d288e39c2.slice/crio-82416f16477da7dbea71a3fc805d9fbaed17a1cb3d3938d023707e9a78ddf590 WatchSource:0}: Error finding container 82416f16477da7dbea71a3fc805d9fbaed17a1cb3d3938d023707e9a78ddf590: Status 404 returned error can't find the container with id 82416f16477da7dbea71a3fc805d9fbaed17a1cb3d3938d023707e9a78ddf590 Jul 12 08:06:56.121394 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:56.121275 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda16f6071_4750_4de3_9b3b_4d9c559fcd8c.slice/crio-eb4ced0be579460faedd2706c8b4a9a0b4cd2fd6210912e012cb35bcedc1e075 WatchSource:0}: Error finding container eb4ced0be579460faedd2706c8b4a9a0b4cd2fd6210912e012cb35bcedc1e075: Status 404 returned error can't find the container with id eb4ced0be579460faedd2706c8b4a9a0b4cd2fd6210912e012cb35bcedc1e075 Jul 12 08:06:56.123735 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:56.123279 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a727b8e_f7fa_464e_88d2_4023165fc773.slice/crio-228695c59de45cbbc8baed71967caf5726a2f28c48ea7484aad2ffa5c20a9666 WatchSource:0}: Error finding container 228695c59de45cbbc8baed71967caf5726a2f28c48ea7484aad2ffa5c20a9666: Status 404 returned error can't find the container with id 228695c59de45cbbc8baed71967caf5726a2f28c48ea7484aad2ffa5c20a9666 Jul 12 08:06:56.124454 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:56.124118 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod778713dd_51aa_4f02_a6bd_2b3c26d176fc.slice/crio-a6c5f6f8ee2d72dc40f55f1788f38e0c8f40d96a3fa2925401142458ec4de5f6 WatchSource:0}: Error finding container a6c5f6f8ee2d72dc40f55f1788f38e0c8f40d96a3fa2925401142458ec4de5f6: Status 404 returned error can't find the container with id a6c5f6f8ee2d72dc40f55f1788f38e0c8f40d96a3fa2925401142458ec4de5f6 Jul 12 08:06:56.125498 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:06:56.125221 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod628c1d5e_923c_4cb5_bccb_3aa5dab35940.slice/crio-acf86ccee957fe57978dfcfb2ff4b877cb86ac16232c70a7dd4ef7bfd47df274 WatchSource:0}: Error finding container acf86ccee957fe57978dfcfb2ff4b877cb86ac16232c70a7dd4ef7bfd47df274: Status 404 returned error can't find the container with id acf86ccee957fe57978dfcfb2ff4b877cb86ac16232c70a7dd4ef7bfd47df274 Jul 12 08:06:56.461659 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:56.461618 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-metrics-certs\") pod \"network-metrics-daemon-bnfwz\" (UID: \"fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f\") " pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:06:56.461659 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:56.461668 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/353ad383-9095-4c48-b3c8-5011b5519c48-original-pull-secret\") pod \"global-pull-secret-syncer-hl94f\" (UID: \"353ad383-9095-4c48-b3c8-5011b5519c48\") " pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:06:56.461848 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:56.461761 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 08:06:56.461848 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:56.461765 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 08:06:56.461848 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:56.461815 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/353ad383-9095-4c48-b3c8-5011b5519c48-original-pull-secret podName:353ad383-9095-4c48-b3c8-5011b5519c48 nodeName:}" failed. No retries permitted until 2026-07-12 08:06:58.461801312 +0000 UTC m=+6.146612163 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/353ad383-9095-4c48-b3c8-5011b5519c48-original-pull-secret") pod "global-pull-secret-syncer-hl94f" (UID: "353ad383-9095-4c48-b3c8-5011b5519c48") : object "kube-system"/"original-pull-secret" not registered Jul 12 08:06:56.461848 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:56.461831 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-metrics-certs podName:fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f nodeName:}" failed. No retries permitted until 2026-07-12 08:06:58.461824525 +0000 UTC m=+6.146635363 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-metrics-certs") pod "network-metrics-daemon-bnfwz" (UID: "fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 08:06:56.562364 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:56.562319 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxs5v\" (UniqueName: \"kubernetes.io/projected/6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c-kube-api-access-nxs5v\") pod \"network-check-target-j4nh6\" (UID: \"6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c\") " pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:06:56.562560 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:56.562545 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 08:06:56.562620 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:56.562568 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 08:06:56.562620 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:56.562581 2576 projected.go:196] Error preparing data for projected volume kube-api-access-nxs5v for pod openshift-network-diagnostics/network-check-target-j4nh6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 08:06:56.562693 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:56.562645 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c-kube-api-access-nxs5v podName:6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c nodeName:}" failed. No retries permitted until 2026-07-12 08:06:58.562626347 +0000 UTC m=+6.247437188 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nxs5v" (UniqueName: "kubernetes.io/projected/6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c-kube-api-access-nxs5v") pod "network-check-target-j4nh6" (UID: "6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 08:06:56.782826 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:56.782676 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 08:01:55 +0000 UTC" deadline="2028-04-04 19:32:38.45048553 +0000 UTC" Jul 12 08:06:56.782826 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:56.782743 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15179h25m41.667746987s" Jul 12 08:06:56.851142 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:56.846084 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:06:56.851142 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:56.846235 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnfwz" podUID="fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f" Jul 12 08:06:56.851142 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:56.846703 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:06:56.851142 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:56.846809 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hl94f" podUID="353ad383-9095-4c48-b3c8-5011b5519c48" Jul 12 08:06:56.871935 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:56.871868 2576 generic.go:356] "Generic (PLEG): container finished" podID="fc1402ad85e5eed66f92bb7fbc1b0c6b" containerID="8dfe7b4de7a88fb9b87f50cfefcefa5bc1f9d42110aef22ba68e204baa5d0ba9" exitCode=0 Jul 12 08:06:56.872166 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:56.871960 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-184.ec2.internal" event={"ID":"fc1402ad85e5eed66f92bb7fbc1b0c6b","Type":"ContainerDied","Data":"8dfe7b4de7a88fb9b87f50cfefcefa5bc1f9d42110aef22ba68e204baa5d0ba9"} Jul 12 08:06:56.889165 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:56.889073 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fjqb" event={"ID":"628c1d5e-923c-4cb5-bccb-3aa5dab35940","Type":"ContainerStarted","Data":"acf86ccee957fe57978dfcfb2ff4b877cb86ac16232c70a7dd4ef7bfd47df274"} Jul 12 08:06:56.899426 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:56.899394 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rvmp5" event={"ID":"778713dd-51aa-4f02-a6bd-2b3c26d176fc","Type":"ContainerStarted","Data":"a6c5f6f8ee2d72dc40f55f1788f38e0c8f40d96a3fa2925401142458ec4de5f6"} Jul 12 08:06:56.903357 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:56.903315 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d98gf" event={"ID":"7a727b8e-f7fa-464e-88d2-4023165fc773","Type":"ContainerStarted","Data":"228695c59de45cbbc8baed71967caf5726a2f28c48ea7484aad2ffa5c20a9666"} Jul 12 08:06:56.915688 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:56.915557 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rccbv" event={"ID":"ba18abe7-7175-41f7-9ba6-719d288e39c2","Type":"ContainerStarted","Data":"82416f16477da7dbea71a3fc805d9fbaed17a1cb3d3938d023707e9a78ddf590"} Jul 12 08:06:56.922203 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:56.922170 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" event={"ID":"97320e27-e583-48a5-a9e1-037fe39253d8","Type":"ContainerStarted","Data":"54f8d649f85499754e51acdd91d0a80a9b13be9e77c71cf47d3561e76890ef98"} Jul 12 08:06:56.929105 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:56.929073 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wz95w" event={"ID":"3b886eaf-a1aa-4e73-bf66-d8d0464561dc","Type":"ContainerStarted","Data":"2367912a2c9278dd2e60462ffaef18f4da8fa2d18fcc0b43dc3fc6ead03d9172"} Jul 12 08:06:56.935621 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:56.935591 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kt97t" event={"ID":"c49f1eec-fc56-4413-8033-f54ed7214323","Type":"ContainerStarted","Data":"7d847d4dcb3303d4419d194930e22e39c3733aed2c86f8b6b44307708b7f11b7"} Jul 12 08:06:56.941417 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:56.941388 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-184.ec2.internal" event={"ID":"9c389db2de5a159deb11c2765258ec9e","Type":"ContainerStarted","Data":"807f153452f4b1f0c264ce8006de099d0827ab6272a76affec4eed72e1fdda99"} Jul 12 08:06:56.965510 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:56.965475 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2bshp" event={"ID":"a16f6071-4750-4de3-9b3b-4d9c559fcd8c","Type":"ContainerStarted","Data":"eb4ced0be579460faedd2706c8b4a9a0b4cd2fd6210912e012cb35bcedc1e075"} Jul 12 08:06:56.982601 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:56.982563 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" event={"ID":"00af3b5b-04d5-49be-8505-4116f740ae52","Type":"ContainerStarted","Data":"869d1b055ffd3809ab16588155c26472557e9cad467146019f477aff29ce5f5b"} Jul 12 08:06:57.844544 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:57.844481 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:06:57.845295 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:57.844613 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4nh6" podUID="6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c" Jul 12 08:06:58.007705 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:58.007610 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-184.ec2.internal" event={"ID":"fc1402ad85e5eed66f92bb7fbc1b0c6b","Type":"ContainerStarted","Data":"b79df52fba04e1aa1c008a3f49fefa7832a08b080a286b467c6e4f05a1ad3cfd"} Jul 12 08:06:58.023591 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:58.022815 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-184.ec2.internal" podStartSLOduration=4.022792019 podStartE2EDuration="4.022792019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:06:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:06:58.022219561 +0000 UTC m=+5.707030424" watchObservedRunningTime="2026-07-12 08:06:58.022792019 +0000 UTC m=+5.707602882" Jul 12 08:06:58.023591 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:58.023365 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-184.ec2.internal" podStartSLOduration=4.023345604 podStartE2EDuration="4.023345604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:06:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:06:56.958045614 +0000 UTC m=+4.642856474" watchObservedRunningTime="2026-07-12 08:06:58.023345604 +0000 UTC m=+5.708156469" Jul 12 08:06:58.480479 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:58.479615 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-metrics-certs\") pod \"network-metrics-daemon-bnfwz\" (UID: \"fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f\") " pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:06:58.480479 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:58.479675 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/353ad383-9095-4c48-b3c8-5011b5519c48-original-pull-secret\") pod \"global-pull-secret-syncer-hl94f\" (UID: \"353ad383-9095-4c48-b3c8-5011b5519c48\") " pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:06:58.480479 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:58.479825 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 08:06:58.480479 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:58.479895 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/353ad383-9095-4c48-b3c8-5011b5519c48-original-pull-secret podName:353ad383-9095-4c48-b3c8-5011b5519c48 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:02.47987332 +0000 UTC m=+10.164684178 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/353ad383-9095-4c48-b3c8-5011b5519c48-original-pull-secret") pod "global-pull-secret-syncer-hl94f" (UID: "353ad383-9095-4c48-b3c8-5011b5519c48") : object "kube-system"/"original-pull-secret" not registered Jul 12 08:06:58.480479 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:58.480375 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 08:06:58.480479 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:58.480434 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-metrics-certs podName:fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f nodeName:}" failed. No retries permitted until 2026-07-12 08:07:02.480416011 +0000 UTC m=+10.165226851 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-metrics-certs") pod "network-metrics-daemon-bnfwz" (UID: "fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 08:06:58.580470 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:58.580427 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxs5v\" (UniqueName: \"kubernetes.io/projected/6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c-kube-api-access-nxs5v\") pod \"network-check-target-j4nh6\" (UID: \"6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c\") " pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:06:58.580672 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:58.580607 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 08:06:58.580672 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:58.580628 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 08:06:58.580672 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:58.580650 2576 projected.go:196] Error preparing data for projected volume kube-api-access-nxs5v for pod openshift-network-diagnostics/network-check-target-j4nh6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 08:06:58.580840 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:58.580717 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c-kube-api-access-nxs5v podName:6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c nodeName:}" failed. No retries permitted until 2026-07-12 08:07:02.580694984 +0000 UTC m=+10.265505825 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nxs5v" (UniqueName: "kubernetes.io/projected/6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c-kube-api-access-nxs5v") pod "network-check-target-j4nh6" (UID: "6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 08:06:58.846216 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:58.846130 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:06:58.846216 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:58.846146 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:06:58.846816 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:58.846265 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hl94f" podUID="353ad383-9095-4c48-b3c8-5011b5519c48" Jul 12 08:06:58.846816 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:58.846607 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnfwz" podUID="fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f" Jul 12 08:06:59.845775 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:06:59.845241 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:06:59.845775 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:06:59.845386 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4nh6" podUID="6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c" Jul 12 08:07:00.846616 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:00.846076 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:07:00.846616 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:00.846217 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hl94f" podUID="353ad383-9095-4c48-b3c8-5011b5519c48" Jul 12 08:07:00.847459 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:00.847281 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:07:00.847459 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:00.847408 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnfwz" podUID="fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f" Jul 12 08:07:01.845158 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:01.845122 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:07:01.845353 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:01.845265 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4nh6" podUID="6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c" Jul 12 08:07:02.516180 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:02.516137 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-metrics-certs\") pod \"network-metrics-daemon-bnfwz\" (UID: \"fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f\") " pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:07:02.516616 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:02.516201 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/353ad383-9095-4c48-b3c8-5011b5519c48-original-pull-secret\") pod \"global-pull-secret-syncer-hl94f\" (UID: \"353ad383-9095-4c48-b3c8-5011b5519c48\") " pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:07:02.516616 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:02.516362 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 08:07:02.516616 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:02.516432 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/353ad383-9095-4c48-b3c8-5011b5519c48-original-pull-secret podName:353ad383-9095-4c48-b3c8-5011b5519c48 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:10.516410118 +0000 UTC m=+18.201220976 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/353ad383-9095-4c48-b3c8-5011b5519c48-original-pull-secret") pod "global-pull-secret-syncer-hl94f" (UID: "353ad383-9095-4c48-b3c8-5011b5519c48") : object "kube-system"/"original-pull-secret" not registered Jul 12 08:07:02.516905 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:02.516881 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 08:07:02.517002 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:02.516941 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-metrics-certs podName:fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f nodeName:}" failed. No retries permitted until 2026-07-12 08:07:10.516923165 +0000 UTC m=+18.201734009 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-metrics-certs") pod "network-metrics-daemon-bnfwz" (UID: "fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 08:07:02.617501 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:02.617431 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxs5v\" (UniqueName: \"kubernetes.io/projected/6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c-kube-api-access-nxs5v\") pod \"network-check-target-j4nh6\" (UID: \"6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c\") " pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:07:02.617680 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:02.617660 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 08:07:02.617746 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:02.617686 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 08:07:02.617746 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:02.617700 2576 projected.go:196] Error preparing data for projected volume kube-api-access-nxs5v for pod openshift-network-diagnostics/network-check-target-j4nh6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 08:07:02.617870 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:02.617767 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c-kube-api-access-nxs5v podName:6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c nodeName:}" failed. No retries permitted until 2026-07-12 08:07:10.617745438 +0000 UTC m=+18.302556291 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nxs5v" (UniqueName: "kubernetes.io/projected/6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c-kube-api-access-nxs5v") pod "network-check-target-j4nh6" (UID: "6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 08:07:02.847835 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:02.847747 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:07:02.848029 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:02.847895 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnfwz" podUID="fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f" Jul 12 08:07:02.848410 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:02.848348 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:07:02.848542 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:02.848448 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hl94f" podUID="353ad383-9095-4c48-b3c8-5011b5519c48" Jul 12 08:07:03.845342 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:03.845141 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:07:03.845827 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:03.845364 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4nh6" podUID="6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c" Jul 12 08:07:04.845226 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:04.845188 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:07:04.845498 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:04.845353 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnfwz" podUID="fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f" Jul 12 08:07:04.845881 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:04.845816 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:07:04.845973 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:04.845927 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hl94f" podUID="353ad383-9095-4c48-b3c8-5011b5519c48" Jul 12 08:07:05.845105 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:05.845069 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:07:05.845276 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:05.845188 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4nh6" podUID="6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c" Jul 12 08:07:06.844713 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:06.844679 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:07:06.845173 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:06.844682 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:07:06.845173 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:06.844820 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hl94f" podUID="353ad383-9095-4c48-b3c8-5011b5519c48" Jul 12 08:07:06.845173 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:06.844904 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnfwz" podUID="fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f" Jul 12 08:07:07.844949 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:07.844909 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:07:07.845334 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:07.845041 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4nh6" podUID="6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c" Jul 12 08:07:08.844513 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:08.844466 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:07:08.844697 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:08.844478 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:07:08.844697 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:08.844608 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hl94f" podUID="353ad383-9095-4c48-b3c8-5011b5519c48" Jul 12 08:07:08.844697 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:08.844662 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnfwz" podUID="fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f" Jul 12 08:07:09.845201 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:09.845161 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:07:09.845637 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:09.845296 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4nh6" podUID="6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c" Jul 12 08:07:10.580568 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:10.580535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-metrics-certs\") pod \"network-metrics-daemon-bnfwz\" (UID: \"fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f\") " pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:07:10.580736 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:10.580576 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/353ad383-9095-4c48-b3c8-5011b5519c48-original-pull-secret\") pod \"global-pull-secret-syncer-hl94f\" (UID: \"353ad383-9095-4c48-b3c8-5011b5519c48\") " pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:07:10.580736 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:10.580705 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 08:07:10.580861 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:10.580776 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-metrics-certs podName:fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f nodeName:}" failed. No retries permitted until 2026-07-12 08:07:26.580754152 +0000 UTC m=+34.265565002 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-metrics-certs") pod "network-metrics-daemon-bnfwz" (UID: "fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 08:07:10.580861 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:10.580712 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 08:07:10.580861 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:10.580850 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/353ad383-9095-4c48-b3c8-5011b5519c48-original-pull-secret podName:353ad383-9095-4c48-b3c8-5011b5519c48 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:26.580835024 +0000 UTC m=+34.265645882 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/353ad383-9095-4c48-b3c8-5011b5519c48-original-pull-secret") pod "global-pull-secret-syncer-hl94f" (UID: "353ad383-9095-4c48-b3c8-5011b5519c48") : object "kube-system"/"original-pull-secret" not registered Jul 12 08:07:10.681494 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:10.681461 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxs5v\" (UniqueName: \"kubernetes.io/projected/6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c-kube-api-access-nxs5v\") pod \"network-check-target-j4nh6\" (UID: \"6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c\") " pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:07:10.681677 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:10.681627 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 08:07:10.681677 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:10.681650 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 08:07:10.681677 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:10.681663 2576 projected.go:196] Error preparing data for projected volume kube-api-access-nxs5v for pod openshift-network-diagnostics/network-check-target-j4nh6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 08:07:10.681803 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:10.681716 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c-kube-api-access-nxs5v podName:6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c nodeName:}" failed. No retries permitted until 2026-07-12 08:07:26.681700408 +0000 UTC m=+34.366511248 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nxs5v" (UniqueName: "kubernetes.io/projected/6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c-kube-api-access-nxs5v") pod "network-check-target-j4nh6" (UID: "6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 08:07:10.845484 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:10.845401 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:07:10.845922 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:10.845401 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:07:10.845922 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:10.845547 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hl94f" podUID="353ad383-9095-4c48-b3c8-5011b5519c48" Jul 12 08:07:10.845922 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:10.845617 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnfwz" podUID="fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f" Jul 12 08:07:11.844590 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:11.844553 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:07:11.844753 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:11.844674 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4nh6" podUID="6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c" Jul 12 08:07:12.844784 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:12.844755 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:07:12.845160 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:12.844833 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hl94f" podUID="353ad383-9095-4c48-b3c8-5011b5519c48" Jul 12 08:07:12.845160 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:12.844850 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:07:12.845160 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:12.844986 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnfwz" podUID="fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f" Jul 12 08:07:13.844531 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:13.844497 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:07:13.844713 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:13.844607 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4nh6" podUID="6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c" Jul 12 08:07:14.845282 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:14.845248 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:07:14.845282 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:14.845283 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:07:14.845948 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:14.845383 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hl94f" podUID="353ad383-9095-4c48-b3c8-5011b5519c48" Jul 12 08:07:14.845948 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:14.845511 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnfwz" podUID="fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f" Jul 12 08:07:15.844692 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:15.844423 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:07:15.844802 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:15.844782 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4nh6" podUID="6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c" Jul 12 08:07:16.055705 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.055623 2576 generic.go:356] "Generic (PLEG): container finished" podID="628c1d5e-923c-4cb5-bccb-3aa5dab35940" containerID="0f3579395975a79c3808be88c31099e56d787c3e9e272811ad43b3ae47c4bdf1" exitCode=0 Jul 12 08:07:16.056494 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.055706 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fjqb" event={"ID":"628c1d5e-923c-4cb5-bccb-3aa5dab35940","Type":"ContainerDied","Data":"0f3579395975a79c3808be88c31099e56d787c3e9e272811ad43b3ae47c4bdf1"} Jul 12 08:07:16.057742 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.057484 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rvmp5" event={"ID":"778713dd-51aa-4f02-a6bd-2b3c26d176fc","Type":"ContainerStarted","Data":"6dfc8c90bfb7c19d08cccf65e1384c937cdb3e049c01572f84866f0ff0b6f191"} Jul 12 08:07:16.059611 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.059591 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rccbv" event={"ID":"ba18abe7-7175-41f7-9ba6-719d288e39c2","Type":"ContainerStarted","Data":"cb634d83f9ad0665d99ad0f96c2e56a51845b5986f2375ffbebb09813977764a"} Jul 12 08:07:16.061544 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.061519 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" event={"ID":"97320e27-e583-48a5-a9e1-037fe39253d8","Type":"ContainerStarted","Data":"2b4805dd2a26283a6677ab86f0369908cacf955adce8ba4671c5982e7e0ea018"} Jul 12 08:07:16.063602 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.063583 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wz95w" event={"ID":"3b886eaf-a1aa-4e73-bf66-d8d0464561dc","Type":"ContainerStarted","Data":"4b2bd664352d57274b192807816b6f28a91b8659e94febdf281bbcdf4669720c"} Jul 12 08:07:16.065253 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.065227 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kt97t" event={"ID":"c49f1eec-fc56-4413-8033-f54ed7214323","Type":"ContainerStarted","Data":"aa14aafbc316b0c5c0782ae8d47177ec288fb67585601c1986c768af2ab6cfd3"} Jul 12 08:07:16.066555 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.066527 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2bshp" event={"ID":"a16f6071-4750-4de3-9b3b-4d9c559fcd8c","Type":"ContainerStarted","Data":"6f2200691d66e788f970c359b1071aa43b65cfd9531e4fbe726213db2b4fcb76"} Jul 12 08:07:16.069262 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.069244 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kd8ct_00af3b5b-04d5-49be-8505-4116f740ae52/ovn-acl-logging/0.log" Jul 12 08:07:16.069973 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.069955 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" event={"ID":"00af3b5b-04d5-49be-8505-4116f740ae52","Type":"ContainerStarted","Data":"5f092c656443cc6bbec3aae1c1e00de06516fe10015c13b1d6a160b0662a684b"} Jul 12 08:07:16.070044 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.070030 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" event={"ID":"00af3b5b-04d5-49be-8505-4116f740ae52","Type":"ContainerStarted","Data":"79ec1699cee4add980733bdf83a37ec2af9ee393d137818e3bf49dd22c99ad24"} Jul 12 08:07:16.070092 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.069952 2576 generic.go:356] "Generic (PLEG): container finished" podID="00af3b5b-04d5-49be-8505-4116f740ae52" containerID="a718afc0cd33258e8cb21843e1804a0dff6b0320527dc02f256209f73c2c7ea2" exitCode=1 Jul 12 08:07:16.070092 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.070061 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" event={"ID":"00af3b5b-04d5-49be-8505-4116f740ae52","Type":"ContainerStarted","Data":"0412f78f637bf87dafbfef2080f548609c9848d778f54648d755d14a5afff8bd"} Jul 12 08:07:16.070092 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.070090 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" event={"ID":"00af3b5b-04d5-49be-8505-4116f740ae52","Type":"ContainerStarted","Data":"ef95734bbb8ca54d2680af663ffcdd2c3f4c388129f3e42705e3cf9749b19f6f"} Jul 12 08:07:16.070181 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.070125 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" event={"ID":"00af3b5b-04d5-49be-8505-4116f740ae52","Type":"ContainerDied","Data":"a718afc0cd33258e8cb21843e1804a0dff6b0320527dc02f256209f73c2c7ea2"} Jul 12 08:07:16.070181 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.070155 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" event={"ID":"00af3b5b-04d5-49be-8505-4116f740ae52","Type":"ContainerStarted","Data":"b5c03a1fd604961e074e947c097b2d730e93264a301cbaf624079bb312c39c75"} Jul 12 08:07:16.093791 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.093749 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kt97t" podStartSLOduration=3.910073149 podStartE2EDuration="23.093737319s" totalImagesPullingTime="19.18366417s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:16.093526112 +0000 UTC m=+23.778336970" watchObservedRunningTime="2026-07-12 08:07:16.093737319 +0000 UTC m=+23.778548176" Jul 12 08:07:16.108471 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.108434 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2bshp" podStartSLOduration=3.879908665 podStartE2EDuration="23.10842167s" totalImagesPullingTime="19.228513005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:16.107990605 +0000 UTC m=+23.792801466" watchObservedRunningTime="2026-07-12 08:07:16.10842167 +0000 UTC m=+23.793232525" Jul 12 08:07:16.120436 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.120402 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rvmp5" podStartSLOduration=3.952741619 podStartE2EDuration="23.120391035s" totalImagesPullingTime="19.167649416s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:16.120242395 +0000 UTC m=+23.805053253" watchObservedRunningTime="2026-07-12 08:07:16.120391035 +0000 UTC m=+23.805201894" Jul 12 08:07:16.133428 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.133394 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wz95w" podStartSLOduration=3.954995318 podStartE2EDuration="23.133381096s" totalImagesPullingTime="19.178385778s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:16.133088066 +0000 UTC m=+23.817898923" watchObservedRunningTime="2026-07-12 08:07:16.133381096 +0000 UTC m=+23.818192005" Jul 12 08:07:16.146044 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.146010 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rccbv" podStartSLOduration=11.919738508 podStartE2EDuration="23.145999493s" totalImagesPullingTime="11.226260985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:16.145520052 +0000 UTC m=+23.830330905" watchObservedRunningTime="2026-07-12 08:07:16.145999493 +0000 UTC m=+23.830810350" Jul 12 08:07:16.764881 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.764855 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 12 08:07:16.836993 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.836828 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-12T08:07:16.764877465Z","UUID":"9d326d3d-6902-43b3-b48c-e8e8c257bb79","Handler":null,"Name":"","Endpoint":""} Jul 12 08:07:16.838784 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.838763 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 12 08:07:16.838925 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.838804 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 12 08:07:16.846435 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.845289 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:07:16.846435 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:16.845305 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:07:16.846435 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:16.845481 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnfwz" podUID="fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f" Jul 12 08:07:16.846435 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:16.845847 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hl94f" podUID="353ad383-9095-4c48-b3c8-5011b5519c48" Jul 12 08:07:17.074238 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:17.074151 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d98gf" event={"ID":"7a727b8e-f7fa-464e-88d2-4023165fc773","Type":"ContainerStarted","Data":"dd28eb5ba0e7f86bc8a694e4b131bcde07215f83b30f9576255ef95fd91c7471"} Jul 12 08:07:17.076431 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:17.076394 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" event={"ID":"97320e27-e583-48a5-a9e1-037fe39253d8","Type":"ContainerStarted","Data":"7dde63b51097ebaa9a26a92e5c4a9c129dcc4c0a4e428f9dda00d686201f43ef"} Jul 12 08:07:17.090941 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:17.090894 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-d98gf" podStartSLOduration=4.91804258 podStartE2EDuration="24.090882871s" totalImagesPullingTime="19.172840291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:17.090726123 +0000 UTC m=+24.775536995" watchObservedRunningTime="2026-07-12 08:07:17.090882871 +0000 UTC m=+24.775693729" Jul 12 08:07:17.845271 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:17.845238 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:07:17.845510 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:17.845371 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4nh6" podUID="6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c" Jul 12 08:07:18.081366 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:18.081332 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" event={"ID":"97320e27-e583-48a5-a9e1-037fe39253d8","Type":"ContainerStarted","Data":"25e4078018c4ba50991a975b8a8bf8bce75cbe9cf495987395e618a45815f567"} Jul 12 08:07:18.096774 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:18.096725 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-58jhq" podStartSLOduration=3.639364062 podStartE2EDuration="25.096704295s" totalImagesPullingTime="21.457340233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:06:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:18.096243429 +0000 UTC m=+25.781054289" watchObservedRunningTime="2026-07-12 08:07:18.096704295 +0000 UTC m=+25.781515153" Jul 12 08:07:18.844997 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:18.844757 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:07:18.845284 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:18.844801 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:07:18.845284 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:18.845110 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnfwz" podUID="fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f" Jul 12 08:07:18.845284 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:18.845194 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hl94f" podUID="353ad383-9095-4c48-b3c8-5011b5519c48" Jul 12 08:07:19.087423 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:19.087395 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kd8ct_00af3b5b-04d5-49be-8505-4116f740ae52/ovn-acl-logging/0.log" Jul 12 08:07:19.087857 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:19.087760 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" event={"ID":"00af3b5b-04d5-49be-8505-4116f740ae52","Type":"ContainerStarted","Data":"036c9fc7433d09e4b27c69944707e21c9fe7e0e0a76ef67c331e609fcbe544c8"} Jul 12 08:07:19.109118 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:19.109045 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rccbv" Jul 12 08:07:19.109698 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:19.109673 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rccbv" Jul 12 08:07:19.845137 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:19.845100 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:07:19.845390 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:19.845219 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4nh6" podUID="6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c" Jul 12 08:07:20.089663 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:20.089631 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rccbv" Jul 12 08:07:20.090233 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:20.090184 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rccbv" Jul 12 08:07:20.845527 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:20.845494 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:07:20.845713 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:20.845494 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:07:20.845713 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:20.845633 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnfwz" podUID="fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f" Jul 12 08:07:20.845828 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:20.845745 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hl94f" podUID="353ad383-9095-4c48-b3c8-5011b5519c48" Jul 12 08:07:21.094715 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:21.094602 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kd8ct_00af3b5b-04d5-49be-8505-4116f740ae52/ovn-acl-logging/0.log" Jul 12 08:07:21.095162 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:21.095034 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" event={"ID":"00af3b5b-04d5-49be-8505-4116f740ae52","Type":"ContainerStarted","Data":"618546b8aa716d0bc713f16b04f3ecb189a9c11c928b4b5ba4ecdab90d566f99"} Jul 12 08:07:21.100495 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:21.100415 2576 scope.go:117] "RemoveContainer" containerID="a718afc0cd33258e8cb21843e1804a0dff6b0320527dc02f256209f73c2c7ea2" Jul 12 08:07:21.100495 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:21.100454 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:07:21.100615 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:21.100526 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:07:21.122230 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:21.122201 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:07:21.844848 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:21.844815 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:07:21.845066 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:21.844956 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4nh6" podUID="6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c" Jul 12 08:07:22.100586 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:22.100521 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kd8ct_00af3b5b-04d5-49be-8505-4116f740ae52/ovn-acl-logging/0.log" Jul 12 08:07:22.101025 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:22.100894 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" event={"ID":"00af3b5b-04d5-49be-8505-4116f740ae52","Type":"ContainerStarted","Data":"4e8e507ab21383ab9b28ea52c0a071a072d95d91ce01e0c5cf2bf99349c97eb8"} Jul 12 08:07:22.101240 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:22.101218 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:07:22.102716 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:22.102690 2576 generic.go:356] "Generic (PLEG): container finished" podID="628c1d5e-923c-4cb5-bccb-3aa5dab35940" containerID="da7783ecacb0fa418b16fcf99f7e8f0e029b2a7424d82dadb3e9766c052d0d61" exitCode=0 Jul 12 08:07:22.102798 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:22.102779 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fjqb" event={"ID":"628c1d5e-923c-4cb5-bccb-3aa5dab35940","Type":"ContainerDied","Data":"da7783ecacb0fa418b16fcf99f7e8f0e029b2a7424d82dadb3e9766c052d0d61"} Jul 12 08:07:22.116901 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:22.116880 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:07:22.130247 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:22.130210 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" podStartSLOduration=9.87529853 podStartE2EDuration="29.130198665s" totalImagesPullingTime="19.254900135s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:22.129909305 +0000 UTC m=+29.814720163" watchObservedRunningTime="2026-07-12 08:07:22.130198665 +0000 UTC m=+29.815009523" Jul 12 08:07:22.844983 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:22.844952 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:07:22.845158 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:22.844952 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:07:22.845158 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:22.845075 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hl94f" podUID="353ad383-9095-4c48-b3c8-5011b5519c48" Jul 12 08:07:22.845158 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:22.845135 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnfwz" podUID="fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f" Jul 12 08:07:22.934748 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:22.934581 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j4nh6"] Jul 12 08:07:22.934879 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:22.934858 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:07:22.934984 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:22.934964 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4nh6" podUID="6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c" Jul 12 08:07:22.938061 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:22.938033 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hl94f"] Jul 12 08:07:22.938808 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:22.938787 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bnfwz"] Jul 12 08:07:23.104501 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:23.104480 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:07:23.104790 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:23.104480 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:07:23.104790 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:23.104576 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hl94f" podUID="353ad383-9095-4c48-b3c8-5011b5519c48" Jul 12 08:07:23.104790 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:23.104665 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnfwz" podUID="fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f" Jul 12 08:07:24.108483 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:24.108385 2576 generic.go:356] "Generic (PLEG): container finished" podID="628c1d5e-923c-4cb5-bccb-3aa5dab35940" containerID="e5fcd8f08bebd73fb4f8f2b969a3bc7c983a662cb049020807f8b8632e602a3c" exitCode=0 Jul 12 08:07:24.108946 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:24.108476 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fjqb" event={"ID":"628c1d5e-923c-4cb5-bccb-3aa5dab35940","Type":"ContainerDied","Data":"e5fcd8f08bebd73fb4f8f2b969a3bc7c983a662cb049020807f8b8632e602a3c"} Jul 12 08:07:24.845026 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:24.844959 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:07:24.845174 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:24.844960 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:07:24.845174 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:24.845061 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4nh6" podUID="6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c" Jul 12 08:07:24.845174 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:24.845071 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:07:24.845319 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:24.845228 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnfwz" podUID="fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f" Jul 12 08:07:24.845319 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:24.845299 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hl94f" podUID="353ad383-9095-4c48-b3c8-5011b5519c48" Jul 12 08:07:25.113775 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:25.113701 2576 generic.go:356] "Generic (PLEG): container finished" podID="628c1d5e-923c-4cb5-bccb-3aa5dab35940" containerID="9d50b26b44f2a8af89c3a1ee8817969ad79eaa35f92f0ece9a99a72eae38e02e" exitCode=0 Jul 12 08:07:25.113775 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:25.113758 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fjqb" event={"ID":"628c1d5e-923c-4cb5-bccb-3aa5dab35940","Type":"ContainerDied","Data":"9d50b26b44f2a8af89c3a1ee8817969ad79eaa35f92f0ece9a99a72eae38e02e"} Jul 12 08:07:26.607466 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:26.607434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-metrics-certs\") pod \"network-metrics-daemon-bnfwz\" (UID: \"fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f\") " pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:07:26.607466 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:26.607471 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/353ad383-9095-4c48-b3c8-5011b5519c48-original-pull-secret\") pod \"global-pull-secret-syncer-hl94f\" (UID: \"353ad383-9095-4c48-b3c8-5011b5519c48\") " pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:07:26.607850 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:26.607568 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 08:07:26.607850 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:26.607570 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 08:07:26.607850 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:26.607620 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/353ad383-9095-4c48-b3c8-5011b5519c48-original-pull-secret podName:353ad383-9095-4c48-b3c8-5011b5519c48 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:58.607606224 +0000 UTC m=+66.292417059 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/353ad383-9095-4c48-b3c8-5011b5519c48-original-pull-secret") pod "global-pull-secret-syncer-hl94f" (UID: "353ad383-9095-4c48-b3c8-5011b5519c48") : object "kube-system"/"original-pull-secret" not registered Jul 12 08:07:26.607850 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:26.607633 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-metrics-certs podName:fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f nodeName:}" failed. No retries permitted until 2026-07-12 08:07:58.607626914 +0000 UTC m=+66.292437749 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-metrics-certs") pod "network-metrics-daemon-bnfwz" (UID: "fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 08:07:26.708502 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:26.708469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxs5v\" (UniqueName: \"kubernetes.io/projected/6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c-kube-api-access-nxs5v\") pod \"network-check-target-j4nh6\" (UID: \"6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c\") " pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:07:26.708676 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:26.708652 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 08:07:26.708676 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:26.708674 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 08:07:26.708778 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:26.708688 2576 projected.go:196] Error preparing data for projected volume kube-api-access-nxs5v for pod openshift-network-diagnostics/network-check-target-j4nh6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 08:07:26.708778 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:26.708753 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c-kube-api-access-nxs5v podName:6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c nodeName:}" failed. No retries permitted until 2026-07-12 08:07:58.708733799 +0000 UTC m=+66.393544650 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nxs5v" (UniqueName: "kubernetes.io/projected/6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c-kube-api-access-nxs5v") pod "network-check-target-j4nh6" (UID: "6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 08:07:26.845624 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:26.845535 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:07:26.845751 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:26.845537 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:07:26.845751 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:26.845663 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j4nh6" podUID="6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c" Jul 12 08:07:26.845751 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:26.845682 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:07:26.845854 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:26.845761 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bnfwz" podUID="fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f" Jul 12 08:07:26.845854 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:26.845817 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hl94f" podUID="353ad383-9095-4c48-b3c8-5011b5519c48" Jul 12 08:07:28.039719 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.039638 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-184.ec2.internal" event="NodeReady" Jul 12 08:07:28.040167 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.039788 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 12 08:07:28.071873 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.071841 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-548bc455f9-b4kpp"] Jul 12 08:07:28.074335 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.074315 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:28.076560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.076538 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 12 08:07:28.076924 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.076860 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 12 08:07:28.077581 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.077374 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vj6z7\"" Jul 12 08:07:28.077763 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.077499 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 12 08:07:28.082459 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.082367 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n89k8"] Jul 12 08:07:28.085720 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.085553 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wrbsq"] Jul 12 08:07:28.085900 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.085685 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n89k8" Jul 12 08:07:28.086783 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.086397 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 12 08:07:28.088560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.088535 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 12 08:07:28.088785 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.088765 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 12 08:07:28.088863 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.088826 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 12 08:07:28.088923 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.088880 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mn9v7\"" Jul 12 08:07:28.089836 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.089811 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-548bc455f9-b4kpp"] Jul 12 08:07:28.090047 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.089974 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wrbsq" Jul 12 08:07:28.091080 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.090905 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n89k8"] Jul 12 08:07:28.092085 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.092064 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lhqtd\"" Jul 12 08:07:28.092779 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.092759 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 12 08:07:28.093061 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.093045 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 12 08:07:28.093802 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.093782 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wrbsq"] Jul 12 08:07:28.220652 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.220622 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-tls\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:28.220652 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.220657 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/19a67523-00cc-4b3d-a1a9-9eb033293b28-ca-trust-extracted\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:28.220870 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.220679 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19a67523-00cc-4b3d-a1a9-9eb033293b28-trusted-ca\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:28.220870 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.220706 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/46481969-347f-4259-8366-a376f786c9f3-config-volume\") pod \"dns-default-wrbsq\" (UID: \"46481969-347f-4259-8366-a376f786c9f3\") " pod="openshift-dns/dns-default-wrbsq" Jul 12 08:07:28.220870 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.220775 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46481969-347f-4259-8366-a376f786c9f3-metrics-tls\") pod \"dns-default-wrbsq\" (UID: \"46481969-347f-4259-8366-a376f786c9f3\") " pod="openshift-dns/dns-default-wrbsq" Jul 12 08:07:28.220870 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.220827 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/19a67523-00cc-4b3d-a1a9-9eb033293b28-installation-pull-secrets\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:28.220870 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.220851 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46481969-347f-4259-8366-a376f786c9f3-tmp-dir\") pod \"dns-default-wrbsq\" (UID: \"46481969-347f-4259-8366-a376f786c9f3\") " pod="openshift-dns/dns-default-wrbsq" Jul 12 08:07:28.221118 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.220874 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q8fp\" (UniqueName: \"kubernetes.io/projected/46481969-347f-4259-8366-a376f786c9f3-kube-api-access-7q8fp\") pod \"dns-default-wrbsq\" (UID: \"46481969-347f-4259-8366-a376f786c9f3\") " pod="openshift-dns/dns-default-wrbsq" Jul 12 08:07:28.221118 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.220919 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-certificates\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:28.221118 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.220990 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/19a67523-00cc-4b3d-a1a9-9eb033293b28-image-registry-private-configuration\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:28.221118 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.221028 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrtrb\" (UniqueName: \"kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-kube-api-access-zrtrb\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:28.221118 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.221069 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djkw5\" (UniqueName: \"kubernetes.io/projected/e291324a-b2bc-4bc5-b624-80fe7c0e5d7a-kube-api-access-djkw5\") pod \"ingress-canary-n89k8\" (UID: \"e291324a-b2bc-4bc5-b624-80fe7c0e5d7a\") " pod="openshift-ingress-canary/ingress-canary-n89k8" Jul 12 08:07:28.221285 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.221123 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-bound-sa-token\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:28.221285 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.221144 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e291324a-b2bc-4bc5-b624-80fe7c0e5d7a-cert\") pod \"ingress-canary-n89k8\" (UID: \"e291324a-b2bc-4bc5-b624-80fe7c0e5d7a\") " pod="openshift-ingress-canary/ingress-canary-n89k8" Jul 12 08:07:28.321816 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.321722 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/19a67523-00cc-4b3d-a1a9-9eb033293b28-ca-trust-extracted\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:28.321816 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.321777 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19a67523-00cc-4b3d-a1a9-9eb033293b28-trusted-ca\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:28.321816 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.321798 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/46481969-347f-4259-8366-a376f786c9f3-config-volume\") pod \"dns-default-wrbsq\" (UID: \"46481969-347f-4259-8366-a376f786c9f3\") " pod="openshift-dns/dns-default-wrbsq" Jul 12 08:07:28.322072 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.321854 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46481969-347f-4259-8366-a376f786c9f3-metrics-tls\") pod \"dns-default-wrbsq\" (UID: \"46481969-347f-4259-8366-a376f786c9f3\") " pod="openshift-dns/dns-default-wrbsq" Jul 12 08:07:28.322072 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.321923 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/19a67523-00cc-4b3d-a1a9-9eb033293b28-installation-pull-secrets\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:28.322072 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.321971 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46481969-347f-4259-8366-a376f786c9f3-tmp-dir\") pod \"dns-default-wrbsq\" (UID: \"46481969-347f-4259-8366-a376f786c9f3\") " pod="openshift-dns/dns-default-wrbsq" Jul 12 08:07:28.322072 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.322004 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q8fp\" (UniqueName: \"kubernetes.io/projected/46481969-347f-4259-8366-a376f786c9f3-kube-api-access-7q8fp\") pod \"dns-default-wrbsq\" (UID: \"46481969-347f-4259-8366-a376f786c9f3\") " pod="openshift-dns/dns-default-wrbsq" Jul 12 08:07:28.322188 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.322069 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-certificates\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:28.322188 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.322112 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/19a67523-00cc-4b3d-a1a9-9eb033293b28-image-registry-private-configuration\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:28.322188 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:28.322128 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 08:07:28.322188 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.322149 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrtrb\" (UniqueName: \"kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-kube-api-access-zrtrb\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:28.322188 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.322181 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djkw5\" (UniqueName: \"kubernetes.io/projected/e291324a-b2bc-4bc5-b624-80fe7c0e5d7a-kube-api-access-djkw5\") pod \"ingress-canary-n89k8\" (UID: \"e291324a-b2bc-4bc5-b624-80fe7c0e5d7a\") " pod="openshift-ingress-canary/ingress-canary-n89k8" Jul 12 08:07:28.322328 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:28.322215 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46481969-347f-4259-8366-a376f786c9f3-metrics-tls podName:46481969-347f-4259-8366-a376f786c9f3 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:28.82218672 +0000 UTC m=+36.506997571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/46481969-347f-4259-8366-a376f786c9f3-metrics-tls") pod "dns-default-wrbsq" (UID: "46481969-347f-4259-8366-a376f786c9f3") : secret "dns-default-metrics-tls" not found Jul 12 08:07:28.322328 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.322274 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-bound-sa-token\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:28.322328 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.322287 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/19a67523-00cc-4b3d-a1a9-9eb033293b28-ca-trust-extracted\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:28.322328 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.322306 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e291324a-b2bc-4bc5-b624-80fe7c0e5d7a-cert\") pod \"ingress-canary-n89k8\" (UID: \"e291324a-b2bc-4bc5-b624-80fe7c0e5d7a\") " pod="openshift-ingress-canary/ingress-canary-n89k8" Jul 12 08:07:28.322446 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.322388 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-tls\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:28.322529 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.322506 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/46481969-347f-4259-8366-a376f786c9f3-config-volume\") pod \"dns-default-wrbsq\" (UID: \"46481969-347f-4259-8366-a376f786c9f3\") " pod="openshift-dns/dns-default-wrbsq" Jul 12 08:07:28.322615 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:28.322520 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 12 08:07:28.322615 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:28.322554 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-548bc455f9-b4kpp: secret "image-registry-tls" not found Jul 12 08:07:28.322615 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:28.322600 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-tls podName:19a67523-00cc-4b3d-a1a9-9eb033293b28 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:28.822588042 +0000 UTC m=+36.507398879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-tls") pod "image-registry-548bc455f9-b4kpp" (UID: "19a67523-00cc-4b3d-a1a9-9eb033293b28") : secret "image-registry-tls" not found Jul 12 08:07:28.322964 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.322946 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-certificates\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:28.323246 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.323217 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46481969-347f-4259-8366-a376f786c9f3-tmp-dir\") pod \"dns-default-wrbsq\" (UID: \"46481969-347f-4259-8366-a376f786c9f3\") " pod="openshift-dns/dns-default-wrbsq" Jul 12 08:07:28.323336 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.323292 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19a67523-00cc-4b3d-a1a9-9eb033293b28-trusted-ca\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:28.327181 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.327158 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/19a67523-00cc-4b3d-a1a9-9eb033293b28-installation-pull-secrets\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:28.327181 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.327176 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/19a67523-00cc-4b3d-a1a9-9eb033293b28-image-registry-private-configuration\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:28.327354 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.327192 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e291324a-b2bc-4bc5-b624-80fe7c0e5d7a-cert\") pod \"ingress-canary-n89k8\" (UID: \"e291324a-b2bc-4bc5-b624-80fe7c0e5d7a\") " pod="openshift-ingress-canary/ingress-canary-n89k8" Jul 12 08:07:28.333306 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.333284 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-bound-sa-token\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:28.333753 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.333726 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q8fp\" (UniqueName: \"kubernetes.io/projected/46481969-347f-4259-8366-a376f786c9f3-kube-api-access-7q8fp\") pod \"dns-default-wrbsq\" (UID: \"46481969-347f-4259-8366-a376f786c9f3\") " pod="openshift-dns/dns-default-wrbsq" Jul 12 08:07:28.333878 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.333823 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djkw5\" (UniqueName: \"kubernetes.io/projected/e291324a-b2bc-4bc5-b624-80fe7c0e5d7a-kube-api-access-djkw5\") pod \"ingress-canary-n89k8\" (UID: \"e291324a-b2bc-4bc5-b624-80fe7c0e5d7a\") " pod="openshift-ingress-canary/ingress-canary-n89k8" Jul 12 08:07:28.334157 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.334114 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrtrb\" (UniqueName: \"kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-kube-api-access-zrtrb\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:28.401068 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.401030 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n89k8" Jul 12 08:07:28.826611 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.826572 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-tls\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:28.826611 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.826617 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46481969-347f-4259-8366-a376f786c9f3-metrics-tls\") pod \"dns-default-wrbsq\" (UID: \"46481969-347f-4259-8366-a376f786c9f3\") " pod="openshift-dns/dns-default-wrbsq" Jul 12 08:07:28.826850 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:28.826740 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 12 08:07:28.826850 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:28.826747 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 08:07:28.826850 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:28.826756 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-548bc455f9-b4kpp: secret "image-registry-tls" not found Jul 12 08:07:28.826850 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:28.826810 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46481969-347f-4259-8366-a376f786c9f3-metrics-tls podName:46481969-347f-4259-8366-a376f786c9f3 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:29.826796341 +0000 UTC m=+37.511607176 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/46481969-347f-4259-8366-a376f786c9f3-metrics-tls") pod "dns-default-wrbsq" (UID: "46481969-347f-4259-8366-a376f786c9f3") : secret "dns-default-metrics-tls" not found Jul 12 08:07:28.826850 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:28.826829 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-tls podName:19a67523-00cc-4b3d-a1a9-9eb033293b28 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:29.826821001 +0000 UTC m=+37.511631851 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-tls") pod "image-registry-548bc455f9-b4kpp" (UID: "19a67523-00cc-4b3d-a1a9-9eb033293b28") : secret "image-registry-tls" not found Jul 12 08:07:28.844856 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.844827 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:07:28.845020 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.844827 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:07:28.845020 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.844962 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:07:28.847131 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.847109 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xxbfq\"" Jul 12 08:07:28.848185 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.848040 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 12 08:07:28.848185 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.848080 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rkfrj\"" Jul 12 08:07:28.848185 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.848038 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 12 08:07:28.848185 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.848147 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 12 08:07:28.848185 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:28.848164 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 12 08:07:29.600218 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:29.600188 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n89k8"] Jul 12 08:07:29.604313 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:07:29.604277 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode291324a_b2bc_4bc5_b624_80fe7c0e5d7a.slice/crio-914f03adffe590cfef8126929662092e892a3762f87ffae1813f7bb643a27646 WatchSource:0}: Error finding container 914f03adffe590cfef8126929662092e892a3762f87ffae1813f7bb643a27646: Status 404 returned error can't find the container with id 914f03adffe590cfef8126929662092e892a3762f87ffae1813f7bb643a27646 Jul 12 08:07:29.836271 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:29.836231 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-tls\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:29.836452 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:29.836281 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46481969-347f-4259-8366-a376f786c9f3-metrics-tls\") pod \"dns-default-wrbsq\" (UID: \"46481969-347f-4259-8366-a376f786c9f3\") " pod="openshift-dns/dns-default-wrbsq" Jul 12 08:07:29.836452 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:29.836398 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 12 08:07:29.836452 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:29.836419 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-548bc455f9-b4kpp: secret "image-registry-tls" not found Jul 12 08:07:29.836597 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:29.836469 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-tls podName:19a67523-00cc-4b3d-a1a9-9eb033293b28 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:31.83645343 +0000 UTC m=+39.521264265 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-tls") pod "image-registry-548bc455f9-b4kpp" (UID: "19a67523-00cc-4b3d-a1a9-9eb033293b28") : secret "image-registry-tls" not found Jul 12 08:07:29.836597 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:29.836405 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 08:07:29.836597 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:29.836545 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46481969-347f-4259-8366-a376f786c9f3-metrics-tls podName:46481969-347f-4259-8366-a376f786c9f3 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:31.83652774 +0000 UTC m=+39.521338576 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/46481969-347f-4259-8366-a376f786c9f3-metrics-tls") pod "dns-default-wrbsq" (UID: "46481969-347f-4259-8366-a376f786c9f3") : secret "dns-default-metrics-tls" not found Jul 12 08:07:30.127295 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:30.127209 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n89k8" event={"ID":"e291324a-b2bc-4bc5-b624-80fe7c0e5d7a","Type":"ContainerStarted","Data":"914f03adffe590cfef8126929662092e892a3762f87ffae1813f7bb643a27646"} Jul 12 08:07:30.130130 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:30.130097 2576 generic.go:356] "Generic (PLEG): container finished" podID="628c1d5e-923c-4cb5-bccb-3aa5dab35940" containerID="e6c346d6811489c2bf50dd492eeb3ac6ae4b5dcc3081461c957b8ec59354cde6" exitCode=0 Jul 12 08:07:30.130255 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:30.130138 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fjqb" event={"ID":"628c1d5e-923c-4cb5-bccb-3aa5dab35940","Type":"ContainerDied","Data":"e6c346d6811489c2bf50dd492eeb3ac6ae4b5dcc3081461c957b8ec59354cde6"} Jul 12 08:07:31.136184 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.135976 2576 generic.go:356] "Generic (PLEG): container finished" podID="628c1d5e-923c-4cb5-bccb-3aa5dab35940" containerID="cae5ba76224afc97edc594361863fe73501256d1e75672f28db2414a482c412b" exitCode=0 Jul 12 08:07:31.136184 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.136057 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fjqb" event={"ID":"628c1d5e-923c-4cb5-bccb-3aa5dab35940","Type":"ContainerDied","Data":"cae5ba76224afc97edc594361863fe73501256d1e75672f28db2414a482c412b"} Jul 12 08:07:31.241426 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.241401 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fjjh5"] Jul 12 08:07:31.243611 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.243593 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fjjh5" Jul 12 08:07:31.246473 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.246450 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 12 08:07:31.246802 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.246787 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 12 08:07:31.246908 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.246823 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 12 08:07:31.246992 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.246909 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dmv4g\"" Jul 12 08:07:31.247045 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.247012 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 12 08:07:31.248086 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.248067 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/43959b97-35ca-4a34-a6a8-9311bec3c904-data-volume\") pod \"insights-runtime-extractor-fjjh5\" (UID: \"43959b97-35ca-4a34-a6a8-9311bec3c904\") " pod="openshift-insights/insights-runtime-extractor-fjjh5" Jul 12 08:07:31.248185 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.248135 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43959b97-35ca-4a34-a6a8-9311bec3c904-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fjjh5\" (UID: \"43959b97-35ca-4a34-a6a8-9311bec3c904\") " pod="openshift-insights/insights-runtime-extractor-fjjh5" Jul 12 08:07:31.248315 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.248183 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/43959b97-35ca-4a34-a6a8-9311bec3c904-crio-socket\") pod \"insights-runtime-extractor-fjjh5\" (UID: \"43959b97-35ca-4a34-a6a8-9311bec3c904\") " pod="openshift-insights/insights-runtime-extractor-fjjh5" Jul 12 08:07:31.248315 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.248216 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43959b97-35ca-4a34-a6a8-9311bec3c904-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fjjh5\" (UID: \"43959b97-35ca-4a34-a6a8-9311bec3c904\") " pod="openshift-insights/insights-runtime-extractor-fjjh5" Jul 12 08:07:31.248315 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.248239 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x26hw\" (UniqueName: \"kubernetes.io/projected/43959b97-35ca-4a34-a6a8-9311bec3c904-kube-api-access-x26hw\") pod \"insights-runtime-extractor-fjjh5\" (UID: \"43959b97-35ca-4a34-a6a8-9311bec3c904\") " pod="openshift-insights/insights-runtime-extractor-fjjh5" Jul 12 08:07:31.265799 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.264067 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fjjh5"] Jul 12 08:07:31.349219 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.349178 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/43959b97-35ca-4a34-a6a8-9311bec3c904-data-volume\") pod \"insights-runtime-extractor-fjjh5\" (UID: \"43959b97-35ca-4a34-a6a8-9311bec3c904\") " pod="openshift-insights/insights-runtime-extractor-fjjh5" Jul 12 08:07:31.349355 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.349266 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43959b97-35ca-4a34-a6a8-9311bec3c904-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fjjh5\" (UID: \"43959b97-35ca-4a34-a6a8-9311bec3c904\") " pod="openshift-insights/insights-runtime-extractor-fjjh5" Jul 12 08:07:31.349355 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.349288 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/43959b97-35ca-4a34-a6a8-9311bec3c904-crio-socket\") pod \"insights-runtime-extractor-fjjh5\" (UID: \"43959b97-35ca-4a34-a6a8-9311bec3c904\") " pod="openshift-insights/insights-runtime-extractor-fjjh5" Jul 12 08:07:31.349355 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.349305 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43959b97-35ca-4a34-a6a8-9311bec3c904-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fjjh5\" (UID: \"43959b97-35ca-4a34-a6a8-9311bec3c904\") " pod="openshift-insights/insights-runtime-extractor-fjjh5" Jul 12 08:07:31.349355 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.349322 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x26hw\" (UniqueName: \"kubernetes.io/projected/43959b97-35ca-4a34-a6a8-9311bec3c904-kube-api-access-x26hw\") pod \"insights-runtime-extractor-fjjh5\" (UID: \"43959b97-35ca-4a34-a6a8-9311bec3c904\") " pod="openshift-insights/insights-runtime-extractor-fjjh5" Jul 12 08:07:31.349505 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.349389 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/43959b97-35ca-4a34-a6a8-9311bec3c904-crio-socket\") pod \"insights-runtime-extractor-fjjh5\" (UID: \"43959b97-35ca-4a34-a6a8-9311bec3c904\") " pod="openshift-insights/insights-runtime-extractor-fjjh5" Jul 12 08:07:31.349505 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:31.349435 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 12 08:07:31.349505 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:31.349479 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 08:07:31.349606 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.349505 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/43959b97-35ca-4a34-a6a8-9311bec3c904-data-volume\") pod \"insights-runtime-extractor-fjjh5\" (UID: \"43959b97-35ca-4a34-a6a8-9311bec3c904\") " pod="openshift-insights/insights-runtime-extractor-fjjh5" Jul 12 08:07:31.349606 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:31.349511 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43959b97-35ca-4a34-a6a8-9311bec3c904-kube-rbac-proxy-cm podName:43959b97-35ca-4a34-a6a8-9311bec3c904 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:31.849491911 +0000 UTC m=+39.534302766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/43959b97-35ca-4a34-a6a8-9311bec3c904-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fjjh5" (UID: "43959b97-35ca-4a34-a6a8-9311bec3c904") : configmap "kube-rbac-proxy" not found Jul 12 08:07:31.349606 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:31.349556 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43959b97-35ca-4a34-a6a8-9311bec3c904-insights-runtime-extractor-tls podName:43959b97-35ca-4a34-a6a8-9311bec3c904 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:31.849537801 +0000 UTC m=+39.534348645 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43959b97-35ca-4a34-a6a8-9311bec3c904-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fjjh5" (UID: "43959b97-35ca-4a34-a6a8-9311bec3c904") : secret "insights-runtime-extractor-tls" not found Jul 12 08:07:31.358370 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.358349 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x26hw\" (UniqueName: \"kubernetes.io/projected/43959b97-35ca-4a34-a6a8-9311bec3c904-kube-api-access-x26hw\") pod \"insights-runtime-extractor-fjjh5\" (UID: \"43959b97-35ca-4a34-a6a8-9311bec3c904\") " pod="openshift-insights/insights-runtime-extractor-fjjh5" Jul 12 08:07:31.852801 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.852760 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43959b97-35ca-4a34-a6a8-9311bec3c904-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fjjh5\" (UID: \"43959b97-35ca-4a34-a6a8-9311bec3c904\") " pod="openshift-insights/insights-runtime-extractor-fjjh5" Jul 12 08:07:31.852992 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.852899 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-tls\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:31.852992 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:31.852924 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 08:07:31.852992 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.852949 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46481969-347f-4259-8366-a376f786c9f3-metrics-tls\") pod \"dns-default-wrbsq\" (UID: \"46481969-347f-4259-8366-a376f786c9f3\") " pod="openshift-dns/dns-default-wrbsq" Jul 12 08:07:31.853153 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:31.853011 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43959b97-35ca-4a34-a6a8-9311bec3c904-insights-runtime-extractor-tls podName:43959b97-35ca-4a34-a6a8-9311bec3c904 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:32.852990191 +0000 UTC m=+40.537801030 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43959b97-35ca-4a34-a6a8-9311bec3c904-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fjjh5" (UID: "43959b97-35ca-4a34-a6a8-9311bec3c904") : secret "insights-runtime-extractor-tls" not found Jul 12 08:07:31.853153 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:31.853031 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 08:07:31.853153 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:31.853036 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 12 08:07:31.853153 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:31.853051 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-548bc455f9-b4kpp: secret "image-registry-tls" not found Jul 12 08:07:31.853153 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:31.853073 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46481969-347f-4259-8366-a376f786c9f3-metrics-tls podName:46481969-347f-4259-8366-a376f786c9f3 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:35.853062154 +0000 UTC m=+43.537872990 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/46481969-347f-4259-8366-a376f786c9f3-metrics-tls") pod "dns-default-wrbsq" (UID: "46481969-347f-4259-8366-a376f786c9f3") : secret "dns-default-metrics-tls" not found Jul 12 08:07:31.853153 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:31.853079 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43959b97-35ca-4a34-a6a8-9311bec3c904-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fjjh5\" (UID: \"43959b97-35ca-4a34-a6a8-9311bec3c904\") " pod="openshift-insights/insights-runtime-extractor-fjjh5" Jul 12 08:07:31.853153 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:31.853090 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-tls podName:19a67523-00cc-4b3d-a1a9-9eb033293b28 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:35.853077831 +0000 UTC m=+43.537888686 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-tls") pod "image-registry-548bc455f9-b4kpp" (UID: "19a67523-00cc-4b3d-a1a9-9eb033293b28") : secret "image-registry-tls" not found Jul 12 08:07:31.853394 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:31.853182 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 12 08:07:31.853394 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:31.853228 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43959b97-35ca-4a34-a6a8-9311bec3c904-kube-rbac-proxy-cm podName:43959b97-35ca-4a34-a6a8-9311bec3c904 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:32.853213148 +0000 UTC m=+40.538023987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/43959b97-35ca-4a34-a6a8-9311bec3c904-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fjjh5" (UID: "43959b97-35ca-4a34-a6a8-9311bec3c904") : configmap "kube-rbac-proxy" not found Jul 12 08:07:32.143141 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:32.143054 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6fjqb" event={"ID":"628c1d5e-923c-4cb5-bccb-3aa5dab35940","Type":"ContainerStarted","Data":"2aef0dd7ab688d7e51c70076d0e1c319fadeaa4123355c6948f61af52fa28707"} Jul 12 08:07:32.165209 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:32.165143 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6fjqb" podStartSLOduration=8.801085139 podStartE2EDuration="39.165123611s" totalImagesPullingTime="30.364038472s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:06:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:32.164324909 +0000 UTC m=+39.849135772" watchObservedRunningTime="2026-07-12 08:07:32.165123611 +0000 UTC m=+39.849934473" Jul 12 08:07:32.861244 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:32.861208 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43959b97-35ca-4a34-a6a8-9311bec3c904-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fjjh5\" (UID: \"43959b97-35ca-4a34-a6a8-9311bec3c904\") " pod="openshift-insights/insights-runtime-extractor-fjjh5" Jul 12 08:07:32.861442 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:32.861337 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43959b97-35ca-4a34-a6a8-9311bec3c904-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fjjh5\" (UID: \"43959b97-35ca-4a34-a6a8-9311bec3c904\") " pod="openshift-insights/insights-runtime-extractor-fjjh5" Jul 12 08:07:32.861442 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:32.861357 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 08:07:32.861442 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:32.861411 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 12 08:07:32.861569 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:32.861416 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43959b97-35ca-4a34-a6a8-9311bec3c904-insights-runtime-extractor-tls podName:43959b97-35ca-4a34-a6a8-9311bec3c904 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:34.861400898 +0000 UTC m=+42.546211734 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43959b97-35ca-4a34-a6a8-9311bec3c904-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fjjh5" (UID: "43959b97-35ca-4a34-a6a8-9311bec3c904") : secret "insights-runtime-extractor-tls" not found Jul 12 08:07:32.861569 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:32.861468 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43959b97-35ca-4a34-a6a8-9311bec3c904-kube-rbac-proxy-cm podName:43959b97-35ca-4a34-a6a8-9311bec3c904 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:34.861453312 +0000 UTC m=+42.546264157 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/43959b97-35ca-4a34-a6a8-9311bec3c904-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fjjh5" (UID: "43959b97-35ca-4a34-a6a8-9311bec3c904") : configmap "kube-rbac-proxy" not found Jul 12 08:07:33.146980 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:33.146886 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n89k8" event={"ID":"e291324a-b2bc-4bc5-b624-80fe7c0e5d7a","Type":"ContainerStarted","Data":"10d3b17f043012b72c84f37713fe2533e0e3ca5b28dfa91ae21ee9d06683b025"} Jul 12 08:07:33.162890 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:33.162831 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n89k8" podStartSLOduration=2.353738084 podStartE2EDuration="5.162811723s" totalImagesPullingTime="2.809073639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:07:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:33.1603255 +0000 UTC m=+40.845136336" watchObservedRunningTime="2026-07-12 08:07:33.162811723 +0000 UTC m=+40.847622584" Jul 12 08:07:33.222048 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:33.222024 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rvmp5_778713dd-51aa-4f02-a6bd-2b3c26d176fc/dns-node-resolver/0.log" Jul 12 08:07:34.423888 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:34.423862 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wz95w_3b886eaf-a1aa-4e73-bf66-d8d0464561dc/node-ca/0.log" Jul 12 08:07:34.875197 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:34.875156 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43959b97-35ca-4a34-a6a8-9311bec3c904-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fjjh5\" (UID: \"43959b97-35ca-4a34-a6a8-9311bec3c904\") " pod="openshift-insights/insights-runtime-extractor-fjjh5" Jul 12 08:07:34.875197 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:34.875204 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43959b97-35ca-4a34-a6a8-9311bec3c904-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fjjh5\" (UID: \"43959b97-35ca-4a34-a6a8-9311bec3c904\") " pod="openshift-insights/insights-runtime-extractor-fjjh5" Jul 12 08:07:34.875428 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:34.875270 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 12 08:07:34.875428 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:34.875297 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 08:07:34.875428 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:34.875329 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43959b97-35ca-4a34-a6a8-9311bec3c904-kube-rbac-proxy-cm podName:43959b97-35ca-4a34-a6a8-9311bec3c904 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:38.875312625 +0000 UTC m=+46.560123461 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/43959b97-35ca-4a34-a6a8-9311bec3c904-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fjjh5" (UID: "43959b97-35ca-4a34-a6a8-9311bec3c904") : configmap "kube-rbac-proxy" not found Jul 12 08:07:34.875428 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:34.875344 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43959b97-35ca-4a34-a6a8-9311bec3c904-insights-runtime-extractor-tls podName:43959b97-35ca-4a34-a6a8-9311bec3c904 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:38.875336339 +0000 UTC m=+46.560147175 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43959b97-35ca-4a34-a6a8-9311bec3c904-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fjjh5" (UID: "43959b97-35ca-4a34-a6a8-9311bec3c904") : secret "insights-runtime-extractor-tls" not found Jul 12 08:07:35.221752 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:35.221679 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n89k8_e291324a-b2bc-4bc5-b624-80fe7c0e5d7a/serve-healthcheck-canary/0.log" Jul 12 08:07:35.882967 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:35.882914 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-tls\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:35.882967 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:35.882972 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46481969-347f-4259-8366-a376f786c9f3-metrics-tls\") pod \"dns-default-wrbsq\" (UID: \"46481969-347f-4259-8366-a376f786c9f3\") " pod="openshift-dns/dns-default-wrbsq" Jul 12 08:07:35.883418 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:35.883069 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 12 08:07:35.883418 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:35.883089 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-548bc455f9-b4kpp: secret "image-registry-tls" not found Jul 12 08:07:35.883418 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:35.883124 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 08:07:35.883418 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:35.883142 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-tls podName:19a67523-00cc-4b3d-a1a9-9eb033293b28 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:43.883126851 +0000 UTC m=+51.567937687 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-tls") pod "image-registry-548bc455f9-b4kpp" (UID: "19a67523-00cc-4b3d-a1a9-9eb033293b28") : secret "image-registry-tls" not found Jul 12 08:07:35.883418 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:35.883175 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46481969-347f-4259-8366-a376f786c9f3-metrics-tls podName:46481969-347f-4259-8366-a376f786c9f3 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:43.883158898 +0000 UTC m=+51.567969733 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/46481969-347f-4259-8366-a376f786c9f3-metrics-tls") pod "dns-default-wrbsq" (UID: "46481969-347f-4259-8366-a376f786c9f3") : secret "dns-default-metrics-tls" not found Jul 12 08:07:38.906275 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:38.906233 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43959b97-35ca-4a34-a6a8-9311bec3c904-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fjjh5\" (UID: \"43959b97-35ca-4a34-a6a8-9311bec3c904\") " pod="openshift-insights/insights-runtime-extractor-fjjh5" Jul 12 08:07:38.906816 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:38.906369 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43959b97-35ca-4a34-a6a8-9311bec3c904-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fjjh5\" (UID: \"43959b97-35ca-4a34-a6a8-9311bec3c904\") " pod="openshift-insights/insights-runtime-extractor-fjjh5" Jul 12 08:07:38.906899 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:38.906868 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43959b97-35ca-4a34-a6a8-9311bec3c904-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fjjh5\" (UID: \"43959b97-35ca-4a34-a6a8-9311bec3c904\") " pod="openshift-insights/insights-runtime-extractor-fjjh5" Jul 12 08:07:38.907086 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:38.907068 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 08:07:38.907161 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:38.907147 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43959b97-35ca-4a34-a6a8-9311bec3c904-insights-runtime-extractor-tls podName:43959b97-35ca-4a34-a6a8-9311bec3c904 nodeName:}" failed. No retries permitted until 2026-07-12 08:07:46.907128284 +0000 UTC m=+54.591939124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43959b97-35ca-4a34-a6a8-9311bec3c904-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fjjh5" (UID: "43959b97-35ca-4a34-a6a8-9311bec3c904") : secret "insights-runtime-extractor-tls" not found Jul 12 08:07:43.946096 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:43.946055 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-tls\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:43.946096 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:43.946101 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46481969-347f-4259-8366-a376f786c9f3-metrics-tls\") pod \"dns-default-wrbsq\" (UID: \"46481969-347f-4259-8366-a376f786c9f3\") " pod="openshift-dns/dns-default-wrbsq" Jul 12 08:07:43.948673 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:43.948647 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/46481969-347f-4259-8366-a376f786c9f3-metrics-tls\") pod \"dns-default-wrbsq\" (UID: \"46481969-347f-4259-8366-a376f786c9f3\") " pod="openshift-dns/dns-default-wrbsq" Jul 12 08:07:43.948785 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:43.948654 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-tls\") pod \"image-registry-548bc455f9-b4kpp\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:43.991672 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:43.991648 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:44.006794 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:44.006774 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wrbsq" Jul 12 08:07:44.140184 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:44.140153 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-548bc455f9-b4kpp"] Jul 12 08:07:44.143381 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:07:44.143347 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a67523_00cc_4b3d_a1a9_9eb033293b28.slice/crio-9efb94958e39c9d909f32afe4c4996cb560f66ac11c2432ec3cb86427af2bcf3 WatchSource:0}: Error finding container 9efb94958e39c9d909f32afe4c4996cb560f66ac11c2432ec3cb86427af2bcf3: Status 404 returned error can't find the container with id 9efb94958e39c9d909f32afe4c4996cb560f66ac11c2432ec3cb86427af2bcf3 Jul 12 08:07:44.155511 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:44.155490 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wrbsq"] Jul 12 08:07:44.158670 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:07:44.158644 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46481969_347f_4259_8366_a376f786c9f3.slice/crio-b661879c07a1307c304d1f0ce58c3f63ec1f79fdefa3a76955e4fcacdc859f73 WatchSource:0}: Error finding container b661879c07a1307c304d1f0ce58c3f63ec1f79fdefa3a76955e4fcacdc859f73: Status 404 returned error can't find the container with id b661879c07a1307c304d1f0ce58c3f63ec1f79fdefa3a76955e4fcacdc859f73 Jul 12 08:07:44.173664 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:44.173637 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wrbsq" event={"ID":"46481969-347f-4259-8366-a376f786c9f3","Type":"ContainerStarted","Data":"b661879c07a1307c304d1f0ce58c3f63ec1f79fdefa3a76955e4fcacdc859f73"} Jul 12 08:07:44.174763 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:44.174740 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" event={"ID":"19a67523-00cc-4b3d-a1a9-9eb033293b28","Type":"ContainerStarted","Data":"9efb94958e39c9d909f32afe4c4996cb560f66ac11c2432ec3cb86427af2bcf3"} Jul 12 08:07:45.178473 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:45.178436 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" event={"ID":"19a67523-00cc-4b3d-a1a9-9eb033293b28","Type":"ContainerStarted","Data":"ea3b7d6a6061e907d74f0fe2caabeb7e082894c201d45cd3339e546c52795eba"} Jul 12 08:07:45.178870 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:45.178546 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:07:45.198461 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:45.198409 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" podStartSLOduration=32.198393645 podStartE2EDuration="32.198393645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:07:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:45.196478678 +0000 UTC m=+52.881289536" watchObservedRunningTime="2026-07-12 08:07:45.198393645 +0000 UTC m=+52.883204503" Jul 12 08:07:46.970019 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:46.969924 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43959b97-35ca-4a34-a6a8-9311bec3c904-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fjjh5\" (UID: \"43959b97-35ca-4a34-a6a8-9311bec3c904\") " pod="openshift-insights/insights-runtime-extractor-fjjh5" Jul 12 08:07:46.972194 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:46.972165 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43959b97-35ca-4a34-a6a8-9311bec3c904-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fjjh5\" (UID: \"43959b97-35ca-4a34-a6a8-9311bec3c904\") " pod="openshift-insights/insights-runtime-extractor-fjjh5" Jul 12 08:07:47.153764 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:47.153729 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fjjh5" Jul 12 08:07:47.191251 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:47.191223 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wrbsq" event={"ID":"46481969-347f-4259-8366-a376f786c9f3","Type":"ContainerStarted","Data":"b172d289de36011ee3ad249a02b915f8f0540fb6309abf8f95e947ff4632053e"} Jul 12 08:07:47.191423 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:47.191301 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wrbsq" event={"ID":"46481969-347f-4259-8366-a376f786c9f3","Type":"ContainerStarted","Data":"bb07cf7399bf233095b7545b280d4d8b4978c5521e283bc96b8005c976b402d5"} Jul 12 08:07:47.191423 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:47.191352 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wrbsq" Jul 12 08:07:47.208646 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:47.208588 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wrbsq" podStartSLOduration=16.674269285 podStartE2EDuration="19.208567046s" totalImagesPullingTime="2.534297761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:07:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:47.207810455 +0000 UTC m=+54.892621314" watchObservedRunningTime="2026-07-12 08:07:47.208567046 +0000 UTC m=+54.893377964" Jul 12 08:07:47.300976 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:47.300949 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fjjh5"] Jul 12 08:07:47.304077 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:07:47.304047 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43959b97_35ca_4a34_a6a8_9311bec3c904.slice/crio-85322722fbce47897970bc6a7169975edeffe9e8a1fc43f93b4b587a0b57b021 WatchSource:0}: Error finding container 85322722fbce47897970bc6a7169975edeffe9e8a1fc43f93b4b587a0b57b021: Status 404 returned error can't find the container with id 85322722fbce47897970bc6a7169975edeffe9e8a1fc43f93b4b587a0b57b021 Jul 12 08:07:48.196892 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:48.196853 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fjjh5" event={"ID":"43959b97-35ca-4a34-a6a8-9311bec3c904","Type":"ContainerStarted","Data":"85322722fbce47897970bc6a7169975edeffe9e8a1fc43f93b4b587a0b57b021"} Jul 12 08:07:51.211475 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:51.211442 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fjjh5" event={"ID":"43959b97-35ca-4a34-a6a8-9311bec3c904","Type":"ContainerStarted","Data":"75ad3907b4ea48ff281c77cdbd2ffc9b2c500b23530f5fb09b4706c7bcef4a50"} Jul 12 08:07:52.220123 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:52.220079 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fjjh5" event={"ID":"43959b97-35ca-4a34-a6a8-9311bec3c904","Type":"ContainerStarted","Data":"ef5410e3681bad0063a0f001108db045afec3cfd5bcd9c4b4125136cb093462f"} Jul 12 08:07:54.121573 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:54.121545 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kd8ct" Jul 12 08:07:55.230985 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:55.230909 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fjjh5" event={"ID":"43959b97-35ca-4a34-a6a8-9311bec3c904","Type":"ContainerStarted","Data":"b8d80eab00d586e5a2c4bc31faf1eaa68a223c7f7f40f29bc37d3b3e0c995c72"} Jul 12 08:07:55.247943 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:55.247889 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fjjh5" podStartSLOduration=17.170569753 podStartE2EDuration="24.247873234s" totalImagesPullingTime="7.077303481s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:07:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:55.247116251 +0000 UTC m=+62.931927132" watchObservedRunningTime="2026-07-12 08:07:55.247873234 +0000 UTC m=+62.932684091" Jul 12 08:07:57.001963 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.001911 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665cdc7994-kzh2x"] Jul 12 08:07:57.004236 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.004216 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-548bc455f9-b4kpp"] Jul 12 08:07:57.004473 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.004442 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665cdc7994-kzh2x" Jul 12 08:07:57.007062 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.007043 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-cj9rp\"" Jul 12 08:07:57.007178 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.007108 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 12 08:07:57.007178 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.007146 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 12 08:07:57.007304 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.007188 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 12 08:07:57.007591 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.007573 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 12 08:07:57.019924 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.019875 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665cdc7994-kzh2x"] Jul 12 08:07:57.046249 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.046215 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6bc1c256-a945-48f0-8aa1-a9b21282e1cd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-665cdc7994-kzh2x\" (UID: \"6bc1c256-a945-48f0-8aa1-a9b21282e1cd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665cdc7994-kzh2x" Jul 12 08:07:57.046249 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.046253 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktzrp\" (UniqueName: \"kubernetes.io/projected/6bc1c256-a945-48f0-8aa1-a9b21282e1cd-kube-api-access-ktzrp\") pod \"managed-serviceaccount-addon-agent-665cdc7994-kzh2x\" (UID: \"6bc1c256-a945-48f0-8aa1-a9b21282e1cd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665cdc7994-kzh2x" Jul 12 08:07:57.100453 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.100422 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54cdcdcd88-vr4mf"] Jul 12 08:07:57.102172 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.102156 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:57.114098 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.114076 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54cdcdcd88-vr4mf"] Jul 12 08:07:57.146898 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.146863 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/62b60b7a-84e3-4502-997a-e238c1862381-installation-pull-secrets\") pod \"image-registry-54cdcdcd88-vr4mf\" (UID: \"62b60b7a-84e3-4502-997a-e238c1862381\") " pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:57.147139 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.146912 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/62b60b7a-84e3-4502-997a-e238c1862381-registry-tls\") pod \"image-registry-54cdcdcd88-vr4mf\" (UID: \"62b60b7a-84e3-4502-997a-e238c1862381\") " pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:57.147139 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.146949 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6bc1c256-a945-48f0-8aa1-a9b21282e1cd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-665cdc7994-kzh2x\" (UID: \"6bc1c256-a945-48f0-8aa1-a9b21282e1cd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665cdc7994-kzh2x" Jul 12 08:07:57.147139 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.146970 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62b60b7a-84e3-4502-997a-e238c1862381-bound-sa-token\") pod \"image-registry-54cdcdcd88-vr4mf\" (UID: \"62b60b7a-84e3-4502-997a-e238c1862381\") " pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:57.147139 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.147009 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/62b60b7a-84e3-4502-997a-e238c1862381-trusted-ca\") pod \"image-registry-54cdcdcd88-vr4mf\" (UID: \"62b60b7a-84e3-4502-997a-e238c1862381\") " pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:57.147139 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.147043 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/62b60b7a-84e3-4502-997a-e238c1862381-image-registry-private-configuration\") pod \"image-registry-54cdcdcd88-vr4mf\" (UID: \"62b60b7a-84e3-4502-997a-e238c1862381\") " pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:57.147139 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.147091 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/62b60b7a-84e3-4502-997a-e238c1862381-registry-certificates\") pod \"image-registry-54cdcdcd88-vr4mf\" (UID: \"62b60b7a-84e3-4502-997a-e238c1862381\") " pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:57.147139 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.147131 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktzrp\" (UniqueName: \"kubernetes.io/projected/6bc1c256-a945-48f0-8aa1-a9b21282e1cd-kube-api-access-ktzrp\") pod \"managed-serviceaccount-addon-agent-665cdc7994-kzh2x\" (UID: \"6bc1c256-a945-48f0-8aa1-a9b21282e1cd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665cdc7994-kzh2x" Jul 12 08:07:57.147457 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.147147 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jp4c\" (UniqueName: \"kubernetes.io/projected/62b60b7a-84e3-4502-997a-e238c1862381-kube-api-access-8jp4c\") pod \"image-registry-54cdcdcd88-vr4mf\" (UID: \"62b60b7a-84e3-4502-997a-e238c1862381\") " pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:57.147457 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.147166 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/62b60b7a-84e3-4502-997a-e238c1862381-ca-trust-extracted\") pod \"image-registry-54cdcdcd88-vr4mf\" (UID: \"62b60b7a-84e3-4502-997a-e238c1862381\") " pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:57.149358 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.149337 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6bc1c256-a945-48f0-8aa1-a9b21282e1cd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-665cdc7994-kzh2x\" (UID: \"6bc1c256-a945-48f0-8aa1-a9b21282e1cd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665cdc7994-kzh2x" Jul 12 08:07:57.156565 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.156542 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktzrp\" (UniqueName: \"kubernetes.io/projected/6bc1c256-a945-48f0-8aa1-a9b21282e1cd-kube-api-access-ktzrp\") pod \"managed-serviceaccount-addon-agent-665cdc7994-kzh2x\" (UID: \"6bc1c256-a945-48f0-8aa1-a9b21282e1cd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665cdc7994-kzh2x" Jul 12 08:07:57.199287 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.199256 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wrbsq" Jul 12 08:07:57.248138 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.248103 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jp4c\" (UniqueName: \"kubernetes.io/projected/62b60b7a-84e3-4502-997a-e238c1862381-kube-api-access-8jp4c\") pod \"image-registry-54cdcdcd88-vr4mf\" (UID: \"62b60b7a-84e3-4502-997a-e238c1862381\") " pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:57.248138 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.248138 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/62b60b7a-84e3-4502-997a-e238c1862381-ca-trust-extracted\") pod \"image-registry-54cdcdcd88-vr4mf\" (UID: \"62b60b7a-84e3-4502-997a-e238c1862381\") " pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:57.248387 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.248159 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/62b60b7a-84e3-4502-997a-e238c1862381-installation-pull-secrets\") pod \"image-registry-54cdcdcd88-vr4mf\" (UID: \"62b60b7a-84e3-4502-997a-e238c1862381\") " pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:57.248387 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.248190 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/62b60b7a-84e3-4502-997a-e238c1862381-registry-tls\") pod \"image-registry-54cdcdcd88-vr4mf\" (UID: \"62b60b7a-84e3-4502-997a-e238c1862381\") " pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:57.248387 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.248209 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62b60b7a-84e3-4502-997a-e238c1862381-bound-sa-token\") pod \"image-registry-54cdcdcd88-vr4mf\" (UID: \"62b60b7a-84e3-4502-997a-e238c1862381\") " pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:57.248387 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.248231 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/62b60b7a-84e3-4502-997a-e238c1862381-trusted-ca\") pod \"image-registry-54cdcdcd88-vr4mf\" (UID: \"62b60b7a-84e3-4502-997a-e238c1862381\") " pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:57.248387 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.248248 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/62b60b7a-84e3-4502-997a-e238c1862381-image-registry-private-configuration\") pod \"image-registry-54cdcdcd88-vr4mf\" (UID: \"62b60b7a-84e3-4502-997a-e238c1862381\") " pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:57.248658 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.248626 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/62b60b7a-84e3-4502-997a-e238c1862381-ca-trust-extracted\") pod \"image-registry-54cdcdcd88-vr4mf\" (UID: \"62b60b7a-84e3-4502-997a-e238c1862381\") " pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:57.249231 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.249197 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/62b60b7a-84e3-4502-997a-e238c1862381-registry-certificates\") pod \"image-registry-54cdcdcd88-vr4mf\" (UID: \"62b60b7a-84e3-4502-997a-e238c1862381\") " pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:57.249740 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.249716 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/62b60b7a-84e3-4502-997a-e238c1862381-trusted-ca\") pod \"image-registry-54cdcdcd88-vr4mf\" (UID: \"62b60b7a-84e3-4502-997a-e238c1862381\") " pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:57.249943 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.249912 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/62b60b7a-84e3-4502-997a-e238c1862381-registry-certificates\") pod \"image-registry-54cdcdcd88-vr4mf\" (UID: \"62b60b7a-84e3-4502-997a-e238c1862381\") " pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:57.250763 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.250740 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/62b60b7a-84e3-4502-997a-e238c1862381-image-registry-private-configuration\") pod \"image-registry-54cdcdcd88-vr4mf\" (UID: \"62b60b7a-84e3-4502-997a-e238c1862381\") " pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:57.250864 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.250746 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/62b60b7a-84e3-4502-997a-e238c1862381-registry-tls\") pod \"image-registry-54cdcdcd88-vr4mf\" (UID: \"62b60b7a-84e3-4502-997a-e238c1862381\") " pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:57.250864 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.250789 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/62b60b7a-84e3-4502-997a-e238c1862381-installation-pull-secrets\") pod \"image-registry-54cdcdcd88-vr4mf\" (UID: \"62b60b7a-84e3-4502-997a-e238c1862381\") " pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:57.260546 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.260515 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62b60b7a-84e3-4502-997a-e238c1862381-bound-sa-token\") pod \"image-registry-54cdcdcd88-vr4mf\" (UID: \"62b60b7a-84e3-4502-997a-e238c1862381\") " pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:57.260679 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.260660 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jp4c\" (UniqueName: \"kubernetes.io/projected/62b60b7a-84e3-4502-997a-e238c1862381-kube-api-access-8jp4c\") pod \"image-registry-54cdcdcd88-vr4mf\" (UID: \"62b60b7a-84e3-4502-997a-e238c1862381\") " pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:57.324021 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.323990 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665cdc7994-kzh2x" Jul 12 08:07:57.410082 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.410049 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:57.443561 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.443530 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665cdc7994-kzh2x"] Jul 12 08:07:57.447155 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:07:57.447133 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bc1c256_a945_48f0_8aa1_a9b21282e1cd.slice/crio-e6314fc1a9cc29466865f5b399bcc03fc3804bd767433b4920b4b03b474d84bd WatchSource:0}: Error finding container e6314fc1a9cc29466865f5b399bcc03fc3804bd767433b4920b4b03b474d84bd: Status 404 returned error can't find the container with id e6314fc1a9cc29466865f5b399bcc03fc3804bd767433b4920b4b03b474d84bd Jul 12 08:07:57.538717 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:57.538629 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54cdcdcd88-vr4mf"] Jul 12 08:07:57.545019 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:07:57.544994 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62b60b7a_84e3_4502_997a_e238c1862381.slice/crio-b56c29f0daa0f06be56b667e7fc54427e68116ca4439a37d0e3772c241edff9a WatchSource:0}: Error finding container b56c29f0daa0f06be56b667e7fc54427e68116ca4439a37d0e3772c241edff9a: Status 404 returned error can't find the container with id b56c29f0daa0f06be56b667e7fc54427e68116ca4439a37d0e3772c241edff9a Jul 12 08:07:58.242578 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:58.242529 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" event={"ID":"62b60b7a-84e3-4502-997a-e238c1862381","Type":"ContainerStarted","Data":"980e835cf5330eab30dc5ad45c58705e58ccfa147edbad0bab4f7098b393d8f5"} Jul 12 08:07:58.243117 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:58.242602 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" event={"ID":"62b60b7a-84e3-4502-997a-e238c1862381","Type":"ContainerStarted","Data":"b56c29f0daa0f06be56b667e7fc54427e68116ca4439a37d0e3772c241edff9a"} Jul 12 08:07:58.243117 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:58.242666 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:07:58.244114 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:58.244087 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665cdc7994-kzh2x" event={"ID":"6bc1c256-a945-48f0-8aa1-a9b21282e1cd","Type":"ContainerStarted","Data":"e6314fc1a9cc29466865f5b399bcc03fc3804bd767433b4920b4b03b474d84bd"} Jul 12 08:07:58.263485 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:58.263438 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" podStartSLOduration=1.263422584 podStartE2EDuration="1.263422584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:07:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:07:58.261481898 +0000 UTC m=+65.946292758" watchObservedRunningTime="2026-07-12 08:07:58.263422584 +0000 UTC m=+65.948233441" Jul 12 08:07:58.661823 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:58.661779 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/353ad383-9095-4c48-b3c8-5011b5519c48-original-pull-secret\") pod \"global-pull-secret-syncer-hl94f\" (UID: \"353ad383-9095-4c48-b3c8-5011b5519c48\") " pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:07:58.662033 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:58.661879 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-metrics-certs\") pod \"network-metrics-daemon-bnfwz\" (UID: \"fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f\") " pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:07:58.664438 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:58.664411 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 12 08:07:58.664556 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:58.664446 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 12 08:07:58.674960 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:58.674919 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/353ad383-9095-4c48-b3c8-5011b5519c48-original-pull-secret\") pod \"global-pull-secret-syncer-hl94f\" (UID: \"353ad383-9095-4c48-b3c8-5011b5519c48\") " pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:07:58.674960 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:58.674952 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f-metrics-certs\") pod \"network-metrics-daemon-bnfwz\" (UID: \"fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f\") " pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:07:58.762950 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:58.762894 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxs5v\" (UniqueName: \"kubernetes.io/projected/6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c-kube-api-access-nxs5v\") pod \"network-check-target-j4nh6\" (UID: \"6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c\") " pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:07:58.765386 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:58.765363 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 12 08:07:58.775206 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:58.775182 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 12 08:07:58.786852 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:58.786828 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxs5v\" (UniqueName: \"kubernetes.io/projected/6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c-kube-api-access-nxs5v\") pod \"network-check-target-j4nh6\" (UID: \"6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c\") " pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:07:58.858083 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:58.858056 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xxbfq\"" Jul 12 08:07:58.864378 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:58.864338 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rkfrj\"" Jul 12 08:07:58.866327 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:58.866308 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:07:58.868613 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:58.868595 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hl94f" Jul 12 08:07:58.873065 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:58.873050 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bnfwz" Jul 12 08:07:59.529750 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:59.529712 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j4nh6"] Jul 12 08:07:59.533151 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:07:59.533093 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c0e84f8_d60c_42e6_b8ac_89ba8d814b8c.slice/crio-c87f45387a28aae39f5f566470f791e9b2f216ecd641d537553b143bc8883b37 WatchSource:0}: Error finding container c87f45387a28aae39f5f566470f791e9b2f216ecd641d537553b143bc8883b37: Status 404 returned error can't find the container with id c87f45387a28aae39f5f566470f791e9b2f216ecd641d537553b143bc8883b37 Jul 12 08:07:59.566136 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:59.566104 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-98xwj"] Jul 12 08:07:59.568825 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:59.568805 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-98xwj" Jul 12 08:07:59.571525 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:59.571504 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-ttzql\"" Jul 12 08:07:59.571627 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:59.571539 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 12 08:07:59.571627 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:59.571542 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 12 08:07:59.579918 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:59.579897 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-98xwj"] Jul 12 08:07:59.668600 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:59.668517 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft4q2\" (UniqueName: \"kubernetes.io/projected/a28b88f7-0a6d-455e-9f0a-eb03ba20cbdc-kube-api-access-ft4q2\") pod \"downloads-68c9cbb497-98xwj\" (UID: \"a28b88f7-0a6d-455e-9f0a-eb03ba20cbdc\") " pod="openshift-console/downloads-68c9cbb497-98xwj" Jul 12 08:07:59.756805 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:59.756772 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hl94f"] Jul 12 08:07:59.757751 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:59.757659 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bnfwz"] Jul 12 08:07:59.759637 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:07:59.759593 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa986cb0_0dc4_4fe1_9cf8_bbe8f5394c7f.slice/crio-692bafe66a698ffd433219f30df702058f1e39bc4de8d6e8df74a9edb7748e45 WatchSource:0}: Error finding container 692bafe66a698ffd433219f30df702058f1e39bc4de8d6e8df74a9edb7748e45: Status 404 returned error can't find the container with id 692bafe66a698ffd433219f30df702058f1e39bc4de8d6e8df74a9edb7748e45 Jul 12 08:07:59.760489 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:07:59.760464 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod353ad383_9095_4c48_b3c8_5011b5519c48.slice/crio-7e23203d3758dbca3cf7c33ed608176bf43bcceebad20221a7bc247dfa245672 WatchSource:0}: Error finding container 7e23203d3758dbca3cf7c33ed608176bf43bcceebad20221a7bc247dfa245672: Status 404 returned error can't find the container with id 7e23203d3758dbca3cf7c33ed608176bf43bcceebad20221a7bc247dfa245672 Jul 12 08:07:59.769042 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:59.769022 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft4q2\" (UniqueName: \"kubernetes.io/projected/a28b88f7-0a6d-455e-9f0a-eb03ba20cbdc-kube-api-access-ft4q2\") pod \"downloads-68c9cbb497-98xwj\" (UID: \"a28b88f7-0a6d-455e-9f0a-eb03ba20cbdc\") " pod="openshift-console/downloads-68c9cbb497-98xwj" Jul 12 08:07:59.776208 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:59.776168 2576 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: writing blob: storing blob to file \"/var/tmp/container_images_storage2452855360/1\": happened during read: unexpected EOF (while reconnecting: Get \"https://cdn01.quay.io/quayio-production-s3/sha256/e1/e17f05d1f8b2f515954250c3c32c313998badd0cfe4355c10908c8d74bcede8d?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260712%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260712T080759Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=ac525d4ed21e186a99058eb2573cbab3639ff072db1e41d715d7228721cb4e39®ion=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=multicluster-engine----managed-serviceaccount-rhel9&akamai_signature=exp=1783844579~hmac=30bdacd43f1bfa87cbe1c1a43f9d62c299275fb4bb245325e7029d9def7df227\": EOF); artifact err: provided artifact is a container image" image="registry.redhat.io/multicluster-engine/managed-serviceaccount-rhel9@sha256:6270079008ddaa493b09474324185a9224c3662bd93826c447f03f09cdd49a72" Jul 12 08:07:59.776308 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:59.776285 2576 kuberuntime_manager.go:1459] "Unhandled Error" err="container addon-agent start failed in pod managed-serviceaccount-addon-agent-665cdc7994-kzh2x_open-cluster-management-agent-addon(6bc1c256-a945-48f0-8aa1-a9b21282e1cd): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: writing blob: storing blob to file \"/var/tmp/container_images_storage2452855360/1\": happened during read: unexpected EOF (while reconnecting: Get \"https://cdn01.quay.io/quayio-production-s3/sha256/e1/e17f05d1f8b2f515954250c3c32c313998badd0cfe4355c10908c8d74bcede8d?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260712%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260712T080759Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=ac525d4ed21e186a99058eb2573cbab3639ff072db1e41d715d7228721cb4e39®ion=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=multicluster-engine----managed-serviceaccount-rhel9&akamai_signature=exp=1783844579~hmac=30bdacd43f1bfa87cbe1c1a43f9d62c299275fb4bb245325e7029d9def7df227\": EOF); artifact err: provided artifact is a container image" logger="UnhandledError" Jul 12 08:07:59.776379 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:07:59.776338 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: writing blob: storing blob to file \\\"/var/tmp/container_images_storage2452855360/1\\\": happened during read: unexpected EOF (while reconnecting: Get \\\"https://cdn01.quay.io/quayio-production-s3/sha256/e1/e17f05d1f8b2f515954250c3c32c313998badd0cfe4355c10908c8d74bcede8d?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260712%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260712T080759Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=ac525d4ed21e186a99058eb2573cbab3639ff072db1e41d715d7228721cb4e39®ion=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=multicluster-engine----managed-serviceaccount-rhel9&akamai_signature=exp=1783844579~hmac=30bdacd43f1bfa87cbe1c1a43f9d62c299275fb4bb245325e7029d9def7df227\\\": EOF); artifact err: provided artifact is a container image\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665cdc7994-kzh2x" podUID="6bc1c256-a945-48f0-8aa1-a9b21282e1cd" Jul 12 08:07:59.776854 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:59.776836 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft4q2\" (UniqueName: \"kubernetes.io/projected/a28b88f7-0a6d-455e-9f0a-eb03ba20cbdc-kube-api-access-ft4q2\") pod \"downloads-68c9cbb497-98xwj\" (UID: \"a28b88f7-0a6d-455e-9f0a-eb03ba20cbdc\") " pod="openshift-console/downloads-68c9cbb497-98xwj" Jul 12 08:07:59.878026 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:07:59.877987 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-98xwj" Jul 12 08:08:00.001694 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:00.001662 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-98xwj"] Jul 12 08:08:00.005414 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:08:00.005389 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda28b88f7_0a6d_455e_9f0a_eb03ba20cbdc.slice/crio-6a4663d93df29bd33e30eb98aa5421ae2f3116a8d5e18c10d29184b5ce6d72dd WatchSource:0}: Error finding container 6a4663d93df29bd33e30eb98aa5421ae2f3116a8d5e18c10d29184b5ce6d72dd: Status 404 returned error can't find the container with id 6a4663d93df29bd33e30eb98aa5421ae2f3116a8d5e18c10d29184b5ce6d72dd Jul 12 08:08:00.256136 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:00.256051 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hl94f" event={"ID":"353ad383-9095-4c48-b3c8-5011b5519c48","Type":"ContainerStarted","Data":"7e23203d3758dbca3cf7c33ed608176bf43bcceebad20221a7bc247dfa245672"} Jul 12 08:08:00.257451 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:00.257419 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-98xwj" event={"ID":"a28b88f7-0a6d-455e-9f0a-eb03ba20cbdc","Type":"ContainerStarted","Data":"6a4663d93df29bd33e30eb98aa5421ae2f3116a8d5e18c10d29184b5ce6d72dd"} Jul 12 08:08:00.259109 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:00.259021 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bnfwz" event={"ID":"fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f","Type":"ContainerStarted","Data":"692bafe66a698ffd433219f30df702058f1e39bc4de8d6e8df74a9edb7748e45"} Jul 12 08:08:00.261436 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:00.261345 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j4nh6" event={"ID":"6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c","Type":"ContainerStarted","Data":"c87f45387a28aae39f5f566470f791e9b2f216ecd641d537553b143bc8883b37"} Jul 12 08:08:00.262418 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:08:00.262374 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/managed-serviceaccount-rhel9@sha256:6270079008ddaa493b09474324185a9224c3662bd93826c447f03f09cdd49a72\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: writing blob: storing blob to file \\\"/var/tmp/container_images_storage2452855360/1\\\": happened during read: unexpected EOF (while reconnecting: Get \\\"https://cdn01.quay.io/quayio-production-s3/sha256/e1/e17f05d1f8b2f515954250c3c32c313998badd0cfe4355c10908c8d74bcede8d?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260712%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260712T080759Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=ac525d4ed21e186a99058eb2573cbab3639ff072db1e41d715d7228721cb4e39®ion=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=multicluster-engine----managed-serviceaccount-rhel9&akamai_signature=exp=1783844579~hmac=30bdacd43f1bfa87cbe1c1a43f9d62c299275fb4bb245325e7029d9def7df227\\\": EOF); artifact err: provided artifact is a container image\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665cdc7994-kzh2x" podUID="6bc1c256-a945-48f0-8aa1-a9b21282e1cd" Jul 12 08:08:01.268954 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:01.268486 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bnfwz" event={"ID":"fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f","Type":"ContainerStarted","Data":"167e0fe2ce2df9bdb9f2c1764721498d8cd967cc1210eb87b5c5032d82f79286"} Jul 12 08:08:01.268954 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:01.268552 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bnfwz" event={"ID":"fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f","Type":"ContainerStarted","Data":"613a693f8708a7c808cbe3ad18d349b703560df4afff7f2da125172ed83d5745"} Jul 12 08:08:01.286405 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:01.286331 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bnfwz" podStartSLOduration=67.116819229 podStartE2EDuration="1m8.286311785s" totalImagesPullingTime="1.169492556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:08:01.283242614 +0000 UTC m=+68.968053473" watchObservedRunningTime="2026-07-12 08:08:01.286311785 +0000 UTC m=+68.971122643" Jul 12 08:08:04.057706 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:04.057670 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-w64qx"] Jul 12 08:08:04.071979 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:04.071327 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-w64qx" Jul 12 08:08:04.072621 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:04.072590 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-w64qx"] Jul 12 08:08:04.074302 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:04.074280 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 12 08:08:04.075669 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:04.075636 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 12 08:08:04.075767 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:04.075711 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7bp76\"" Jul 12 08:08:04.076073 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:04.075902 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 12 08:08:04.076073 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:04.075956 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 12 08:08:04.076227 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:04.076176 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 12 08:08:04.210073 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:04.210035 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/205176ff-afa8-4166-98af-968c7fb79620-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-w64qx\" (UID: \"205176ff-afa8-4166-98af-968c7fb79620\") " pod="openshift-monitoring/prometheus-operator-64785b6675-w64qx" Jul 12 08:08:04.210268 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:04.210086 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/205176ff-afa8-4166-98af-968c7fb79620-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-w64qx\" (UID: \"205176ff-afa8-4166-98af-968c7fb79620\") " pod="openshift-monitoring/prometheus-operator-64785b6675-w64qx" Jul 12 08:08:04.210268 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:04.210130 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2pcg\" (UniqueName: \"kubernetes.io/projected/205176ff-afa8-4166-98af-968c7fb79620-kube-api-access-f2pcg\") pod \"prometheus-operator-64785b6675-w64qx\" (UID: \"205176ff-afa8-4166-98af-968c7fb79620\") " pod="openshift-monitoring/prometheus-operator-64785b6675-w64qx" Jul 12 08:08:04.210268 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:04.210160 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/205176ff-afa8-4166-98af-968c7fb79620-metrics-client-ca\") pod \"prometheus-operator-64785b6675-w64qx\" (UID: \"205176ff-afa8-4166-98af-968c7fb79620\") " pod="openshift-monitoring/prometheus-operator-64785b6675-w64qx" Jul 12 08:08:04.310900 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:04.310808 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/205176ff-afa8-4166-98af-968c7fb79620-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-w64qx\" (UID: \"205176ff-afa8-4166-98af-968c7fb79620\") " pod="openshift-monitoring/prometheus-operator-64785b6675-w64qx" Jul 12 08:08:04.310900 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:04.310850 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2pcg\" (UniqueName: \"kubernetes.io/projected/205176ff-afa8-4166-98af-968c7fb79620-kube-api-access-f2pcg\") pod \"prometheus-operator-64785b6675-w64qx\" (UID: \"205176ff-afa8-4166-98af-968c7fb79620\") " pod="openshift-monitoring/prometheus-operator-64785b6675-w64qx" Jul 12 08:08:04.310900 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:04.310874 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/205176ff-afa8-4166-98af-968c7fb79620-metrics-client-ca\") pod \"prometheus-operator-64785b6675-w64qx\" (UID: \"205176ff-afa8-4166-98af-968c7fb79620\") " pod="openshift-monitoring/prometheus-operator-64785b6675-w64qx" Jul 12 08:08:04.311193 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:04.310925 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/205176ff-afa8-4166-98af-968c7fb79620-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-w64qx\" (UID: \"205176ff-afa8-4166-98af-968c7fb79620\") " pod="openshift-monitoring/prometheus-operator-64785b6675-w64qx" Jul 12 08:08:04.311193 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:08:04.311002 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 12 08:08:04.311193 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:08:04.311086 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/205176ff-afa8-4166-98af-968c7fb79620-prometheus-operator-tls podName:205176ff-afa8-4166-98af-968c7fb79620 nodeName:}" failed. No retries permitted until 2026-07-12 08:08:04.811062277 +0000 UTC m=+72.495873129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/205176ff-afa8-4166-98af-968c7fb79620-prometheus-operator-tls") pod "prometheus-operator-64785b6675-w64qx" (UID: "205176ff-afa8-4166-98af-968c7fb79620") : secret "prometheus-operator-tls" not found Jul 12 08:08:04.311804 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:04.311753 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/205176ff-afa8-4166-98af-968c7fb79620-metrics-client-ca\") pod \"prometheus-operator-64785b6675-w64qx\" (UID: \"205176ff-afa8-4166-98af-968c7fb79620\") " pod="openshift-monitoring/prometheus-operator-64785b6675-w64qx" Jul 12 08:08:04.313871 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:04.313829 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/205176ff-afa8-4166-98af-968c7fb79620-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-w64qx\" (UID: \"205176ff-afa8-4166-98af-968c7fb79620\") " pod="openshift-monitoring/prometheus-operator-64785b6675-w64qx" Jul 12 08:08:04.323125 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:04.323076 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2pcg\" (UniqueName: \"kubernetes.io/projected/205176ff-afa8-4166-98af-968c7fb79620-kube-api-access-f2pcg\") pod \"prometheus-operator-64785b6675-w64qx\" (UID: \"205176ff-afa8-4166-98af-968c7fb79620\") " pod="openshift-monitoring/prometheus-operator-64785b6675-w64qx" Jul 12 08:08:04.814341 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:04.814291 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/205176ff-afa8-4166-98af-968c7fb79620-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-w64qx\" (UID: \"205176ff-afa8-4166-98af-968c7fb79620\") " pod="openshift-monitoring/prometheus-operator-64785b6675-w64qx" Jul 12 08:08:04.814522 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:08:04.814467 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 12 08:08:04.814579 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:08:04.814547 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/205176ff-afa8-4166-98af-968c7fb79620-prometheus-operator-tls podName:205176ff-afa8-4166-98af-968c7fb79620 nodeName:}" failed. No retries permitted until 2026-07-12 08:08:05.814524233 +0000 UTC m=+73.499335068 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/205176ff-afa8-4166-98af-968c7fb79620-prometheus-operator-tls") pod "prometheus-operator-64785b6675-w64qx" (UID: "205176ff-afa8-4166-98af-968c7fb79620") : secret "prometheus-operator-tls" not found Jul 12 08:08:05.287491 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:05.287219 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j4nh6" event={"ID":"6c0e84f8-d60c-42e6-b8ac-89ba8d814b8c","Type":"ContainerStarted","Data":"74f8f71b1628041e976e3be647aea552526d5cce010dbfb850699e56fcf7a768"} Jul 12 08:08:05.287491 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:05.287286 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:08:05.289129 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:05.289099 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hl94f" event={"ID":"353ad383-9095-4c48-b3c8-5011b5519c48","Type":"ContainerStarted","Data":"07111f45763b329e97c03ed807dcabf7f20e29bbb0dcddde0497b1293d6907cb"} Jul 12 08:08:05.306823 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:05.306778 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-j4nh6" podStartSLOduration=66.790253568 podStartE2EDuration="1m12.306763557s" totalImagesPullingTime="5.516509989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:08:05.306056703 +0000 UTC m=+72.990867566" watchObservedRunningTime="2026-07-12 08:08:05.306763557 +0000 UTC m=+72.991574414" Jul 12 08:08:05.324867 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:05.324778 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hl94f" podStartSLOduration=67.031346824 podStartE2EDuration="1m12.324759605s" totalImagesPullingTime="5.293412781s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:08:05.323218996 +0000 UTC m=+73.008029853" watchObservedRunningTime="2026-07-12 08:08:05.324759605 +0000 UTC m=+73.009570465" Jul 12 08:08:05.822023 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:05.821983 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/205176ff-afa8-4166-98af-968c7fb79620-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-w64qx\" (UID: \"205176ff-afa8-4166-98af-968c7fb79620\") " pod="openshift-monitoring/prometheus-operator-64785b6675-w64qx" Jul 12 08:08:05.824449 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:05.824419 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/205176ff-afa8-4166-98af-968c7fb79620-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-w64qx\" (UID: \"205176ff-afa8-4166-98af-968c7fb79620\") " pod="openshift-monitoring/prometheus-operator-64785b6675-w64qx" Jul 12 08:08:05.883768 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:05.883745 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-w64qx" Jul 12 08:08:06.020784 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:06.020755 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-w64qx"] Jul 12 08:08:06.024352 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:08:06.024323 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod205176ff_afa8_4166_98af_968c7fb79620.slice/crio-976109b33aef97f513a966fc8d2c37cd525bea04b740396ae4367fb27cc409ad WatchSource:0}: Error finding container 976109b33aef97f513a966fc8d2c37cd525bea04b740396ae4367fb27cc409ad: Status 404 returned error can't find the container with id 976109b33aef97f513a966fc8d2c37cd525bea04b740396ae4367fb27cc409ad Jul 12 08:08:06.294471 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:06.294435 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-w64qx" event={"ID":"205176ff-afa8-4166-98af-968c7fb79620","Type":"ContainerStarted","Data":"976109b33aef97f513a966fc8d2c37cd525bea04b740396ae4367fb27cc409ad"} Jul 12 08:08:07.011447 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:07.011412 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:08:08.306691 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:08.306650 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-w64qx" event={"ID":"205176ff-afa8-4166-98af-968c7fb79620","Type":"ContainerStarted","Data":"034bf3319af5df99e73543bca9a88a15235df9e55a5c92580c650468dcfb73ee"} Jul 12 08:08:08.307223 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:08.306710 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-w64qx" event={"ID":"205176ff-afa8-4166-98af-968c7fb79620","Type":"ContainerStarted","Data":"19dd5b5a0a9ad48c2ef98675dfa72e421f9a85808ee2a45c37b0ade4b6720618"} Jul 12 08:08:08.323626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:08.323570 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-w64qx" podStartSLOduration=2.944698301 podStartE2EDuration="4.323552293s" totalImagesPullingTime="1.378853992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:08:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:08:08.321191866 +0000 UTC m=+76.006002751" watchObservedRunningTime="2026-07-12 08:08:08.323552293 +0000 UTC m=+76.008363130" Jul 12 08:08:09.282531 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.282492 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5454fff6d5-brcsw"] Jul 12 08:08:09.284737 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.284711 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5454fff6d5-brcsw" Jul 12 08:08:09.288149 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.288039 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 12 08:08:09.288149 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.288046 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 12 08:08:09.288149 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.288083 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 12 08:08:09.288149 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.288108 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 12 08:08:09.288149 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.288123 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rw7h5\"" Jul 12 08:08:09.288517 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.288177 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 12 08:08:09.295188 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.295137 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5454fff6d5-brcsw"] Jul 12 08:08:09.352002 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.351960 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-oauth-serving-cert\") pod \"console-5454fff6d5-brcsw\" (UID: \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\") " pod="openshift-console/console-5454fff6d5-brcsw" Jul 12 08:08:09.352002 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.352007 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9lzm\" (UniqueName: \"kubernetes.io/projected/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-kube-api-access-l9lzm\") pod \"console-5454fff6d5-brcsw\" (UID: \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\") " pod="openshift-console/console-5454fff6d5-brcsw" Jul 12 08:08:09.352483 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.352043 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-console-config\") pod \"console-5454fff6d5-brcsw\" (UID: \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\") " pod="openshift-console/console-5454fff6d5-brcsw" Jul 12 08:08:09.352483 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.352072 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-console-oauth-config\") pod \"console-5454fff6d5-brcsw\" (UID: \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\") " pod="openshift-console/console-5454fff6d5-brcsw" Jul 12 08:08:09.352483 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.352096 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-console-serving-cert\") pod \"console-5454fff6d5-brcsw\" (UID: \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\") " pod="openshift-console/console-5454fff6d5-brcsw" Jul 12 08:08:09.352483 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.352160 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-service-ca\") pod \"console-5454fff6d5-brcsw\" (UID: \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\") " pod="openshift-console/console-5454fff6d5-brcsw" Jul 12 08:08:09.453276 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.453236 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-service-ca\") pod \"console-5454fff6d5-brcsw\" (UID: \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\") " pod="openshift-console/console-5454fff6d5-brcsw" Jul 12 08:08:09.453487 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.453293 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-oauth-serving-cert\") pod \"console-5454fff6d5-brcsw\" (UID: \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\") " pod="openshift-console/console-5454fff6d5-brcsw" Jul 12 08:08:09.453558 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.453486 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9lzm\" (UniqueName: \"kubernetes.io/projected/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-kube-api-access-l9lzm\") pod \"console-5454fff6d5-brcsw\" (UID: \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\") " pod="openshift-console/console-5454fff6d5-brcsw" Jul 12 08:08:09.453616 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.453568 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-console-config\") pod \"console-5454fff6d5-brcsw\" (UID: \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\") " pod="openshift-console/console-5454fff6d5-brcsw" Jul 12 08:08:09.453616 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.453596 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-console-oauth-config\") pod \"console-5454fff6d5-brcsw\" (UID: \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\") " pod="openshift-console/console-5454fff6d5-brcsw" Jul 12 08:08:09.453730 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.453638 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-console-serving-cert\") pod \"console-5454fff6d5-brcsw\" (UID: \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\") " pod="openshift-console/console-5454fff6d5-brcsw" Jul 12 08:08:09.454123 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.454099 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-oauth-serving-cert\") pod \"console-5454fff6d5-brcsw\" (UID: \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\") " pod="openshift-console/console-5454fff6d5-brcsw" Jul 12 08:08:09.454197 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.454108 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-service-ca\") pod \"console-5454fff6d5-brcsw\" (UID: \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\") " pod="openshift-console/console-5454fff6d5-brcsw" Jul 12 08:08:09.454257 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.454237 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-console-config\") pod \"console-5454fff6d5-brcsw\" (UID: \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\") " pod="openshift-console/console-5454fff6d5-brcsw" Jul 12 08:08:09.455925 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.455905 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-console-serving-cert\") pod \"console-5454fff6d5-brcsw\" (UID: \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\") " pod="openshift-console/console-5454fff6d5-brcsw" Jul 12 08:08:09.456025 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.455994 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-console-oauth-config\") pod \"console-5454fff6d5-brcsw\" (UID: \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\") " pod="openshift-console/console-5454fff6d5-brcsw" Jul 12 08:08:09.461581 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.461562 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9lzm\" (UniqueName: \"kubernetes.io/projected/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-kube-api-access-l9lzm\") pod \"console-5454fff6d5-brcsw\" (UID: \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\") " pod="openshift-console/console-5454fff6d5-brcsw" Jul 12 08:08:09.595921 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.595823 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5454fff6d5-brcsw" Jul 12 08:08:09.734552 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:09.734517 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5454fff6d5-brcsw"] Jul 12 08:08:09.738205 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:08:09.738175 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode81c68f9_a3a3_4fea_b3f1_bd59957eb53c.slice/crio-f8ff7ba705604c641aafc36d742e35d9a37970e88dddc06430e162e490c20579 WatchSource:0}: Error finding container f8ff7ba705604c641aafc36d742e35d9a37970e88dddc06430e162e490c20579: Status 404 returned error can't find the container with id f8ff7ba705604c641aafc36d742e35d9a37970e88dddc06430e162e490c20579 Jul 12 08:08:10.315370 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.315334 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5454fff6d5-brcsw" event={"ID":"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c","Type":"ContainerStarted","Data":"f8ff7ba705604c641aafc36d742e35d9a37970e88dddc06430e162e490c20579"} Jul 12 08:08:10.427469 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.427296 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-nl698"] Jul 12 08:08:10.429749 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.429725 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nl698" Jul 12 08:08:10.436178 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.436158 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 12 08:08:10.436296 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.436224 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jldws\"" Jul 12 08:08:10.436296 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.436233 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 12 08:08:10.447712 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.447691 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-nl698"] Jul 12 08:08:10.450648 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.450623 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-b5btx"] Jul 12 08:08:10.453166 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.453147 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-b5btx" Jul 12 08:08:10.455628 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.455604 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 12 08:08:10.455867 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.455850 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 12 08:08:10.456099 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.456079 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 12 08:08:10.456209 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.456171 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-vpllq\"" Jul 12 08:08:10.473066 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.473006 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-b5btx"] Jul 12 08:08:10.490213 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.488826 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4fz9p"] Jul 12 08:08:10.495249 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.495090 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.500442 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.499851 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 12 08:08:10.500442 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.500184 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jwfft\"" Jul 12 08:08:10.500442 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.500191 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 12 08:08:10.500442 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.500330 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 12 08:08:10.565217 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.565126 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b92aecde-082a-4a08-8c62-7c83695c896b-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-b5btx\" (UID: \"b92aecde-082a-4a08-8c62-7c83695c896b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5btx" Jul 12 08:08:10.565217 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.565184 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b92aecde-082a-4a08-8c62-7c83695c896b-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-b5btx\" (UID: \"b92aecde-082a-4a08-8c62-7c83695c896b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5btx" Jul 12 08:08:10.565217 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.565215 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ad878c8-4904-410c-b036-8ad5226f7e1c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-nl698\" (UID: \"1ad878c8-4904-410c-b036-8ad5226f7e1c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nl698" Jul 12 08:08:10.565544 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.565249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-metrics-client-ca\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.565544 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.565293 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-root\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.565544 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.565321 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-node-exporter-wtmp\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.565544 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.565356 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgff9\" (UniqueName: \"kubernetes.io/projected/1ad878c8-4904-410c-b036-8ad5226f7e1c-kube-api-access-rgff9\") pod \"openshift-state-metrics-84bd68b896-nl698\" (UID: \"1ad878c8-4904-410c-b036-8ad5226f7e1c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nl698" Jul 12 08:08:10.565544 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.565421 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b92aecde-082a-4a08-8c62-7c83695c896b-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-b5btx\" (UID: \"b92aecde-082a-4a08-8c62-7c83695c896b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5btx" Jul 12 08:08:10.565544 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.565470 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-sys\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.565544 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.565516 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-node-exporter-textfile\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.565869 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.565570 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.565869 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.565607 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b92aecde-082a-4a08-8c62-7c83695c896b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-b5btx\" (UID: \"b92aecde-082a-4a08-8c62-7c83695c896b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5btx" Jul 12 08:08:10.565869 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.565645 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ad878c8-4904-410c-b036-8ad5226f7e1c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-nl698\" (UID: \"1ad878c8-4904-410c-b036-8ad5226f7e1c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nl698" Jul 12 08:08:10.565869 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.565682 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ad878c8-4904-410c-b036-8ad5226f7e1c-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-nl698\" (UID: \"1ad878c8-4904-410c-b036-8ad5226f7e1c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nl698" Jul 12 08:08:10.565869 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.565717 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b92aecde-082a-4a08-8c62-7c83695c896b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-b5btx\" (UID: \"b92aecde-082a-4a08-8c62-7c83695c896b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5btx" Jul 12 08:08:10.565869 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.565749 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-node-exporter-accelerators-collector-config\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.565869 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.565777 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7zcl\" (UniqueName: \"kubernetes.io/projected/b92aecde-082a-4a08-8c62-7c83695c896b-kube-api-access-p7zcl\") pod \"kube-state-metrics-785778ff74-b5btx\" (UID: \"b92aecde-082a-4a08-8c62-7c83695c896b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5btx" Jul 12 08:08:10.565869 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.565806 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9fr8\" (UniqueName: \"kubernetes.io/projected/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-kube-api-access-q9fr8\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.565869 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.565840 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-node-exporter-tls\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.666998 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.666956 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-root\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.666998 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.666997 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-node-exporter-wtmp\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.667266 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.667026 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgff9\" (UniqueName: \"kubernetes.io/projected/1ad878c8-4904-410c-b036-8ad5226f7e1c-kube-api-access-rgff9\") pod \"openshift-state-metrics-84bd68b896-nl698\" (UID: \"1ad878c8-4904-410c-b036-8ad5226f7e1c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nl698" Jul 12 08:08:10.667266 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.667062 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b92aecde-082a-4a08-8c62-7c83695c896b-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-b5btx\" (UID: \"b92aecde-082a-4a08-8c62-7c83695c896b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5btx" Jul 12 08:08:10.667266 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.667082 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-sys\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.667266 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.667079 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-root\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.667266 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.667112 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-node-exporter-textfile\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.667266 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.667155 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-node-exporter-wtmp\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.667266 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.667176 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.667266 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.667209 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-sys\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.667266 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.667218 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b92aecde-082a-4a08-8c62-7c83695c896b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-b5btx\" (UID: \"b92aecde-082a-4a08-8c62-7c83695c896b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5btx" Jul 12 08:08:10.667266 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.667253 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ad878c8-4904-410c-b036-8ad5226f7e1c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-nl698\" (UID: \"1ad878c8-4904-410c-b036-8ad5226f7e1c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nl698" Jul 12 08:08:10.667788 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.667284 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ad878c8-4904-410c-b036-8ad5226f7e1c-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-nl698\" (UID: \"1ad878c8-4904-410c-b036-8ad5226f7e1c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nl698" Jul 12 08:08:10.667788 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.667315 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b92aecde-082a-4a08-8c62-7c83695c896b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-b5btx\" (UID: \"b92aecde-082a-4a08-8c62-7c83695c896b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5btx" Jul 12 08:08:10.667788 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.667342 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-node-exporter-accelerators-collector-config\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.667788 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.667369 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7zcl\" (UniqueName: \"kubernetes.io/projected/b92aecde-082a-4a08-8c62-7c83695c896b-kube-api-access-p7zcl\") pod \"kube-state-metrics-785778ff74-b5btx\" (UID: \"b92aecde-082a-4a08-8c62-7c83695c896b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5btx" Jul 12 08:08:10.667788 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.667393 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9fr8\" (UniqueName: \"kubernetes.io/projected/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-kube-api-access-q9fr8\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.667788 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.667422 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-node-exporter-tls\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.667788 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.667456 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b92aecde-082a-4a08-8c62-7c83695c896b-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-b5btx\" (UID: \"b92aecde-082a-4a08-8c62-7c83695c896b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5btx" Jul 12 08:08:10.667788 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.667483 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b92aecde-082a-4a08-8c62-7c83695c896b-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-b5btx\" (UID: \"b92aecde-082a-4a08-8c62-7c83695c896b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5btx" Jul 12 08:08:10.667788 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.667508 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-node-exporter-textfile\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.667788 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.667510 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ad878c8-4904-410c-b036-8ad5226f7e1c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-nl698\" (UID: \"1ad878c8-4904-410c-b036-8ad5226f7e1c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nl698" Jul 12 08:08:10.667788 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.667625 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-metrics-client-ca\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.668344 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.668168 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ad878c8-4904-410c-b036-8ad5226f7e1c-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-nl698\" (UID: \"1ad878c8-4904-410c-b036-8ad5226f7e1c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nl698" Jul 12 08:08:10.668344 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.668304 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-metrics-client-ca\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.668457 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:08:10.668421 2576 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 12 08:08:10.668511 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:08:10.668484 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b92aecde-082a-4a08-8c62-7c83695c896b-kube-state-metrics-tls podName:b92aecde-082a-4a08-8c62-7c83695c896b nodeName:}" failed. No retries permitted until 2026-07-12 08:08:11.168464917 +0000 UTC m=+78.853275767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b92aecde-082a-4a08-8c62-7c83695c896b-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-b5btx" (UID: "b92aecde-082a-4a08-8c62-7c83695c896b") : secret "kube-state-metrics-tls" not found Jul 12 08:08:10.668582 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.668555 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b92aecde-082a-4a08-8c62-7c83695c896b-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-b5btx\" (UID: \"b92aecde-082a-4a08-8c62-7c83695c896b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5btx" Jul 12 08:08:10.668794 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:08:10.668772 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 12 08:08:10.668914 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:08:10.668828 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-node-exporter-tls podName:48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b nodeName:}" failed. No retries permitted until 2026-07-12 08:08:11.168810669 +0000 UTC m=+78.853621507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-node-exporter-tls") pod "node-exporter-4fz9p" (UID: "48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b") : secret "node-exporter-tls" not found Jul 12 08:08:10.669101 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.669077 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b92aecde-082a-4a08-8c62-7c83695c896b-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-b5btx\" (UID: \"b92aecde-082a-4a08-8c62-7c83695c896b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5btx" Jul 12 08:08:10.669205 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.668158 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b92aecde-082a-4a08-8c62-7c83695c896b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-b5btx\" (UID: \"b92aecde-082a-4a08-8c62-7c83695c896b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5btx" Jul 12 08:08:10.669205 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.669193 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-node-exporter-accelerators-collector-config\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.671159 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.671028 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ad878c8-4904-410c-b036-8ad5226f7e1c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-nl698\" (UID: \"1ad878c8-4904-410c-b036-8ad5226f7e1c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nl698" Jul 12 08:08:10.671159 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.671076 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b92aecde-082a-4a08-8c62-7c83695c896b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-b5btx\" (UID: \"b92aecde-082a-4a08-8c62-7c83695c896b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5btx" Jul 12 08:08:10.671320 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.671175 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.671468 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.671439 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ad878c8-4904-410c-b036-8ad5226f7e1c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-nl698\" (UID: \"1ad878c8-4904-410c-b036-8ad5226f7e1c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nl698" Jul 12 08:08:10.677624 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.677601 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7zcl\" (UniqueName: \"kubernetes.io/projected/b92aecde-082a-4a08-8c62-7c83695c896b-kube-api-access-p7zcl\") pod \"kube-state-metrics-785778ff74-b5btx\" (UID: \"b92aecde-082a-4a08-8c62-7c83695c896b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5btx" Jul 12 08:08:10.677741 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.677713 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9fr8\" (UniqueName: \"kubernetes.io/projected/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-kube-api-access-q9fr8\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:10.677893 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.677864 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgff9\" (UniqueName: \"kubernetes.io/projected/1ad878c8-4904-410c-b036-8ad5226f7e1c-kube-api-access-rgff9\") pod \"openshift-state-metrics-84bd68b896-nl698\" (UID: \"1ad878c8-4904-410c-b036-8ad5226f7e1c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nl698" Jul 12 08:08:10.741082 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.741033 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nl698" Jul 12 08:08:10.899258 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:10.899221 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-nl698"] Jul 12 08:08:10.904404 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:08:10.904353 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ad878c8_4904_410c_b036_8ad5226f7e1c.slice/crio-2d4f8133540fee4338b6e593a9ddb5b423581a0e1b255fcc152e7352cd1be2cd WatchSource:0}: Error finding container 2d4f8133540fee4338b6e593a9ddb5b423581a0e1b255fcc152e7352cd1be2cd: Status 404 returned error can't find the container with id 2d4f8133540fee4338b6e593a9ddb5b423581a0e1b255fcc152e7352cd1be2cd Jul 12 08:08:11.171282 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.171203 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-node-exporter-tls\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:11.171282 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.171257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b92aecde-082a-4a08-8c62-7c83695c896b-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-b5btx\" (UID: \"b92aecde-082a-4a08-8c62-7c83695c896b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5btx" Jul 12 08:08:11.174513 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.174467 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b-node-exporter-tls\") pod \"node-exporter-4fz9p\" (UID: \"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b\") " pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:11.174781 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.174748 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b92aecde-082a-4a08-8c62-7c83695c896b-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-b5btx\" (UID: \"b92aecde-082a-4a08-8c62-7c83695c896b\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-b5btx" Jul 12 08:08:11.324069 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.324023 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nl698" event={"ID":"1ad878c8-4904-410c-b036-8ad5226f7e1c","Type":"ContainerStarted","Data":"b1a8adf87e574ee3a99a474918ae0439a6c0ad9d870d91be356dc88473d11940"} Jul 12 08:08:11.324251 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.324097 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nl698" event={"ID":"1ad878c8-4904-410c-b036-8ad5226f7e1c","Type":"ContainerStarted","Data":"f6df5de24fe364ef6f296ee4a3e0451797aa77a0c53d60a9e2dc628dfa4b7aef"} Jul 12 08:08:11.324251 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.324131 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nl698" event={"ID":"1ad878c8-4904-410c-b036-8ad5226f7e1c","Type":"ContainerStarted","Data":"2d4f8133540fee4338b6e593a9ddb5b423581a0e1b255fcc152e7352cd1be2cd"} Jul 12 08:08:11.363703 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.363664 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-b5btx" Jul 12 08:08:11.410870 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.410830 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4fz9p" Jul 12 08:08:11.497533 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.497501 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 08:08:11.501270 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.501214 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.503748 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.503723 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 12 08:08:11.504112 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.504093 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-chp59\"" Jul 12 08:08:11.504267 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.504248 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 12 08:08:11.504357 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.504093 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 12 08:08:11.504464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.504447 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 12 08:08:11.504464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.504211 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 12 08:08:11.504631 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.504261 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 12 08:08:11.504631 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.504096 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 12 08:08:11.504743 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.504216 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 12 08:08:11.505122 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.504944 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 12 08:08:11.516219 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.516198 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 08:08:11.528696 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.528672 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-b5btx"] Jul 12 08:08:11.531800 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:08:11.531774 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb92aecde_082a_4a08_8c62_7c83695c896b.slice/crio-f4cd80b800113df020187858ec2943a540a33bf2483d6823730ae3ab6053b220 WatchSource:0}: Error finding container f4cd80b800113df020187858ec2943a540a33bf2483d6823730ae3ab6053b220: Status 404 returned error can't find the container with id f4cd80b800113df020187858ec2943a540a33bf2483d6823730ae3ab6053b220 Jul 12 08:08:11.575626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.575080 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e6191a3-cd19-4080-87e7-d2a49c814401-config-out\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.575626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.575125 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.575626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.575155 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.575626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.575193 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e6191a3-cd19-4080-87e7-d2a49c814401-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.575626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.575222 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-config-volume\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.575626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.575244 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf87d\" (UniqueName: \"kubernetes.io/projected/7e6191a3-cd19-4080-87e7-d2a49c814401-kube-api-access-lf87d\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.575626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.575279 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e6191a3-cd19-4080-87e7-d2a49c814401-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.575626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.575351 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.575626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.575428 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.575626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.575460 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7e6191a3-cd19-4080-87e7-d2a49c814401-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.575626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.575501 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-web-config\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.575626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.575530 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.575626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.575552 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e6191a3-cd19-4080-87e7-d2a49c814401-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.676882 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.676775 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-web-config\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.677422 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.677390 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.677546 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.677450 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e6191a3-cd19-4080-87e7-d2a49c814401-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.677546 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.677498 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e6191a3-cd19-4080-87e7-d2a49c814401-config-out\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.677546 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.677526 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.677708 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.677558 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.677708 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.677598 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e6191a3-cd19-4080-87e7-d2a49c814401-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.677708 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.677627 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-config-volume\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.677708 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.677653 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf87d\" (UniqueName: \"kubernetes.io/projected/7e6191a3-cd19-4080-87e7-d2a49c814401-kube-api-access-lf87d\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.677708 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.677691 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e6191a3-cd19-4080-87e7-d2a49c814401-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.678141 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.677730 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.678141 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.677769 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.678141 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.677808 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7e6191a3-cd19-4080-87e7-d2a49c814401-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.678302 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.678266 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7e6191a3-cd19-4080-87e7-d2a49c814401-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.679154 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.679126 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e6191a3-cd19-4080-87e7-d2a49c814401-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.679282 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:08:11.679265 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e6191a3-cd19-4080-87e7-d2a49c814401-alertmanager-trusted-ca-bundle podName:7e6191a3-cd19-4080-87e7-d2a49c814401 nodeName:}" failed. No retries permitted until 2026-07-12 08:08:12.179244496 +0000 UTC m=+79.864055352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e6191a3-cd19-4080-87e7-d2a49c814401-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "7e6191a3-cd19-4080-87e7-d2a49c814401") : configmap references non-existent config key: ca-bundle.crt Jul 12 08:08:11.681662 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.680423 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-web-config\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.681662 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.681258 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.682477 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.682432 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-config-volume\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.682821 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.682780 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.683994 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.683947 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.685238 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.685194 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e6191a3-cd19-4080-87e7-d2a49c814401-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.685386 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.685367 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e6191a3-cd19-4080-87e7-d2a49c814401-config-out\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.686418 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.686239 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.686418 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.686320 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:11.688841 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:11.688801 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf87d\" (UniqueName: \"kubernetes.io/projected/7e6191a3-cd19-4080-87e7-d2a49c814401-kube-api-access-lf87d\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:12.182021 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:12.181982 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e6191a3-cd19-4080-87e7-d2a49c814401-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:12.182822 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:12.182787 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e6191a3-cd19-4080-87e7-d2a49c814401-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:12.328913 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:12.328871 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4fz9p" event={"ID":"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b","Type":"ContainerStarted","Data":"fae9868e5322d4291ce85183e898ce2f3886a4b60c8bc421cee948477221044d"} Jul 12 08:08:12.330304 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:12.330266 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-b5btx" event={"ID":"b92aecde-082a-4a08-8c62-7c83695c896b","Type":"ContainerStarted","Data":"f4cd80b800113df020187858ec2943a540a33bf2483d6823730ae3ab6053b220"} Jul 12 08:08:12.417082 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:12.417030 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:08:18.074835 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:18.074709 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5676459676-p7spp"] Jul 12 08:08:18.154794 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:18.154745 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5676459676-p7spp"] Jul 12 08:08:18.154996 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:18.154890 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:18.162392 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:18.162366 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 12 08:08:18.338980 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:18.338874 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bae875db-2c09-4ad5-b4e4-1f1714d437c6-console-serving-cert\") pod \"console-5676459676-p7spp\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:18.338980 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:18.338963 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae875db-2c09-4ad5-b4e4-1f1714d437c6-trusted-ca-bundle\") pod \"console-5676459676-p7spp\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:18.339194 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:18.338997 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bae875db-2c09-4ad5-b4e4-1f1714d437c6-console-oauth-config\") pod \"console-5676459676-p7spp\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:18.339194 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:18.339031 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bae875db-2c09-4ad5-b4e4-1f1714d437c6-console-config\") pod \"console-5676459676-p7spp\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:18.339194 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:18.339060 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79p5l\" (UniqueName: \"kubernetes.io/projected/bae875db-2c09-4ad5-b4e4-1f1714d437c6-kube-api-access-79p5l\") pod \"console-5676459676-p7spp\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:18.339194 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:18.339087 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bae875db-2c09-4ad5-b4e4-1f1714d437c6-service-ca\") pod \"console-5676459676-p7spp\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:18.339194 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:18.339125 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bae875db-2c09-4ad5-b4e4-1f1714d437c6-oauth-serving-cert\") pod \"console-5676459676-p7spp\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:18.440213 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:18.440177 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bae875db-2c09-4ad5-b4e4-1f1714d437c6-oauth-serving-cert\") pod \"console-5676459676-p7spp\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:18.440467 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:18.440246 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bae875db-2c09-4ad5-b4e4-1f1714d437c6-console-serving-cert\") pod \"console-5676459676-p7spp\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:18.440467 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:18.440304 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae875db-2c09-4ad5-b4e4-1f1714d437c6-trusted-ca-bundle\") pod \"console-5676459676-p7spp\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:18.440467 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:18.440326 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bae875db-2c09-4ad5-b4e4-1f1714d437c6-console-oauth-config\") pod \"console-5676459676-p7spp\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:18.440467 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:18.440408 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bae875db-2c09-4ad5-b4e4-1f1714d437c6-console-config\") pod \"console-5676459676-p7spp\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:18.440467 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:18.440450 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79p5l\" (UniqueName: \"kubernetes.io/projected/bae875db-2c09-4ad5-b4e4-1f1714d437c6-kube-api-access-79p5l\") pod \"console-5676459676-p7spp\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:18.440751 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:18.440474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bae875db-2c09-4ad5-b4e4-1f1714d437c6-service-ca\") pod \"console-5676459676-p7spp\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:18.441058 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:18.441027 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bae875db-2c09-4ad5-b4e4-1f1714d437c6-oauth-serving-cert\") pod \"console-5676459676-p7spp\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:18.441214 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:18.441186 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bae875db-2c09-4ad5-b4e4-1f1714d437c6-service-ca\") pod \"console-5676459676-p7spp\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:18.441812 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:18.441792 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bae875db-2c09-4ad5-b4e4-1f1714d437c6-console-config\") pod \"console-5676459676-p7spp\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:18.442246 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:18.442219 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae875db-2c09-4ad5-b4e4-1f1714d437c6-trusted-ca-bundle\") pod \"console-5676459676-p7spp\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:18.443618 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:18.443596 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bae875db-2c09-4ad5-b4e4-1f1714d437c6-console-oauth-config\") pod \"console-5676459676-p7spp\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:18.443945 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:18.443916 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bae875db-2c09-4ad5-b4e4-1f1714d437c6-console-serving-cert\") pod \"console-5676459676-p7spp\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:18.451672 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:18.451648 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79p5l\" (UniqueName: \"kubernetes.io/projected/bae875db-2c09-4ad5-b4e4-1f1714d437c6-kube-api-access-79p5l\") pod \"console-5676459676-p7spp\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:18.466459 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:18.466432 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:19.253410 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:19.253374 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54cdcdcd88-vr4mf" Jul 12 08:08:21.656668 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:21.656639 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 08:08:21.852293 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:08:21.852263 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e6191a3_cd19_4080_87e7_d2a49c814401.slice/crio-d90fc9631e4de23a123f09823554e03391a67717bf20d2abf965d8109572a523 WatchSource:0}: Error finding container d90fc9631e4de23a123f09823554e03391a67717bf20d2abf965d8109572a523: Status 404 returned error can't find the container with id d90fc9631e4de23a123f09823554e03391a67717bf20d2abf965d8109572a523 Jul 12 08:08:21.996376 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:21.996310 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5676459676-p7spp"] Jul 12 08:08:22.033984 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.028063 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" podUID="19a67523-00cc-4b3d-a1a9-9eb033293b28" containerName="registry" containerID="cri-o://ea3b7d6a6061e907d74f0fe2caabeb7e082894c201d45cd3339e546c52795eba" gracePeriod=30 Jul 12 08:08:22.312483 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.312441 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:08:22.380196 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.380096 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5676459676-p7spp" event={"ID":"bae875db-2c09-4ad5-b4e4-1f1714d437c6","Type":"ContainerStarted","Data":"e8627301b9e812b42060701e03f66c25f696d823eab8e3c94f47ee3233f92b98"} Jul 12 08:08:22.380356 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.380203 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5676459676-p7spp" event={"ID":"bae875db-2c09-4ad5-b4e4-1f1714d437c6","Type":"ContainerStarted","Data":"617a92b0c68a446e4552638c79d363ae6f3514724fc1dc4f1b4550a048b67b86"} Jul 12 08:08:22.383084 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.383048 2576 generic.go:356] "Generic (PLEG): container finished" podID="19a67523-00cc-4b3d-a1a9-9eb033293b28" containerID="ea3b7d6a6061e907d74f0fe2caabeb7e082894c201d45cd3339e546c52795eba" exitCode=0 Jul 12 08:08:22.383667 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.383182 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" Jul 12 08:08:22.383667 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.383203 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" event={"ID":"19a67523-00cc-4b3d-a1a9-9eb033293b28","Type":"ContainerDied","Data":"ea3b7d6a6061e907d74f0fe2caabeb7e082894c201d45cd3339e546c52795eba"} Jul 12 08:08:22.383667 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.383490 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-548bc455f9-b4kpp" event={"ID":"19a67523-00cc-4b3d-a1a9-9eb033293b28","Type":"ContainerDied","Data":"9efb94958e39c9d909f32afe4c4996cb560f66ac11c2432ec3cb86427af2bcf3"} Jul 12 08:08:22.383667 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.383525 2576 scope.go:117] "RemoveContainer" containerID="ea3b7d6a6061e907d74f0fe2caabeb7e082894c201d45cd3339e546c52795eba" Jul 12 08:08:22.389488 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.389412 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665cdc7994-kzh2x" event={"ID":"6bc1c256-a945-48f0-8aa1-a9b21282e1cd","Type":"ContainerStarted","Data":"deadea683b529f29cb88cc69f4392dd2fca4a293689d192c9c609d1fdebb5681"} Jul 12 08:08:22.393095 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.393071 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-98xwj" event={"ID":"a28b88f7-0a6d-455e-9f0a-eb03ba20cbdc","Type":"ContainerStarted","Data":"a72f6616e09760f1bdbcc9d21fda054d6873d3b340142b6ef57971c0a73e54fb"} Jul 12 08:08:22.393917 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.393899 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-98xwj" Jul 12 08:08:22.398181 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.397053 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5676459676-p7spp" podStartSLOduration=4.397036576 podStartE2EDuration="4.397036576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:08:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:08:22.39671154 +0000 UTC m=+90.081522410" watchObservedRunningTime="2026-07-12 08:08:22.397036576 +0000 UTC m=+90.081847437" Jul 12 08:08:22.398349 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.396707 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5454fff6d5-brcsw" event={"ID":"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c","Type":"ContainerStarted","Data":"147b244a7bdbd53907caf41872688b2d38c058b48e4408887772125266da19dc"} Jul 12 08:08:22.402069 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.402049 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nl698" event={"ID":"1ad878c8-4904-410c-b036-8ad5226f7e1c","Type":"ContainerStarted","Data":"b0bfc0d371de9c76165259fdc43ad89ecd6a90ce3204377ca5ef198cf24d4044"} Jul 12 08:08:22.404925 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.404908 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-98xwj" Jul 12 08:08:22.405329 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.405311 2576 scope.go:117] "RemoveContainer" containerID="ea3b7d6a6061e907d74f0fe2caabeb7e082894c201d45cd3339e546c52795eba" Jul 12 08:08:22.406059 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:08:22.405778 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea3b7d6a6061e907d74f0fe2caabeb7e082894c201d45cd3339e546c52795eba\": container with ID starting with ea3b7d6a6061e907d74f0fe2caabeb7e082894c201d45cd3339e546c52795eba not found: ID does not exist" containerID="ea3b7d6a6061e907d74f0fe2caabeb7e082894c201d45cd3339e546c52795eba" Jul 12 08:08:22.406059 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.405812 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea3b7d6a6061e907d74f0fe2caabeb7e082894c201d45cd3339e546c52795eba"} err="failed to get container status \"ea3b7d6a6061e907d74f0fe2caabeb7e082894c201d45cd3339e546c52795eba\": rpc error: code = NotFound desc = could not find container \"ea3b7d6a6061e907d74f0fe2caabeb7e082894c201d45cd3339e546c52795eba\": container with ID starting with ea3b7d6a6061e907d74f0fe2caabeb7e082894c201d45cd3339e546c52795eba not found: ID does not exist" Jul 12 08:08:22.406059 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.405988 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e6191a3-cd19-4080-87e7-d2a49c814401","Type":"ContainerStarted","Data":"d90fc9631e4de23a123f09823554e03391a67717bf20d2abf965d8109572a523"} Jul 12 08:08:22.409083 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.408328 2576 generic.go:356] "Generic (PLEG): container finished" podID="48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b" containerID="580b0d67623d5310198c1879b8083f0753a0180594440502761a52423ac028b3" exitCode=0 Jul 12 08:08:22.409083 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.408409 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4fz9p" event={"ID":"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b","Type":"ContainerDied","Data":"580b0d67623d5310198c1879b8083f0753a0180594440502761a52423ac028b3"} Jul 12 08:08:22.414454 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.414059 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665cdc7994-kzh2x" podStartSLOduration=2.003660971 podStartE2EDuration="26.414042427s" totalImagesPullingTime="24.410381456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-12 08:08:22.412727398 +0000 UTC m=+90.097538257" watchObservedRunningTime="2026-07-12 08:08:22.414042427 +0000 UTC m=+90.098853285" Jul 12 08:08:22.416852 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.416579 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-b5btx" event={"ID":"b92aecde-082a-4a08-8c62-7c83695c896b","Type":"ContainerStarted","Data":"12de21119bdd88e3cd1deee78e7f28db525d6e2bc0b6dd1db5129e7dbc2f475a"} Jul 12 08:08:22.416852 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.416634 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-b5btx" event={"ID":"b92aecde-082a-4a08-8c62-7c83695c896b","Type":"ContainerStarted","Data":"dba81be3d9e5285801d270ccdadf772747eca7f32f1b782a94cbd00c046c9ec9"} Jul 12 08:08:22.416852 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.416661 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-b5btx" event={"ID":"b92aecde-082a-4a08-8c62-7c83695c896b","Type":"ContainerStarted","Data":"9ce6b01ce4824cf908132faaeb499c185447577b0676e1f20babd844f4d46615"} Jul 12 08:08:22.429498 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.429451 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-98xwj" podStartSLOduration=1.5875629 podStartE2EDuration="23.42943388s" totalImagesPullingTime="21.84187098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:07:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:08:22.428411126 +0000 UTC m=+90.113222006" watchObservedRunningTime="2026-07-12 08:08:22.42943388 +0000 UTC m=+90.114244739" Jul 12 08:08:22.448382 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.448335 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-b5btx" podStartSLOduration=2.068494691 podStartE2EDuration="12.44831555s" totalImagesPullingTime="10.379820859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:08:22.445116087 +0000 UTC m=+90.129926945" watchObservedRunningTime="2026-07-12 08:08:22.44831555 +0000 UTC m=+90.133126405" Jul 12 08:08:22.479941 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.479166 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrtrb\" (UniqueName: \"kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-kube-api-access-zrtrb\") pod \"19a67523-00cc-4b3d-a1a9-9eb033293b28\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " Jul 12 08:08:22.479941 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.479242 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-certificates\") pod \"19a67523-00cc-4b3d-a1a9-9eb033293b28\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " Jul 12 08:08:22.479941 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.479274 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-tls\") pod \"19a67523-00cc-4b3d-a1a9-9eb033293b28\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " Jul 12 08:08:22.479941 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.479313 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19a67523-00cc-4b3d-a1a9-9eb033293b28-trusted-ca\") pod \"19a67523-00cc-4b3d-a1a9-9eb033293b28\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " Jul 12 08:08:22.479941 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.479390 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/19a67523-00cc-4b3d-a1a9-9eb033293b28-ca-trust-extracted\") pod \"19a67523-00cc-4b3d-a1a9-9eb033293b28\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " Jul 12 08:08:22.479941 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.479424 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/19a67523-00cc-4b3d-a1a9-9eb033293b28-installation-pull-secrets\") pod \"19a67523-00cc-4b3d-a1a9-9eb033293b28\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " Jul 12 08:08:22.479941 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.479455 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-bound-sa-token\") pod \"19a67523-00cc-4b3d-a1a9-9eb033293b28\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " Jul 12 08:08:22.479941 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.479502 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/19a67523-00cc-4b3d-a1a9-9eb033293b28-image-registry-private-configuration\") pod \"19a67523-00cc-4b3d-a1a9-9eb033293b28\" (UID: \"19a67523-00cc-4b3d-a1a9-9eb033293b28\") " Jul 12 08:08:22.479941 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.479641 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "19a67523-00cc-4b3d-a1a9-9eb033293b28" (UID: "19a67523-00cc-4b3d-a1a9-9eb033293b28"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 08:08:22.479941 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.479835 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19a67523-00cc-4b3d-a1a9-9eb033293b28-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "19a67523-00cc-4b3d-a1a9-9eb033293b28" (UID: "19a67523-00cc-4b3d-a1a9-9eb033293b28"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 08:08:22.480517 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.479966 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-certificates\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:08:22.480517 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.479987 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/19a67523-00cc-4b3d-a1a9-9eb033293b28-trusted-ca\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:08:22.484870 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.484836 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19a67523-00cc-4b3d-a1a9-9eb033293b28-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "19a67523-00cc-4b3d-a1a9-9eb033293b28" (UID: "19a67523-00cc-4b3d-a1a9-9eb033293b28"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 08:08:22.485798 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.485765 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19a67523-00cc-4b3d-a1a9-9eb033293b28-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "19a67523-00cc-4b3d-a1a9-9eb033293b28" (UID: "19a67523-00cc-4b3d-a1a9-9eb033293b28"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 08:08:22.489072 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.489003 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5454fff6d5-brcsw" podStartSLOduration=1.375653909 podStartE2EDuration="13.488983165s" totalImagesPullingTime="12.113329256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:08:22.466659538 +0000 UTC m=+90.151470399" watchObservedRunningTime="2026-07-12 08:08:22.488983165 +0000 UTC m=+90.173794024" Jul 12 08:08:22.489164 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.489135 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "19a67523-00cc-4b3d-a1a9-9eb033293b28" (UID: "19a67523-00cc-4b3d-a1a9-9eb033293b28"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 08:08:22.489229 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.489132 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-nl698" podStartSLOduration=1.673101753 podStartE2EDuration="12.489125078s" totalImagesPullingTime="10.816023325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:08:22.48730645 +0000 UTC m=+90.172117309" watchObservedRunningTime="2026-07-12 08:08:22.489125078 +0000 UTC m=+90.173935937" Jul 12 08:08:22.491055 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.490510 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-kube-api-access-zrtrb" (OuterVolumeSpecName: "kube-api-access-zrtrb") pod "19a67523-00cc-4b3d-a1a9-9eb033293b28" (UID: "19a67523-00cc-4b3d-a1a9-9eb033293b28"). InnerVolumeSpecName "kube-api-access-zrtrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 08:08:22.491055 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.491024 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "19a67523-00cc-4b3d-a1a9-9eb033293b28" (UID: "19a67523-00cc-4b3d-a1a9-9eb033293b28"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 08:08:22.494070 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.494043 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a67523-00cc-4b3d-a1a9-9eb033293b28-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "19a67523-00cc-4b3d-a1a9-9eb033293b28" (UID: "19a67523-00cc-4b3d-a1a9-9eb033293b28"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 08:08:22.582804 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.580997 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-registry-tls\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:08:22.582804 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.581026 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/19a67523-00cc-4b3d-a1a9-9eb033293b28-ca-trust-extracted\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:08:22.582804 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.581041 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/19a67523-00cc-4b3d-a1a9-9eb033293b28-installation-pull-secrets\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:08:22.582804 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.581055 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-bound-sa-token\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:08:22.582804 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.581070 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/19a67523-00cc-4b3d-a1a9-9eb033293b28-image-registry-private-configuration\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:08:22.582804 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.581083 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrtrb\" (UniqueName: \"kubernetes.io/projected/19a67523-00cc-4b3d-a1a9-9eb033293b28-kube-api-access-zrtrb\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:08:22.707786 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.707750 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-548bc455f9-b4kpp"] Jul 12 08:08:22.713267 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.713202 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-548bc455f9-b4kpp"] Jul 12 08:08:22.855294 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:22.855147 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19a67523-00cc-4b3d-a1a9-9eb033293b28" path="/var/lib/kubelet/pods/19a67523-00cc-4b3d-a1a9-9eb033293b28/volumes" Jul 12 08:08:23.426597 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:23.426553 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4fz9p" event={"ID":"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b","Type":"ContainerStarted","Data":"cc1d0c0b2bef6a0f953e7bf59eed5803b81ba0280e9b075e7732455e29396e94"} Jul 12 08:08:23.426766 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:23.426663 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4fz9p" event={"ID":"48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b","Type":"ContainerStarted","Data":"6c368c4f0bf376ed2f22b4538def9bffd9a3f54675669ba5ffb04213abc64866"} Jul 12 08:08:23.458414 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:23.458345 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4fz9p" podStartSLOduration=2.906154242 podStartE2EDuration="13.458323558s" totalImagesPullingTime="10.428911367s" totalInitContainerRuntime="123.257949ms" isStatefulPod=true podCreationTimestamp="2026-07-12 08:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:08:23.456144579 +0000 UTC m=+91.140955464" watchObservedRunningTime="2026-07-12 08:08:23.458323558 +0000 UTC m=+91.143134416" Jul 12 08:08:24.433463 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:24.433421 2576 generic.go:356] "Generic (PLEG): container finished" podID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerID="2d133269fb186aac5856c1b6702446d72a7789afd77c229196479ce1c5863823" exitCode=0 Jul 12 08:08:24.433964 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:24.433499 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e6191a3-cd19-4080-87e7-d2a49c814401","Type":"ContainerDied","Data":"2d133269fb186aac5856c1b6702446d72a7789afd77c229196479ce1c5863823"} Jul 12 08:08:27.461161 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:27.461083 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e6191a3-cd19-4080-87e7-d2a49c814401","Type":"ContainerStarted","Data":"ed0c24fbf26fbb2bb233b1f4417409d3b1a1bf8c067666af1616f0da4501bc00"} Jul 12 08:08:27.461632 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:27.461168 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e6191a3-cd19-4080-87e7-d2a49c814401","Type":"ContainerStarted","Data":"afb1944a06b96a87d2cec481fe03af710422e3d94af5d6631124840506185032"} Jul 12 08:08:27.461632 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:27.461233 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e6191a3-cd19-4080-87e7-d2a49c814401","Type":"ContainerStarted","Data":"b86ad042b0f512b2070ecbce5e61268c59cc476e64124bd81a358a6f100c7f82"} Jul 12 08:08:27.461632 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:27.461270 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e6191a3-cd19-4080-87e7-d2a49c814401","Type":"ContainerStarted","Data":"50e3c503090c791d396c9b88b184e1fa76d95010042367d4f320d51653a222cb"} Jul 12 08:08:27.461632 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:27.461294 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e6191a3-cd19-4080-87e7-d2a49c814401","Type":"ContainerStarted","Data":"3d4f478cea47ec4e8f2c98d4693aa56aaa29d8e689d61bf830bb98790fbeb151"} Jul 12 08:08:28.467452 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:28.467422 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:28.467875 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:28.467498 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:28.473044 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:28.473024 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:29.474185 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:29.474145 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e6191a3-cd19-4080-87e7-d2a49c814401","Type":"ContainerStarted","Data":"543df9e2b33ff3c88135d7c618334ba7c67fce34a1a8683faf16842c15574f0c"} Jul 12 08:08:29.479727 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:29.479701 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5676459676-p7spp" Jul 12 08:08:29.501274 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:29.501230 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=13.274370566 podStartE2EDuration="18.501215334s" totalImagesPullingTime="5.196427951s" totalInitContainerRuntime="30.416817ms" isStatefulPod=false podCreationTimestamp="2026-07-12 08:08:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:08:29.498906319 +0000 UTC m=+97.183717179" watchObservedRunningTime="2026-07-12 08:08:29.501215334 +0000 UTC m=+97.186026189" Jul 12 08:08:29.544537 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:29.544500 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5454fff6d5-brcsw"] Jul 12 08:08:29.596217 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:29.596174 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5454fff6d5-brcsw" Jul 12 08:08:36.297611 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:36.297579 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-j4nh6" Jul 12 08:08:54.574435 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:54.574369 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5454fff6d5-brcsw" podUID="e81c68f9-a3a3-4fea-b3f1-bd59957eb53c" containerName="console" containerID="cri-o://147b244a7bdbd53907caf41872688b2d38c058b48e4408887772125266da19dc" gracePeriod=15 Jul 12 08:08:54.857335 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:54.857301 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5454fff6d5-brcsw" Jul 12 08:08:54.952181 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:54.952149 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-console-serving-cert\") pod \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\" (UID: \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\") " Jul 12 08:08:54.952321 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:54.952199 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-console-config\") pod \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\" (UID: \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\") " Jul 12 08:08:54.952321 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:54.952235 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-oauth-serving-cert\") pod \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\" (UID: \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\") " Jul 12 08:08:54.952321 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:54.952270 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9lzm\" (UniqueName: \"kubernetes.io/projected/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-kube-api-access-l9lzm\") pod \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\" (UID: \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\") " Jul 12 08:08:54.952321 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:54.952296 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-console-oauth-config\") pod \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\" (UID: \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\") " Jul 12 08:08:54.952525 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:54.952387 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-service-ca\") pod \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\" (UID: \"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c\") " Jul 12 08:08:54.952726 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:54.952702 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-console-config" (OuterVolumeSpecName: "console-config") pod "e81c68f9-a3a3-4fea-b3f1-bd59957eb53c" (UID: "e81c68f9-a3a3-4fea-b3f1-bd59957eb53c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 08:08:54.952792 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:54.952715 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e81c68f9-a3a3-4fea-b3f1-bd59957eb53c" (UID: "e81c68f9-a3a3-4fea-b3f1-bd59957eb53c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 08:08:54.952792 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:54.952762 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-service-ca" (OuterVolumeSpecName: "service-ca") pod "e81c68f9-a3a3-4fea-b3f1-bd59957eb53c" (UID: "e81c68f9-a3a3-4fea-b3f1-bd59957eb53c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 08:08:54.954454 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:54.954423 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-kube-api-access-l9lzm" (OuterVolumeSpecName: "kube-api-access-l9lzm") pod "e81c68f9-a3a3-4fea-b3f1-bd59957eb53c" (UID: "e81c68f9-a3a3-4fea-b3f1-bd59957eb53c"). InnerVolumeSpecName "kube-api-access-l9lzm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 08:08:54.954454 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:54.954445 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e81c68f9-a3a3-4fea-b3f1-bd59957eb53c" (UID: "e81c68f9-a3a3-4fea-b3f1-bd59957eb53c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 08:08:54.954595 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:54.954461 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e81c68f9-a3a3-4fea-b3f1-bd59957eb53c" (UID: "e81c68f9-a3a3-4fea-b3f1-bd59957eb53c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 08:08:55.053887 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:55.053862 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9lzm\" (UniqueName: \"kubernetes.io/projected/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-kube-api-access-l9lzm\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:08:55.053887 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:55.053886 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-console-oauth-config\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:08:55.054054 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:55.053896 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-service-ca\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:08:55.054054 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:55.053905 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-console-serving-cert\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:08:55.054054 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:55.053913 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-console-config\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:08:55.054054 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:55.053921 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c-oauth-serving-cert\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:08:55.577238 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:55.577203 2576 generic.go:356] "Generic (PLEG): container finished" podID="e81c68f9-a3a3-4fea-b3f1-bd59957eb53c" containerID="147b244a7bdbd53907caf41872688b2d38c058b48e4408887772125266da19dc" exitCode=0 Jul 12 08:08:55.577741 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:55.577249 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5454fff6d5-brcsw" Jul 12 08:08:55.577741 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:55.577267 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5454fff6d5-brcsw" event={"ID":"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c","Type":"ContainerDied","Data":"147b244a7bdbd53907caf41872688b2d38c058b48e4408887772125266da19dc"} Jul 12 08:08:55.577741 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:55.577321 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5454fff6d5-brcsw" event={"ID":"e81c68f9-a3a3-4fea-b3f1-bd59957eb53c","Type":"ContainerDied","Data":"f8ff7ba705604c641aafc36d742e35d9a37970e88dddc06430e162e490c20579"} Jul 12 08:08:55.577741 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:55.577343 2576 scope.go:117] "RemoveContainer" containerID="147b244a7bdbd53907caf41872688b2d38c058b48e4408887772125266da19dc" Jul 12 08:08:55.586992 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:55.586975 2576 scope.go:117] "RemoveContainer" containerID="147b244a7bdbd53907caf41872688b2d38c058b48e4408887772125266da19dc" Jul 12 08:08:55.587388 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:08:55.587368 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"147b244a7bdbd53907caf41872688b2d38c058b48e4408887772125266da19dc\": container with ID starting with 147b244a7bdbd53907caf41872688b2d38c058b48e4408887772125266da19dc not found: ID does not exist" containerID="147b244a7bdbd53907caf41872688b2d38c058b48e4408887772125266da19dc" Jul 12 08:08:55.587511 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:55.587490 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"147b244a7bdbd53907caf41872688b2d38c058b48e4408887772125266da19dc"} err="failed to get container status \"147b244a7bdbd53907caf41872688b2d38c058b48e4408887772125266da19dc\": rpc error: code = NotFound desc = could not find container \"147b244a7bdbd53907caf41872688b2d38c058b48e4408887772125266da19dc\": container with ID starting with 147b244a7bdbd53907caf41872688b2d38c058b48e4408887772125266da19dc not found: ID does not exist" Jul 12 08:08:55.598017 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:55.597993 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5454fff6d5-brcsw"] Jul 12 08:08:55.602812 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:55.602786 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5454fff6d5-brcsw"] Jul 12 08:08:56.849967 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:56.849912 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e81c68f9-a3a3-4fea-b3f1-bd59957eb53c" path="/var/lib/kubelet/pods/e81c68f9-a3a3-4fea-b3f1-bd59957eb53c/volumes" Jul 12 08:08:57.177707 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:08:57.177629 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n89k8_e291324a-b2bc-4bc5-b624-80fe7c0e5d7a/serve-healthcheck-canary/0.log" Jul 12 08:09:30.657355 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:30.657314 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 08:09:30.657896 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:30.657623 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerName="alertmanager" containerID="cri-o://3d4f478cea47ec4e8f2c98d4693aa56aaa29d8e689d61bf830bb98790fbeb151" gracePeriod=120 Jul 12 08:09:30.657896 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:30.657651 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerName="prom-label-proxy" containerID="cri-o://543df9e2b33ff3c88135d7c618334ba7c67fce34a1a8683faf16842c15574f0c" gracePeriod=120 Jul 12 08:09:30.657896 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:30.657697 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerName="kube-rbac-proxy-web" containerID="cri-o://b86ad042b0f512b2070ecbce5e61268c59cc476e64124bd81a358a6f100c7f82" gracePeriod=120 Jul 12 08:09:30.657896 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:30.657721 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerName="kube-rbac-proxy-metric" containerID="cri-o://ed0c24fbf26fbb2bb233b1f4417409d3b1a1bf8c067666af1616f0da4501bc00" gracePeriod=120 Jul 12 08:09:30.657896 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:30.657661 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerName="kube-rbac-proxy" containerID="cri-o://afb1944a06b96a87d2cec481fe03af710422e3d94af5d6631124840506185032" gracePeriod=120 Jul 12 08:09:30.657896 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:30.657730 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerName="config-reloader" containerID="cri-o://50e3c503090c791d396c9b88b184e1fa76d95010042367d4f320d51653a222cb" gracePeriod=120 Jul 12 08:09:31.718541 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.718507 2576 generic.go:356] "Generic (PLEG): container finished" podID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerID="543df9e2b33ff3c88135d7c618334ba7c67fce34a1a8683faf16842c15574f0c" exitCode=0 Jul 12 08:09:31.718541 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.718536 2576 generic.go:356] "Generic (PLEG): container finished" podID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerID="ed0c24fbf26fbb2bb233b1f4417409d3b1a1bf8c067666af1616f0da4501bc00" exitCode=0 Jul 12 08:09:31.718541 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.718544 2576 generic.go:356] "Generic (PLEG): container finished" podID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerID="afb1944a06b96a87d2cec481fe03af710422e3d94af5d6631124840506185032" exitCode=0 Jul 12 08:09:31.718541 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.718549 2576 generic.go:356] "Generic (PLEG): container finished" podID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerID="50e3c503090c791d396c9b88b184e1fa76d95010042367d4f320d51653a222cb" exitCode=0 Jul 12 08:09:31.719125 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.718554 2576 generic.go:356] "Generic (PLEG): container finished" podID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerID="3d4f478cea47ec4e8f2c98d4693aa56aaa29d8e689d61bf830bb98790fbeb151" exitCode=0 Jul 12 08:09:31.719125 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.718586 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e6191a3-cd19-4080-87e7-d2a49c814401","Type":"ContainerDied","Data":"543df9e2b33ff3c88135d7c618334ba7c67fce34a1a8683faf16842c15574f0c"} Jul 12 08:09:31.719125 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.718714 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e6191a3-cd19-4080-87e7-d2a49c814401","Type":"ContainerDied","Data":"ed0c24fbf26fbb2bb233b1f4417409d3b1a1bf8c067666af1616f0da4501bc00"} Jul 12 08:09:31.719125 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.718758 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e6191a3-cd19-4080-87e7-d2a49c814401","Type":"ContainerDied","Data":"afb1944a06b96a87d2cec481fe03af710422e3d94af5d6631124840506185032"} Jul 12 08:09:31.719125 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.718800 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e6191a3-cd19-4080-87e7-d2a49c814401","Type":"ContainerDied","Data":"50e3c503090c791d396c9b88b184e1fa76d95010042367d4f320d51653a222cb"} Jul 12 08:09:31.719125 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.718840 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e6191a3-cd19-4080-87e7-d2a49c814401","Type":"ContainerDied","Data":"3d4f478cea47ec4e8f2c98d4693aa56aaa29d8e689d61bf830bb98790fbeb151"} Jul 12 08:09:31.904099 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.904073 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:31.939415 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.939393 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-web-config\") pod \"7e6191a3-cd19-4080-87e7-d2a49c814401\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " Jul 12 08:09:31.939562 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.939443 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-secret-alertmanager-kube-rbac-proxy-web\") pod \"7e6191a3-cd19-4080-87e7-d2a49c814401\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " Jul 12 08:09:31.939562 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.939475 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-secret-alertmanager-kube-rbac-proxy-metric\") pod \"7e6191a3-cd19-4080-87e7-d2a49c814401\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " Jul 12 08:09:31.939562 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.939523 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-secret-alertmanager-main-tls\") pod \"7e6191a3-cd19-4080-87e7-d2a49c814401\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " Jul 12 08:09:31.939562 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.939554 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7e6191a3-cd19-4080-87e7-d2a49c814401-alertmanager-main-db\") pod \"7e6191a3-cd19-4080-87e7-d2a49c814401\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " Jul 12 08:09:31.939767 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.939582 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-config-volume\") pod \"7e6191a3-cd19-4080-87e7-d2a49c814401\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " Jul 12 08:09:31.939767 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.939616 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e6191a3-cd19-4080-87e7-d2a49c814401-config-out\") pod \"7e6191a3-cd19-4080-87e7-d2a49c814401\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " Jul 12 08:09:31.939767 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.939641 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e6191a3-cd19-4080-87e7-d2a49c814401-metrics-client-ca\") pod \"7e6191a3-cd19-4080-87e7-d2a49c814401\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " Jul 12 08:09:31.939767 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.939675 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-secret-alertmanager-kube-rbac-proxy\") pod \"7e6191a3-cd19-4080-87e7-d2a49c814401\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " Jul 12 08:09:31.939767 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.939699 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-cluster-tls-config\") pod \"7e6191a3-cd19-4080-87e7-d2a49c814401\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " Jul 12 08:09:31.939767 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.939734 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lf87d\" (UniqueName: \"kubernetes.io/projected/7e6191a3-cd19-4080-87e7-d2a49c814401-kube-api-access-lf87d\") pod \"7e6191a3-cd19-4080-87e7-d2a49c814401\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " Jul 12 08:09:31.940062 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.939773 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e6191a3-cd19-4080-87e7-d2a49c814401-tls-assets\") pod \"7e6191a3-cd19-4080-87e7-d2a49c814401\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " Jul 12 08:09:31.940062 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.939799 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e6191a3-cd19-4080-87e7-d2a49c814401-alertmanager-trusted-ca-bundle\") pod \"7e6191a3-cd19-4080-87e7-d2a49c814401\" (UID: \"7e6191a3-cd19-4080-87e7-d2a49c814401\") " Jul 12 08:09:31.940675 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.940261 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e6191a3-cd19-4080-87e7-d2a49c814401-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "7e6191a3-cd19-4080-87e7-d2a49c814401" (UID: "7e6191a3-cd19-4080-87e7-d2a49c814401"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 08:09:31.940675 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.940377 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e6191a3-cd19-4080-87e7-d2a49c814401-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "7e6191a3-cd19-4080-87e7-d2a49c814401" (UID: "7e6191a3-cd19-4080-87e7-d2a49c814401"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 08:09:31.940854 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.940668 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e6191a3-cd19-4080-87e7-d2a49c814401-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "7e6191a3-cd19-4080-87e7-d2a49c814401" (UID: "7e6191a3-cd19-4080-87e7-d2a49c814401"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 08:09:31.943872 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.943823 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "7e6191a3-cd19-4080-87e7-d2a49c814401" (UID: "7e6191a3-cd19-4080-87e7-d2a49c814401"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 08:09:31.944508 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.944407 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e6191a3-cd19-4080-87e7-d2a49c814401-kube-api-access-lf87d" (OuterVolumeSpecName: "kube-api-access-lf87d") pod "7e6191a3-cd19-4080-87e7-d2a49c814401" (UID: "7e6191a3-cd19-4080-87e7-d2a49c814401"). InnerVolumeSpecName "kube-api-access-lf87d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 08:09:31.944508 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.944472 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e6191a3-cd19-4080-87e7-d2a49c814401-config-out" (OuterVolumeSpecName: "config-out") pod "7e6191a3-cd19-4080-87e7-d2a49c814401" (UID: "7e6191a3-cd19-4080-87e7-d2a49c814401"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 08:09:31.944654 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.944537 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "7e6191a3-cd19-4080-87e7-d2a49c814401" (UID: "7e6191a3-cd19-4080-87e7-d2a49c814401"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 08:09:31.944964 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.944783 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e6191a3-cd19-4080-87e7-d2a49c814401-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7e6191a3-cd19-4080-87e7-d2a49c814401" (UID: "7e6191a3-cd19-4080-87e7-d2a49c814401"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 08:09:31.944964 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.944847 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "7e6191a3-cd19-4080-87e7-d2a49c814401" (UID: "7e6191a3-cd19-4080-87e7-d2a49c814401"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 08:09:31.945197 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.945173 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-config-volume" (OuterVolumeSpecName: "config-volume") pod "7e6191a3-cd19-4080-87e7-d2a49c814401" (UID: "7e6191a3-cd19-4080-87e7-d2a49c814401"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 08:09:31.945636 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.945603 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "7e6191a3-cd19-4080-87e7-d2a49c814401" (UID: "7e6191a3-cd19-4080-87e7-d2a49c814401"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 08:09:31.948390 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.948262 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "7e6191a3-cd19-4080-87e7-d2a49c814401" (UID: "7e6191a3-cd19-4080-87e7-d2a49c814401"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 08:09:31.954376 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:31.954353 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-web-config" (OuterVolumeSpecName: "web-config") pod "7e6191a3-cd19-4080-87e7-d2a49c814401" (UID: "7e6191a3-cd19-4080-87e7-d2a49c814401"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 08:09:32.040949 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.040895 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:09:32.041112 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.040958 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:09:32.041112 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.040977 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-secret-alertmanager-main-tls\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:09:32.041112 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.040993 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7e6191a3-cd19-4080-87e7-d2a49c814401-alertmanager-main-db\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:09:32.041112 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.041006 2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-config-volume\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:09:32.041112 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.041014 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e6191a3-cd19-4080-87e7-d2a49c814401-config-out\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:09:32.041112 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.041023 2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e6191a3-cd19-4080-87e7-d2a49c814401-metrics-client-ca\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:09:32.041112 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.041032 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:09:32.041112 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.041042 2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-cluster-tls-config\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:09:32.041112 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.041050 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lf87d\" (UniqueName: \"kubernetes.io/projected/7e6191a3-cd19-4080-87e7-d2a49c814401-kube-api-access-lf87d\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:09:32.041112 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.041058 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e6191a3-cd19-4080-87e7-d2a49c814401-tls-assets\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:09:32.041112 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.041066 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e6191a3-cd19-4080-87e7-d2a49c814401-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:09:32.041112 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.041074 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e6191a3-cd19-4080-87e7-d2a49c814401-web-config\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:09:32.725310 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.725274 2576 generic.go:356] "Generic (PLEG): container finished" podID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerID="b86ad042b0f512b2070ecbce5e61268c59cc476e64124bd81a358a6f100c7f82" exitCode=0 Jul 12 08:09:32.725702 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.725315 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e6191a3-cd19-4080-87e7-d2a49c814401","Type":"ContainerDied","Data":"b86ad042b0f512b2070ecbce5e61268c59cc476e64124bd81a358a6f100c7f82"} Jul 12 08:09:32.725702 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.725356 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.725702 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.725374 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e6191a3-cd19-4080-87e7-d2a49c814401","Type":"ContainerDied","Data":"d90fc9631e4de23a123f09823554e03391a67717bf20d2abf965d8109572a523"} Jul 12 08:09:32.725702 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.725408 2576 scope.go:117] "RemoveContainer" containerID="543df9e2b33ff3c88135d7c618334ba7c67fce34a1a8683faf16842c15574f0c" Jul 12 08:09:32.733699 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.733677 2576 scope.go:117] "RemoveContainer" containerID="ed0c24fbf26fbb2bb233b1f4417409d3b1a1bf8c067666af1616f0da4501bc00" Jul 12 08:09:32.740250 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.740235 2576 scope.go:117] "RemoveContainer" containerID="afb1944a06b96a87d2cec481fe03af710422e3d94af5d6631124840506185032" Jul 12 08:09:32.746363 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.746342 2576 scope.go:117] "RemoveContainer" containerID="b86ad042b0f512b2070ecbce5e61268c59cc476e64124bd81a358a6f100c7f82" Jul 12 08:09:32.755692 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.755675 2576 scope.go:117] "RemoveContainer" containerID="50e3c503090c791d396c9b88b184e1fa76d95010042367d4f320d51653a222cb" Jul 12 08:09:32.764807 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.764789 2576 scope.go:117] "RemoveContainer" containerID="3d4f478cea47ec4e8f2c98d4693aa56aaa29d8e689d61bf830bb98790fbeb151" Jul 12 08:09:32.768644 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.768624 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 08:09:32.772359 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.772343 2576 scope.go:117] "RemoveContainer" containerID="2d133269fb186aac5856c1b6702446d72a7789afd77c229196479ce1c5863823" Jul 12 08:09:32.779375 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.779358 2576 scope.go:117] "RemoveContainer" containerID="543df9e2b33ff3c88135d7c618334ba7c67fce34a1a8683faf16842c15574f0c" Jul 12 08:09:32.779631 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:09:32.779612 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"543df9e2b33ff3c88135d7c618334ba7c67fce34a1a8683faf16842c15574f0c\": container with ID starting with 543df9e2b33ff3c88135d7c618334ba7c67fce34a1a8683faf16842c15574f0c not found: ID does not exist" containerID="543df9e2b33ff3c88135d7c618334ba7c67fce34a1a8683faf16842c15574f0c" Jul 12 08:09:32.779700 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.779641 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"543df9e2b33ff3c88135d7c618334ba7c67fce34a1a8683faf16842c15574f0c"} err="failed to get container status \"543df9e2b33ff3c88135d7c618334ba7c67fce34a1a8683faf16842c15574f0c\": rpc error: code = NotFound desc = could not find container \"543df9e2b33ff3c88135d7c618334ba7c67fce34a1a8683faf16842c15574f0c\": container with ID starting with 543df9e2b33ff3c88135d7c618334ba7c67fce34a1a8683faf16842c15574f0c not found: ID does not exist" Jul 12 08:09:32.779700 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.779659 2576 scope.go:117] "RemoveContainer" containerID="ed0c24fbf26fbb2bb233b1f4417409d3b1a1bf8c067666af1616f0da4501bc00" Jul 12 08:09:32.779973 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:09:32.779919 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed0c24fbf26fbb2bb233b1f4417409d3b1a1bf8c067666af1616f0da4501bc00\": container with ID starting with ed0c24fbf26fbb2bb233b1f4417409d3b1a1bf8c067666af1616f0da4501bc00 not found: ID does not exist" containerID="ed0c24fbf26fbb2bb233b1f4417409d3b1a1bf8c067666af1616f0da4501bc00" Jul 12 08:09:32.780038 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.779967 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed0c24fbf26fbb2bb233b1f4417409d3b1a1bf8c067666af1616f0da4501bc00"} err="failed to get container status \"ed0c24fbf26fbb2bb233b1f4417409d3b1a1bf8c067666af1616f0da4501bc00\": rpc error: code = NotFound desc = could not find container \"ed0c24fbf26fbb2bb233b1f4417409d3b1a1bf8c067666af1616f0da4501bc00\": container with ID starting with ed0c24fbf26fbb2bb233b1f4417409d3b1a1bf8c067666af1616f0da4501bc00 not found: ID does not exist" Jul 12 08:09:32.780038 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.779984 2576 scope.go:117] "RemoveContainer" containerID="afb1944a06b96a87d2cec481fe03af710422e3d94af5d6631124840506185032" Jul 12 08:09:32.780242 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:09:32.780219 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afb1944a06b96a87d2cec481fe03af710422e3d94af5d6631124840506185032\": container with ID starting with afb1944a06b96a87d2cec481fe03af710422e3d94af5d6631124840506185032 not found: ID does not exist" containerID="afb1944a06b96a87d2cec481fe03af710422e3d94af5d6631124840506185032" Jul 12 08:09:32.780307 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.780252 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb1944a06b96a87d2cec481fe03af710422e3d94af5d6631124840506185032"} err="failed to get container status \"afb1944a06b96a87d2cec481fe03af710422e3d94af5d6631124840506185032\": rpc error: code = NotFound desc = could not find container \"afb1944a06b96a87d2cec481fe03af710422e3d94af5d6631124840506185032\": container with ID starting with afb1944a06b96a87d2cec481fe03af710422e3d94af5d6631124840506185032 not found: ID does not exist" Jul 12 08:09:32.780307 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.780282 2576 scope.go:117] "RemoveContainer" containerID="b86ad042b0f512b2070ecbce5e61268c59cc476e64124bd81a358a6f100c7f82" Jul 12 08:09:32.780524 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.780507 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 08:09:32.780578 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:09:32.780558 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b86ad042b0f512b2070ecbce5e61268c59cc476e64124bd81a358a6f100c7f82\": container with ID starting with b86ad042b0f512b2070ecbce5e61268c59cc476e64124bd81a358a6f100c7f82 not found: ID does not exist" containerID="b86ad042b0f512b2070ecbce5e61268c59cc476e64124bd81a358a6f100c7f82" Jul 12 08:09:32.780620 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.780585 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b86ad042b0f512b2070ecbce5e61268c59cc476e64124bd81a358a6f100c7f82"} err="failed to get container status \"b86ad042b0f512b2070ecbce5e61268c59cc476e64124bd81a358a6f100c7f82\": rpc error: code = NotFound desc = could not find container \"b86ad042b0f512b2070ecbce5e61268c59cc476e64124bd81a358a6f100c7f82\": container with ID starting with b86ad042b0f512b2070ecbce5e61268c59cc476e64124bd81a358a6f100c7f82 not found: ID does not exist" Jul 12 08:09:32.780620 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.780600 2576 scope.go:117] "RemoveContainer" containerID="50e3c503090c791d396c9b88b184e1fa76d95010042367d4f320d51653a222cb" Jul 12 08:09:32.780829 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:09:32.780814 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50e3c503090c791d396c9b88b184e1fa76d95010042367d4f320d51653a222cb\": container with ID starting with 50e3c503090c791d396c9b88b184e1fa76d95010042367d4f320d51653a222cb not found: ID does not exist" containerID="50e3c503090c791d396c9b88b184e1fa76d95010042367d4f320d51653a222cb" Jul 12 08:09:32.780868 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.780834 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50e3c503090c791d396c9b88b184e1fa76d95010042367d4f320d51653a222cb"} err="failed to get container status \"50e3c503090c791d396c9b88b184e1fa76d95010042367d4f320d51653a222cb\": rpc error: code = NotFound desc = could not find container \"50e3c503090c791d396c9b88b184e1fa76d95010042367d4f320d51653a222cb\": container with ID starting with 50e3c503090c791d396c9b88b184e1fa76d95010042367d4f320d51653a222cb not found: ID does not exist" Jul 12 08:09:32.780868 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.780848 2576 scope.go:117] "RemoveContainer" containerID="3d4f478cea47ec4e8f2c98d4693aa56aaa29d8e689d61bf830bb98790fbeb151" Jul 12 08:09:32.781096 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:09:32.781080 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d4f478cea47ec4e8f2c98d4693aa56aaa29d8e689d61bf830bb98790fbeb151\": container with ID starting with 3d4f478cea47ec4e8f2c98d4693aa56aaa29d8e689d61bf830bb98790fbeb151 not found: ID does not exist" containerID="3d4f478cea47ec4e8f2c98d4693aa56aaa29d8e689d61bf830bb98790fbeb151" Jul 12 08:09:32.781144 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.781100 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d4f478cea47ec4e8f2c98d4693aa56aaa29d8e689d61bf830bb98790fbeb151"} err="failed to get container status \"3d4f478cea47ec4e8f2c98d4693aa56aaa29d8e689d61bf830bb98790fbeb151\": rpc error: code = NotFound desc = could not find container \"3d4f478cea47ec4e8f2c98d4693aa56aaa29d8e689d61bf830bb98790fbeb151\": container with ID starting with 3d4f478cea47ec4e8f2c98d4693aa56aaa29d8e689d61bf830bb98790fbeb151 not found: ID does not exist" Jul 12 08:09:32.781144 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.781116 2576 scope.go:117] "RemoveContainer" containerID="2d133269fb186aac5856c1b6702446d72a7789afd77c229196479ce1c5863823" Jul 12 08:09:32.781323 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:09:32.781309 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d133269fb186aac5856c1b6702446d72a7789afd77c229196479ce1c5863823\": container with ID starting with 2d133269fb186aac5856c1b6702446d72a7789afd77c229196479ce1c5863823 not found: ID does not exist" containerID="2d133269fb186aac5856c1b6702446d72a7789afd77c229196479ce1c5863823" Jul 12 08:09:32.781363 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.781330 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d133269fb186aac5856c1b6702446d72a7789afd77c229196479ce1c5863823"} err="failed to get container status \"2d133269fb186aac5856c1b6702446d72a7789afd77c229196479ce1c5863823\": rpc error: code = NotFound desc = could not find container \"2d133269fb186aac5856c1b6702446d72a7789afd77c229196479ce1c5863823\": container with ID starting with 2d133269fb186aac5856c1b6702446d72a7789afd77c229196479ce1c5863823 not found: ID does not exist" Jul 12 08:09:32.825417 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825381 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 08:09:32.825640 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825628 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerName="kube-rbac-proxy" Jul 12 08:09:32.825692 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825641 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerName="kube-rbac-proxy" Jul 12 08:09:32.825692 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825653 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e81c68f9-a3a3-4fea-b3f1-bd59957eb53c" containerName="console" Jul 12 08:09:32.825692 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825658 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e81c68f9-a3a3-4fea-b3f1-bd59957eb53c" containerName="console" Jul 12 08:09:32.825692 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825666 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerName="prom-label-proxy" Jul 12 08:09:32.825692 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825674 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerName="prom-label-proxy" Jul 12 08:09:32.825692 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825685 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerName="kube-rbac-proxy-web" Jul 12 08:09:32.825692 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825690 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerName="kube-rbac-proxy-web" Jul 12 08:09:32.825894 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825696 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a67523-00cc-4b3d-a1a9-9eb033293b28" containerName="registry" Jul 12 08:09:32.825894 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825703 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a67523-00cc-4b3d-a1a9-9eb033293b28" containerName="registry" Jul 12 08:09:32.825894 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825712 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerName="init-config-reloader" Jul 12 08:09:32.825894 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825717 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerName="init-config-reloader" Jul 12 08:09:32.825894 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825723 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerName="config-reloader" Jul 12 08:09:32.825894 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825728 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerName="config-reloader" Jul 12 08:09:32.825894 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825739 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerName="kube-rbac-proxy-metric" Jul 12 08:09:32.825894 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825744 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerName="kube-rbac-proxy-metric" Jul 12 08:09:32.825894 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825750 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerName="alertmanager" Jul 12 08:09:32.825894 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825755 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerName="alertmanager" Jul 12 08:09:32.825894 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825810 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerName="alertmanager" Jul 12 08:09:32.825894 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825817 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="19a67523-00cc-4b3d-a1a9-9eb033293b28" containerName="registry" Jul 12 08:09:32.825894 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825822 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerName="kube-rbac-proxy-web" Jul 12 08:09:32.825894 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825829 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerName="config-reloader" Jul 12 08:09:32.825894 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825834 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerName="kube-rbac-proxy-metric" Jul 12 08:09:32.825894 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825840 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e81c68f9-a3a3-4fea-b3f1-bd59957eb53c" containerName="console" Jul 12 08:09:32.825894 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825845 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerName="kube-rbac-proxy" Jul 12 08:09:32.825894 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.825851 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" containerName="prom-label-proxy" Jul 12 08:09:32.830113 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.830088 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.832436 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.832413 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 12 08:09:32.832612 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.832592 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 12 08:09:32.832689 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.832635 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 12 08:09:32.832689 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.832674 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 12 08:09:32.832823 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.832765 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-chp59\"" Jul 12 08:09:32.833111 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.833029 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 12 08:09:32.833111 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.833074 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 12 08:09:32.833111 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.833079 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 12 08:09:32.833350 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.833092 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 12 08:09:32.837607 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.837420 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 12 08:09:32.842785 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.842763 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 08:09:32.846757 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.846737 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/92d9ce27-e309-4b19-b4e0-16a5d67326ed-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.846858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.846767 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/92d9ce27-e309-4b19-b4e0-16a5d67326ed-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.846858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.846791 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92d9ce27-e309-4b19-b4e0-16a5d67326ed-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.846858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.846812 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92d9ce27-e309-4b19-b4e0-16a5d67326ed-config-out\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.846995 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.846878 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92d9ce27-e309-4b19-b4e0-16a5d67326ed-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.846995 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.846908 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92d9ce27-e309-4b19-b4e0-16a5d67326ed-tls-assets\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.846995 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.846943 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/92d9ce27-e309-4b19-b4e0-16a5d67326ed-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.846995 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.846965 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/92d9ce27-e309-4b19-b4e0-16a5d67326ed-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.846995 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.846982 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92d9ce27-e309-4b19-b4e0-16a5d67326ed-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.847192 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.846999 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92d9ce27-e309-4b19-b4e0-16a5d67326ed-web-config\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.847192 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.847031 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/92d9ce27-e309-4b19-b4e0-16a5d67326ed-config-volume\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.847192 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.847055 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9vn2\" (UniqueName: \"kubernetes.io/projected/92d9ce27-e309-4b19-b4e0-16a5d67326ed-kube-api-access-x9vn2\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.847192 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.847089 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d9ce27-e309-4b19-b4e0-16a5d67326ed-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.849386 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.849365 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e6191a3-cd19-4080-87e7-d2a49c814401" path="/var/lib/kubelet/pods/7e6191a3-cd19-4080-87e7-d2a49c814401/volumes" Jul 12 08:09:32.948303 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.948265 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92d9ce27-e309-4b19-b4e0-16a5d67326ed-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.948457 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.948306 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92d9ce27-e309-4b19-b4e0-16a5d67326ed-tls-assets\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.948457 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.948329 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/92d9ce27-e309-4b19-b4e0-16a5d67326ed-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.948457 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.948355 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/92d9ce27-e309-4b19-b4e0-16a5d67326ed-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.948457 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.948384 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92d9ce27-e309-4b19-b4e0-16a5d67326ed-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.948457 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.948412 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92d9ce27-e309-4b19-b4e0-16a5d67326ed-web-config\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.948457 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.948440 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/92d9ce27-e309-4b19-b4e0-16a5d67326ed-config-volume\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.948750 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.948564 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9vn2\" (UniqueName: \"kubernetes.io/projected/92d9ce27-e309-4b19-b4e0-16a5d67326ed-kube-api-access-x9vn2\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.948750 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.948614 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d9ce27-e309-4b19-b4e0-16a5d67326ed-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.948750 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.948645 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/92d9ce27-e309-4b19-b4e0-16a5d67326ed-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.948750 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.948680 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/92d9ce27-e309-4b19-b4e0-16a5d67326ed-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.948750 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.948722 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92d9ce27-e309-4b19-b4e0-16a5d67326ed-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.949050 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.948757 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92d9ce27-e309-4b19-b4e0-16a5d67326ed-config-out\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.950990 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.949777 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92d9ce27-e309-4b19-b4e0-16a5d67326ed-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.950990 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.950054 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/92d9ce27-e309-4b19-b4e0-16a5d67326ed-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.951155 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.951125 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d9ce27-e309-4b19-b4e0-16a5d67326ed-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.951299 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.951277 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92d9ce27-e309-4b19-b4e0-16a5d67326ed-tls-assets\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.951386 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.951346 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/92d9ce27-e309-4b19-b4e0-16a5d67326ed-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.951386 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.951367 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92d9ce27-e309-4b19-b4e0-16a5d67326ed-config-out\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.951500 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.951411 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/92d9ce27-e309-4b19-b4e0-16a5d67326ed-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.951500 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.951456 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92d9ce27-e309-4b19-b4e0-16a5d67326ed-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.951732 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.951713 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/92d9ce27-e309-4b19-b4e0-16a5d67326ed-config-volume\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.952017 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.951998 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92d9ce27-e309-4b19-b4e0-16a5d67326ed-web-config\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.953359 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.953338 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/92d9ce27-e309-4b19-b4e0-16a5d67326ed-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.953406 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.953342 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92d9ce27-e309-4b19-b4e0-16a5d67326ed-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:32.957696 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:32.957674 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9vn2\" (UniqueName: \"kubernetes.io/projected/92d9ce27-e309-4b19-b4e0-16a5d67326ed-kube-api-access-x9vn2\") pod \"alertmanager-main-0\" (UID: \"92d9ce27-e309-4b19-b4e0-16a5d67326ed\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:33.140286 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:33.140245 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 12 08:09:33.274322 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:33.274287 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 08:09:33.278245 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:09:33.278213 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92d9ce27_e309_4b19_b4e0_16a5d67326ed.slice/crio-5fc24927ef6602985e6e7ec563105c47a6000940806cf0f4f69cee7367d42bda WatchSource:0}: Error finding container 5fc24927ef6602985e6e7ec563105c47a6000940806cf0f4f69cee7367d42bda: Status 404 returned error can't find the container with id 5fc24927ef6602985e6e7ec563105c47a6000940806cf0f4f69cee7367d42bda Jul 12 08:09:33.730209 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:33.730176 2576 generic.go:356] "Generic (PLEG): container finished" podID="92d9ce27-e309-4b19-b4e0-16a5d67326ed" containerID="62014adcfca120672d5b48ab6d59c7200ef3f57a388831d0f95891c8341e937c" exitCode=0 Jul 12 08:09:33.730596 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:33.730272 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"92d9ce27-e309-4b19-b4e0-16a5d67326ed","Type":"ContainerDied","Data":"62014adcfca120672d5b48ab6d59c7200ef3f57a388831d0f95891c8341e937c"} Jul 12 08:09:33.730596 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:33.730357 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"92d9ce27-e309-4b19-b4e0-16a5d67326ed","Type":"ContainerStarted","Data":"5fc24927ef6602985e6e7ec563105c47a6000940806cf0f4f69cee7367d42bda"} Jul 12 08:09:34.690166 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.690125 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-679d74b6b9-rmbvg"] Jul 12 08:09:34.693045 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.693022 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" Jul 12 08:09:34.695291 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.695260 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 12 08:09:34.695595 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.695574 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 12 08:09:34.695784 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.695765 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 12 08:09:34.696089 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.696069 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-zbp8d\"" Jul 12 08:09:34.696296 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.696279 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 12 08:09:34.696639 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.696608 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 12 08:09:34.699817 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.699796 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 12 08:09:34.706207 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.706184 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-679d74b6b9-rmbvg"] Jul 12 08:09:34.739172 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.739139 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"92d9ce27-e309-4b19-b4e0-16a5d67326ed","Type":"ContainerStarted","Data":"52d17dc902264d3fc65c0d6952d31d6271495f054563cdd19d5a9ba4fe5fe293"} Jul 12 08:09:34.739599 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.739215 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"92d9ce27-e309-4b19-b4e0-16a5d67326ed","Type":"ContainerStarted","Data":"88085de03852845fa5e1cd555ba28dce5fd7a33b08fbc01dd373d8232db67ce3"} Jul 12 08:09:34.739599 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.739258 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"92d9ce27-e309-4b19-b4e0-16a5d67326ed","Type":"ContainerStarted","Data":"f1b06881f2a643207dec9a025232a843efd1080670fa22e8d10aa9dfc46c5523"} Jul 12 08:09:34.739599 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.739301 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"92d9ce27-e309-4b19-b4e0-16a5d67326ed","Type":"ContainerStarted","Data":"ca292efa40274dd67e7276c1522764f52873d86801de50ad2fddbeb359ed46d2"} Jul 12 08:09:34.739599 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.739342 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"92d9ce27-e309-4b19-b4e0-16a5d67326ed","Type":"ContainerStarted","Data":"51a7184ca51a707712ff95fd10d0ec8b392111acfe73cf649e9965f69ee7a99b"} Jul 12 08:09:34.739599 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.739370 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"92d9ce27-e309-4b19-b4e0-16a5d67326ed","Type":"ContainerStarted","Data":"2234b407b388c976c6df095c9540879352282256a4018366e81c9246b2a74cc2"} Jul 12 08:09:34.762690 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.762654 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ba4aedf5-c822-4edd-827c-c18ec3b57ab4-secret-telemeter-client\") pod \"telemeter-client-679d74b6b9-rmbvg\" (UID: \"ba4aedf5-c822-4edd-827c-c18ec3b57ab4\") " pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" Jul 12 08:09:34.762690 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.762688 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ba4aedf5-c822-4edd-827c-c18ec3b57ab4-federate-client-tls\") pod \"telemeter-client-679d74b6b9-rmbvg\" (UID: \"ba4aedf5-c822-4edd-827c-c18ec3b57ab4\") " pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" Jul 12 08:09:34.762893 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.762817 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba4aedf5-c822-4edd-827c-c18ec3b57ab4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-679d74b6b9-rmbvg\" (UID: \"ba4aedf5-c822-4edd-827c-c18ec3b57ab4\") " pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" Jul 12 08:09:34.762893 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.762859 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba4aedf5-c822-4edd-827c-c18ec3b57ab4-metrics-client-ca\") pod \"telemeter-client-679d74b6b9-rmbvg\" (UID: \"ba4aedf5-c822-4edd-827c-c18ec3b57ab4\") " pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" Jul 12 08:09:34.763029 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.762899 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4aedf5-c822-4edd-827c-c18ec3b57ab4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-679d74b6b9-rmbvg\" (UID: \"ba4aedf5-c822-4edd-827c-c18ec3b57ab4\") " pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" Jul 12 08:09:34.763085 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.763058 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jxgt\" (UniqueName: \"kubernetes.io/projected/ba4aedf5-c822-4edd-827c-c18ec3b57ab4-kube-api-access-9jxgt\") pod \"telemeter-client-679d74b6b9-rmbvg\" (UID: \"ba4aedf5-c822-4edd-827c-c18ec3b57ab4\") " pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" Jul 12 08:09:34.763585 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.763420 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ba4aedf5-c822-4edd-827c-c18ec3b57ab4-telemeter-client-tls\") pod \"telemeter-client-679d74b6b9-rmbvg\" (UID: \"ba4aedf5-c822-4edd-827c-c18ec3b57ab4\") " pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" Jul 12 08:09:34.763585 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.763473 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4aedf5-c822-4edd-827c-c18ec3b57ab4-serving-certs-ca-bundle\") pod \"telemeter-client-679d74b6b9-rmbvg\" (UID: \"ba4aedf5-c822-4edd-827c-c18ec3b57ab4\") " pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" Jul 12 08:09:34.764209 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.764172 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.749350549 podStartE2EDuration="2.764158604s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.808055ms" isStatefulPod=false podCreationTimestamp="2026-07-12 08:09:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:09:34.762371459 +0000 UTC m=+162.447182340" watchObservedRunningTime="2026-07-12 08:09:34.764158604 +0000 UTC m=+162.448969461" Jul 12 08:09:34.865488 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.865438 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4aedf5-c822-4edd-827c-c18ec3b57ab4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-679d74b6b9-rmbvg\" (UID: \"ba4aedf5-c822-4edd-827c-c18ec3b57ab4\") " pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" Jul 12 08:09:34.865678 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.865521 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jxgt\" (UniqueName: \"kubernetes.io/projected/ba4aedf5-c822-4edd-827c-c18ec3b57ab4-kube-api-access-9jxgt\") pod \"telemeter-client-679d74b6b9-rmbvg\" (UID: \"ba4aedf5-c822-4edd-827c-c18ec3b57ab4\") " pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" Jul 12 08:09:34.865678 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.865585 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ba4aedf5-c822-4edd-827c-c18ec3b57ab4-telemeter-client-tls\") pod \"telemeter-client-679d74b6b9-rmbvg\" (UID: \"ba4aedf5-c822-4edd-827c-c18ec3b57ab4\") " pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" Jul 12 08:09:34.865678 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.865622 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4aedf5-c822-4edd-827c-c18ec3b57ab4-serving-certs-ca-bundle\") pod \"telemeter-client-679d74b6b9-rmbvg\" (UID: \"ba4aedf5-c822-4edd-827c-c18ec3b57ab4\") " pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" Jul 12 08:09:34.865678 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.865672 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ba4aedf5-c822-4edd-827c-c18ec3b57ab4-secret-telemeter-client\") pod \"telemeter-client-679d74b6b9-rmbvg\" (UID: \"ba4aedf5-c822-4edd-827c-c18ec3b57ab4\") " pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" Jul 12 08:09:34.865906 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.865703 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ba4aedf5-c822-4edd-827c-c18ec3b57ab4-federate-client-tls\") pod \"telemeter-client-679d74b6b9-rmbvg\" (UID: \"ba4aedf5-c822-4edd-827c-c18ec3b57ab4\") " pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" Jul 12 08:09:34.865906 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.865730 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba4aedf5-c822-4edd-827c-c18ec3b57ab4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-679d74b6b9-rmbvg\" (UID: \"ba4aedf5-c822-4edd-827c-c18ec3b57ab4\") " pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" Jul 12 08:09:34.865906 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.865760 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba4aedf5-c822-4edd-827c-c18ec3b57ab4-metrics-client-ca\") pod \"telemeter-client-679d74b6b9-rmbvg\" (UID: \"ba4aedf5-c822-4edd-827c-c18ec3b57ab4\") " pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" Jul 12 08:09:34.866766 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.866731 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4aedf5-c822-4edd-827c-c18ec3b57ab4-serving-certs-ca-bundle\") pod \"telemeter-client-679d74b6b9-rmbvg\" (UID: \"ba4aedf5-c822-4edd-827c-c18ec3b57ab4\") " pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" Jul 12 08:09:34.866908 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.866889 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4aedf5-c822-4edd-827c-c18ec3b57ab4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-679d74b6b9-rmbvg\" (UID: \"ba4aedf5-c822-4edd-827c-c18ec3b57ab4\") " pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" Jul 12 08:09:34.867000 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.866980 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba4aedf5-c822-4edd-827c-c18ec3b57ab4-metrics-client-ca\") pod \"telemeter-client-679d74b6b9-rmbvg\" (UID: \"ba4aedf5-c822-4edd-827c-c18ec3b57ab4\") " pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" Jul 12 08:09:34.869310 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.869271 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ba4aedf5-c822-4edd-827c-c18ec3b57ab4-federate-client-tls\") pod \"telemeter-client-679d74b6b9-rmbvg\" (UID: \"ba4aedf5-c822-4edd-827c-c18ec3b57ab4\") " pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" Jul 12 08:09:34.870301 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.870278 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ba4aedf5-c822-4edd-827c-c18ec3b57ab4-telemeter-client-tls\") pod \"telemeter-client-679d74b6b9-rmbvg\" (UID: \"ba4aedf5-c822-4edd-827c-c18ec3b57ab4\") " pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" Jul 12 08:09:34.870375 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.870302 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba4aedf5-c822-4edd-827c-c18ec3b57ab4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-679d74b6b9-rmbvg\" (UID: \"ba4aedf5-c822-4edd-827c-c18ec3b57ab4\") " pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" Jul 12 08:09:34.870375 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.870318 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ba4aedf5-c822-4edd-827c-c18ec3b57ab4-secret-telemeter-client\") pod \"telemeter-client-679d74b6b9-rmbvg\" (UID: \"ba4aedf5-c822-4edd-827c-c18ec3b57ab4\") " pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" Jul 12 08:09:34.873440 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:34.873423 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jxgt\" (UniqueName: \"kubernetes.io/projected/ba4aedf5-c822-4edd-827c-c18ec3b57ab4-kube-api-access-9jxgt\") pod \"telemeter-client-679d74b6b9-rmbvg\" (UID: \"ba4aedf5-c822-4edd-827c-c18ec3b57ab4\") " pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" Jul 12 08:09:35.003391 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:35.003292 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" Jul 12 08:09:35.148285 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:35.148242 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-679d74b6b9-rmbvg"] Jul 12 08:09:35.151389 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:09:35.151363 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba4aedf5_c822_4edd_827c_c18ec3b57ab4.slice/crio-505854c02cb8ac885c114d276f7ad1ca1a14d93e61be605b6ed0f4e1ddb17013 WatchSource:0}: Error finding container 505854c02cb8ac885c114d276f7ad1ca1a14d93e61be605b6ed0f4e1ddb17013: Status 404 returned error can't find the container with id 505854c02cb8ac885c114d276f7ad1ca1a14d93e61be605b6ed0f4e1ddb17013 Jul 12 08:09:35.743662 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:35.743623 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" event={"ID":"ba4aedf5-c822-4edd-827c-c18ec3b57ab4","Type":"ContainerStarted","Data":"505854c02cb8ac885c114d276f7ad1ca1a14d93e61be605b6ed0f4e1ddb17013"} Jul 12 08:09:37.754957 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:37.754857 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" event={"ID":"ba4aedf5-c822-4edd-827c-c18ec3b57ab4","Type":"ContainerStarted","Data":"db925feb8a6e47c8588c207400cf421023daf82da0770ebe7f4d96b17476b4fd"} Jul 12 08:09:37.754957 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:37.754915 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" event={"ID":"ba4aedf5-c822-4edd-827c-c18ec3b57ab4","Type":"ContainerStarted","Data":"dd8c17d4d507b73a63793b2367d5837c5f0a2f77bf08a5cb5344d531d5e5de58"} Jul 12 08:09:37.755497 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:37.754962 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" event={"ID":"ba4aedf5-c822-4edd-827c-c18ec3b57ab4","Type":"ContainerStarted","Data":"a32bfe18a6e4eb8e2182ae81d82a0e4b60c34d3d37c7251375acff955c492e1d"} Jul 12 08:09:37.776645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:37.776596 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-679d74b6b9-rmbvg" podStartSLOduration=1.553946641 podStartE2EDuration="3.776579633s" totalImagesPullingTime="2.222632992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:09:37.775103239 +0000 UTC m=+165.459914108" watchObservedRunningTime="2026-07-12 08:09:37.776579633 +0000 UTC m=+165.461390490" Jul 12 08:09:38.344749 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:38.344697 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5795f7f684-x2dj6"] Jul 12 08:09:38.347017 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:38.346999 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:38.358067 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:38.358042 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5795f7f684-x2dj6"] Jul 12 08:09:38.399059 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:38.399024 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3543a4c-e9fc-4936-a90b-99933edc257c-trusted-ca-bundle\") pod \"console-5795f7f684-x2dj6\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:38.399238 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:38.399066 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3543a4c-e9fc-4936-a90b-99933edc257c-console-oauth-config\") pod \"console-5795f7f684-x2dj6\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:38.399238 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:38.399090 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9gsz\" (UniqueName: \"kubernetes.io/projected/d3543a4c-e9fc-4936-a90b-99933edc257c-kube-api-access-q9gsz\") pod \"console-5795f7f684-x2dj6\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:38.399238 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:38.399116 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3543a4c-e9fc-4936-a90b-99933edc257c-console-serving-cert\") pod \"console-5795f7f684-x2dj6\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:38.399238 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:38.399138 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3543a4c-e9fc-4936-a90b-99933edc257c-service-ca\") pod \"console-5795f7f684-x2dj6\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:38.399238 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:38.399156 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3543a4c-e9fc-4936-a90b-99933edc257c-oauth-serving-cert\") pod \"console-5795f7f684-x2dj6\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:38.399425 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:38.399231 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3543a4c-e9fc-4936-a90b-99933edc257c-console-config\") pod \"console-5795f7f684-x2dj6\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:38.500359 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:38.500322 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3543a4c-e9fc-4936-a90b-99933edc257c-console-serving-cert\") pod \"console-5795f7f684-x2dj6\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:38.500518 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:38.500365 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3543a4c-e9fc-4936-a90b-99933edc257c-service-ca\") pod \"console-5795f7f684-x2dj6\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:38.500518 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:38.500391 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3543a4c-e9fc-4936-a90b-99933edc257c-oauth-serving-cert\") pod \"console-5795f7f684-x2dj6\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:38.500518 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:38.500420 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3543a4c-e9fc-4936-a90b-99933edc257c-console-config\") pod \"console-5795f7f684-x2dj6\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:38.500518 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:38.500464 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3543a4c-e9fc-4936-a90b-99933edc257c-trusted-ca-bundle\") pod \"console-5795f7f684-x2dj6\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:38.500518 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:38.500504 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3543a4c-e9fc-4936-a90b-99933edc257c-console-oauth-config\") pod \"console-5795f7f684-x2dj6\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:38.500745 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:38.500534 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9gsz\" (UniqueName: \"kubernetes.io/projected/d3543a4c-e9fc-4936-a90b-99933edc257c-kube-api-access-q9gsz\") pod \"console-5795f7f684-x2dj6\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:38.501286 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:38.501263 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3543a4c-e9fc-4936-a90b-99933edc257c-oauth-serving-cert\") pod \"console-5795f7f684-x2dj6\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:38.501397 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:38.501259 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3543a4c-e9fc-4936-a90b-99933edc257c-console-config\") pod \"console-5795f7f684-x2dj6\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:38.501397 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:38.501341 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3543a4c-e9fc-4936-a90b-99933edc257c-service-ca\") pod \"console-5795f7f684-x2dj6\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:38.501466 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:38.501414 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3543a4c-e9fc-4936-a90b-99933edc257c-trusted-ca-bundle\") pod \"console-5795f7f684-x2dj6\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:38.502857 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:38.502841 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3543a4c-e9fc-4936-a90b-99933edc257c-console-serving-cert\") pod \"console-5795f7f684-x2dj6\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:38.502941 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:38.502914 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3543a4c-e9fc-4936-a90b-99933edc257c-console-oauth-config\") pod \"console-5795f7f684-x2dj6\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:38.507538 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:38.507521 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9gsz\" (UniqueName: \"kubernetes.io/projected/d3543a4c-e9fc-4936-a90b-99933edc257c-kube-api-access-q9gsz\") pod \"console-5795f7f684-x2dj6\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:38.656852 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:38.656756 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:38.802912 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:38.802835 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5795f7f684-x2dj6"] Jul 12 08:09:38.805906 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:09:38.805881 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3543a4c_e9fc_4936_a90b_99933edc257c.slice/crio-5e6a5e8676347a9e7133d83664dc33dfc64011f9293202e9b1d5c180819bc61d WatchSource:0}: Error finding container 5e6a5e8676347a9e7133d83664dc33dfc64011f9293202e9b1d5c180819bc61d: Status 404 returned error can't find the container with id 5e6a5e8676347a9e7133d83664dc33dfc64011f9293202e9b1d5c180819bc61d Jul 12 08:09:39.766627 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:39.766588 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5795f7f684-x2dj6" event={"ID":"d3543a4c-e9fc-4936-a90b-99933edc257c","Type":"ContainerStarted","Data":"fe396cb3e50ddab3cf945588f03534c33f47da555bb6b131d82d1f829f4f87da"} Jul 12 08:09:39.766803 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:39.766644 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5795f7f684-x2dj6" event={"ID":"d3543a4c-e9fc-4936-a90b-99933edc257c","Type":"ContainerStarted","Data":"5e6a5e8676347a9e7133d83664dc33dfc64011f9293202e9b1d5c180819bc61d"} Jul 12 08:09:39.783333 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:39.783282 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5795f7f684-x2dj6" podStartSLOduration=1.783268214 podStartE2EDuration="1.783268214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:09:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:09:39.782369649 +0000 UTC m=+167.467180508" watchObservedRunningTime="2026-07-12 08:09:39.783268214 +0000 UTC m=+167.468079073" Jul 12 08:09:48.657364 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:48.657276 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:48.657364 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:48.657335 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:48.661913 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:48.661895 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:48.805171 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:48.805145 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:09:48.856479 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:09:48.856448 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5676459676-p7spp"] Jul 12 08:10:13.876828 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:13.876758 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5676459676-p7spp" podUID="bae875db-2c09-4ad5-b4e4-1f1714d437c6" containerName="console" containerID="cri-o://e8627301b9e812b42060701e03f66c25f696d823eab8e3c94f47ee3233f92b98" gracePeriod=15 Jul 12 08:10:14.117101 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.117075 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5676459676-p7spp" Jul 12 08:10:14.297902 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.297872 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae875db-2c09-4ad5-b4e4-1f1714d437c6-trusted-ca-bundle\") pod \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " Jul 12 08:10:14.298087 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.297911 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bae875db-2c09-4ad5-b4e4-1f1714d437c6-oauth-serving-cert\") pod \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " Jul 12 08:10:14.298087 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.297965 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bae875db-2c09-4ad5-b4e4-1f1714d437c6-console-config\") pod \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " Jul 12 08:10:14.298087 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.298006 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bae875db-2c09-4ad5-b4e4-1f1714d437c6-service-ca\") pod \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " Jul 12 08:10:14.298087 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.298027 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79p5l\" (UniqueName: \"kubernetes.io/projected/bae875db-2c09-4ad5-b4e4-1f1714d437c6-kube-api-access-79p5l\") pod \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " Jul 12 08:10:14.298087 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.298060 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bae875db-2c09-4ad5-b4e4-1f1714d437c6-console-serving-cert\") pod \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " Jul 12 08:10:14.298347 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.298141 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bae875db-2c09-4ad5-b4e4-1f1714d437c6-console-oauth-config\") pod \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\" (UID: \"bae875db-2c09-4ad5-b4e4-1f1714d437c6\") " Jul 12 08:10:14.298431 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.298397 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bae875db-2c09-4ad5-b4e4-1f1714d437c6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bae875db-2c09-4ad5-b4e4-1f1714d437c6" (UID: "bae875db-2c09-4ad5-b4e4-1f1714d437c6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 08:10:14.298431 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.298411 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bae875db-2c09-4ad5-b4e4-1f1714d437c6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bae875db-2c09-4ad5-b4e4-1f1714d437c6" (UID: "bae875db-2c09-4ad5-b4e4-1f1714d437c6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 08:10:14.298531 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.298468 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bae875db-2c09-4ad5-b4e4-1f1714d437c6-service-ca" (OuterVolumeSpecName: "service-ca") pod "bae875db-2c09-4ad5-b4e4-1f1714d437c6" (UID: "bae875db-2c09-4ad5-b4e4-1f1714d437c6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 08:10:14.298531 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.298473 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bae875db-2c09-4ad5-b4e4-1f1714d437c6-console-config" (OuterVolumeSpecName: "console-config") pod "bae875db-2c09-4ad5-b4e4-1f1714d437c6" (UID: "bae875db-2c09-4ad5-b4e4-1f1714d437c6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 08:10:14.300257 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.300232 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bae875db-2c09-4ad5-b4e4-1f1714d437c6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bae875db-2c09-4ad5-b4e4-1f1714d437c6" (UID: "bae875db-2c09-4ad5-b4e4-1f1714d437c6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 08:10:14.300386 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.300250 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bae875db-2c09-4ad5-b4e4-1f1714d437c6-kube-api-access-79p5l" (OuterVolumeSpecName: "kube-api-access-79p5l") pod "bae875db-2c09-4ad5-b4e4-1f1714d437c6" (UID: "bae875db-2c09-4ad5-b4e4-1f1714d437c6"). InnerVolumeSpecName "kube-api-access-79p5l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 08:10:14.300386 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.300296 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bae875db-2c09-4ad5-b4e4-1f1714d437c6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bae875db-2c09-4ad5-b4e4-1f1714d437c6" (UID: "bae875db-2c09-4ad5-b4e4-1f1714d437c6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 08:10:14.399498 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.399461 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bae875db-2c09-4ad5-b4e4-1f1714d437c6-console-oauth-config\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:10:14.399498 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.399492 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae875db-2c09-4ad5-b4e4-1f1714d437c6-trusted-ca-bundle\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:10:14.399498 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.399502 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bae875db-2c09-4ad5-b4e4-1f1714d437c6-oauth-serving-cert\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:10:14.399731 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.399510 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bae875db-2c09-4ad5-b4e4-1f1714d437c6-console-config\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:10:14.399731 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.399519 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bae875db-2c09-4ad5-b4e4-1f1714d437c6-service-ca\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:10:14.399731 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.399527 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79p5l\" (UniqueName: \"kubernetes.io/projected/bae875db-2c09-4ad5-b4e4-1f1714d437c6-kube-api-access-79p5l\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:10:14.399731 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.399535 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bae875db-2c09-4ad5-b4e4-1f1714d437c6-console-serving-cert\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:10:14.895231 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.895195 2576 generic.go:356] "Generic (PLEG): container finished" podID="bae875db-2c09-4ad5-b4e4-1f1714d437c6" containerID="e8627301b9e812b42060701e03f66c25f696d823eab8e3c94f47ee3233f92b98" exitCode=0 Jul 12 08:10:14.895591 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.895236 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5676459676-p7spp" Jul 12 08:10:14.895591 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.895260 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5676459676-p7spp" event={"ID":"bae875db-2c09-4ad5-b4e4-1f1714d437c6","Type":"ContainerDied","Data":"e8627301b9e812b42060701e03f66c25f696d823eab8e3c94f47ee3233f92b98"} Jul 12 08:10:14.895591 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.895300 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5676459676-p7spp" event={"ID":"bae875db-2c09-4ad5-b4e4-1f1714d437c6","Type":"ContainerDied","Data":"617a92b0c68a446e4552638c79d363ae6f3514724fc1dc4f1b4550a048b67b86"} Jul 12 08:10:14.895591 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.895321 2576 scope.go:117] "RemoveContainer" containerID="e8627301b9e812b42060701e03f66c25f696d823eab8e3c94f47ee3233f92b98" Jul 12 08:10:14.903505 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.903486 2576 scope.go:117] "RemoveContainer" containerID="e8627301b9e812b42060701e03f66c25f696d823eab8e3c94f47ee3233f92b98" Jul 12 08:10:14.903751 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:10:14.903733 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8627301b9e812b42060701e03f66c25f696d823eab8e3c94f47ee3233f92b98\": container with ID starting with e8627301b9e812b42060701e03f66c25f696d823eab8e3c94f47ee3233f92b98 not found: ID does not exist" containerID="e8627301b9e812b42060701e03f66c25f696d823eab8e3c94f47ee3233f92b98" Jul 12 08:10:14.903801 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.903759 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8627301b9e812b42060701e03f66c25f696d823eab8e3c94f47ee3233f92b98"} err="failed to get container status \"e8627301b9e812b42060701e03f66c25f696d823eab8e3c94f47ee3233f92b98\": rpc error: code = NotFound desc = could not find container \"e8627301b9e812b42060701e03f66c25f696d823eab8e3c94f47ee3233f92b98\": container with ID starting with e8627301b9e812b42060701e03f66c25f696d823eab8e3c94f47ee3233f92b98 not found: ID does not exist" Jul 12 08:10:14.910852 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.910828 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5676459676-p7spp"] Jul 12 08:10:14.914125 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:14.914100 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5676459676-p7spp"] Jul 12 08:10:16.849871 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:16.849839 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bae875db-2c09-4ad5-b4e4-1f1714d437c6" path="/var/lib/kubelet/pods/bae875db-2c09-4ad5-b4e4-1f1714d437c6/volumes" Jul 12 08:10:49.326496 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.326459 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-677ddd858c-jsvxs"] Jul 12 08:10:49.326996 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.326771 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bae875db-2c09-4ad5-b4e4-1f1714d437c6" containerName="console" Jul 12 08:10:49.326996 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.326783 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bae875db-2c09-4ad5-b4e4-1f1714d437c6" containerName="console" Jul 12 08:10:49.326996 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.326830 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bae875db-2c09-4ad5-b4e4-1f1714d437c6" containerName="console" Jul 12 08:10:49.329697 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.329673 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:10:49.340473 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.340449 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-677ddd858c-jsvxs"] Jul 12 08:10:49.491819 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.491782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-service-ca\") pod \"console-677ddd858c-jsvxs\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:10:49.492016 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.491825 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-console-serving-cert\") pod \"console-677ddd858c-jsvxs\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:10:49.492016 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.491899 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8278\" (UniqueName: \"kubernetes.io/projected/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-kube-api-access-b8278\") pod \"console-677ddd858c-jsvxs\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:10:49.492016 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.491923 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-console-oauth-config\") pod \"console-677ddd858c-jsvxs\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:10:49.492016 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.491962 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-console-config\") pod \"console-677ddd858c-jsvxs\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:10:49.492016 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.491982 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-oauth-serving-cert\") pod \"console-677ddd858c-jsvxs\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:10:49.492211 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.492051 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-trusted-ca-bundle\") pod \"console-677ddd858c-jsvxs\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:10:49.592733 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.592654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-console-config\") pod \"console-677ddd858c-jsvxs\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:10:49.592733 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.592688 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-oauth-serving-cert\") pod \"console-677ddd858c-jsvxs\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:10:49.592972 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.592735 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-trusted-ca-bundle\") pod \"console-677ddd858c-jsvxs\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:10:49.592972 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.592765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-service-ca\") pod \"console-677ddd858c-jsvxs\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:10:49.592972 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.592784 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-console-serving-cert\") pod \"console-677ddd858c-jsvxs\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:10:49.593136 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.592966 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8278\" (UniqueName: \"kubernetes.io/projected/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-kube-api-access-b8278\") pod \"console-677ddd858c-jsvxs\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:10:49.593136 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.593011 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-console-oauth-config\") pod \"console-677ddd858c-jsvxs\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:10:49.593556 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.593532 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-console-config\") pod \"console-677ddd858c-jsvxs\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:10:49.593556 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.593545 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-oauth-serving-cert\") pod \"console-677ddd858c-jsvxs\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:10:49.593695 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.593624 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-trusted-ca-bundle\") pod \"console-677ddd858c-jsvxs\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:10:49.593695 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.593628 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-service-ca\") pod \"console-677ddd858c-jsvxs\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:10:49.595235 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.595208 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-console-serving-cert\") pod \"console-677ddd858c-jsvxs\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:10:49.595412 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.595394 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-console-oauth-config\") pod \"console-677ddd858c-jsvxs\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:10:49.600029 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.599996 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8278\" (UniqueName: \"kubernetes.io/projected/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-kube-api-access-b8278\") pod \"console-677ddd858c-jsvxs\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:10:49.639138 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.639115 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:10:49.768442 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:49.768409 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-677ddd858c-jsvxs"] Jul 12 08:10:49.771815 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:10:49.771789 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9ed8b8c_eb5d_4fd5_b526_776ed2342891.slice/crio-9733b58be6df525460cc87cf2fe2fce768f48541f694e7cb592a5ce2b1d6af5e WatchSource:0}: Error finding container 9733b58be6df525460cc87cf2fe2fce768f48541f694e7cb592a5ce2b1d6af5e: Status 404 returned error can't find the container with id 9733b58be6df525460cc87cf2fe2fce768f48541f694e7cb592a5ce2b1d6af5e Jul 12 08:10:50.025730 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:50.025697 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677ddd858c-jsvxs" event={"ID":"a9ed8b8c-eb5d-4fd5-b526-776ed2342891","Type":"ContainerStarted","Data":"98acc493427bf6622aa79780a453335b8d6ded5bd8a1fcf7a02b8ea354e3e9c8"} Jul 12 08:10:50.025898 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:50.025747 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677ddd858c-jsvxs" event={"ID":"a9ed8b8c-eb5d-4fd5-b526-776ed2342891","Type":"ContainerStarted","Data":"9733b58be6df525460cc87cf2fe2fce768f48541f694e7cb592a5ce2b1d6af5e"} Jul 12 08:10:50.041414 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:50.041334 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-677ddd858c-jsvxs" podStartSLOduration=1.041298333 podStartE2EDuration="1.041298333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:10:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:10:50.041062429 +0000 UTC m=+237.725873289" watchObservedRunningTime="2026-07-12 08:10:50.041298333 +0000 UTC m=+237.726109192" Jul 12 08:10:59.639827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:59.639788 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:10:59.640229 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:59.639845 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:10:59.644502 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:10:59.644480 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:11:00.067197 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:00.067169 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:11:00.111999 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:00.111960 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5795f7f684-x2dj6"] Jul 12 08:11:25.133068 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:25.133025 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5795f7f684-x2dj6" podUID="d3543a4c-e9fc-4936-a90b-99933edc257c" containerName="console" containerID="cri-o://fe396cb3e50ddab3cf945588f03534c33f47da555bb6b131d82d1f829f4f87da" gracePeriod=15 Jul 12 08:11:25.369290 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:25.369263 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:11:25.500017 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:25.499847 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3543a4c-e9fc-4936-a90b-99933edc257c-console-serving-cert\") pod \"d3543a4c-e9fc-4936-a90b-99933edc257c\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " Jul 12 08:11:25.500017 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:25.500002 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9gsz\" (UniqueName: \"kubernetes.io/projected/d3543a4c-e9fc-4936-a90b-99933edc257c-kube-api-access-q9gsz\") pod \"d3543a4c-e9fc-4936-a90b-99933edc257c\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " Jul 12 08:11:25.500241 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:25.500086 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3543a4c-e9fc-4936-a90b-99933edc257c-service-ca\") pod \"d3543a4c-e9fc-4936-a90b-99933edc257c\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " Jul 12 08:11:25.500241 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:25.500114 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3543a4c-e9fc-4936-a90b-99933edc257c-trusted-ca-bundle\") pod \"d3543a4c-e9fc-4936-a90b-99933edc257c\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " Jul 12 08:11:25.500241 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:25.500145 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3543a4c-e9fc-4936-a90b-99933edc257c-oauth-serving-cert\") pod \"d3543a4c-e9fc-4936-a90b-99933edc257c\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " Jul 12 08:11:25.500241 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:25.500182 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3543a4c-e9fc-4936-a90b-99933edc257c-console-oauth-config\") pod \"d3543a4c-e9fc-4936-a90b-99933edc257c\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " Jul 12 08:11:25.500241 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:25.500217 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3543a4c-e9fc-4936-a90b-99933edc257c-console-config\") pod \"d3543a4c-e9fc-4936-a90b-99933edc257c\" (UID: \"d3543a4c-e9fc-4936-a90b-99933edc257c\") " Jul 12 08:11:25.500547 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:25.500515 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3543a4c-e9fc-4936-a90b-99933edc257c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d3543a4c-e9fc-4936-a90b-99933edc257c" (UID: "d3543a4c-e9fc-4936-a90b-99933edc257c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 08:11:25.500621 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:25.500552 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3543a4c-e9fc-4936-a90b-99933edc257c-service-ca" (OuterVolumeSpecName: "service-ca") pod "d3543a4c-e9fc-4936-a90b-99933edc257c" (UID: "d3543a4c-e9fc-4936-a90b-99933edc257c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 08:11:25.500621 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:25.500566 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3543a4c-e9fc-4936-a90b-99933edc257c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d3543a4c-e9fc-4936-a90b-99933edc257c" (UID: "d3543a4c-e9fc-4936-a90b-99933edc257c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 08:11:25.500805 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:25.500780 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3543a4c-e9fc-4936-a90b-99933edc257c-console-config" (OuterVolumeSpecName: "console-config") pod "d3543a4c-e9fc-4936-a90b-99933edc257c" (UID: "d3543a4c-e9fc-4936-a90b-99933edc257c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 08:11:25.502067 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:25.502047 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3543a4c-e9fc-4936-a90b-99933edc257c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d3543a4c-e9fc-4936-a90b-99933edc257c" (UID: "d3543a4c-e9fc-4936-a90b-99933edc257c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 08:11:25.502146 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:25.502091 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3543a4c-e9fc-4936-a90b-99933edc257c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d3543a4c-e9fc-4936-a90b-99933edc257c" (UID: "d3543a4c-e9fc-4936-a90b-99933edc257c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 08:11:25.502258 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:25.502241 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3543a4c-e9fc-4936-a90b-99933edc257c-kube-api-access-q9gsz" (OuterVolumeSpecName: "kube-api-access-q9gsz") pod "d3543a4c-e9fc-4936-a90b-99933edc257c" (UID: "d3543a4c-e9fc-4936-a90b-99933edc257c"). InnerVolumeSpecName "kube-api-access-q9gsz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 08:11:25.600949 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:25.600891 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3543a4c-e9fc-4936-a90b-99933edc257c-console-serving-cert\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:11:25.600949 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:25.600949 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9gsz\" (UniqueName: \"kubernetes.io/projected/d3543a4c-e9fc-4936-a90b-99933edc257c-kube-api-access-q9gsz\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:11:25.600949 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:25.600959 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3543a4c-e9fc-4936-a90b-99933edc257c-service-ca\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:11:25.601164 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:25.600969 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3543a4c-e9fc-4936-a90b-99933edc257c-trusted-ca-bundle\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:11:25.601164 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:25.600977 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3543a4c-e9fc-4936-a90b-99933edc257c-oauth-serving-cert\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:11:25.601164 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:25.600999 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3543a4c-e9fc-4936-a90b-99933edc257c-console-oauth-config\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:11:25.601164 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:25.601007 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3543a4c-e9fc-4936-a90b-99933edc257c-console-config\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:11:26.163093 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:26.163059 2576 generic.go:356] "Generic (PLEG): container finished" podID="d3543a4c-e9fc-4936-a90b-99933edc257c" containerID="fe396cb3e50ddab3cf945588f03534c33f47da555bb6b131d82d1f829f4f87da" exitCode=0 Jul 12 08:11:26.163472 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:26.163104 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5795f7f684-x2dj6" Jul 12 08:11:26.163472 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:26.163124 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5795f7f684-x2dj6" event={"ID":"d3543a4c-e9fc-4936-a90b-99933edc257c","Type":"ContainerDied","Data":"fe396cb3e50ddab3cf945588f03534c33f47da555bb6b131d82d1f829f4f87da"} Jul 12 08:11:26.163472 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:26.163170 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5795f7f684-x2dj6" event={"ID":"d3543a4c-e9fc-4936-a90b-99933edc257c","Type":"ContainerDied","Data":"5e6a5e8676347a9e7133d83664dc33dfc64011f9293202e9b1d5c180819bc61d"} Jul 12 08:11:26.163472 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:26.163190 2576 scope.go:117] "RemoveContainer" containerID="fe396cb3e50ddab3cf945588f03534c33f47da555bb6b131d82d1f829f4f87da" Jul 12 08:11:26.171422 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:26.171414 2576 scope.go:117] "RemoveContainer" containerID="fe396cb3e50ddab3cf945588f03534c33f47da555bb6b131d82d1f829f4f87da" Jul 12 08:11:26.171674 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:11:26.171657 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe396cb3e50ddab3cf945588f03534c33f47da555bb6b131d82d1f829f4f87da\": container with ID starting with fe396cb3e50ddab3cf945588f03534c33f47da555bb6b131d82d1f829f4f87da not found: ID does not exist" containerID="fe396cb3e50ddab3cf945588f03534c33f47da555bb6b131d82d1f829f4f87da" Jul 12 08:11:26.171720 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:26.171682 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe396cb3e50ddab3cf945588f03534c33f47da555bb6b131d82d1f829f4f87da"} err="failed to get container status \"fe396cb3e50ddab3cf945588f03534c33f47da555bb6b131d82d1f829f4f87da\": rpc error: code = NotFound desc = could not find container \"fe396cb3e50ddab3cf945588f03534c33f47da555bb6b131d82d1f829f4f87da\": container with ID starting with fe396cb3e50ddab3cf945588f03534c33f47da555bb6b131d82d1f829f4f87da not found: ID does not exist" Jul 12 08:11:26.183123 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:26.183096 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5795f7f684-x2dj6"] Jul 12 08:11:26.186191 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:26.186170 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5795f7f684-x2dj6"] Jul 12 08:11:26.849751 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:26.849715 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3543a4c-e9fc-4936-a90b-99933edc257c" path="/var/lib/kubelet/pods/d3543a4c-e9fc-4936-a90b-99933edc257c/volumes" Jul 12 08:11:52.759554 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:52.759528 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kd8ct_00af3b5b-04d5-49be-8505-4116f740ae52/ovn-acl-logging/0.log" Jul 12 08:11:52.759980 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:52.759558 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kd8ct_00af3b5b-04d5-49be-8505-4116f740ae52/ovn-acl-logging/0.log" Jul 12 08:11:52.762345 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:11:52.762322 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 12 08:12:12.676744 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:12.676683 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4"] Jul 12 08:12:12.679143 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:12.677015 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3543a4c-e9fc-4936-a90b-99933edc257c" containerName="console" Jul 12 08:12:12.679143 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:12.677028 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3543a4c-e9fc-4936-a90b-99933edc257c" containerName="console" Jul 12 08:12:12.679143 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:12.677077 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3543a4c-e9fc-4936-a90b-99933edc257c" containerName="console" Jul 12 08:12:12.679961 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:12.679945 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4" Jul 12 08:12:12.682202 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:12.682170 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c46hf\"" Jul 12 08:12:12.682321 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:12.682231 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 12 08:12:12.683038 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:12.683021 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 12 08:12:12.687117 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:12.687098 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4"] Jul 12 08:12:12.783594 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:12.783563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4\" (UID: \"6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4" Jul 12 08:12:12.783594 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:12.783596 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmxhp\" (UniqueName: \"kubernetes.io/projected/6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010-kube-api-access-pmxhp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4\" (UID: \"6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4" Jul 12 08:12:12.783805 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:12.783624 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4\" (UID: \"6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4" Jul 12 08:12:12.885002 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:12.884965 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4\" (UID: \"6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4" Jul 12 08:12:12.885002 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:12.884996 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmxhp\" (UniqueName: \"kubernetes.io/projected/6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010-kube-api-access-pmxhp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4\" (UID: \"6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4" Jul 12 08:12:12.885349 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:12.885086 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4\" (UID: \"6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4" Jul 12 08:12:12.885421 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:12.885377 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4\" (UID: \"6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4" Jul 12 08:12:12.885485 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:12.885429 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4\" (UID: \"6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4" Jul 12 08:12:12.893001 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:12.892969 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmxhp\" (UniqueName: \"kubernetes.io/projected/6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010-kube-api-access-pmxhp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4\" (UID: \"6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4" Jul 12 08:12:12.989692 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:12.989604 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4" Jul 12 08:12:13.119284 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:13.119248 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4"] Jul 12 08:12:13.122491 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:12:13.122460 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ce3c8bb_fb92_4f39_a331_f0fb8a2ca010.slice/crio-a229c5adeae2b3bb64b5fcc0eb991b9ad8df0d76b8f6f87f37967fea3258bbf2 WatchSource:0}: Error finding container a229c5adeae2b3bb64b5fcc0eb991b9ad8df0d76b8f6f87f37967fea3258bbf2: Status 404 returned error can't find the container with id a229c5adeae2b3bb64b5fcc0eb991b9ad8df0d76b8f6f87f37967fea3258bbf2 Jul 12 08:12:13.124334 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:13.124315 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 08:12:13.343080 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:13.343041 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4" event={"ID":"6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010","Type":"ContainerStarted","Data":"a229c5adeae2b3bb64b5fcc0eb991b9ad8df0d76b8f6f87f37967fea3258bbf2"} Jul 12 08:12:21.375812 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:21.375778 2576 generic.go:356] "Generic (PLEG): container finished" podID="6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010" containerID="6253932fdbd2854b4996284243b1216eb5505ace286b89fea49cc9f388fdd19a" exitCode=0 Jul 12 08:12:21.376204 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:21.375851 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4" event={"ID":"6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010","Type":"ContainerDied","Data":"6253932fdbd2854b4996284243b1216eb5505ace286b89fea49cc9f388fdd19a"} Jul 12 08:12:24.389779 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:24.389741 2576 generic.go:356] "Generic (PLEG): container finished" podID="6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010" containerID="9480752025dcd92148ec2eebc90a65fd4d656d44d9924aa918fc8fc948b5cc62" exitCode=0 Jul 12 08:12:24.390283 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:24.389827 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4" event={"ID":"6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010","Type":"ContainerDied","Data":"9480752025dcd92148ec2eebc90a65fd4d656d44d9924aa918fc8fc948b5cc62"} Jul 12 08:12:32.425759 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:32.425718 2576 generic.go:356] "Generic (PLEG): container finished" podID="6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010" containerID="c65c0529c23f390f145a78a8414ce310cb435f49248b7f856a194bc29290d8e8" exitCode=0 Jul 12 08:12:32.425759 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:32.425755 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4" event={"ID":"6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010","Type":"ContainerDied","Data":"c65c0529c23f390f145a78a8414ce310cb435f49248b7f856a194bc29290d8e8"} Jul 12 08:12:33.592356 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:33.592328 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4" Jul 12 08:12:33.671594 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:33.671565 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010-bundle\") pod \"6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010\" (UID: \"6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010\") " Jul 12 08:12:33.671729 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:33.671627 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmxhp\" (UniqueName: \"kubernetes.io/projected/6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010-kube-api-access-pmxhp\") pod \"6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010\" (UID: \"6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010\") " Jul 12 08:12:33.671729 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:33.671676 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010-util\") pod \"6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010\" (UID: \"6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010\") " Jul 12 08:12:33.672335 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:33.672307 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010-bundle" (OuterVolumeSpecName: "bundle") pod "6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010" (UID: "6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 08:12:33.673847 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:33.673818 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010-kube-api-access-pmxhp" (OuterVolumeSpecName: "kube-api-access-pmxhp") pod "6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010" (UID: "6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010"). InnerVolumeSpecName "kube-api-access-pmxhp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 08:12:33.676693 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:33.676669 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010-util" (OuterVolumeSpecName: "util") pod "6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010" (UID: "6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 08:12:33.772410 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:33.772390 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010-util\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:12:33.772491 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:33.772411 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010-bundle\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:12:33.772491 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:33.772420 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmxhp\" (UniqueName: \"kubernetes.io/projected/6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010-kube-api-access-pmxhp\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:12:34.435194 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:34.435169 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4" Jul 12 08:12:34.435344 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:34.435168 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540fx9k4" event={"ID":"6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010","Type":"ContainerDied","Data":"a229c5adeae2b3bb64b5fcc0eb991b9ad8df0d76b8f6f87f37967fea3258bbf2"} Jul 12 08:12:34.435344 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:34.435285 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a229c5adeae2b3bb64b5fcc0eb991b9ad8df0d76b8f6f87f37967fea3258bbf2" Jul 12 08:12:40.600910 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:40.600873 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nw2q2"] Jul 12 08:12:40.601306 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:40.601166 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010" containerName="extract" Jul 12 08:12:40.601306 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:40.601178 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010" containerName="extract" Jul 12 08:12:40.601306 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:40.601187 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010" containerName="util" Jul 12 08:12:40.601306 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:40.601193 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010" containerName="util" Jul 12 08:12:40.601306 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:40.601207 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010" containerName="pull" Jul 12 08:12:40.601306 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:40.601213 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010" containerName="pull" Jul 12 08:12:40.601306 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:40.601263 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ce3c8bb-fb92-4f39-a331-f0fb8a2ca010" containerName="extract" Jul 12 08:12:40.603445 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:40.603427 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nw2q2" Jul 12 08:12:40.605911 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:40.605888 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-hrpr5\"" Jul 12 08:12:40.606156 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:40.606139 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 12 08:12:40.606197 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:40.606160 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 12 08:12:40.616087 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:40.616060 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nw2q2"] Jul 12 08:12:40.731505 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:40.731467 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aaf6efaa-1a17-44d4-b8d6-dd3fcb67b602-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nw2q2\" (UID: \"aaf6efaa-1a17-44d4-b8d6-dd3fcb67b602\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nw2q2" Jul 12 08:12:40.731683 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:40.731538 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hr7p\" (UniqueName: \"kubernetes.io/projected/aaf6efaa-1a17-44d4-b8d6-dd3fcb67b602-kube-api-access-2hr7p\") pod \"cert-manager-operator-controller-manager-55c444bf86-nw2q2\" (UID: \"aaf6efaa-1a17-44d4-b8d6-dd3fcb67b602\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nw2q2" Jul 12 08:12:40.832256 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:40.832223 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aaf6efaa-1a17-44d4-b8d6-dd3fcb67b602-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nw2q2\" (UID: \"aaf6efaa-1a17-44d4-b8d6-dd3fcb67b602\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nw2q2" Jul 12 08:12:40.832397 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:40.832280 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hr7p\" (UniqueName: \"kubernetes.io/projected/aaf6efaa-1a17-44d4-b8d6-dd3fcb67b602-kube-api-access-2hr7p\") pod \"cert-manager-operator-controller-manager-55c444bf86-nw2q2\" (UID: \"aaf6efaa-1a17-44d4-b8d6-dd3fcb67b602\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nw2q2" Jul 12 08:12:40.832637 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:40.832617 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aaf6efaa-1a17-44d4-b8d6-dd3fcb67b602-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nw2q2\" (UID: \"aaf6efaa-1a17-44d4-b8d6-dd3fcb67b602\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nw2q2" Jul 12 08:12:40.843305 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:40.843281 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hr7p\" (UniqueName: \"kubernetes.io/projected/aaf6efaa-1a17-44d4-b8d6-dd3fcb67b602-kube-api-access-2hr7p\") pod \"cert-manager-operator-controller-manager-55c444bf86-nw2q2\" (UID: \"aaf6efaa-1a17-44d4-b8d6-dd3fcb67b602\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nw2q2" Jul 12 08:12:40.912719 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:40.912657 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nw2q2" Jul 12 08:12:41.058234 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:41.058205 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nw2q2"] Jul 12 08:12:41.060971 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:12:41.060921 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaf6efaa_1a17_44d4_b8d6_dd3fcb67b602.slice/crio-fcb1b18c96fc7e5f263f067f92a3760e2e45e21b8f0505f952f92d7a7fca8b3d WatchSource:0}: Error finding container fcb1b18c96fc7e5f263f067f92a3760e2e45e21b8f0505f952f92d7a7fca8b3d: Status 404 returned error can't find the container with id fcb1b18c96fc7e5f263f067f92a3760e2e45e21b8f0505f952f92d7a7fca8b3d Jul 12 08:12:41.463149 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:41.463112 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nw2q2" event={"ID":"aaf6efaa-1a17-44d4-b8d6-dd3fcb67b602","Type":"ContainerStarted","Data":"fcb1b18c96fc7e5f263f067f92a3760e2e45e21b8f0505f952f92d7a7fca8b3d"} Jul 12 08:12:43.472822 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:43.472785 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nw2q2" event={"ID":"aaf6efaa-1a17-44d4-b8d6-dd3fcb67b602","Type":"ContainerStarted","Data":"112d2e4da50b73c217e7fdfb27d091443528d85a96eccbee903bd629300e802a"} Jul 12 08:12:43.492056 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:43.492000 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nw2q2" podStartSLOduration=2.054719499 podStartE2EDuration="3.491982337s" totalImagesPullingTime="1.437262838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:12:43.490516501 +0000 UTC m=+351.175327360" watchObservedRunningTime="2026-07-12 08:12:43.491982337 +0000 UTC m=+351.176793196" Jul 12 08:12:44.526239 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.526202 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm"] Jul 12 08:12:44.528654 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.528629 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm" Jul 12 08:12:44.529252 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.529230 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qgnkl"] Jul 12 08:12:44.531100 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.531080 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 12 08:12:44.531186 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.531086 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-qgnkl" Jul 12 08:12:44.531986 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.531963 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c46hf\"" Jul 12 08:12:44.532086 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.531970 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 12 08:12:44.533280 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.533261 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 12 08:12:44.533374 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.533325 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 12 08:12:44.533434 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.533404 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-wl8w4\"" Jul 12 08:12:44.538850 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.538804 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm"] Jul 12 08:12:44.541202 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.541178 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qgnkl"] Jul 12 08:12:44.664491 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.664452 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bab96892-7984-4c24-8c3e-33b2eba4845d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm\" (UID: \"bab96892-7984-4c24-8c3e-33b2eba4845d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm" Jul 12 08:12:44.664491 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.664494 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4p9b\" (UniqueName: \"kubernetes.io/projected/018a1beb-c058-4bfe-953c-0dccd295fc33-kube-api-access-w4p9b\") pod \"cert-manager-webhook-6486ffd997-qgnkl\" (UID: \"018a1beb-c058-4bfe-953c-0dccd295fc33\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qgnkl" Jul 12 08:12:44.664699 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.664516 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bab96892-7984-4c24-8c3e-33b2eba4845d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm\" (UID: \"bab96892-7984-4c24-8c3e-33b2eba4845d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm" Jul 12 08:12:44.664699 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.664609 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/018a1beb-c058-4bfe-953c-0dccd295fc33-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qgnkl\" (UID: \"018a1beb-c058-4bfe-953c-0dccd295fc33\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qgnkl" Jul 12 08:12:44.664699 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.664689 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9c8h\" (UniqueName: \"kubernetes.io/projected/bab96892-7984-4c24-8c3e-33b2eba4845d-kube-api-access-q9c8h\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm\" (UID: \"bab96892-7984-4c24-8c3e-33b2eba4845d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm" Jul 12 08:12:44.766026 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.765991 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9c8h\" (UniqueName: \"kubernetes.io/projected/bab96892-7984-4c24-8c3e-33b2eba4845d-kube-api-access-q9c8h\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm\" (UID: \"bab96892-7984-4c24-8c3e-33b2eba4845d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm" Jul 12 08:12:44.766188 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.766035 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bab96892-7984-4c24-8c3e-33b2eba4845d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm\" (UID: \"bab96892-7984-4c24-8c3e-33b2eba4845d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm" Jul 12 08:12:44.766188 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.766054 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4p9b\" (UniqueName: \"kubernetes.io/projected/018a1beb-c058-4bfe-953c-0dccd295fc33-kube-api-access-w4p9b\") pod \"cert-manager-webhook-6486ffd997-qgnkl\" (UID: \"018a1beb-c058-4bfe-953c-0dccd295fc33\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qgnkl" Jul 12 08:12:44.766188 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.766078 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bab96892-7984-4c24-8c3e-33b2eba4845d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm\" (UID: \"bab96892-7984-4c24-8c3e-33b2eba4845d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm" Jul 12 08:12:44.766188 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.766124 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/018a1beb-c058-4bfe-953c-0dccd295fc33-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qgnkl\" (UID: \"018a1beb-c058-4bfe-953c-0dccd295fc33\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qgnkl" Jul 12 08:12:44.766415 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.766397 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bab96892-7984-4c24-8c3e-33b2eba4845d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm\" (UID: \"bab96892-7984-4c24-8c3e-33b2eba4845d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm" Jul 12 08:12:44.766498 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.766474 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bab96892-7984-4c24-8c3e-33b2eba4845d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm\" (UID: \"bab96892-7984-4c24-8c3e-33b2eba4845d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm" Jul 12 08:12:44.775699 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.775661 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9c8h\" (UniqueName: \"kubernetes.io/projected/bab96892-7984-4c24-8c3e-33b2eba4845d-kube-api-access-q9c8h\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm\" (UID: \"bab96892-7984-4c24-8c3e-33b2eba4845d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm" Jul 12 08:12:44.776618 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.776568 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/018a1beb-c058-4bfe-953c-0dccd295fc33-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qgnkl\" (UID: \"018a1beb-c058-4bfe-953c-0dccd295fc33\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qgnkl" Jul 12 08:12:44.776753 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.776730 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4p9b\" (UniqueName: \"kubernetes.io/projected/018a1beb-c058-4bfe-953c-0dccd295fc33-kube-api-access-w4p9b\") pod \"cert-manager-webhook-6486ffd997-qgnkl\" (UID: \"018a1beb-c058-4bfe-953c-0dccd295fc33\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qgnkl" Jul 12 08:12:44.840686 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.840651 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm" Jul 12 08:12:44.846543 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.846521 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-qgnkl" Jul 12 08:12:44.977876 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.977844 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm"] Jul 12 08:12:44.980581 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:12:44.980553 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbab96892_7984_4c24_8c3e_33b2eba4845d.slice/crio-3cfd7a0ca1aa63aaa52207acb98bb0ff5a26d2a60edf994eef1522ff5d718afb WatchSource:0}: Error finding container 3cfd7a0ca1aa63aaa52207acb98bb0ff5a26d2a60edf994eef1522ff5d718afb: Status 404 returned error can't find the container with id 3cfd7a0ca1aa63aaa52207acb98bb0ff5a26d2a60edf994eef1522ff5d718afb Jul 12 08:12:44.998422 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:44.998401 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qgnkl"] Jul 12 08:12:44.999994 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:12:44.999970 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod018a1beb_c058_4bfe_953c_0dccd295fc33.slice/crio-ec5938b5b3be24fe034d37bc3e223a1d2f9e0b536eccda47cde53bcf184b9c75 WatchSource:0}: Error finding container ec5938b5b3be24fe034d37bc3e223a1d2f9e0b536eccda47cde53bcf184b9c75: Status 404 returned error can't find the container with id ec5938b5b3be24fe034d37bc3e223a1d2f9e0b536eccda47cde53bcf184b9c75 Jul 12 08:12:45.482553 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:45.482476 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-qgnkl" event={"ID":"018a1beb-c058-4bfe-953c-0dccd295fc33","Type":"ContainerStarted","Data":"ec5938b5b3be24fe034d37bc3e223a1d2f9e0b536eccda47cde53bcf184b9c75"} Jul 12 08:12:45.483919 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:45.483889 2576 generic.go:356] "Generic (PLEG): container finished" podID="bab96892-7984-4c24-8c3e-33b2eba4845d" containerID="fd3ca274d24def5e8057ec65044efcb1f2da408cc292fc30f901f155a1463743" exitCode=0 Jul 12 08:12:45.484082 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:45.483984 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm" event={"ID":"bab96892-7984-4c24-8c3e-33b2eba4845d","Type":"ContainerDied","Data":"fd3ca274d24def5e8057ec65044efcb1f2da408cc292fc30f901f155a1463743"} Jul 12 08:12:45.484082 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:45.484044 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm" event={"ID":"bab96892-7984-4c24-8c3e-33b2eba4845d","Type":"ContainerStarted","Data":"3cfd7a0ca1aa63aaa52207acb98bb0ff5a26d2a60edf994eef1522ff5d718afb"} Jul 12 08:12:48.499920 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:48.499832 2576 generic.go:356] "Generic (PLEG): container finished" podID="bab96892-7984-4c24-8c3e-33b2eba4845d" containerID="df0dc3eebbb6ba1f87316e09f7432eeecb9230f7d39009e1e03decbcefe4cb90" exitCode=0 Jul 12 08:12:48.500339 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:48.499911 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm" event={"ID":"bab96892-7984-4c24-8c3e-33b2eba4845d","Type":"ContainerDied","Data":"df0dc3eebbb6ba1f87316e09f7432eeecb9230f7d39009e1e03decbcefe4cb90"} Jul 12 08:12:48.501504 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:48.501481 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-qgnkl" event={"ID":"018a1beb-c058-4bfe-953c-0dccd295fc33","Type":"ContainerStarted","Data":"10969ac48b95094fcb48b145ab0886526146bad4b882d0e36609846ae4d116c5"} Jul 12 08:12:48.501623 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:48.501610 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-qgnkl" Jul 12 08:12:48.537338 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:48.537296 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-qgnkl" podStartSLOduration=1.3316568850000001 podStartE2EDuration="4.537281795s" totalImagesPullingTime="3.20562491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:12:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:12:48.535674669 +0000 UTC m=+356.220485528" watchObservedRunningTime="2026-07-12 08:12:48.537281795 +0000 UTC m=+356.222092653" Jul 12 08:12:49.507865 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:49.507831 2576 generic.go:356] "Generic (PLEG): container finished" podID="bab96892-7984-4c24-8c3e-33b2eba4845d" containerID="7c391727cd2af61e0a2e99abbf661abd34e24c66eea548ed5ec0bf1413c68147" exitCode=0 Jul 12 08:12:49.508388 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:49.507917 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm" event={"ID":"bab96892-7984-4c24-8c3e-33b2eba4845d","Type":"ContainerDied","Data":"7c391727cd2af61e0a2e99abbf661abd34e24c66eea548ed5ec0bf1413c68147"} Jul 12 08:12:50.635877 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:50.635855 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm" Jul 12 08:12:50.816156 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:50.816074 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9c8h\" (UniqueName: \"kubernetes.io/projected/bab96892-7984-4c24-8c3e-33b2eba4845d-kube-api-access-q9c8h\") pod \"bab96892-7984-4c24-8c3e-33b2eba4845d\" (UID: \"bab96892-7984-4c24-8c3e-33b2eba4845d\") " Jul 12 08:12:50.816325 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:50.816170 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bab96892-7984-4c24-8c3e-33b2eba4845d-util\") pod \"bab96892-7984-4c24-8c3e-33b2eba4845d\" (UID: \"bab96892-7984-4c24-8c3e-33b2eba4845d\") " Jul 12 08:12:50.816325 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:50.816215 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bab96892-7984-4c24-8c3e-33b2eba4845d-bundle\") pod \"bab96892-7984-4c24-8c3e-33b2eba4845d\" (UID: \"bab96892-7984-4c24-8c3e-33b2eba4845d\") " Jul 12 08:12:50.816587 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:50.816558 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bab96892-7984-4c24-8c3e-33b2eba4845d-bundle" (OuterVolumeSpecName: "bundle") pod "bab96892-7984-4c24-8c3e-33b2eba4845d" (UID: "bab96892-7984-4c24-8c3e-33b2eba4845d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 08:12:50.818112 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:50.818093 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bab96892-7984-4c24-8c3e-33b2eba4845d-kube-api-access-q9c8h" (OuterVolumeSpecName: "kube-api-access-q9c8h") pod "bab96892-7984-4c24-8c3e-33b2eba4845d" (UID: "bab96892-7984-4c24-8c3e-33b2eba4845d"). InnerVolumeSpecName "kube-api-access-q9c8h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 08:12:50.821338 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:50.821305 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bab96892-7984-4c24-8c3e-33b2eba4845d-util" (OuterVolumeSpecName: "util") pod "bab96892-7984-4c24-8c3e-33b2eba4845d" (UID: "bab96892-7984-4c24-8c3e-33b2eba4845d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 08:12:50.917006 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:50.916979 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bab96892-7984-4c24-8c3e-33b2eba4845d-util\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:12:50.917006 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:50.917005 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bab96892-7984-4c24-8c3e-33b2eba4845d-bundle\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:12:50.917149 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:50.917021 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9c8h\" (UniqueName: \"kubernetes.io/projected/bab96892-7984-4c24-8c3e-33b2eba4845d-kube-api-access-q9c8h\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:12:51.517408 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:51.517376 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm" Jul 12 08:12:51.517408 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:51.517402 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fw7zdm" event={"ID":"bab96892-7984-4c24-8c3e-33b2eba4845d","Type":"ContainerDied","Data":"3cfd7a0ca1aa63aaa52207acb98bb0ff5a26d2a60edf994eef1522ff5d718afb"} Jul 12 08:12:51.517615 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:51.517441 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cfd7a0ca1aa63aaa52207acb98bb0ff5a26d2a60edf994eef1522ff5d718afb" Jul 12 08:12:54.510725 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:54.510692 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-qgnkl" Jul 12 08:12:55.798190 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:55.798148 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rzkj2"] Jul 12 08:12:55.798566 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:55.798443 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bab96892-7984-4c24-8c3e-33b2eba4845d" containerName="pull" Jul 12 08:12:55.798566 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:55.798456 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bab96892-7984-4c24-8c3e-33b2eba4845d" containerName="pull" Jul 12 08:12:55.798566 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:55.798463 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bab96892-7984-4c24-8c3e-33b2eba4845d" containerName="extract" Jul 12 08:12:55.798566 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:55.798468 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bab96892-7984-4c24-8c3e-33b2eba4845d" containerName="extract" Jul 12 08:12:55.798566 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:55.798483 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bab96892-7984-4c24-8c3e-33b2eba4845d" containerName="util" Jul 12 08:12:55.798566 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:55.798488 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bab96892-7984-4c24-8c3e-33b2eba4845d" containerName="util" Jul 12 08:12:55.798566 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:55.798539 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bab96892-7984-4c24-8c3e-33b2eba4845d" containerName="extract" Jul 12 08:12:55.802178 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:55.802161 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-rzkj2" Jul 12 08:12:55.804595 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:55.804574 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-zb8wq\"" Jul 12 08:12:55.810065 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:55.810043 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rzkj2"] Jul 12 08:12:55.956719 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:55.956683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cf8b34d-6b11-4fa9-ba26-2d15ddfddfb0-bound-sa-token\") pod \"cert-manager-55b4d954d5-rzkj2\" (UID: \"0cf8b34d-6b11-4fa9-ba26-2d15ddfddfb0\") " pod="cert-manager/cert-manager-55b4d954d5-rzkj2" Jul 12 08:12:55.956853 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:55.956809 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9l4b\" (UniqueName: \"kubernetes.io/projected/0cf8b34d-6b11-4fa9-ba26-2d15ddfddfb0-kube-api-access-t9l4b\") pod \"cert-manager-55b4d954d5-rzkj2\" (UID: \"0cf8b34d-6b11-4fa9-ba26-2d15ddfddfb0\") " pod="cert-manager/cert-manager-55b4d954d5-rzkj2" Jul 12 08:12:56.057296 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:56.057202 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9l4b\" (UniqueName: \"kubernetes.io/projected/0cf8b34d-6b11-4fa9-ba26-2d15ddfddfb0-kube-api-access-t9l4b\") pod \"cert-manager-55b4d954d5-rzkj2\" (UID: \"0cf8b34d-6b11-4fa9-ba26-2d15ddfddfb0\") " pod="cert-manager/cert-manager-55b4d954d5-rzkj2" Jul 12 08:12:56.057296 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:56.057257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cf8b34d-6b11-4fa9-ba26-2d15ddfddfb0-bound-sa-token\") pod \"cert-manager-55b4d954d5-rzkj2\" (UID: \"0cf8b34d-6b11-4fa9-ba26-2d15ddfddfb0\") " pod="cert-manager/cert-manager-55b4d954d5-rzkj2" Jul 12 08:12:56.065659 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:56.065639 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cf8b34d-6b11-4fa9-ba26-2d15ddfddfb0-bound-sa-token\") pod \"cert-manager-55b4d954d5-rzkj2\" (UID: \"0cf8b34d-6b11-4fa9-ba26-2d15ddfddfb0\") " pod="cert-manager/cert-manager-55b4d954d5-rzkj2" Jul 12 08:12:56.065842 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:56.065821 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9l4b\" (UniqueName: \"kubernetes.io/projected/0cf8b34d-6b11-4fa9-ba26-2d15ddfddfb0-kube-api-access-t9l4b\") pod \"cert-manager-55b4d954d5-rzkj2\" (UID: \"0cf8b34d-6b11-4fa9-ba26-2d15ddfddfb0\") " pod="cert-manager/cert-manager-55b4d954d5-rzkj2" Jul 12 08:12:56.112151 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:56.112112 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-rzkj2" Jul 12 08:12:56.238437 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:56.238405 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rzkj2"] Jul 12 08:12:56.241409 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:12:56.241379 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0cf8b34d_6b11_4fa9_ba26_2d15ddfddfb0.slice/crio-e186e2b64f324223bd7786e7d79d5d1532462fa35c8999efb732814cbe295a97 WatchSource:0}: Error finding container e186e2b64f324223bd7786e7d79d5d1532462fa35c8999efb732814cbe295a97: Status 404 returned error can't find the container with id e186e2b64f324223bd7786e7d79d5d1532462fa35c8999efb732814cbe295a97 Jul 12 08:12:56.540163 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:56.540123 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-rzkj2" event={"ID":"0cf8b34d-6b11-4fa9-ba26-2d15ddfddfb0","Type":"ContainerStarted","Data":"2fcce603d5e6119b43803e6a8344536465c55f82e486218989248209b380e0c7"} Jul 12 08:12:56.540356 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:56.540166 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-rzkj2" event={"ID":"0cf8b34d-6b11-4fa9-ba26-2d15ddfddfb0","Type":"ContainerStarted","Data":"e186e2b64f324223bd7786e7d79d5d1532462fa35c8999efb732814cbe295a97"} Jul 12 08:12:56.555203 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:56.555155 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-rzkj2" podStartSLOduration=1.555140459 podStartE2EDuration="1.555140459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:12:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:12:56.554589804 +0000 UTC m=+364.239400685" watchObservedRunningTime="2026-07-12 08:12:56.555140459 +0000 UTC m=+364.239951318" Jul 12 08:12:58.496152 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:58.496114 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rmdm5"] Jul 12 08:12:58.556604 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:58.556570 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rmdm5"] Jul 12 08:12:58.556767 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:58.556668 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rmdm5" Jul 12 08:12:58.559360 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:58.559337 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-zt8d2\"" Jul 12 08:12:58.560032 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:58.560010 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 12 08:12:58.560148 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:58.560067 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 12 08:12:58.576972 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:58.576922 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4rt6\" (UniqueName: \"kubernetes.io/projected/00da6c87-f6c2-468c-8bdd-06461e34e833-kube-api-access-d4rt6\") pod \"openshift-lws-operator-fd8ccff4c-rmdm5\" (UID: \"00da6c87-f6c2-468c-8bdd-06461e34e833\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rmdm5" Jul 12 08:12:58.577118 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:58.577001 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00da6c87-f6c2-468c-8bdd-06461e34e833-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rmdm5\" (UID: \"00da6c87-f6c2-468c-8bdd-06461e34e833\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rmdm5" Jul 12 08:12:58.678323 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:58.678282 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00da6c87-f6c2-468c-8bdd-06461e34e833-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rmdm5\" (UID: \"00da6c87-f6c2-468c-8bdd-06461e34e833\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rmdm5" Jul 12 08:12:58.678494 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:58.678355 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4rt6\" (UniqueName: \"kubernetes.io/projected/00da6c87-f6c2-468c-8bdd-06461e34e833-kube-api-access-d4rt6\") pod \"openshift-lws-operator-fd8ccff4c-rmdm5\" (UID: \"00da6c87-f6c2-468c-8bdd-06461e34e833\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rmdm5" Jul 12 08:12:58.678677 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:58.678656 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00da6c87-f6c2-468c-8bdd-06461e34e833-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rmdm5\" (UID: \"00da6c87-f6c2-468c-8bdd-06461e34e833\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rmdm5" Jul 12 08:12:58.690730 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:58.690697 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4rt6\" (UniqueName: \"kubernetes.io/projected/00da6c87-f6c2-468c-8bdd-06461e34e833-kube-api-access-d4rt6\") pod \"openshift-lws-operator-fd8ccff4c-rmdm5\" (UID: \"00da6c87-f6c2-468c-8bdd-06461e34e833\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rmdm5" Jul 12 08:12:58.866539 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:58.866506 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rmdm5" Jul 12 08:12:59.009736 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:59.009619 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rmdm5"] Jul 12 08:12:59.012048 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:12:59.012020 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00da6c87_f6c2_468c_8bdd_06461e34e833.slice/crio-ef097a02e031077badb166089ae2263c12e345f0e8494e9d775e14140e3e1b4c WatchSource:0}: Error finding container ef097a02e031077badb166089ae2263c12e345f0e8494e9d775e14140e3e1b4c: Status 404 returned error can't find the container with id ef097a02e031077badb166089ae2263c12e345f0e8494e9d775e14140e3e1b4c Jul 12 08:12:59.554352 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:12:59.554316 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rmdm5" event={"ID":"00da6c87-f6c2-468c-8bdd-06461e34e833","Type":"ContainerStarted","Data":"ef097a02e031077badb166089ae2263c12e345f0e8494e9d775e14140e3e1b4c"} Jul 12 08:13:01.566877 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:01.566840 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rmdm5" event={"ID":"00da6c87-f6c2-468c-8bdd-06461e34e833","Type":"ContainerStarted","Data":"7216bf3cdc3a3cad7c4a6620666c0185c219349e7a52a3b4939146086c94f1c8"} Jul 12 08:13:01.582830 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:01.582480 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rmdm5" podStartSLOduration=1.43557504 podStartE2EDuration="3.582459753s" totalImagesPullingTime="2.146884713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:12:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:13:01.581643599 +0000 UTC m=+369.266454461" watchObservedRunningTime="2026-07-12 08:13:01.582459753 +0000 UTC m=+369.267270611" Jul 12 08:13:04.412694 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:04.412654 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs"] Jul 12 08:13:04.415047 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:04.415028 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs" Jul 12 08:13:04.417200 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:04.417177 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c46hf\"" Jul 12 08:13:04.417349 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:04.417284 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 12 08:13:04.418075 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:04.418056 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 12 08:13:04.422687 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:04.422656 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pp5k\" (UniqueName: \"kubernetes.io/projected/2b4c610c-03bc-4fa0-b47c-9a0db708195b-kube-api-access-2pp5k\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs\" (UID: \"2b4c610c-03bc-4fa0-b47c-9a0db708195b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs" Jul 12 08:13:04.422801 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:04.422723 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b4c610c-03bc-4fa0-b47c-9a0db708195b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs\" (UID: \"2b4c610c-03bc-4fa0-b47c-9a0db708195b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs" Jul 12 08:13:04.422801 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:04.422754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b4c610c-03bc-4fa0-b47c-9a0db708195b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs\" (UID: \"2b4c610c-03bc-4fa0-b47c-9a0db708195b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs" Jul 12 08:13:04.423559 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:04.423528 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs"] Jul 12 08:13:04.523124 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:04.523094 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pp5k\" (UniqueName: \"kubernetes.io/projected/2b4c610c-03bc-4fa0-b47c-9a0db708195b-kube-api-access-2pp5k\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs\" (UID: \"2b4c610c-03bc-4fa0-b47c-9a0db708195b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs" Jul 12 08:13:04.523272 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:04.523137 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b4c610c-03bc-4fa0-b47c-9a0db708195b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs\" (UID: \"2b4c610c-03bc-4fa0-b47c-9a0db708195b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs" Jul 12 08:13:04.523272 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:04.523170 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b4c610c-03bc-4fa0-b47c-9a0db708195b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs\" (UID: \"2b4c610c-03bc-4fa0-b47c-9a0db708195b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs" Jul 12 08:13:04.523462 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:04.523442 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b4c610c-03bc-4fa0-b47c-9a0db708195b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs\" (UID: \"2b4c610c-03bc-4fa0-b47c-9a0db708195b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs" Jul 12 08:13:04.523507 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:04.523480 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b4c610c-03bc-4fa0-b47c-9a0db708195b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs\" (UID: \"2b4c610c-03bc-4fa0-b47c-9a0db708195b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs" Jul 12 08:13:04.530945 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:04.530915 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pp5k\" (UniqueName: \"kubernetes.io/projected/2b4c610c-03bc-4fa0-b47c-9a0db708195b-kube-api-access-2pp5k\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs\" (UID: \"2b4c610c-03bc-4fa0-b47c-9a0db708195b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs" Jul 12 08:13:04.724718 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:04.724630 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs" Jul 12 08:13:04.856120 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:04.856096 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs"] Jul 12 08:13:05.584795 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:05.584755 2576 generic.go:356] "Generic (PLEG): container finished" podID="2b4c610c-03bc-4fa0-b47c-9a0db708195b" containerID="4e8de21e2202437491cb221f139e8cb87923e7466a81377703443fcbf300d9b6" exitCode=0 Jul 12 08:13:05.585152 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:05.584815 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs" event={"ID":"2b4c610c-03bc-4fa0-b47c-9a0db708195b","Type":"ContainerDied","Data":"4e8de21e2202437491cb221f139e8cb87923e7466a81377703443fcbf300d9b6"} Jul 12 08:13:05.585152 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:05.584888 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs" event={"ID":"2b4c610c-03bc-4fa0-b47c-9a0db708195b","Type":"ContainerStarted","Data":"67fde441cd6c668453d58fcc48a489cea196d8d5e909934a9d1c9cdb76ac85c0"} Jul 12 08:13:06.591243 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:06.591154 2576 generic.go:356] "Generic (PLEG): container finished" podID="2b4c610c-03bc-4fa0-b47c-9a0db708195b" containerID="289278b4beb77e2452dad49f97de7d8aef961ea19e2d181058203fe4eb695ff0" exitCode=0 Jul 12 08:13:06.591595 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:06.591243 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs" event={"ID":"2b4c610c-03bc-4fa0-b47c-9a0db708195b","Type":"ContainerDied","Data":"289278b4beb77e2452dad49f97de7d8aef961ea19e2d181058203fe4eb695ff0"} Jul 12 08:13:07.597906 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:07.597865 2576 generic.go:356] "Generic (PLEG): container finished" podID="2b4c610c-03bc-4fa0-b47c-9a0db708195b" containerID="9b281bafa34d206eeb92e0d54f35115b694ba707b09264a61fd1a31405ff5c97" exitCode=0 Jul 12 08:13:07.598366 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:07.597923 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs" event={"ID":"2b4c610c-03bc-4fa0-b47c-9a0db708195b","Type":"ContainerDied","Data":"9b281bafa34d206eeb92e0d54f35115b694ba707b09264a61fd1a31405ff5c97"} Jul 12 08:13:08.727358 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:08.727335 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs" Jul 12 08:13:08.755693 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:08.755662 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pp5k\" (UniqueName: \"kubernetes.io/projected/2b4c610c-03bc-4fa0-b47c-9a0db708195b-kube-api-access-2pp5k\") pod \"2b4c610c-03bc-4fa0-b47c-9a0db708195b\" (UID: \"2b4c610c-03bc-4fa0-b47c-9a0db708195b\") " Jul 12 08:13:08.755819 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:08.755699 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b4c610c-03bc-4fa0-b47c-9a0db708195b-bundle\") pod \"2b4c610c-03bc-4fa0-b47c-9a0db708195b\" (UID: \"2b4c610c-03bc-4fa0-b47c-9a0db708195b\") " Jul 12 08:13:08.755819 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:08.755757 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b4c610c-03bc-4fa0-b47c-9a0db708195b-util\") pod \"2b4c610c-03bc-4fa0-b47c-9a0db708195b\" (UID: \"2b4c610c-03bc-4fa0-b47c-9a0db708195b\") " Jul 12 08:13:08.756674 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:08.756638 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b4c610c-03bc-4fa0-b47c-9a0db708195b-bundle" (OuterVolumeSpecName: "bundle") pod "2b4c610c-03bc-4fa0-b47c-9a0db708195b" (UID: "2b4c610c-03bc-4fa0-b47c-9a0db708195b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 08:13:08.757946 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:08.757907 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b4c610c-03bc-4fa0-b47c-9a0db708195b-kube-api-access-2pp5k" (OuterVolumeSpecName: "kube-api-access-2pp5k") pod "2b4c610c-03bc-4fa0-b47c-9a0db708195b" (UID: "2b4c610c-03bc-4fa0-b47c-9a0db708195b"). InnerVolumeSpecName "kube-api-access-2pp5k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 08:13:08.761999 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:08.761966 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b4c610c-03bc-4fa0-b47c-9a0db708195b-util" (OuterVolumeSpecName: "util") pod "2b4c610c-03bc-4fa0-b47c-9a0db708195b" (UID: "2b4c610c-03bc-4fa0-b47c-9a0db708195b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 08:13:08.856609 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:08.856517 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pp5k\" (UniqueName: \"kubernetes.io/projected/2b4c610c-03bc-4fa0-b47c-9a0db708195b-kube-api-access-2pp5k\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:13:08.856609 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:08.856542 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b4c610c-03bc-4fa0-b47c-9a0db708195b-bundle\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:13:08.856609 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:08.856551 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b4c610c-03bc-4fa0-b47c-9a0db708195b-util\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:13:09.608335 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:09.608293 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs" event={"ID":"2b4c610c-03bc-4fa0-b47c-9a0db708195b","Type":"ContainerDied","Data":"67fde441cd6c668453d58fcc48a489cea196d8d5e909934a9d1c9cdb76ac85c0"} Jul 12 08:13:09.608515 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:09.608342 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm29hs" Jul 12 08:13:09.608515 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:09.608347 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67fde441cd6c668453d58fcc48a489cea196d8d5e909934a9d1c9cdb76ac85c0" Jul 12 08:13:21.475344 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.475308 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc"] Jul 12 08:13:21.475827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.475671 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b4c610c-03bc-4fa0-b47c-9a0db708195b" containerName="util" Jul 12 08:13:21.475827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.475685 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b4c610c-03bc-4fa0-b47c-9a0db708195b" containerName="util" Jul 12 08:13:21.475827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.475694 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b4c610c-03bc-4fa0-b47c-9a0db708195b" containerName="extract" Jul 12 08:13:21.475827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.475701 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b4c610c-03bc-4fa0-b47c-9a0db708195b" containerName="extract" Jul 12 08:13:21.475827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.475708 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b4c610c-03bc-4fa0-b47c-9a0db708195b" containerName="pull" Jul 12 08:13:21.475827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.475714 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b4c610c-03bc-4fa0-b47c-9a0db708195b" containerName="pull" Jul 12 08:13:21.475827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.475821 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b4c610c-03bc-4fa0-b47c-9a0db708195b" containerName="extract" Jul 12 08:13:21.477835 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.477817 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc" Jul 12 08:13:21.480274 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.480247 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 12 08:13:21.480417 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.480292 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mxs99\"" Jul 12 08:13:21.480417 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.480317 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 12 08:13:21.480417 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.480298 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 12 08:13:21.480417 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.480400 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 12 08:13:21.493486 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.493450 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc"] Jul 12 08:13:21.558921 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.558885 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1629a10e-2a82-4cc2-adc8-e20d7bfb3b05-apiservice-cert\") pod \"opendatahub-operator-controller-manager-595c444865-gcdjc\" (UID: \"1629a10e-2a82-4cc2-adc8-e20d7bfb3b05\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc" Jul 12 08:13:21.559102 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.558948 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1629a10e-2a82-4cc2-adc8-e20d7bfb3b05-tmp\") pod \"opendatahub-operator-controller-manager-595c444865-gcdjc\" (UID: \"1629a10e-2a82-4cc2-adc8-e20d7bfb3b05\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc" Jul 12 08:13:21.559102 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.558982 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1629a10e-2a82-4cc2-adc8-e20d7bfb3b05-manifests\") pod \"opendatahub-operator-controller-manager-595c444865-gcdjc\" (UID: \"1629a10e-2a82-4cc2-adc8-e20d7bfb3b05\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc" Jul 12 08:13:21.559102 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.559077 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4hnh\" (UniqueName: \"kubernetes.io/projected/1629a10e-2a82-4cc2-adc8-e20d7bfb3b05-kube-api-access-k4hnh\") pod \"opendatahub-operator-controller-manager-595c444865-gcdjc\" (UID: \"1629a10e-2a82-4cc2-adc8-e20d7bfb3b05\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc" Jul 12 08:13:21.559271 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.559142 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1629a10e-2a82-4cc2-adc8-e20d7bfb3b05-webhook-cert\") pod \"opendatahub-operator-controller-manager-595c444865-gcdjc\" (UID: \"1629a10e-2a82-4cc2-adc8-e20d7bfb3b05\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc" Jul 12 08:13:21.659907 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.659864 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4hnh\" (UniqueName: \"kubernetes.io/projected/1629a10e-2a82-4cc2-adc8-e20d7bfb3b05-kube-api-access-k4hnh\") pod \"opendatahub-operator-controller-manager-595c444865-gcdjc\" (UID: \"1629a10e-2a82-4cc2-adc8-e20d7bfb3b05\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc" Jul 12 08:13:21.660093 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.659922 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1629a10e-2a82-4cc2-adc8-e20d7bfb3b05-webhook-cert\") pod \"opendatahub-operator-controller-manager-595c444865-gcdjc\" (UID: \"1629a10e-2a82-4cc2-adc8-e20d7bfb3b05\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc" Jul 12 08:13:21.660093 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.659992 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1629a10e-2a82-4cc2-adc8-e20d7bfb3b05-apiservice-cert\") pod \"opendatahub-operator-controller-manager-595c444865-gcdjc\" (UID: \"1629a10e-2a82-4cc2-adc8-e20d7bfb3b05\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc" Jul 12 08:13:21.660093 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.660027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1629a10e-2a82-4cc2-adc8-e20d7bfb3b05-tmp\") pod \"opendatahub-operator-controller-manager-595c444865-gcdjc\" (UID: \"1629a10e-2a82-4cc2-adc8-e20d7bfb3b05\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc" Jul 12 08:13:21.660093 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.660060 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1629a10e-2a82-4cc2-adc8-e20d7bfb3b05-manifests\") pod \"opendatahub-operator-controller-manager-595c444865-gcdjc\" (UID: \"1629a10e-2a82-4cc2-adc8-e20d7bfb3b05\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc" Jul 12 08:13:21.660586 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.660554 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1629a10e-2a82-4cc2-adc8-e20d7bfb3b05-manifests\") pod \"opendatahub-operator-controller-manager-595c444865-gcdjc\" (UID: \"1629a10e-2a82-4cc2-adc8-e20d7bfb3b05\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc" Jul 12 08:13:21.663004 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.662975 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1629a10e-2a82-4cc2-adc8-e20d7bfb3b05-apiservice-cert\") pod \"opendatahub-operator-controller-manager-595c444865-gcdjc\" (UID: \"1629a10e-2a82-4cc2-adc8-e20d7bfb3b05\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc" Jul 12 08:13:21.663131 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.663049 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1629a10e-2a82-4cc2-adc8-e20d7bfb3b05-webhook-cert\") pod \"opendatahub-operator-controller-manager-595c444865-gcdjc\" (UID: \"1629a10e-2a82-4cc2-adc8-e20d7bfb3b05\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc" Jul 12 08:13:21.669113 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.669087 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1629a10e-2a82-4cc2-adc8-e20d7bfb3b05-tmp\") pod \"opendatahub-operator-controller-manager-595c444865-gcdjc\" (UID: \"1629a10e-2a82-4cc2-adc8-e20d7bfb3b05\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc" Jul 12 08:13:21.673616 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.673587 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4hnh\" (UniqueName: \"kubernetes.io/projected/1629a10e-2a82-4cc2-adc8-e20d7bfb3b05-kube-api-access-k4hnh\") pod \"opendatahub-operator-controller-manager-595c444865-gcdjc\" (UID: \"1629a10e-2a82-4cc2-adc8-e20d7bfb3b05\") " pod="opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc" Jul 12 08:13:21.787878 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.787847 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc" Jul 12 08:13:21.922182 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:21.922148 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc"] Jul 12 08:13:21.925725 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:13:21.925683 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1629a10e_2a82_4cc2_adc8_e20d7bfb3b05.slice/crio-f0771a6f5c81a2745fb6865665a8464ec2f5139f1fb18c85d81a1a68a9dfe745 WatchSource:0}: Error finding container f0771a6f5c81a2745fb6865665a8464ec2f5139f1fb18c85d81a1a68a9dfe745: Status 404 returned error can't find the container with id f0771a6f5c81a2745fb6865665a8464ec2f5139f1fb18c85d81a1a68a9dfe745 Jul 12 08:13:22.679101 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:22.679052 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc" event={"ID":"1629a10e-2a82-4cc2-adc8-e20d7bfb3b05","Type":"ContainerStarted","Data":"f0771a6f5c81a2745fb6865665a8464ec2f5139f1fb18c85d81a1a68a9dfe745"} Jul 12 08:13:25.696987 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:25.696947 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc" event={"ID":"1629a10e-2a82-4cc2-adc8-e20d7bfb3b05","Type":"ContainerStarted","Data":"6a14683ee667d72f8aad77f83707109a3aa3608cc7900b0ca690610282da6828"} Jul 12 08:13:26.702537 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:26.702499 2576 generic.go:356] "Generic (PLEG): container finished" podID="1629a10e-2a82-4cc2-adc8-e20d7bfb3b05" containerID="6a14683ee667d72f8aad77f83707109a3aa3608cc7900b0ca690610282da6828" exitCode=0 Jul 12 08:13:26.702970 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:26.702591 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc" event={"ID":"1629a10e-2a82-4cc2-adc8-e20d7bfb3b05","Type":"ContainerDied","Data":"6a14683ee667d72f8aad77f83707109a3aa3608cc7900b0ca690610282da6828"} Jul 12 08:13:27.709269 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:27.709234 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc" event={"ID":"1629a10e-2a82-4cc2-adc8-e20d7bfb3b05","Type":"ContainerStarted","Data":"a063137c101cf5220492debd3d149b46f919697c11a365c5da85f7418839f442"} Jul 12 08:13:27.709755 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:27.709375 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc" Jul 12 08:13:27.731802 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:27.731743 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc" podStartSLOduration=2.316883176 podStartE2EDuration="6.731720303s" totalImagesPullingTime="3.255300871s" totalInitContainerRuntime="1.159536256s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:13:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:13:27.728871375 +0000 UTC m=+395.413682254" watchObservedRunningTime="2026-07-12 08:13:27.731720303 +0000 UTC m=+395.416531161" Jul 12 08:13:38.715898 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:38.715862 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-595c444865-gcdjc" Jul 12 08:13:40.918487 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:40.918450 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-65cfff4589-b4nws"] Jul 12 08:13:40.927653 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:40.927624 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65cfff4589-b4nws" Jul 12 08:13:40.930035 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:40.930006 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 12 08:13:40.930175 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:40.930160 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 12 08:13:40.930344 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:40.930322 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 12 08:13:40.931064 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:40.931047 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 12 08:13:40.931126 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:40.931067 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-bh65g\"" Jul 12 08:13:40.938907 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:40.938888 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65cfff4589-b4nws"] Jul 12 08:13:41.034901 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:41.034863 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85hbc\" (UniqueName: \"kubernetes.io/projected/6138fabc-d22b-477c-9d28-0c35474e8f00-kube-api-access-85hbc\") pod \"kube-auth-proxy-65cfff4589-b4nws\" (UID: \"6138fabc-d22b-477c-9d28-0c35474e8f00\") " pod="openshift-ingress/kube-auth-proxy-65cfff4589-b4nws" Jul 12 08:13:41.035079 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:41.034913 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6138fabc-d22b-477c-9d28-0c35474e8f00-tls-certs\") pod \"kube-auth-proxy-65cfff4589-b4nws\" (UID: \"6138fabc-d22b-477c-9d28-0c35474e8f00\") " pod="openshift-ingress/kube-auth-proxy-65cfff4589-b4nws" Jul 12 08:13:41.035079 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:41.034971 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6138fabc-d22b-477c-9d28-0c35474e8f00-tmp\") pod \"kube-auth-proxy-65cfff4589-b4nws\" (UID: \"6138fabc-d22b-477c-9d28-0c35474e8f00\") " pod="openshift-ingress/kube-auth-proxy-65cfff4589-b4nws" Jul 12 08:13:41.135729 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:41.135698 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6138fabc-d22b-477c-9d28-0c35474e8f00-tls-certs\") pod \"kube-auth-proxy-65cfff4589-b4nws\" (UID: \"6138fabc-d22b-477c-9d28-0c35474e8f00\") " pod="openshift-ingress/kube-auth-proxy-65cfff4589-b4nws" Jul 12 08:13:41.135914 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:41.135738 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6138fabc-d22b-477c-9d28-0c35474e8f00-tmp\") pod \"kube-auth-proxy-65cfff4589-b4nws\" (UID: \"6138fabc-d22b-477c-9d28-0c35474e8f00\") " pod="openshift-ingress/kube-auth-proxy-65cfff4589-b4nws" Jul 12 08:13:41.135914 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:41.135836 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85hbc\" (UniqueName: \"kubernetes.io/projected/6138fabc-d22b-477c-9d28-0c35474e8f00-kube-api-access-85hbc\") pod \"kube-auth-proxy-65cfff4589-b4nws\" (UID: \"6138fabc-d22b-477c-9d28-0c35474e8f00\") " pod="openshift-ingress/kube-auth-proxy-65cfff4589-b4nws" Jul 12 08:13:41.138137 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:41.138111 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6138fabc-d22b-477c-9d28-0c35474e8f00-tmp\") pod \"kube-auth-proxy-65cfff4589-b4nws\" (UID: \"6138fabc-d22b-477c-9d28-0c35474e8f00\") " pod="openshift-ingress/kube-auth-proxy-65cfff4589-b4nws" Jul 12 08:13:41.138368 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:41.138343 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6138fabc-d22b-477c-9d28-0c35474e8f00-tls-certs\") pod \"kube-auth-proxy-65cfff4589-b4nws\" (UID: \"6138fabc-d22b-477c-9d28-0c35474e8f00\") " pod="openshift-ingress/kube-auth-proxy-65cfff4589-b4nws" Jul 12 08:13:41.143396 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:41.143370 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85hbc\" (UniqueName: \"kubernetes.io/projected/6138fabc-d22b-477c-9d28-0c35474e8f00-kube-api-access-85hbc\") pod \"kube-auth-proxy-65cfff4589-b4nws\" (UID: \"6138fabc-d22b-477c-9d28-0c35474e8f00\") " pod="openshift-ingress/kube-auth-proxy-65cfff4589-b4nws" Jul 12 08:13:41.237419 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:41.237326 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65cfff4589-b4nws" Jul 12 08:13:41.377757 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:41.377690 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65cfff4589-b4nws"] Jul 12 08:13:41.380496 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:13:41.380463 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6138fabc_d22b_477c_9d28_0c35474e8f00.slice/crio-18fc68daccdca636de4fc7f12ed895f8c08052c70b9b2ddb379172277eceef24 WatchSource:0}: Error finding container 18fc68daccdca636de4fc7f12ed895f8c08052c70b9b2ddb379172277eceef24: Status 404 returned error can't find the container with id 18fc68daccdca636de4fc7f12ed895f8c08052c70b9b2ddb379172277eceef24 Jul 12 08:13:41.777470 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:41.777437 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65cfff4589-b4nws" event={"ID":"6138fabc-d22b-477c-9d28-0c35474e8f00","Type":"ContainerStarted","Data":"18fc68daccdca636de4fc7f12ed895f8c08052c70b9b2ddb379172277eceef24"} Jul 12 08:13:44.794161 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:44.794131 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65cfff4589-b4nws" event={"ID":"6138fabc-d22b-477c-9d28-0c35474e8f00","Type":"ContainerStarted","Data":"d732fb126901b5463c75b3d6e0693ac058737ae544d27093d2ebe7108c91e1f3"} Jul 12 08:13:44.810653 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:44.810587 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-65cfff4589-b4nws" podStartSLOduration=1.91627123 podStartE2EDuration="4.810561357s" totalImagesPullingTime="2.894290127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:13:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:13:44.810065196 +0000 UTC m=+412.494876055" watchObservedRunningTime="2026-07-12 08:13:44.810561357 +0000 UTC m=+412.495372214" Jul 12 08:13:49.106769 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.106725 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx"] Jul 12 08:13:49.110728 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.110706 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" Jul 12 08:13:49.113134 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.113108 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 12 08:13:49.113270 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.113143 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 12 08:13:49.113270 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.113144 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 12 08:13:49.113431 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.113412 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vwqgr\"" Jul 12 08:13:49.113490 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.113469 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 12 08:13:49.125218 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.125194 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx"] Jul 12 08:13:49.208706 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.208660 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f271bd1d-ec4f-4b9f-aee0-16232f40a72a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-4fqrx\" (UID: \"f271bd1d-ec4f-4b9f-aee0-16232f40a72a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" Jul 12 08:13:49.208706 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.208708 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzn2n\" (UniqueName: \"kubernetes.io/projected/f271bd1d-ec4f-4b9f-aee0-16232f40a72a-kube-api-access-fzn2n\") pod \"istiod-openshift-gateway-94bb8fbfd-4fqrx\" (UID: \"f271bd1d-ec4f-4b9f-aee0-16232f40a72a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" Jul 12 08:13:49.209018 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.208794 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f271bd1d-ec4f-4b9f-aee0-16232f40a72a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-4fqrx\" (UID: \"f271bd1d-ec4f-4b9f-aee0-16232f40a72a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" Jul 12 08:13:49.209018 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.208851 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f271bd1d-ec4f-4b9f-aee0-16232f40a72a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-4fqrx\" (UID: \"f271bd1d-ec4f-4b9f-aee0-16232f40a72a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" Jul 12 08:13:49.209018 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.208882 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f271bd1d-ec4f-4b9f-aee0-16232f40a72a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-4fqrx\" (UID: \"f271bd1d-ec4f-4b9f-aee0-16232f40a72a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" Jul 12 08:13:49.209018 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.208954 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f271bd1d-ec4f-4b9f-aee0-16232f40a72a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-4fqrx\" (UID: \"f271bd1d-ec4f-4b9f-aee0-16232f40a72a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" Jul 12 08:13:49.209018 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.208992 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f271bd1d-ec4f-4b9f-aee0-16232f40a72a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-4fqrx\" (UID: \"f271bd1d-ec4f-4b9f-aee0-16232f40a72a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" Jul 12 08:13:49.310161 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.310127 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f271bd1d-ec4f-4b9f-aee0-16232f40a72a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-4fqrx\" (UID: \"f271bd1d-ec4f-4b9f-aee0-16232f40a72a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" Jul 12 08:13:49.310161 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.310163 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f271bd1d-ec4f-4b9f-aee0-16232f40a72a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-4fqrx\" (UID: \"f271bd1d-ec4f-4b9f-aee0-16232f40a72a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" Jul 12 08:13:49.310426 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.310182 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f271bd1d-ec4f-4b9f-aee0-16232f40a72a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-4fqrx\" (UID: \"f271bd1d-ec4f-4b9f-aee0-16232f40a72a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" Jul 12 08:13:49.310426 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.310213 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f271bd1d-ec4f-4b9f-aee0-16232f40a72a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-4fqrx\" (UID: \"f271bd1d-ec4f-4b9f-aee0-16232f40a72a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" Jul 12 08:13:49.310426 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.310253 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f271bd1d-ec4f-4b9f-aee0-16232f40a72a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-4fqrx\" (UID: \"f271bd1d-ec4f-4b9f-aee0-16232f40a72a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" Jul 12 08:13:49.310426 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.310295 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f271bd1d-ec4f-4b9f-aee0-16232f40a72a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-4fqrx\" (UID: \"f271bd1d-ec4f-4b9f-aee0-16232f40a72a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" Jul 12 08:13:49.310426 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.310326 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzn2n\" (UniqueName: \"kubernetes.io/projected/f271bd1d-ec4f-4b9f-aee0-16232f40a72a-kube-api-access-fzn2n\") pod \"istiod-openshift-gateway-94bb8fbfd-4fqrx\" (UID: \"f271bd1d-ec4f-4b9f-aee0-16232f40a72a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" Jul 12 08:13:49.311082 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.311036 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f271bd1d-ec4f-4b9f-aee0-16232f40a72a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-4fqrx\" (UID: \"f271bd1d-ec4f-4b9f-aee0-16232f40a72a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" Jul 12 08:13:49.312479 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.312455 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f271bd1d-ec4f-4b9f-aee0-16232f40a72a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-4fqrx\" (UID: \"f271bd1d-ec4f-4b9f-aee0-16232f40a72a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" Jul 12 08:13:49.312713 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.312692 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f271bd1d-ec4f-4b9f-aee0-16232f40a72a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-4fqrx\" (UID: \"f271bd1d-ec4f-4b9f-aee0-16232f40a72a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" Jul 12 08:13:49.312762 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.312710 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f271bd1d-ec4f-4b9f-aee0-16232f40a72a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-4fqrx\" (UID: \"f271bd1d-ec4f-4b9f-aee0-16232f40a72a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" Jul 12 08:13:49.312762 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.312718 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f271bd1d-ec4f-4b9f-aee0-16232f40a72a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-4fqrx\" (UID: \"f271bd1d-ec4f-4b9f-aee0-16232f40a72a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" Jul 12 08:13:49.318399 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.318367 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f271bd1d-ec4f-4b9f-aee0-16232f40a72a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-4fqrx\" (UID: \"f271bd1d-ec4f-4b9f-aee0-16232f40a72a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" Jul 12 08:13:49.318705 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.318684 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzn2n\" (UniqueName: \"kubernetes.io/projected/f271bd1d-ec4f-4b9f-aee0-16232f40a72a-kube-api-access-fzn2n\") pod \"istiod-openshift-gateway-94bb8fbfd-4fqrx\" (UID: \"f271bd1d-ec4f-4b9f-aee0-16232f40a72a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" Jul 12 08:13:49.420596 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.420502 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" Jul 12 08:13:49.597997 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.597962 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx"] Jul 12 08:13:49.598324 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:13:49.598301 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf271bd1d_ec4f_4b9f_aee0_16232f40a72a.slice/crio-bc34a348e06b866f95386dc2bf5b6a8b946afd6b467be0add2d3ae4fbd55ef10 WatchSource:0}: Error finding container bc34a348e06b866f95386dc2bf5b6a8b946afd6b467be0add2d3ae4fbd55ef10: Status 404 returned error can't find the container with id bc34a348e06b866f95386dc2bf5b6a8b946afd6b467be0add2d3ae4fbd55ef10 Jul 12 08:13:49.819988 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:49.819952 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" event={"ID":"f271bd1d-ec4f-4b9f-aee0-16232f40a72a","Type":"ContainerStarted","Data":"bc34a348e06b866f95386dc2bf5b6a8b946afd6b467be0add2d3ae4fbd55ef10"} Jul 12 08:13:51.176394 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:51.176361 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4nh4l"] Jul 12 08:13:51.182885 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:51.182859 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4nh4l" Jul 12 08:13:51.185771 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:51.185749 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-xb62v\"" Jul 12 08:13:51.185894 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:51.185803 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 12 08:13:51.191419 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:51.191380 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hq6ds"] Jul 12 08:13:51.196903 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:51.196882 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hq6ds" Jul 12 08:13:51.198816 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:51.198791 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4nh4l"] Jul 12 08:13:51.199416 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:51.199395 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-gzvzw\"" Jul 12 08:13:51.199514 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:51.199410 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 12 08:13:51.209739 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:51.209588 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hq6ds"] Jul 12 08:13:51.228033 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:51.227994 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq7dp\" (UniqueName: \"kubernetes.io/projected/2c6acf83-e3ee-482a-8eb1-c462ca1663d4-kube-api-access-nq7dp\") pod \"llmisvc-controller-manager-777c6bd7d5-hq6ds\" (UID: \"2c6acf83-e3ee-482a-8eb1-c462ca1663d4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hq6ds" Jul 12 08:13:51.228199 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:51.228096 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c6acf83-e3ee-482a-8eb1-c462ca1663d4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hq6ds\" (UID: \"2c6acf83-e3ee-482a-8eb1-c462ca1663d4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hq6ds" Jul 12 08:13:51.228199 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:51.228128 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzkqb\" (UniqueName: \"kubernetes.io/projected/fbffebce-ec32-4aa2-bf19-15521ced0923-kube-api-access-wzkqb\") pod \"kserve-controller-manager-d6f4b65b8-4nh4l\" (UID: \"fbffebce-ec32-4aa2-bf19-15521ced0923\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4nh4l" Jul 12 08:13:51.228199 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:51.228167 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbffebce-ec32-4aa2-bf19-15521ced0923-cert\") pod \"kserve-controller-manager-d6f4b65b8-4nh4l\" (UID: \"fbffebce-ec32-4aa2-bf19-15521ced0923\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4nh4l" Jul 12 08:13:51.328984 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:51.328916 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbffebce-ec32-4aa2-bf19-15521ced0923-cert\") pod \"kserve-controller-manager-d6f4b65b8-4nh4l\" (UID: \"fbffebce-ec32-4aa2-bf19-15521ced0923\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4nh4l" Jul 12 08:13:51.329167 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:51.329048 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq7dp\" (UniqueName: \"kubernetes.io/projected/2c6acf83-e3ee-482a-8eb1-c462ca1663d4-kube-api-access-nq7dp\") pod \"llmisvc-controller-manager-777c6bd7d5-hq6ds\" (UID: \"2c6acf83-e3ee-482a-8eb1-c462ca1663d4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hq6ds" Jul 12 08:13:51.329167 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:13:51.329095 2576 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 12 08:13:51.329167 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:51.329123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c6acf83-e3ee-482a-8eb1-c462ca1663d4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hq6ds\" (UID: \"2c6acf83-e3ee-482a-8eb1-c462ca1663d4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hq6ds" Jul 12 08:13:51.329167 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:51.329148 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzkqb\" (UniqueName: \"kubernetes.io/projected/fbffebce-ec32-4aa2-bf19-15521ced0923-kube-api-access-wzkqb\") pod \"kserve-controller-manager-d6f4b65b8-4nh4l\" (UID: \"fbffebce-ec32-4aa2-bf19-15521ced0923\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4nh4l" Jul 12 08:13:51.329167 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:13:51.329168 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbffebce-ec32-4aa2-bf19-15521ced0923-cert podName:fbffebce-ec32-4aa2-bf19-15521ced0923 nodeName:}" failed. No retries permitted until 2026-07-12 08:13:51.829147647 +0000 UTC m=+419.513958498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fbffebce-ec32-4aa2-bf19-15521ced0923-cert") pod "kserve-controller-manager-d6f4b65b8-4nh4l" (UID: "fbffebce-ec32-4aa2-bf19-15521ced0923") : secret "kserve-webhook-server-cert" not found Jul 12 08:13:51.329525 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:13:51.329486 2576 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 12 08:13:51.329621 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:13:51.329580 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c6acf83-e3ee-482a-8eb1-c462ca1663d4-cert podName:2c6acf83-e3ee-482a-8eb1-c462ca1663d4 nodeName:}" failed. No retries permitted until 2026-07-12 08:13:51.829562055 +0000 UTC m=+419.514372907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2c6acf83-e3ee-482a-8eb1-c462ca1663d4-cert") pod "llmisvc-controller-manager-777c6bd7d5-hq6ds" (UID: "2c6acf83-e3ee-482a-8eb1-c462ca1663d4") : secret "llmisvc-webhook-server-cert" not found Jul 12 08:13:51.341417 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:51.341318 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzkqb\" (UniqueName: \"kubernetes.io/projected/fbffebce-ec32-4aa2-bf19-15521ced0923-kube-api-access-wzkqb\") pod \"kserve-controller-manager-d6f4b65b8-4nh4l\" (UID: \"fbffebce-ec32-4aa2-bf19-15521ced0923\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4nh4l" Jul 12 08:13:51.342245 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:51.342209 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq7dp\" (UniqueName: \"kubernetes.io/projected/2c6acf83-e3ee-482a-8eb1-c462ca1663d4-kube-api-access-nq7dp\") pod \"llmisvc-controller-manager-777c6bd7d5-hq6ds\" (UID: \"2c6acf83-e3ee-482a-8eb1-c462ca1663d4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hq6ds" Jul 12 08:13:51.833988 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:51.833950 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c6acf83-e3ee-482a-8eb1-c462ca1663d4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hq6ds\" (UID: \"2c6acf83-e3ee-482a-8eb1-c462ca1663d4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hq6ds" Jul 12 08:13:51.834186 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:51.834017 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbffebce-ec32-4aa2-bf19-15521ced0923-cert\") pod \"kserve-controller-manager-d6f4b65b8-4nh4l\" (UID: \"fbffebce-ec32-4aa2-bf19-15521ced0923\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4nh4l" Jul 12 08:13:51.836627 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:51.836597 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbffebce-ec32-4aa2-bf19-15521ced0923-cert\") pod \"kserve-controller-manager-d6f4b65b8-4nh4l\" (UID: \"fbffebce-ec32-4aa2-bf19-15521ced0923\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4nh4l" Jul 12 08:13:51.836766 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:51.836698 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c6acf83-e3ee-482a-8eb1-c462ca1663d4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-hq6ds\" (UID: \"2c6acf83-e3ee-482a-8eb1-c462ca1663d4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hq6ds" Jul 12 08:13:52.029371 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:52.029328 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 08:13:52.029480 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:52.029405 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 08:13:52.095947 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:52.095905 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4nh4l" Jul 12 08:13:52.111564 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:52.111534 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hq6ds" Jul 12 08:13:52.310857 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:52.310793 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4nh4l"] Jul 12 08:13:52.315283 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:13:52.314981 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbffebce_ec32_4aa2_bf19_15521ced0923.slice/crio-753c0b3d6ea95141b0c12731ea8a8744c3a3c4bc6dc12d619e477104baa5dc04 WatchSource:0}: Error finding container 753c0b3d6ea95141b0c12731ea8a8744c3a3c4bc6dc12d619e477104baa5dc04: Status 404 returned error can't find the container with id 753c0b3d6ea95141b0c12731ea8a8744c3a3c4bc6dc12d619e477104baa5dc04 Jul 12 08:13:52.318725 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:52.318695 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-hq6ds"] Jul 12 08:13:52.326360 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:13:52.326320 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2c6acf83_e3ee_482a_8eb1_c462ca1663d4.slice/crio-ae32bd56cac5ea627da17ae698a03ef9a4f56b20385a3a9dd01bc2d4642b27f1 WatchSource:0}: Error finding container ae32bd56cac5ea627da17ae698a03ef9a4f56b20385a3a9dd01bc2d4642b27f1: Status 404 returned error can't find the container with id ae32bd56cac5ea627da17ae698a03ef9a4f56b20385a3a9dd01bc2d4642b27f1 Jul 12 08:13:52.835649 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:52.835612 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hq6ds" event={"ID":"2c6acf83-e3ee-482a-8eb1-c462ca1663d4","Type":"ContainerStarted","Data":"ae32bd56cac5ea627da17ae698a03ef9a4f56b20385a3a9dd01bc2d4642b27f1"} Jul 12 08:13:52.837189 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:52.837160 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" event={"ID":"f271bd1d-ec4f-4b9f-aee0-16232f40a72a","Type":"ContainerStarted","Data":"d98b95ef6fb364f0d36c830c1269ee5c7f28f2e0d15d885ca6fe72765b68dcac"} Jul 12 08:13:52.837331 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:52.837320 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" Jul 12 08:13:52.838349 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:52.838324 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4nh4l" event={"ID":"fbffebce-ec32-4aa2-bf19-15521ced0923","Type":"ContainerStarted","Data":"753c0b3d6ea95141b0c12731ea8a8744c3a3c4bc6dc12d619e477104baa5dc04"} Jul 12 08:13:52.865323 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:52.865278 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" podStartSLOduration=1.4365595930000001 podStartE2EDuration="3.865264244s" totalImagesPullingTime="2.428704651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:13:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:13:52.863291727 +0000 UTC m=+420.548102609" watchObservedRunningTime="2026-07-12 08:13:52.865264244 +0000 UTC m=+420.550075102" Jul 12 08:13:53.845850 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:53.845813 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4fqrx" Jul 12 08:13:54.852318 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:54.852283 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4nh4l" Jul 12 08:13:54.852662 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:54.852336 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4nh4l" event={"ID":"fbffebce-ec32-4aa2-bf19-15521ced0923","Type":"ContainerStarted","Data":"2a372d94eb5d8317217fa56fea2950f33a1308b0d4d61e997a4842ad29b758f8"} Jul 12 08:13:54.868378 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:54.868331 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4nh4l" podStartSLOduration=1.458352323 podStartE2EDuration="3.8683164s" totalImagesPullingTime="2.409964077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:13:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:13:54.866140412 +0000 UTC m=+422.550951271" watchObservedRunningTime="2026-07-12 08:13:54.8683164 +0000 UTC m=+422.553127235" Jul 12 08:13:56.862867 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:56.862830 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hq6ds" event={"ID":"2c6acf83-e3ee-482a-8eb1-c462ca1663d4","Type":"ContainerStarted","Data":"c372ded2c94973e0f43e1bf4bd3f47c79a4deff988b3225433fe0fecf0f18b9b"} Jul 12 08:13:56.863366 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:56.862898 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hq6ds" Jul 12 08:13:56.881613 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:13:56.881564 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hq6ds" podStartSLOduration=2.213316811 podStartE2EDuration="5.881550353s" totalImagesPullingTime="3.668233542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:13:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:13:56.87980909 +0000 UTC m=+424.564619973" watchObservedRunningTime="2026-07-12 08:13:56.881550353 +0000 UTC m=+424.566361211" Jul 12 08:14:26.868135 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:26.868104 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4nh4l" Jul 12 08:14:27.871680 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:27.871649 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-hq6ds" Jul 12 08:14:57.185747 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:57.185708 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82"] Jul 12 08:14:57.188310 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:57.188281 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82" Jul 12 08:14:57.190681 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:57.190656 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ppmvh\"" Jul 12 08:14:57.190681 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:57.190678 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 12 08:14:57.190852 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:57.190678 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 12 08:14:57.196715 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:57.196684 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82"] Jul 12 08:14:57.305112 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:57.305080 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98ae7d70-c453-4217-80e8-5f4fc497ffe2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82\" (UID: \"98ae7d70-c453-4217-80e8-5f4fc497ffe2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82" Jul 12 08:14:57.305320 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:57.305138 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98ae7d70-c453-4217-80e8-5f4fc497ffe2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82\" (UID: \"98ae7d70-c453-4217-80e8-5f4fc497ffe2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82" Jul 12 08:14:57.305320 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:57.305248 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s442x\" (UniqueName: \"kubernetes.io/projected/98ae7d70-c453-4217-80e8-5f4fc497ffe2-kube-api-access-s442x\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82\" (UID: \"98ae7d70-c453-4217-80e8-5f4fc497ffe2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82" Jul 12 08:14:57.406289 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:57.406253 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98ae7d70-c453-4217-80e8-5f4fc497ffe2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82\" (UID: \"98ae7d70-c453-4217-80e8-5f4fc497ffe2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82" Jul 12 08:14:57.406468 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:57.406318 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s442x\" (UniqueName: \"kubernetes.io/projected/98ae7d70-c453-4217-80e8-5f4fc497ffe2-kube-api-access-s442x\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82\" (UID: \"98ae7d70-c453-4217-80e8-5f4fc497ffe2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82" Jul 12 08:14:57.406468 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:57.406353 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98ae7d70-c453-4217-80e8-5f4fc497ffe2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82\" (UID: \"98ae7d70-c453-4217-80e8-5f4fc497ffe2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82" Jul 12 08:14:57.406634 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:57.406610 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98ae7d70-c453-4217-80e8-5f4fc497ffe2-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82\" (UID: \"98ae7d70-c453-4217-80e8-5f4fc497ffe2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82" Jul 12 08:14:57.406710 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:57.406685 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98ae7d70-c453-4217-80e8-5f4fc497ffe2-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82\" (UID: \"98ae7d70-c453-4217-80e8-5f4fc497ffe2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82" Jul 12 08:14:57.413862 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:57.413840 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s442x\" (UniqueName: \"kubernetes.io/projected/98ae7d70-c453-4217-80e8-5f4fc497ffe2-kube-api-access-s442x\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82\" (UID: \"98ae7d70-c453-4217-80e8-5f4fc497ffe2\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82" Jul 12 08:14:57.498662 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:57.498605 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82" Jul 12 08:14:57.626285 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:57.626260 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82"] Jul 12 08:14:57.628607 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:14:57.628581 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98ae7d70_c453_4217_80e8_5f4fc497ffe2.slice/crio-c1554eee191b7773e7bff75b4000e5e4b5fa712dad3cf09710f9dffb9d6f207b WatchSource:0}: Error finding container c1554eee191b7773e7bff75b4000e5e4b5fa712dad3cf09710f9dffb9d6f207b: Status 404 returned error can't find the container with id c1554eee191b7773e7bff75b4000e5e4b5fa712dad3cf09710f9dffb9d6f207b Jul 12 08:14:57.791376 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:57.791341 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn"] Jul 12 08:14:57.795059 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:57.795038 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn" Jul 12 08:14:57.802544 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:57.802498 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn"] Jul 12 08:14:57.910464 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:57.910437 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h8qt\" (UniqueName: \"kubernetes.io/projected/fbd04735-c0dc-4a54-8b75-3ab96b145cf9-kube-api-access-9h8qt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn\" (UID: \"fbd04735-c0dc-4a54-8b75-3ab96b145cf9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn" Jul 12 08:14:57.910616 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:57.910469 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbd04735-c0dc-4a54-8b75-3ab96b145cf9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn\" (UID: \"fbd04735-c0dc-4a54-8b75-3ab96b145cf9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn" Jul 12 08:14:57.910616 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:57.910545 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbd04735-c0dc-4a54-8b75-3ab96b145cf9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn\" (UID: \"fbd04735-c0dc-4a54-8b75-3ab96b145cf9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn" Jul 12 08:14:58.011752 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.011719 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbd04735-c0dc-4a54-8b75-3ab96b145cf9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn\" (UID: \"fbd04735-c0dc-4a54-8b75-3ab96b145cf9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn" Jul 12 08:14:58.011923 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.011800 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h8qt\" (UniqueName: \"kubernetes.io/projected/fbd04735-c0dc-4a54-8b75-3ab96b145cf9-kube-api-access-9h8qt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn\" (UID: \"fbd04735-c0dc-4a54-8b75-3ab96b145cf9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn" Jul 12 08:14:58.011923 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.011830 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbd04735-c0dc-4a54-8b75-3ab96b145cf9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn\" (UID: \"fbd04735-c0dc-4a54-8b75-3ab96b145cf9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn" Jul 12 08:14:58.012123 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.012102 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbd04735-c0dc-4a54-8b75-3ab96b145cf9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn\" (UID: \"fbd04735-c0dc-4a54-8b75-3ab96b145cf9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn" Jul 12 08:14:58.012183 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.012163 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbd04735-c0dc-4a54-8b75-3ab96b145cf9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn\" (UID: \"fbd04735-c0dc-4a54-8b75-3ab96b145cf9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn" Jul 12 08:14:58.020681 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.020651 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h8qt\" (UniqueName: \"kubernetes.io/projected/fbd04735-c0dc-4a54-8b75-3ab96b145cf9-kube-api-access-9h8qt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn\" (UID: \"fbd04735-c0dc-4a54-8b75-3ab96b145cf9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn" Jul 12 08:14:58.104986 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.104910 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn" Jul 12 08:14:58.179558 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.179517 2576 generic.go:356] "Generic (PLEG): container finished" podID="98ae7d70-c453-4217-80e8-5f4fc497ffe2" containerID="6becc952a87824b3eb02e51a3c451d2e74f1d5df6185c50f106db3e9d1888fb7" exitCode=0 Jul 12 08:14:58.179729 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.179683 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82" event={"ID":"98ae7d70-c453-4217-80e8-5f4fc497ffe2","Type":"ContainerDied","Data":"6becc952a87824b3eb02e51a3c451d2e74f1d5df6185c50f106db3e9d1888fb7"} Jul 12 08:14:58.179797 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.179731 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82" event={"ID":"98ae7d70-c453-4217-80e8-5f4fc497ffe2","Type":"ContainerStarted","Data":"c1554eee191b7773e7bff75b4000e5e4b5fa712dad3cf09710f9dffb9d6f207b"} Jul 12 08:14:58.259161 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.259123 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn"] Jul 12 08:14:58.261255 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:14:58.261231 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbd04735_c0dc_4a54_8b75_3ab96b145cf9.slice/crio-98fad94e1aa1cc850a831fd356e9fc7c8dba421687e36602f71bc597bbdb788f WatchSource:0}: Error finding container 98fad94e1aa1cc850a831fd356e9fc7c8dba421687e36602f71bc597bbdb788f: Status 404 returned error can't find the container with id 98fad94e1aa1cc850a831fd356e9fc7c8dba421687e36602f71bc597bbdb788f Jul 12 08:14:58.387919 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.387887 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5"] Jul 12 08:14:58.391483 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.391459 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5" Jul 12 08:14:58.399126 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.399104 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5"] Jul 12 08:14:58.517490 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.517454 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67clg\" (UniqueName: \"kubernetes.io/projected/7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c-kube-api-access-67clg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5\" (UID: \"7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5" Jul 12 08:14:58.517698 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.517595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5\" (UID: \"7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5" Jul 12 08:14:58.517698 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.517636 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5\" (UID: \"7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5" Jul 12 08:14:58.618823 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.618728 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5\" (UID: \"7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5" Jul 12 08:14:58.618823 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.618774 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5\" (UID: \"7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5" Jul 12 08:14:58.618823 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.618804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67clg\" (UniqueName: \"kubernetes.io/projected/7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c-kube-api-access-67clg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5\" (UID: \"7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5" Jul 12 08:14:58.619264 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.619239 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5\" (UID: \"7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5" Jul 12 08:14:58.619340 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.619250 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5\" (UID: \"7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5" Jul 12 08:14:58.627229 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.627199 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67clg\" (UniqueName: \"kubernetes.io/projected/7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c-kube-api-access-67clg\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5\" (UID: \"7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5" Jul 12 08:14:58.745810 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.745773 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5" Jul 12 08:14:58.796604 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.796570 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n"] Jul 12 08:14:58.801257 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.801232 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n" Jul 12 08:14:58.809172 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.809142 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n"] Jul 12 08:14:58.880831 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.880806 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5"] Jul 12 08:14:58.882605 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:14:58.882573 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7268afa5_6ab8_4ca2_a0bf_2e11e9c7d98c.slice/crio-e1cffee8d661dc759eb2d2a400cdf10aa325914d6da907439fbfcaff0a350ab7 WatchSource:0}: Error finding container e1cffee8d661dc759eb2d2a400cdf10aa325914d6da907439fbfcaff0a350ab7: Status 404 returned error can't find the container with id e1cffee8d661dc759eb2d2a400cdf10aa325914d6da907439fbfcaff0a350ab7 Jul 12 08:14:58.921080 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.921054 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bnvq\" (UniqueName: \"kubernetes.io/projected/f82cfbb3-7e34-417a-b134-0ec921399861-kube-api-access-7bnvq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n\" (UID: \"f82cfbb3-7e34-417a-b134-0ec921399861\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n" Jul 12 08:14:58.921173 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.921107 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f82cfbb3-7e34-417a-b134-0ec921399861-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n\" (UID: \"f82cfbb3-7e34-417a-b134-0ec921399861\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n" Jul 12 08:14:58.921289 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:58.921265 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f82cfbb3-7e34-417a-b134-0ec921399861-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n\" (UID: \"f82cfbb3-7e34-417a-b134-0ec921399861\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n" Jul 12 08:14:59.022718 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:59.022683 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bnvq\" (UniqueName: \"kubernetes.io/projected/f82cfbb3-7e34-417a-b134-0ec921399861-kube-api-access-7bnvq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n\" (UID: \"f82cfbb3-7e34-417a-b134-0ec921399861\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n" Jul 12 08:14:59.022897 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:59.022730 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f82cfbb3-7e34-417a-b134-0ec921399861-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n\" (UID: \"f82cfbb3-7e34-417a-b134-0ec921399861\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n" Jul 12 08:14:59.022897 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:59.022786 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f82cfbb3-7e34-417a-b134-0ec921399861-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n\" (UID: \"f82cfbb3-7e34-417a-b134-0ec921399861\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n" Jul 12 08:14:59.023152 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:59.023137 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f82cfbb3-7e34-417a-b134-0ec921399861-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n\" (UID: \"f82cfbb3-7e34-417a-b134-0ec921399861\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n" Jul 12 08:14:59.023208 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:59.023182 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f82cfbb3-7e34-417a-b134-0ec921399861-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n\" (UID: \"f82cfbb3-7e34-417a-b134-0ec921399861\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n" Jul 12 08:14:59.032144 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:59.032115 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bnvq\" (UniqueName: \"kubernetes.io/projected/f82cfbb3-7e34-417a-b134-0ec921399861-kube-api-access-7bnvq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n\" (UID: \"f82cfbb3-7e34-417a-b134-0ec921399861\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n" Jul 12 08:14:59.114553 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:59.114526 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n" Jul 12 08:14:59.187627 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:59.187562 2576 generic.go:356] "Generic (PLEG): container finished" podID="7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c" containerID="81127376b74e284b89379f53cba69fb01708d0295231d2394c1bf359e2e0877b" exitCode=0 Jul 12 08:14:59.187627 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:59.187606 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5" event={"ID":"7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c","Type":"ContainerDied","Data":"81127376b74e284b89379f53cba69fb01708d0295231d2394c1bf359e2e0877b"} Jul 12 08:14:59.187853 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:59.187687 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5" event={"ID":"7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c","Type":"ContainerStarted","Data":"e1cffee8d661dc759eb2d2a400cdf10aa325914d6da907439fbfcaff0a350ab7"} Jul 12 08:14:59.190265 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:59.190238 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82" event={"ID":"98ae7d70-c453-4217-80e8-5f4fc497ffe2","Type":"ContainerStarted","Data":"bcb52b552a6b1d706542a665ca2ce6ba1602327a3f2bb2613f10f948be58d572"} Jul 12 08:14:59.192991 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:59.192836 2576 generic.go:356] "Generic (PLEG): container finished" podID="fbd04735-c0dc-4a54-8b75-3ab96b145cf9" containerID="b0ebb7067047f4516f083c57bf42cebebd24b2827d64f5f6aedc0e48af001867" exitCode=0 Jul 12 08:14:59.192991 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:59.192900 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn" event={"ID":"fbd04735-c0dc-4a54-8b75-3ab96b145cf9","Type":"ContainerDied","Data":"b0ebb7067047f4516f083c57bf42cebebd24b2827d64f5f6aedc0e48af001867"} Jul 12 08:14:59.192991 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:59.192964 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn" event={"ID":"fbd04735-c0dc-4a54-8b75-3ab96b145cf9","Type":"ContainerStarted","Data":"98fad94e1aa1cc850a831fd356e9fc7c8dba421687e36602f71bc597bbdb788f"} Jul 12 08:14:59.255949 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:14:59.255908 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n"] Jul 12 08:14:59.258181 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:14:59.258153 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf82cfbb3_7e34_417a_b134_0ec921399861.slice/crio-51bbe388763698dc38014e39e832837164576ac99a0d506f5b96cfc302d07945 WatchSource:0}: Error finding container 51bbe388763698dc38014e39e832837164576ac99a0d506f5b96cfc302d07945: Status 404 returned error can't find the container with id 51bbe388763698dc38014e39e832837164576ac99a0d506f5b96cfc302d07945 Jul 12 08:15:00.202967 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.202908 2576 generic.go:356] "Generic (PLEG): container finished" podID="f82cfbb3-7e34-417a-b134-0ec921399861" containerID="c110a901556387d37a68fae62fe243d87912b92973573aefab2a3920e7063fa9" exitCode=0 Jul 12 08:15:00.203354 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.203014 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n" event={"ID":"f82cfbb3-7e34-417a-b134-0ec921399861","Type":"ContainerDied","Data":"c110a901556387d37a68fae62fe243d87912b92973573aefab2a3920e7063fa9"} Jul 12 08:15:00.203354 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.203085 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n" event={"ID":"f82cfbb3-7e34-417a-b134-0ec921399861","Type":"ContainerStarted","Data":"51bbe388763698dc38014e39e832837164576ac99a0d506f5b96cfc302d07945"} Jul 12 08:15:00.205236 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.205208 2576 generic.go:356] "Generic (PLEG): container finished" podID="98ae7d70-c453-4217-80e8-5f4fc497ffe2" containerID="bcb52b552a6b1d706542a665ca2ce6ba1602327a3f2bb2613f10f948be58d572" exitCode=0 Jul 12 08:15:00.205352 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.205335 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82" event={"ID":"98ae7d70-c453-4217-80e8-5f4fc497ffe2","Type":"ContainerDied","Data":"bcb52b552a6b1d706542a665ca2ce6ba1602327a3f2bb2613f10f948be58d572"} Jul 12 08:15:00.270697 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.270669 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5764bdbdbc-9rxhs"] Jul 12 08:15:00.274147 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.274127 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:00.286731 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.286697 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5764bdbdbc-9rxhs"] Jul 12 08:15:00.336794 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.336765 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9670afd-4d1e-4944-a293-86b49f2070ad-trusted-ca-bundle\") pod \"console-5764bdbdbc-9rxhs\" (UID: \"d9670afd-4d1e-4944-a293-86b49f2070ad\") " pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:00.336951 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.336820 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9670afd-4d1e-4944-a293-86b49f2070ad-console-serving-cert\") pod \"console-5764bdbdbc-9rxhs\" (UID: \"d9670afd-4d1e-4944-a293-86b49f2070ad\") " pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:00.336951 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.336847 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9670afd-4d1e-4944-a293-86b49f2070ad-oauth-serving-cert\") pod \"console-5764bdbdbc-9rxhs\" (UID: \"d9670afd-4d1e-4944-a293-86b49f2070ad\") " pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:00.337076 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.336957 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9670afd-4d1e-4944-a293-86b49f2070ad-console-config\") pod \"console-5764bdbdbc-9rxhs\" (UID: \"d9670afd-4d1e-4944-a293-86b49f2070ad\") " pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:00.337076 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.336993 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9670afd-4d1e-4944-a293-86b49f2070ad-console-oauth-config\") pod \"console-5764bdbdbc-9rxhs\" (UID: \"d9670afd-4d1e-4944-a293-86b49f2070ad\") " pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:00.337076 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.337036 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r725f\" (UniqueName: \"kubernetes.io/projected/d9670afd-4d1e-4944-a293-86b49f2070ad-kube-api-access-r725f\") pod \"console-5764bdbdbc-9rxhs\" (UID: \"d9670afd-4d1e-4944-a293-86b49f2070ad\") " pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:00.337244 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.337183 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9670afd-4d1e-4944-a293-86b49f2070ad-service-ca\") pod \"console-5764bdbdbc-9rxhs\" (UID: \"d9670afd-4d1e-4944-a293-86b49f2070ad\") " pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:00.438685 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.438325 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9670afd-4d1e-4944-a293-86b49f2070ad-console-config\") pod \"console-5764bdbdbc-9rxhs\" (UID: \"d9670afd-4d1e-4944-a293-86b49f2070ad\") " pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:00.438685 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.438380 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9670afd-4d1e-4944-a293-86b49f2070ad-console-oauth-config\") pod \"console-5764bdbdbc-9rxhs\" (UID: \"d9670afd-4d1e-4944-a293-86b49f2070ad\") " pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:00.438685 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.438406 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r725f\" (UniqueName: \"kubernetes.io/projected/d9670afd-4d1e-4944-a293-86b49f2070ad-kube-api-access-r725f\") pod \"console-5764bdbdbc-9rxhs\" (UID: \"d9670afd-4d1e-4944-a293-86b49f2070ad\") " pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:00.438685 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.438479 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9670afd-4d1e-4944-a293-86b49f2070ad-service-ca\") pod \"console-5764bdbdbc-9rxhs\" (UID: \"d9670afd-4d1e-4944-a293-86b49f2070ad\") " pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:00.438685 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.438535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9670afd-4d1e-4944-a293-86b49f2070ad-trusted-ca-bundle\") pod \"console-5764bdbdbc-9rxhs\" (UID: \"d9670afd-4d1e-4944-a293-86b49f2070ad\") " pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:00.439093 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.438852 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9670afd-4d1e-4944-a293-86b49f2070ad-console-serving-cert\") pod \"console-5764bdbdbc-9rxhs\" (UID: \"d9670afd-4d1e-4944-a293-86b49f2070ad\") " pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:00.439093 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.438886 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9670afd-4d1e-4944-a293-86b49f2070ad-oauth-serving-cert\") pod \"console-5764bdbdbc-9rxhs\" (UID: \"d9670afd-4d1e-4944-a293-86b49f2070ad\") " pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:00.439206 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.439146 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9670afd-4d1e-4944-a293-86b49f2070ad-console-config\") pod \"console-5764bdbdbc-9rxhs\" (UID: \"d9670afd-4d1e-4944-a293-86b49f2070ad\") " pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:00.439823 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.439774 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9670afd-4d1e-4944-a293-86b49f2070ad-oauth-serving-cert\") pod \"console-5764bdbdbc-9rxhs\" (UID: \"d9670afd-4d1e-4944-a293-86b49f2070ad\") " pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:00.440015 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.439860 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9670afd-4d1e-4944-a293-86b49f2070ad-trusted-ca-bundle\") pod \"console-5764bdbdbc-9rxhs\" (UID: \"d9670afd-4d1e-4944-a293-86b49f2070ad\") " pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:00.440215 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.440048 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9670afd-4d1e-4944-a293-86b49f2070ad-service-ca\") pod \"console-5764bdbdbc-9rxhs\" (UID: \"d9670afd-4d1e-4944-a293-86b49f2070ad\") " pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:00.441340 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.441313 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9670afd-4d1e-4944-a293-86b49f2070ad-console-oauth-config\") pod \"console-5764bdbdbc-9rxhs\" (UID: \"d9670afd-4d1e-4944-a293-86b49f2070ad\") " pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:00.442010 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.441986 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9670afd-4d1e-4944-a293-86b49f2070ad-console-serving-cert\") pod \"console-5764bdbdbc-9rxhs\" (UID: \"d9670afd-4d1e-4944-a293-86b49f2070ad\") " pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:00.448203 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.448185 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r725f\" (UniqueName: \"kubernetes.io/projected/d9670afd-4d1e-4944-a293-86b49f2070ad-kube-api-access-r725f\") pod \"console-5764bdbdbc-9rxhs\" (UID: \"d9670afd-4d1e-4944-a293-86b49f2070ad\") " pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:00.641187 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.641089 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:00.772766 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:00.772741 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5764bdbdbc-9rxhs"] Jul 12 08:15:00.774526 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:15:00.774496 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9670afd_4d1e_4944_a293_86b49f2070ad.slice/crio-fb6426e14db556991fd1f603ce5fc372df9f9ee3930240802a03bf18eb1e0ec1 WatchSource:0}: Error finding container fb6426e14db556991fd1f603ce5fc372df9f9ee3930240802a03bf18eb1e0ec1: Status 404 returned error can't find the container with id fb6426e14db556991fd1f603ce5fc372df9f9ee3930240802a03bf18eb1e0ec1 Jul 12 08:15:01.212578 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:01.212479 2576 generic.go:356] "Generic (PLEG): container finished" podID="7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c" containerID="cbb0eba6afba176590b29101b83adbb8daf729b89d6c4e5ab6be062f57d0423c" exitCode=0 Jul 12 08:15:01.213004 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:01.212567 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5" event={"ID":"7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c","Type":"ContainerDied","Data":"cbb0eba6afba176590b29101b83adbb8daf729b89d6c4e5ab6be062f57d0423c"} Jul 12 08:15:01.214387 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:01.214367 2576 generic.go:356] "Generic (PLEG): container finished" podID="f82cfbb3-7e34-417a-b134-0ec921399861" containerID="7729b0717bb36ff7d973b48f92f5a186e7492b52c676aac1ba9d37459c2e4322" exitCode=0 Jul 12 08:15:01.214482 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:01.214452 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n" event={"ID":"f82cfbb3-7e34-417a-b134-0ec921399861","Type":"ContainerDied","Data":"7729b0717bb36ff7d973b48f92f5a186e7492b52c676aac1ba9d37459c2e4322"} Jul 12 08:15:01.216238 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:01.216204 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5764bdbdbc-9rxhs" event={"ID":"d9670afd-4d1e-4944-a293-86b49f2070ad","Type":"ContainerStarted","Data":"020eaea92fa033fa7740503f35ce37481ad82afabf1388941b4391a8ee47bc2a"} Jul 12 08:15:01.216330 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:01.216250 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5764bdbdbc-9rxhs" event={"ID":"d9670afd-4d1e-4944-a293-86b49f2070ad","Type":"ContainerStarted","Data":"fb6426e14db556991fd1f603ce5fc372df9f9ee3930240802a03bf18eb1e0ec1"} Jul 12 08:15:01.218402 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:01.218382 2576 generic.go:356] "Generic (PLEG): container finished" podID="98ae7d70-c453-4217-80e8-5f4fc497ffe2" containerID="8c3a4560852d4d7814787d14217c3893c751219021f661ff9babdf39a45d888d" exitCode=0 Jul 12 08:15:01.218532 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:01.218446 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82" event={"ID":"98ae7d70-c453-4217-80e8-5f4fc497ffe2","Type":"ContainerDied","Data":"8c3a4560852d4d7814787d14217c3893c751219021f661ff9babdf39a45d888d"} Jul 12 08:15:01.220320 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:01.220301 2576 generic.go:356] "Generic (PLEG): container finished" podID="fbd04735-c0dc-4a54-8b75-3ab96b145cf9" containerID="9b27a320288e243396bde1349545d22e7830573f2e0ed5dedb7c6c5126f737b1" exitCode=0 Jul 12 08:15:01.220401 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:01.220379 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn" event={"ID":"fbd04735-c0dc-4a54-8b75-3ab96b145cf9","Type":"ContainerDied","Data":"9b27a320288e243396bde1349545d22e7830573f2e0ed5dedb7c6c5126f737b1"} Jul 12 08:15:01.275609 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:01.275562 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5764bdbdbc-9rxhs" podStartSLOduration=1.275544531 podStartE2EDuration="1.275544531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:15:01.273252804 +0000 UTC m=+488.958063685" watchObservedRunningTime="2026-07-12 08:15:01.275544531 +0000 UTC m=+488.960355389" Jul 12 08:15:02.227696 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:02.227657 2576 generic.go:356] "Generic (PLEG): container finished" podID="7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c" containerID="05a9849c2040693ba2b7151ea0fd601825f61103298c7cd5a7790cdc34f987d0" exitCode=0 Jul 12 08:15:02.228186 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:02.227733 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5" event={"ID":"7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c","Type":"ContainerDied","Data":"05a9849c2040693ba2b7151ea0fd601825f61103298c7cd5a7790cdc34f987d0"} Jul 12 08:15:02.229761 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:02.229733 2576 generic.go:356] "Generic (PLEG): container finished" podID="f82cfbb3-7e34-417a-b134-0ec921399861" containerID="22a6dee807e705bf2e950ea6f1db3a283183b5930553c6bcfe966596efbafcb1" exitCode=0 Jul 12 08:15:02.229858 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:02.229819 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n" event={"ID":"f82cfbb3-7e34-417a-b134-0ec921399861","Type":"ContainerDied","Data":"22a6dee807e705bf2e950ea6f1db3a283183b5930553c6bcfe966596efbafcb1"} Jul 12 08:15:02.231907 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:02.231888 2576 generic.go:356] "Generic (PLEG): container finished" podID="fbd04735-c0dc-4a54-8b75-3ab96b145cf9" containerID="3d7d80b9677b5b7483b3f5479e52beb60aea3e7c609de88406ad70c548aa1af2" exitCode=0 Jul 12 08:15:02.232019 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:02.231951 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn" event={"ID":"fbd04735-c0dc-4a54-8b75-3ab96b145cf9","Type":"ContainerDied","Data":"3d7d80b9677b5b7483b3f5479e52beb60aea3e7c609de88406ad70c548aa1af2"} Jul 12 08:15:02.364659 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:02.364631 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82" Jul 12 08:15:02.457305 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:02.457267 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98ae7d70-c453-4217-80e8-5f4fc497ffe2-bundle\") pod \"98ae7d70-c453-4217-80e8-5f4fc497ffe2\" (UID: \"98ae7d70-c453-4217-80e8-5f4fc497ffe2\") " Jul 12 08:15:02.457489 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:02.457432 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98ae7d70-c453-4217-80e8-5f4fc497ffe2-util\") pod \"98ae7d70-c453-4217-80e8-5f4fc497ffe2\" (UID: \"98ae7d70-c453-4217-80e8-5f4fc497ffe2\") " Jul 12 08:15:02.457489 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:02.457464 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s442x\" (UniqueName: \"kubernetes.io/projected/98ae7d70-c453-4217-80e8-5f4fc497ffe2-kube-api-access-s442x\") pod \"98ae7d70-c453-4217-80e8-5f4fc497ffe2\" (UID: \"98ae7d70-c453-4217-80e8-5f4fc497ffe2\") " Jul 12 08:15:02.457954 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:02.457903 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98ae7d70-c453-4217-80e8-5f4fc497ffe2-bundle" (OuterVolumeSpecName: "bundle") pod "98ae7d70-c453-4217-80e8-5f4fc497ffe2" (UID: "98ae7d70-c453-4217-80e8-5f4fc497ffe2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 08:15:02.459777 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:02.459596 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98ae7d70-c453-4217-80e8-5f4fc497ffe2-kube-api-access-s442x" (OuterVolumeSpecName: "kube-api-access-s442x") pod "98ae7d70-c453-4217-80e8-5f4fc497ffe2" (UID: "98ae7d70-c453-4217-80e8-5f4fc497ffe2"). InnerVolumeSpecName "kube-api-access-s442x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 08:15:02.466951 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:02.465385 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98ae7d70-c453-4217-80e8-5f4fc497ffe2-util" (OuterVolumeSpecName: "util") pod "98ae7d70-c453-4217-80e8-5f4fc497ffe2" (UID: "98ae7d70-c453-4217-80e8-5f4fc497ffe2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 08:15:02.559090 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:02.559054 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98ae7d70-c453-4217-80e8-5f4fc497ffe2-util\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:15:02.559090 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:02.559088 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s442x\" (UniqueName: \"kubernetes.io/projected/98ae7d70-c453-4217-80e8-5f4fc497ffe2-kube-api-access-s442x\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:15:02.559279 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:02.559098 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98ae7d70-c453-4217-80e8-5f4fc497ffe2-bundle\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:15:03.238748 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.238648 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82" event={"ID":"98ae7d70-c453-4217-80e8-5f4fc497ffe2","Type":"ContainerDied","Data":"c1554eee191b7773e7bff75b4000e5e4b5fa712dad3cf09710f9dffb9d6f207b"} Jul 12 08:15:03.238748 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.238687 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82" Jul 12 08:15:03.238748 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.238706 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c1554eee191b7773e7bff75b4000e5e4b5fa712dad3cf09710f9dffb9d6f207b" Jul 12 08:15:03.389349 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.389317 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5" Jul 12 08:15:03.437568 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.437544 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n" Jul 12 08:15:03.440704 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.440680 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn" Jul 12 08:15:03.465809 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.465778 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c-util\") pod \"7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c\" (UID: \"7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c\") " Jul 12 08:15:03.465993 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.465841 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67clg\" (UniqueName: \"kubernetes.io/projected/7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c-kube-api-access-67clg\") pod \"7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c\" (UID: \"7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c\") " Jul 12 08:15:03.465993 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.465971 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c-bundle\") pod \"7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c\" (UID: \"7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c\") " Jul 12 08:15:03.466597 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.466564 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c-bundle" (OuterVolumeSpecName: "bundle") pod "7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c" (UID: "7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 08:15:03.469539 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.469485 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c-kube-api-access-67clg" (OuterVolumeSpecName: "kube-api-access-67clg") pod "7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c" (UID: "7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c"). InnerVolumeSpecName "kube-api-access-67clg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 08:15:03.474089 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.474043 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c-util" (OuterVolumeSpecName: "util") pod "7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c" (UID: "7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 08:15:03.567292 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.567262 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f82cfbb3-7e34-417a-b134-0ec921399861-bundle\") pod \"f82cfbb3-7e34-417a-b134-0ec921399861\" (UID: \"f82cfbb3-7e34-417a-b134-0ec921399861\") " Jul 12 08:15:03.567452 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.567305 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9h8qt\" (UniqueName: \"kubernetes.io/projected/fbd04735-c0dc-4a54-8b75-3ab96b145cf9-kube-api-access-9h8qt\") pod \"fbd04735-c0dc-4a54-8b75-3ab96b145cf9\" (UID: \"fbd04735-c0dc-4a54-8b75-3ab96b145cf9\") " Jul 12 08:15:03.567452 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.567363 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbd04735-c0dc-4a54-8b75-3ab96b145cf9-bundle\") pod \"fbd04735-c0dc-4a54-8b75-3ab96b145cf9\" (UID: \"fbd04735-c0dc-4a54-8b75-3ab96b145cf9\") " Jul 12 08:15:03.567452 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.567385 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bnvq\" (UniqueName: \"kubernetes.io/projected/f82cfbb3-7e34-417a-b134-0ec921399861-kube-api-access-7bnvq\") pod \"f82cfbb3-7e34-417a-b134-0ec921399861\" (UID: \"f82cfbb3-7e34-417a-b134-0ec921399861\") " Jul 12 08:15:03.567452 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.567445 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f82cfbb3-7e34-417a-b134-0ec921399861-util\") pod \"f82cfbb3-7e34-417a-b134-0ec921399861\" (UID: \"f82cfbb3-7e34-417a-b134-0ec921399861\") " Jul 12 08:15:03.567603 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.567466 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbd04735-c0dc-4a54-8b75-3ab96b145cf9-util\") pod \"fbd04735-c0dc-4a54-8b75-3ab96b145cf9\" (UID: \"fbd04735-c0dc-4a54-8b75-3ab96b145cf9\") " Jul 12 08:15:03.567721 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.567699 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c-bundle\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:15:03.567864 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.567848 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c-util\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:15:03.567968 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.567869 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67clg\" (UniqueName: \"kubernetes.io/projected/7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c-kube-api-access-67clg\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:15:03.568034 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.567972 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f82cfbb3-7e34-417a-b134-0ec921399861-bundle" (OuterVolumeSpecName: "bundle") pod "f82cfbb3-7e34-417a-b134-0ec921399861" (UID: "f82cfbb3-7e34-417a-b134-0ec921399861"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 08:15:03.568034 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.567979 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbd04735-c0dc-4a54-8b75-3ab96b145cf9-bundle" (OuterVolumeSpecName: "bundle") pod "fbd04735-c0dc-4a54-8b75-3ab96b145cf9" (UID: "fbd04735-c0dc-4a54-8b75-3ab96b145cf9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 08:15:03.569572 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.569550 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbd04735-c0dc-4a54-8b75-3ab96b145cf9-kube-api-access-9h8qt" (OuterVolumeSpecName: "kube-api-access-9h8qt") pod "fbd04735-c0dc-4a54-8b75-3ab96b145cf9" (UID: "fbd04735-c0dc-4a54-8b75-3ab96b145cf9"). InnerVolumeSpecName "kube-api-access-9h8qt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 08:15:03.569825 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.569808 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f82cfbb3-7e34-417a-b134-0ec921399861-kube-api-access-7bnvq" (OuterVolumeSpecName: "kube-api-access-7bnvq") pod "f82cfbb3-7e34-417a-b134-0ec921399861" (UID: "f82cfbb3-7e34-417a-b134-0ec921399861"). InnerVolumeSpecName "kube-api-access-7bnvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 08:15:03.573503 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.573465 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f82cfbb3-7e34-417a-b134-0ec921399861-util" (OuterVolumeSpecName: "util") pod "f82cfbb3-7e34-417a-b134-0ec921399861" (UID: "f82cfbb3-7e34-417a-b134-0ec921399861"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 08:15:03.573670 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.573646 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbd04735-c0dc-4a54-8b75-3ab96b145cf9-util" (OuterVolumeSpecName: "util") pod "fbd04735-c0dc-4a54-8b75-3ab96b145cf9" (UID: "fbd04735-c0dc-4a54-8b75-3ab96b145cf9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 08:15:03.668829 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.668797 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbd04735-c0dc-4a54-8b75-3ab96b145cf9-bundle\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:15:03.668829 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.668828 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bnvq\" (UniqueName: \"kubernetes.io/projected/f82cfbb3-7e34-417a-b134-0ec921399861-kube-api-access-7bnvq\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:15:03.669017 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.668839 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f82cfbb3-7e34-417a-b134-0ec921399861-util\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:15:03.669017 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.668847 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbd04735-c0dc-4a54-8b75-3ab96b145cf9-util\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:15:03.669017 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.668856 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f82cfbb3-7e34-417a-b134-0ec921399861-bundle\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:15:03.669017 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:03.668863 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9h8qt\" (UniqueName: \"kubernetes.io/projected/fbd04735-c0dc-4a54-8b75-3ab96b145cf9-kube-api-access-9h8qt\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:15:04.245992 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:04.245963 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5" Jul 12 08:15:04.245992 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:04.245981 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5" event={"ID":"7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c","Type":"ContainerDied","Data":"e1cffee8d661dc759eb2d2a400cdf10aa325914d6da907439fbfcaff0a350ab7"} Jul 12 08:15:04.246460 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:04.246023 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e1cffee8d661dc759eb2d2a400cdf10aa325914d6da907439fbfcaff0a350ab7" Jul 12 08:15:04.247868 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:04.247847 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n" Jul 12 08:15:04.248013 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:04.247847 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n" event={"ID":"f82cfbb3-7e34-417a-b134-0ec921399861","Type":"ContainerDied","Data":"51bbe388763698dc38014e39e832837164576ac99a0d506f5b96cfc302d07945"} Jul 12 08:15:04.248013 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:04.247971 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51bbe388763698dc38014e39e832837164576ac99a0d506f5b96cfc302d07945" Jul 12 08:15:04.249838 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:04.249810 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn" Jul 12 08:15:04.249838 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:04.249812 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn" event={"ID":"fbd04735-c0dc-4a54-8b75-3ab96b145cf9","Type":"ContainerDied","Data":"98fad94e1aa1cc850a831fd356e9fc7c8dba421687e36602f71bc597bbdb788f"} Jul 12 08:15:04.249978 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:04.249856 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98fad94e1aa1cc850a831fd356e9fc7c8dba421687e36602f71bc597bbdb788f" Jul 12 08:15:10.641634 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:10.641596 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:10.642134 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:10.641670 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:10.646527 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:10.646505 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:11.289770 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:11.289736 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5764bdbdbc-9rxhs" Jul 12 08:15:11.336784 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:11.336744 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-677ddd858c-jsvxs"] Jul 12 08:15:25.167118 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167078 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4"] Jul 12 08:15:25.167645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167436 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98ae7d70-c453-4217-80e8-5f4fc497ffe2" containerName="util" Jul 12 08:15:25.167645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167447 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="98ae7d70-c453-4217-80e8-5f4fc497ffe2" containerName="util" Jul 12 08:15:25.167645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167454 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c" containerName="util" Jul 12 08:15:25.167645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167459 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c" containerName="util" Jul 12 08:15:25.167645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167468 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbd04735-c0dc-4a54-8b75-3ab96b145cf9" containerName="pull" Jul 12 08:15:25.167645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167473 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbd04735-c0dc-4a54-8b75-3ab96b145cf9" containerName="pull" Jul 12 08:15:25.167645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167486 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f82cfbb3-7e34-417a-b134-0ec921399861" containerName="util" Jul 12 08:15:25.167645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167491 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f82cfbb3-7e34-417a-b134-0ec921399861" containerName="util" Jul 12 08:15:25.167645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167498 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98ae7d70-c453-4217-80e8-5f4fc497ffe2" containerName="extract" Jul 12 08:15:25.167645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167503 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="98ae7d70-c453-4217-80e8-5f4fc497ffe2" containerName="extract" Jul 12 08:15:25.167645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167515 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f82cfbb3-7e34-417a-b134-0ec921399861" containerName="pull" Jul 12 08:15:25.167645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167519 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f82cfbb3-7e34-417a-b134-0ec921399861" containerName="pull" Jul 12 08:15:25.167645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167526 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c" containerName="extract" Jul 12 08:15:25.167645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167532 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c" containerName="extract" Jul 12 08:15:25.167645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167538 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f82cfbb3-7e34-417a-b134-0ec921399861" containerName="extract" Jul 12 08:15:25.167645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167543 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f82cfbb3-7e34-417a-b134-0ec921399861" containerName="extract" Jul 12 08:15:25.167645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167550 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbd04735-c0dc-4a54-8b75-3ab96b145cf9" containerName="extract" Jul 12 08:15:25.167645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167555 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbd04735-c0dc-4a54-8b75-3ab96b145cf9" containerName="extract" Jul 12 08:15:25.167645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167562 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98ae7d70-c453-4217-80e8-5f4fc497ffe2" containerName="pull" Jul 12 08:15:25.167645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167566 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="98ae7d70-c453-4217-80e8-5f4fc497ffe2" containerName="pull" Jul 12 08:15:25.167645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167575 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c" containerName="pull" Jul 12 08:15:25.167645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167580 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c" containerName="pull" Jul 12 08:15:25.167645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167587 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbd04735-c0dc-4a54-8b75-3ab96b145cf9" containerName="util" Jul 12 08:15:25.167645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167592 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbd04735-c0dc-4a54-8b75-3ab96b145cf9" containerName="util" Jul 12 08:15:25.167645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167648 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbd04735-c0dc-4a54-8b75-3ab96b145cf9" containerName="extract" Jul 12 08:15:25.167645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167655 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c" containerName="extract" Jul 12 08:15:25.168455 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167663 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f82cfbb3-7e34-417a-b134-0ec921399861" containerName="extract" Jul 12 08:15:25.168455 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.167670 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="98ae7d70-c453-4217-80e8-5f4fc497ffe2" containerName="extract" Jul 12 08:15:25.170755 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.170739 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4" Jul 12 08:15:25.173494 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.173471 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 12 08:15:25.173619 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.173512 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 12 08:15:25.173667 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.173636 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4m58q\"" Jul 12 08:15:25.185953 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.185913 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4"] Jul 12 08:15:25.264135 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.264112 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0299f3e9-da8b-4e73-9841-6e72e34dd370-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gddv4\" (UID: \"0299f3e9-da8b-4e73-9841-6e72e34dd370\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4" Jul 12 08:15:25.264258 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.264141 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9jfl\" (UniqueName: \"kubernetes.io/projected/0299f3e9-da8b-4e73-9841-6e72e34dd370-kube-api-access-k9jfl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gddv4\" (UID: \"0299f3e9-da8b-4e73-9841-6e72e34dd370\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4" Jul 12 08:15:25.365276 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.365248 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0299f3e9-da8b-4e73-9841-6e72e34dd370-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gddv4\" (UID: \"0299f3e9-da8b-4e73-9841-6e72e34dd370\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4" Jul 12 08:15:25.365405 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.365279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9jfl\" (UniqueName: \"kubernetes.io/projected/0299f3e9-da8b-4e73-9841-6e72e34dd370-kube-api-access-k9jfl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gddv4\" (UID: \"0299f3e9-da8b-4e73-9841-6e72e34dd370\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4" Jul 12 08:15:25.365637 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.365620 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0299f3e9-da8b-4e73-9841-6e72e34dd370-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gddv4\" (UID: \"0299f3e9-da8b-4e73-9841-6e72e34dd370\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4" Jul 12 08:15:25.374202 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.374180 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9jfl\" (UniqueName: \"kubernetes.io/projected/0299f3e9-da8b-4e73-9841-6e72e34dd370-kube-api-access-k9jfl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gddv4\" (UID: \"0299f3e9-da8b-4e73-9841-6e72e34dd370\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4" Jul 12 08:15:25.481239 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.481151 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4" Jul 12 08:15:25.617985 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:25.617959 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4"] Jul 12 08:15:25.619767 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:15:25.619734 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0299f3e9_da8b_4e73_9841_6e72e34dd370.slice/crio-b13af3eb0e684c4c93cc9662db85c1935c7de6548b7a4f926f1e46d87bc25cf5 WatchSource:0}: Error finding container b13af3eb0e684c4c93cc9662db85c1935c7de6548b7a4f926f1e46d87bc25cf5: Status 404 returned error can't find the container with id b13af3eb0e684c4c93cc9662db85c1935c7de6548b7a4f926f1e46d87bc25cf5 Jul 12 08:15:26.363823 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:26.363790 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4" event={"ID":"0299f3e9-da8b-4e73-9841-6e72e34dd370","Type":"ContainerStarted","Data":"b13af3eb0e684c4c93cc9662db85c1935c7de6548b7a4f926f1e46d87bc25cf5"} Jul 12 08:15:31.401386 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:31.401332 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4" event={"ID":"0299f3e9-da8b-4e73-9841-6e72e34dd370","Type":"ContainerStarted","Data":"a9063c48197239c5c83f74a92cb0fa1cf048f49fbd8c3d7b9fda3cb18cb6df7d"} Jul 12 08:15:31.401767 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:31.401474 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4" Jul 12 08:15:31.420600 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:31.420543 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4" podStartSLOduration=0.864055072 podStartE2EDuration="6.420528697s" totalImagesPullingTime="5.556473625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:15:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:15:31.418437879 +0000 UTC m=+519.103248750" watchObservedRunningTime="2026-07-12 08:15:31.420528697 +0000 UTC m=+519.105339557" Jul 12 08:15:36.363198 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:36.363130 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-677ddd858c-jsvxs" podUID="a9ed8b8c-eb5d-4fd5-b526-776ed2342891" containerName="console" containerID="cri-o://98acc493427bf6622aa79780a453335b8d6ded5bd8a1fcf7a02b8ea354e3e9c8" gracePeriod=15 Jul 12 08:15:36.607332 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:36.607308 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:15:36.669177 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:36.669113 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8278\" (UniqueName: \"kubernetes.io/projected/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-kube-api-access-b8278\") pod \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " Jul 12 08:15:36.669320 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:36.669182 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-trusted-ca-bundle\") pod \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " Jul 12 08:15:36.669320 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:36.669209 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-console-serving-cert\") pod \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " Jul 12 08:15:36.669320 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:36.669237 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-oauth-serving-cert\") pod \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " Jul 12 08:15:36.669320 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:36.669281 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-service-ca\") pod \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " Jul 12 08:15:36.669531 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:36.669334 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-console-config\") pod \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " Jul 12 08:15:36.669531 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:36.669372 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-console-oauth-config\") pod \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\" (UID: \"a9ed8b8c-eb5d-4fd5-b526-776ed2342891\") " Jul 12 08:15:36.669634 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:36.669603 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a9ed8b8c-eb5d-4fd5-b526-776ed2342891" (UID: "a9ed8b8c-eb5d-4fd5-b526-776ed2342891"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 08:15:36.669693 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:36.669675 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-console-config" (OuterVolumeSpecName: "console-config") pod "a9ed8b8c-eb5d-4fd5-b526-776ed2342891" (UID: "a9ed8b8c-eb5d-4fd5-b526-776ed2342891"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 08:15:36.669738 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:36.669672 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a9ed8b8c-eb5d-4fd5-b526-776ed2342891" (UID: "a9ed8b8c-eb5d-4fd5-b526-776ed2342891"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 08:15:36.669924 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:36.669899 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-service-ca" (OuterVolumeSpecName: "service-ca") pod "a9ed8b8c-eb5d-4fd5-b526-776ed2342891" (UID: "a9ed8b8c-eb5d-4fd5-b526-776ed2342891"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 08:15:36.671239 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:36.671212 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-kube-api-access-b8278" (OuterVolumeSpecName: "kube-api-access-b8278") pod "a9ed8b8c-eb5d-4fd5-b526-776ed2342891" (UID: "a9ed8b8c-eb5d-4fd5-b526-776ed2342891"). InnerVolumeSpecName "kube-api-access-b8278". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 08:15:36.671436 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:36.671417 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a9ed8b8c-eb5d-4fd5-b526-776ed2342891" (UID: "a9ed8b8c-eb5d-4fd5-b526-776ed2342891"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 08:15:36.671518 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:36.671489 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a9ed8b8c-eb5d-4fd5-b526-776ed2342891" (UID: "a9ed8b8c-eb5d-4fd5-b526-776ed2342891"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 08:15:36.770231 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:36.770201 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8278\" (UniqueName: \"kubernetes.io/projected/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-kube-api-access-b8278\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:15:36.770231 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:36.770228 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-trusted-ca-bundle\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:15:36.770367 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:36.770237 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-console-serving-cert\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:15:36.770367 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:36.770245 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-oauth-serving-cert\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:15:36.770367 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:36.770254 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-service-ca\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:15:36.770367 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:36.770263 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-console-config\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:15:36.770367 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:36.770271 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a9ed8b8c-eb5d-4fd5-b526-776ed2342891-console-oauth-config\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:15:37.433102 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:37.433061 2576 generic.go:356] "Generic (PLEG): container finished" podID="a9ed8b8c-eb5d-4fd5-b526-776ed2342891" containerID="98acc493427bf6622aa79780a453335b8d6ded5bd8a1fcf7a02b8ea354e3e9c8" exitCode=0 Jul 12 08:15:37.433594 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:37.433110 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677ddd858c-jsvxs" Jul 12 08:15:37.433594 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:37.433147 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677ddd858c-jsvxs" event={"ID":"a9ed8b8c-eb5d-4fd5-b526-776ed2342891","Type":"ContainerDied","Data":"98acc493427bf6622aa79780a453335b8d6ded5bd8a1fcf7a02b8ea354e3e9c8"} Jul 12 08:15:37.433594 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:37.433209 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677ddd858c-jsvxs" event={"ID":"a9ed8b8c-eb5d-4fd5-b526-776ed2342891","Type":"ContainerDied","Data":"9733b58be6df525460cc87cf2fe2fce768f48541f694e7cb592a5ce2b1d6af5e"} Jul 12 08:15:37.433594 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:37.433238 2576 scope.go:117] "RemoveContainer" containerID="98acc493427bf6622aa79780a453335b8d6ded5bd8a1fcf7a02b8ea354e3e9c8" Jul 12 08:15:37.442284 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:37.442266 2576 scope.go:117] "RemoveContainer" containerID="98acc493427bf6622aa79780a453335b8d6ded5bd8a1fcf7a02b8ea354e3e9c8" Jul 12 08:15:37.442535 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:15:37.442515 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98acc493427bf6622aa79780a453335b8d6ded5bd8a1fcf7a02b8ea354e3e9c8\": container with ID starting with 98acc493427bf6622aa79780a453335b8d6ded5bd8a1fcf7a02b8ea354e3e9c8 not found: ID does not exist" containerID="98acc493427bf6622aa79780a453335b8d6ded5bd8a1fcf7a02b8ea354e3e9c8" Jul 12 08:15:37.442610 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:37.442547 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98acc493427bf6622aa79780a453335b8d6ded5bd8a1fcf7a02b8ea354e3e9c8"} err="failed to get container status \"98acc493427bf6622aa79780a453335b8d6ded5bd8a1fcf7a02b8ea354e3e9c8\": rpc error: code = NotFound desc = could not find container \"98acc493427bf6622aa79780a453335b8d6ded5bd8a1fcf7a02b8ea354e3e9c8\": container with ID starting with 98acc493427bf6622aa79780a453335b8d6ded5bd8a1fcf7a02b8ea354e3e9c8 not found: ID does not exist" Jul 12 08:15:37.449202 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:37.449178 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-677ddd858c-jsvxs"] Jul 12 08:15:37.455394 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:37.455374 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-677ddd858c-jsvxs"] Jul 12 08:15:38.850314 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:38.850281 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9ed8b8c-eb5d-4fd5-b526-776ed2342891" path="/var/lib/kubelet/pods/a9ed8b8c-eb5d-4fd5-b526-776ed2342891/volumes" Jul 12 08:15:42.408880 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:42.408848 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4" Jul 12 08:15:44.169198 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.169164 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4"] Jul 12 08:15:44.169675 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.169448 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4" podUID="0299f3e9-da8b-4e73-9841-6e72e34dd370" containerName="manager" containerID="cri-o://a9063c48197239c5c83f74a92cb0fa1cf048f49fbd8c3d7b9fda3cb18cb6df7d" gracePeriod=2 Jul 12 08:15:44.181108 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.181084 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l8gp2"] Jul 12 08:15:44.181562 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.181542 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9ed8b8c-eb5d-4fd5-b526-776ed2342891" containerName="console" Jul 12 08:15:44.181562 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.181560 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9ed8b8c-eb5d-4fd5-b526-776ed2342891" containerName="console" Jul 12 08:15:44.181728 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.181660 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9ed8b8c-eb5d-4fd5-b526-776ed2342891" containerName="console" Jul 12 08:15:44.184594 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.184572 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4"] Jul 12 08:15:44.184693 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.184662 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l8gp2" Jul 12 08:15:44.189885 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:15:44.189843 2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0299f3e9-da8b-4e73-9841-6e72e34dd370\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-gddv4\": pods \"kuadrant-operator-controller-manager-8684c9ff49-gddv4\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4" Jul 12 08:15:44.196719 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.196694 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l8gp2"] Jul 12 08:15:44.215686 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:15:44.215645 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gddv4\" is forbidden: User \"system:node:ip-10-0-128-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-184.ec2.internal' and this object" podUID="0299f3e9-da8b-4e73-9841-6e72e34dd370" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4" Jul 12 08:15:44.230015 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.229978 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zch2k"] Jul 12 08:15:44.230424 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.230406 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0299f3e9-da8b-4e73-9841-6e72e34dd370" containerName="manager" Jul 12 08:15:44.230424 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.230425 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0299f3e9-da8b-4e73-9841-6e72e34dd370" containerName="manager" Jul 12 08:15:44.230550 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.230497 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0299f3e9-da8b-4e73-9841-6e72e34dd370" containerName="manager" Jul 12 08:15:44.235348 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.235324 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zch2k" Jul 12 08:15:44.237791 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.237771 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-82frv\"" Jul 12 08:15:44.243071 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.243049 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zch2k"] Jul 12 08:15:44.253198 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:15:44.253165 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gddv4\" is forbidden: User \"system:node:ip-10-0-128-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-184.ec2.internal' and this object" podUID="0299f3e9-da8b-4e73-9841-6e72e34dd370" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4" Jul 12 08:15:44.338960 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.338895 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fvtc\" (UniqueName: \"kubernetes.io/projected/06a16d54-e827-4081-9789-4d87744a0a0e-kube-api-access-4fvtc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-l8gp2\" (UID: \"06a16d54-e827-4081-9789-4d87744a0a0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l8gp2" Jul 12 08:15:44.339225 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.339206 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2gmq\" (UniqueName: \"kubernetes.io/projected/060c763a-3b7b-44b0-8ef9-be0c6c207031-kube-api-access-g2gmq\") pod \"limitador-operator-controller-manager-859d7b78bd-zch2k\" (UID: \"060c763a-3b7b-44b0-8ef9-be0c6c207031\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zch2k" Jul 12 08:15:44.339386 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.339371 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06a16d54-e827-4081-9789-4d87744a0a0e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-l8gp2\" (UID: \"06a16d54-e827-4081-9789-4d87744a0a0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l8gp2" Jul 12 08:15:44.418798 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.418766 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4" Jul 12 08:15:44.421201 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:15:44.421147 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gddv4\" is forbidden: User \"system:node:ip-10-0-128-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-184.ec2.internal' and this object" podUID="0299f3e9-da8b-4e73-9841-6e72e34dd370" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4" Jul 12 08:15:44.440639 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.440606 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fvtc\" (UniqueName: \"kubernetes.io/projected/06a16d54-e827-4081-9789-4d87744a0a0e-kube-api-access-4fvtc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-l8gp2\" (UID: \"06a16d54-e827-4081-9789-4d87744a0a0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l8gp2" Jul 12 08:15:44.440741 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.440648 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2gmq\" (UniqueName: \"kubernetes.io/projected/060c763a-3b7b-44b0-8ef9-be0c6c207031-kube-api-access-g2gmq\") pod \"limitador-operator-controller-manager-859d7b78bd-zch2k\" (UID: \"060c763a-3b7b-44b0-8ef9-be0c6c207031\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zch2k" Jul 12 08:15:44.440844 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.440822 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06a16d54-e827-4081-9789-4d87744a0a0e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-l8gp2\" (UID: \"06a16d54-e827-4081-9789-4d87744a0a0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l8gp2" Jul 12 08:15:44.441191 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.441172 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06a16d54-e827-4081-9789-4d87744a0a0e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-l8gp2\" (UID: \"06a16d54-e827-4081-9789-4d87744a0a0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l8gp2" Jul 12 08:15:44.448728 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.448698 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2gmq\" (UniqueName: \"kubernetes.io/projected/060c763a-3b7b-44b0-8ef9-be0c6c207031-kube-api-access-g2gmq\") pod \"limitador-operator-controller-manager-859d7b78bd-zch2k\" (UID: \"060c763a-3b7b-44b0-8ef9-be0c6c207031\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zch2k" Jul 12 08:15:44.448852 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.448777 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fvtc\" (UniqueName: \"kubernetes.io/projected/06a16d54-e827-4081-9789-4d87744a0a0e-kube-api-access-4fvtc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-l8gp2\" (UID: \"06a16d54-e827-4081-9789-4d87744a0a0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l8gp2" Jul 12 08:15:44.470466 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.470433 2576 generic.go:356] "Generic (PLEG): container finished" podID="0299f3e9-da8b-4e73-9841-6e72e34dd370" containerID="a9063c48197239c5c83f74a92cb0fa1cf048f49fbd8c3d7b9fda3cb18cb6df7d" exitCode=0 Jul 12 08:15:44.470631 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.470474 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4" Jul 12 08:15:44.470631 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.470538 2576 scope.go:117] "RemoveContainer" containerID="a9063c48197239c5c83f74a92cb0fa1cf048f49fbd8c3d7b9fda3cb18cb6df7d" Jul 12 08:15:44.472574 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:15:44.472552 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gddv4\" is forbidden: User \"system:node:ip-10-0-128-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-184.ec2.internal' and this object" podUID="0299f3e9-da8b-4e73-9841-6e72e34dd370" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4" Jul 12 08:15:44.479308 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.479290 2576 scope.go:117] "RemoveContainer" containerID="a9063c48197239c5c83f74a92cb0fa1cf048f49fbd8c3d7b9fda3cb18cb6df7d" Jul 12 08:15:44.479573 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:15:44.479554 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9063c48197239c5c83f74a92cb0fa1cf048f49fbd8c3d7b9fda3cb18cb6df7d\": container with ID starting with a9063c48197239c5c83f74a92cb0fa1cf048f49fbd8c3d7b9fda3cb18cb6df7d not found: ID does not exist" containerID="a9063c48197239c5c83f74a92cb0fa1cf048f49fbd8c3d7b9fda3cb18cb6df7d" Jul 12 08:15:44.479621 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.479585 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9063c48197239c5c83f74a92cb0fa1cf048f49fbd8c3d7b9fda3cb18cb6df7d"} err="failed to get container status \"a9063c48197239c5c83f74a92cb0fa1cf048f49fbd8c3d7b9fda3cb18cb6df7d\": rpc error: code = NotFound desc = could not find container \"a9063c48197239c5c83f74a92cb0fa1cf048f49fbd8c3d7b9fda3cb18cb6df7d\": container with ID starting with a9063c48197239c5c83f74a92cb0fa1cf048f49fbd8c3d7b9fda3cb18cb6df7d not found: ID does not exist" Jul 12 08:15:44.541501 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.541463 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9jfl\" (UniqueName: \"kubernetes.io/projected/0299f3e9-da8b-4e73-9841-6e72e34dd370-kube-api-access-k9jfl\") pod \"0299f3e9-da8b-4e73-9841-6e72e34dd370\" (UID: \"0299f3e9-da8b-4e73-9841-6e72e34dd370\") " Jul 12 08:15:44.541648 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.541508 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0299f3e9-da8b-4e73-9841-6e72e34dd370-extensions-socket-volume\") pod \"0299f3e9-da8b-4e73-9841-6e72e34dd370\" (UID: \"0299f3e9-da8b-4e73-9841-6e72e34dd370\") " Jul 12 08:15:44.542055 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.542029 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0299f3e9-da8b-4e73-9841-6e72e34dd370-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0299f3e9-da8b-4e73-9841-6e72e34dd370" (UID: "0299f3e9-da8b-4e73-9841-6e72e34dd370"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 08:15:44.543537 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.543518 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0299f3e9-da8b-4e73-9841-6e72e34dd370-kube-api-access-k9jfl" (OuterVolumeSpecName: "kube-api-access-k9jfl") pod "0299f3e9-da8b-4e73-9841-6e72e34dd370" (UID: "0299f3e9-da8b-4e73-9841-6e72e34dd370"). InnerVolumeSpecName "kube-api-access-k9jfl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 08:15:44.558707 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.558681 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l8gp2" Jul 12 08:15:44.565743 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.565722 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zch2k" Jul 12 08:15:44.643014 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.642976 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9jfl\" (UniqueName: \"kubernetes.io/projected/0299f3e9-da8b-4e73-9841-6e72e34dd370-kube-api-access-k9jfl\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:15:44.643014 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.643012 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0299f3e9-da8b-4e73-9841-6e72e34dd370-extensions-socket-volume\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:15:44.707689 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.707627 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l8gp2"] Jul 12 08:15:44.709636 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:15:44.709598 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a16d54_e827_4081_9789_4d87744a0a0e.slice/crio-00da404ff4155b664653fbaae134565f19717620e173226bdf7a9f6d0ad9f0d0 WatchSource:0}: Error finding container 00da404ff4155b664653fbaae134565f19717620e173226bdf7a9f6d0ad9f0d0: Status 404 returned error can't find the container with id 00da404ff4155b664653fbaae134565f19717620e173226bdf7a9f6d0ad9f0d0 Jul 12 08:15:44.731631 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.731605 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zch2k"] Jul 12 08:15:44.734444 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:15:44.734420 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod060c763a_3b7b_44b0_8ef9_be0c6c207031.slice/crio-d1d042e857a282d754f45e43888a48044bd75e64619375ef87fcfef4d4905772 WatchSource:0}: Error finding container d1d042e857a282d754f45e43888a48044bd75e64619375ef87fcfef4d4905772: Status 404 returned error can't find the container with id d1d042e857a282d754f45e43888a48044bd75e64619375ef87fcfef4d4905772 Jul 12 08:15:44.781790 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:15:44.781760 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gddv4\" is forbidden: User \"system:node:ip-10-0-128-184.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-184.ec2.internal' and this object" podUID="0299f3e9-da8b-4e73-9841-6e72e34dd370" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gddv4" Jul 12 08:15:44.850972 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:44.850909 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0299f3e9-da8b-4e73-9841-6e72e34dd370" path="/var/lib/kubelet/pods/0299f3e9-da8b-4e73-9841-6e72e34dd370/volumes" Jul 12 08:15:45.477951 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:45.477858 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zch2k" event={"ID":"060c763a-3b7b-44b0-8ef9-be0c6c207031","Type":"ContainerStarted","Data":"d1d042e857a282d754f45e43888a48044bd75e64619375ef87fcfef4d4905772"} Jul 12 08:15:45.480686 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:45.480659 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l8gp2" event={"ID":"06a16d54-e827-4081-9789-4d87744a0a0e","Type":"ContainerStarted","Data":"ef27fcb8ba750f1520bdd03b5d1bf1cbc5a182f3114e880fc08b1fc4460c470e"} Jul 12 08:15:45.480822 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:45.480710 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l8gp2" event={"ID":"06a16d54-e827-4081-9789-4d87744a0a0e","Type":"ContainerStarted","Data":"00da404ff4155b664653fbaae134565f19717620e173226bdf7a9f6d0ad9f0d0"} Jul 12 08:15:45.480878 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:45.480819 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l8gp2" Jul 12 08:15:45.501124 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:45.501076 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l8gp2" podStartSLOduration=1.50105947 podStartE2EDuration="1.50105947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:15:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:15:45.499663168 +0000 UTC m=+533.184474051" watchObservedRunningTime="2026-07-12 08:15:45.50105947 +0000 UTC m=+533.185870330" Jul 12 08:15:46.488243 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:46.488139 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zch2k" event={"ID":"060c763a-3b7b-44b0-8ef9-be0c6c207031","Type":"ContainerStarted","Data":"4c3019fb4c626bda349ed34a744afa1d78107eb11c7e3f88efe9c76e77b85eef"} Jul 12 08:15:46.488692 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:46.488268 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zch2k" Jul 12 08:15:46.509607 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:46.509527 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zch2k" podStartSLOduration=1.032441642 podStartE2EDuration="2.50950928s" totalImagesPullingTime="1.477067638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:15:46.508431615 +0000 UTC m=+534.193242483" watchObservedRunningTime="2026-07-12 08:15:46.50950928 +0000 UTC m=+534.194320257" Jul 12 08:15:56.490863 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:56.490831 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l8gp2" Jul 12 08:15:57.496734 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:15:57.496702 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zch2k" Jul 12 08:16:13.588357 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:13.588322 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l8gp2"] Jul 12 08:16:13.589178 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:13.589115 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l8gp2" podUID="06a16d54-e827-4081-9789-4d87744a0a0e" containerName="manager" containerID="cri-o://ef27fcb8ba750f1520bdd03b5d1bf1cbc5a182f3114e880fc08b1fc4460c470e" gracePeriod=10 Jul 12 08:16:13.843481 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:13.843419 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l8gp2" Jul 12 08:16:13.902317 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:13.902279 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06a16d54-e827-4081-9789-4d87744a0a0e-extensions-socket-volume\") pod \"06a16d54-e827-4081-9789-4d87744a0a0e\" (UID: \"06a16d54-e827-4081-9789-4d87744a0a0e\") " Jul 12 08:16:13.902486 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:13.902329 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fvtc\" (UniqueName: \"kubernetes.io/projected/06a16d54-e827-4081-9789-4d87744a0a0e-kube-api-access-4fvtc\") pod \"06a16d54-e827-4081-9789-4d87744a0a0e\" (UID: \"06a16d54-e827-4081-9789-4d87744a0a0e\") " Jul 12 08:16:13.902662 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:13.902638 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06a16d54-e827-4081-9789-4d87744a0a0e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "06a16d54-e827-4081-9789-4d87744a0a0e" (UID: "06a16d54-e827-4081-9789-4d87744a0a0e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 08:16:13.904528 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:13.904496 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06a16d54-e827-4081-9789-4d87744a0a0e-kube-api-access-4fvtc" (OuterVolumeSpecName: "kube-api-access-4fvtc") pod "06a16d54-e827-4081-9789-4d87744a0a0e" (UID: "06a16d54-e827-4081-9789-4d87744a0a0e"). InnerVolumeSpecName "kube-api-access-4fvtc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 08:16:14.003686 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:14.003646 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/06a16d54-e827-4081-9789-4d87744a0a0e-extensions-socket-volume\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:16:14.003686 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:14.003683 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fvtc\" (UniqueName: \"kubernetes.io/projected/06a16d54-e827-4081-9789-4d87744a0a0e-kube-api-access-4fvtc\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:16:14.636825 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:14.636789 2576 generic.go:356] "Generic (PLEG): container finished" podID="06a16d54-e827-4081-9789-4d87744a0a0e" containerID="ef27fcb8ba750f1520bdd03b5d1bf1cbc5a182f3114e880fc08b1fc4460c470e" exitCode=0 Jul 12 08:16:14.637250 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:14.636832 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l8gp2" Jul 12 08:16:14.637250 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:14.636835 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l8gp2" event={"ID":"06a16d54-e827-4081-9789-4d87744a0a0e","Type":"ContainerDied","Data":"ef27fcb8ba750f1520bdd03b5d1bf1cbc5a182f3114e880fc08b1fc4460c470e"} Jul 12 08:16:14.637250 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:14.636977 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l8gp2" event={"ID":"06a16d54-e827-4081-9789-4d87744a0a0e","Type":"ContainerDied","Data":"00da404ff4155b664653fbaae134565f19717620e173226bdf7a9f6d0ad9f0d0"} Jul 12 08:16:14.637250 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:14.637007 2576 scope.go:117] "RemoveContainer" containerID="ef27fcb8ba750f1520bdd03b5d1bf1cbc5a182f3114e880fc08b1fc4460c470e" Jul 12 08:16:14.650912 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:14.650885 2576 scope.go:117] "RemoveContainer" containerID="ef27fcb8ba750f1520bdd03b5d1bf1cbc5a182f3114e880fc08b1fc4460c470e" Jul 12 08:16:14.651320 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:16:14.651287 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef27fcb8ba750f1520bdd03b5d1bf1cbc5a182f3114e880fc08b1fc4460c470e\": container with ID starting with ef27fcb8ba750f1520bdd03b5d1bf1cbc5a182f3114e880fc08b1fc4460c470e not found: ID does not exist" containerID="ef27fcb8ba750f1520bdd03b5d1bf1cbc5a182f3114e880fc08b1fc4460c470e" Jul 12 08:16:14.651398 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:14.651343 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef27fcb8ba750f1520bdd03b5d1bf1cbc5a182f3114e880fc08b1fc4460c470e"} err="failed to get container status \"ef27fcb8ba750f1520bdd03b5d1bf1cbc5a182f3114e880fc08b1fc4460c470e\": rpc error: code = NotFound desc = could not find container \"ef27fcb8ba750f1520bdd03b5d1bf1cbc5a182f3114e880fc08b1fc4460c470e\": container with ID starting with ef27fcb8ba750f1520bdd03b5d1bf1cbc5a182f3114e880fc08b1fc4460c470e not found: ID does not exist" Jul 12 08:16:14.663374 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:14.663346 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l8gp2"] Jul 12 08:16:14.667258 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:14.667233 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-l8gp2"] Jul 12 08:16:14.850744 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:14.850712 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06a16d54-e827-4081-9789-4d87744a0a0e" path="/var/lib/kubelet/pods/06a16d54-e827-4081-9789-4d87744a0a0e/volumes" Jul 12 08:16:32.501092 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:32.501055 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:16:32.501795 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:32.501766 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06a16d54-e827-4081-9789-4d87744a0a0e" containerName="manager" Jul 12 08:16:32.501795 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:32.501789 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="06a16d54-e827-4081-9789-4d87744a0a0e" containerName="manager" Jul 12 08:16:32.501998 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:32.501877 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="06a16d54-e827-4081-9789-4d87744a0a0e" containerName="manager" Jul 12 08:16:32.505437 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:32.505417 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7pzjm" Jul 12 08:16:32.507636 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:32.507605 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 12 08:16:32.507771 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:32.507706 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ppmvh\"" Jul 12 08:16:32.513816 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:32.513796 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:16:32.540364 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:32.540337 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:16:32.675578 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:32.675542 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/02215969-d7d4-4259-99a3-0d54450f7489-config-file\") pod \"limitador-limitador-54d6d988d5-7pzjm\" (UID: \"02215969-d7d4-4259-99a3-0d54450f7489\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7pzjm" Jul 12 08:16:32.675747 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:32.675657 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kzzk\" (UniqueName: \"kubernetes.io/projected/02215969-d7d4-4259-99a3-0d54450f7489-kube-api-access-4kzzk\") pod \"limitador-limitador-54d6d988d5-7pzjm\" (UID: \"02215969-d7d4-4259-99a3-0d54450f7489\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7pzjm" Jul 12 08:16:32.777144 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:32.777110 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/02215969-d7d4-4259-99a3-0d54450f7489-config-file\") pod \"limitador-limitador-54d6d988d5-7pzjm\" (UID: \"02215969-d7d4-4259-99a3-0d54450f7489\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7pzjm" Jul 12 08:16:32.777370 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:32.777198 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kzzk\" (UniqueName: \"kubernetes.io/projected/02215969-d7d4-4259-99a3-0d54450f7489-kube-api-access-4kzzk\") pod \"limitador-limitador-54d6d988d5-7pzjm\" (UID: \"02215969-d7d4-4259-99a3-0d54450f7489\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7pzjm" Jul 12 08:16:32.777822 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:32.777795 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/02215969-d7d4-4259-99a3-0d54450f7489-config-file\") pod \"limitador-limitador-54d6d988d5-7pzjm\" (UID: \"02215969-d7d4-4259-99a3-0d54450f7489\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7pzjm" Jul 12 08:16:32.786289 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:32.786261 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kzzk\" (UniqueName: \"kubernetes.io/projected/02215969-d7d4-4259-99a3-0d54450f7489-kube-api-access-4kzzk\") pod \"limitador-limitador-54d6d988d5-7pzjm\" (UID: \"02215969-d7d4-4259-99a3-0d54450f7489\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7pzjm" Jul 12 08:16:32.816212 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:32.816186 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7pzjm" Jul 12 08:16:32.948104 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:32.948080 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:16:32.950344 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:16:32.950320 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02215969_d7d4_4259_99a3_0d54450f7489.slice/crio-151ea8167664f1dd3d22b285444acc951186e36f539700d317f14ead36f0ec49 WatchSource:0}: Error finding container 151ea8167664f1dd3d22b285444acc951186e36f539700d317f14ead36f0ec49: Status 404 returned error can't find the container with id 151ea8167664f1dd3d22b285444acc951186e36f539700d317f14ead36f0ec49 Jul 12 08:16:33.740638 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:33.740592 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7pzjm" event={"ID":"02215969-d7d4-4259-99a3-0d54450f7489","Type":"ContainerStarted","Data":"151ea8167664f1dd3d22b285444acc951186e36f539700d317f14ead36f0ec49"} Jul 12 08:16:35.752991 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:35.752901 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7pzjm" event={"ID":"02215969-d7d4-4259-99a3-0d54450f7489","Type":"ContainerStarted","Data":"dee0578718b8f4998f15086fbf70450b927e57e597c69a074d93df3b8c111582"} Jul 12 08:16:35.753343 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:35.753040 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7pzjm" Jul 12 08:16:35.768852 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:35.768805 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-7pzjm" podStartSLOduration=1.340149375 podStartE2EDuration="3.768792126s" totalImagesPullingTime="2.428642751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:16:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:16:35.767733621 +0000 UTC m=+583.452544481" watchObservedRunningTime="2026-07-12 08:16:35.768792126 +0000 UTC m=+583.453602996" Jul 12 08:16:46.759534 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:46.759504 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7pzjm" Jul 12 08:16:52.796917 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:52.796890 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kd8ct_00af3b5b-04d5-49be-8505-4116f740ae52/ovn-acl-logging/0.log" Jul 12 08:16:52.797438 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:16:52.797416 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kd8ct_00af3b5b-04d5-49be-8505-4116f740ae52/ovn-acl-logging/0.log" Jul 12 08:17:49.123522 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:17:49.123481 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:18:16.710374 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:16.710336 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:18:25.932376 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:25.932342 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-24269"] Jul 12 08:18:25.936015 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:25.935991 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" Jul 12 08:18:25.939957 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:25.939924 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 12 08:18:25.940402 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:25.940380 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 12 08:18:25.940507 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:25.940399 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 12 08:18:25.940507 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:25.940392 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vxrzn\"" Jul 12 08:18:25.956128 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:25.956101 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-24269"] Jul 12 08:18:25.959191 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:25.959168 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88f33449-5b1a-4696-ad4c-6dc868b6951a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-24269\" (UID: \"88f33449-5b1a-4696-ad4c-6dc868b6951a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" Jul 12 08:18:25.959343 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:25.959200 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88f33449-5b1a-4696-ad4c-6dc868b6951a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-24269\" (UID: \"88f33449-5b1a-4696-ad4c-6dc868b6951a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" Jul 12 08:18:25.959343 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:25.959252 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88f33449-5b1a-4696-ad4c-6dc868b6951a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-24269\" (UID: \"88f33449-5b1a-4696-ad4c-6dc868b6951a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" Jul 12 08:18:25.959343 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:25.959287 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88f33449-5b1a-4696-ad4c-6dc868b6951a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-24269\" (UID: \"88f33449-5b1a-4696-ad4c-6dc868b6951a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" Jul 12 08:18:25.959343 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:25.959326 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s6b9\" (UniqueName: \"kubernetes.io/projected/88f33449-5b1a-4696-ad4c-6dc868b6951a-kube-api-access-6s6b9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-24269\" (UID: \"88f33449-5b1a-4696-ad4c-6dc868b6951a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" Jul 12 08:18:25.959560 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:25.959435 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88f33449-5b1a-4696-ad4c-6dc868b6951a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-24269\" (UID: \"88f33449-5b1a-4696-ad4c-6dc868b6951a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" Jul 12 08:18:26.060020 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:26.059975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88f33449-5b1a-4696-ad4c-6dc868b6951a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-24269\" (UID: \"88f33449-5b1a-4696-ad4c-6dc868b6951a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" Jul 12 08:18:26.060195 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:26.060034 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s6b9\" (UniqueName: \"kubernetes.io/projected/88f33449-5b1a-4696-ad4c-6dc868b6951a-kube-api-access-6s6b9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-24269\" (UID: \"88f33449-5b1a-4696-ad4c-6dc868b6951a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" Jul 12 08:18:26.060195 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:26.060078 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88f33449-5b1a-4696-ad4c-6dc868b6951a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-24269\" (UID: \"88f33449-5b1a-4696-ad4c-6dc868b6951a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" Jul 12 08:18:26.060195 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:26.060127 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88f33449-5b1a-4696-ad4c-6dc868b6951a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-24269\" (UID: \"88f33449-5b1a-4696-ad4c-6dc868b6951a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" Jul 12 08:18:26.060195 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:26.060146 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88f33449-5b1a-4696-ad4c-6dc868b6951a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-24269\" (UID: \"88f33449-5b1a-4696-ad4c-6dc868b6951a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" Jul 12 08:18:26.060195 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:26.060172 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88f33449-5b1a-4696-ad4c-6dc868b6951a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-24269\" (UID: \"88f33449-5b1a-4696-ad4c-6dc868b6951a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" Jul 12 08:18:26.060553 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:26.060530 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88f33449-5b1a-4696-ad4c-6dc868b6951a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-24269\" (UID: \"88f33449-5b1a-4696-ad4c-6dc868b6951a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" Jul 12 08:18:26.060626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:26.060543 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88f33449-5b1a-4696-ad4c-6dc868b6951a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-24269\" (UID: \"88f33449-5b1a-4696-ad4c-6dc868b6951a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" Jul 12 08:18:26.060626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:26.060611 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88f33449-5b1a-4696-ad4c-6dc868b6951a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-24269\" (UID: \"88f33449-5b1a-4696-ad4c-6dc868b6951a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" Jul 12 08:18:26.062322 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:26.062302 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88f33449-5b1a-4696-ad4c-6dc868b6951a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-24269\" (UID: \"88f33449-5b1a-4696-ad4c-6dc868b6951a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" Jul 12 08:18:26.062572 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:26.062546 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88f33449-5b1a-4696-ad4c-6dc868b6951a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-24269\" (UID: \"88f33449-5b1a-4696-ad4c-6dc868b6951a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" Jul 12 08:18:26.071311 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:26.071283 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s6b9\" (UniqueName: \"kubernetes.io/projected/88f33449-5b1a-4696-ad4c-6dc868b6951a-kube-api-access-6s6b9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-24269\" (UID: \"88f33449-5b1a-4696-ad4c-6dc868b6951a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" Jul 12 08:18:26.246331 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:26.246249 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" Jul 12 08:18:26.385305 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:26.385280 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-24269"] Jul 12 08:18:26.387440 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:18:26.387410 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88f33449_5b1a_4696_ad4c_6dc868b6951a.slice/crio-3d9501215806e44025658a6ecadc7f1cbb4bc4bb22d1bebd542a95c00077bbba WatchSource:0}: Error finding container 3d9501215806e44025658a6ecadc7f1cbb4bc4bb22d1bebd542a95c00077bbba: Status 404 returned error can't find the container with id 3d9501215806e44025658a6ecadc7f1cbb4bc4bb22d1bebd542a95c00077bbba Jul 12 08:18:26.388806 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:26.388789 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 08:18:26.855451 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:26.855306 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:18:27.334884 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:27.334846 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" event={"ID":"88f33449-5b1a-4696-ad4c-6dc868b6951a","Type":"ContainerStarted","Data":"3d9501215806e44025658a6ecadc7f1cbb4bc4bb22d1bebd542a95c00077bbba"} Jul 12 08:18:28.342098 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:28.342053 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" event={"ID":"88f33449-5b1a-4696-ad4c-6dc868b6951a","Type":"ContainerStarted","Data":"ae80cf29da75b3f7f2d717eb3a309254f676e9ce78828b6d7673e63cc96ee9d5"} Jul 12 08:18:28.385161 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:28.385110 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" podStartSLOduration=2.388040314 podStartE2EDuration="3.385094099s" totalImagesPullingTime="997.053785ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:18:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:18:28.383189144 +0000 UTC m=+696.068000002" watchObservedRunningTime="2026-07-12 08:18:28.385094099 +0000 UTC m=+696.069904956" Jul 12 08:18:30.204359 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:30.204322 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:18:35.620350 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:35.620316 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:18:36.247165 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:36.247130 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" Jul 12 08:18:36.247348 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:36.247190 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" Jul 12 08:18:36.259469 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:36.259449 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" Jul 12 08:18:36.395365 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:36.395336 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-24269" Jul 12 08:18:45.793313 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:45.793225 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb"] Jul 12 08:18:45.798462 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:45.798436 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" Jul 12 08:18:45.801194 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:45.801175 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 12 08:18:45.812263 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:45.812237 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb"] Jul 12 08:18:45.936813 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:45.936774 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b52207bf-41ad-4c7e-98de-a0a8fec4a9dd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ddvb\" (UID: \"b52207bf-41ad-4c7e-98de-a0a8fec4a9dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" Jul 12 08:18:45.936987 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:45.936844 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7d4n\" (UniqueName: \"kubernetes.io/projected/b52207bf-41ad-4c7e-98de-a0a8fec4a9dd-kube-api-access-n7d4n\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ddvb\" (UID: \"b52207bf-41ad-4c7e-98de-a0a8fec4a9dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" Jul 12 08:18:45.936987 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:45.936923 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b52207bf-41ad-4c7e-98de-a0a8fec4a9dd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ddvb\" (UID: \"b52207bf-41ad-4c7e-98de-a0a8fec4a9dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" Jul 12 08:18:45.937093 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:45.937019 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b52207bf-41ad-4c7e-98de-a0a8fec4a9dd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ddvb\" (UID: \"b52207bf-41ad-4c7e-98de-a0a8fec4a9dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" Jul 12 08:18:45.937093 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:45.937063 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b52207bf-41ad-4c7e-98de-a0a8fec4a9dd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ddvb\" (UID: \"b52207bf-41ad-4c7e-98de-a0a8fec4a9dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" Jul 12 08:18:45.937093 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:45.937078 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b52207bf-41ad-4c7e-98de-a0a8fec4a9dd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ddvb\" (UID: \"b52207bf-41ad-4c7e-98de-a0a8fec4a9dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" Jul 12 08:18:46.038127 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:46.038092 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b52207bf-41ad-4c7e-98de-a0a8fec4a9dd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ddvb\" (UID: \"b52207bf-41ad-4c7e-98de-a0a8fec4a9dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" Jul 12 08:18:46.038127 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:46.038128 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b52207bf-41ad-4c7e-98de-a0a8fec4a9dd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ddvb\" (UID: \"b52207bf-41ad-4c7e-98de-a0a8fec4a9dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" Jul 12 08:18:46.038331 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:46.038157 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b52207bf-41ad-4c7e-98de-a0a8fec4a9dd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ddvb\" (UID: \"b52207bf-41ad-4c7e-98de-a0a8fec4a9dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" Jul 12 08:18:46.038331 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:46.038204 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7d4n\" (UniqueName: \"kubernetes.io/projected/b52207bf-41ad-4c7e-98de-a0a8fec4a9dd-kube-api-access-n7d4n\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ddvb\" (UID: \"b52207bf-41ad-4c7e-98de-a0a8fec4a9dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" Jul 12 08:18:46.038331 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:46.038241 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b52207bf-41ad-4c7e-98de-a0a8fec4a9dd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ddvb\" (UID: \"b52207bf-41ad-4c7e-98de-a0a8fec4a9dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" Jul 12 08:18:46.038331 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:46.038287 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b52207bf-41ad-4c7e-98de-a0a8fec4a9dd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ddvb\" (UID: \"b52207bf-41ad-4c7e-98de-a0a8fec4a9dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" Jul 12 08:18:46.038543 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:46.038519 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b52207bf-41ad-4c7e-98de-a0a8fec4a9dd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ddvb\" (UID: \"b52207bf-41ad-4c7e-98de-a0a8fec4a9dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" Jul 12 08:18:46.038607 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:46.038566 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b52207bf-41ad-4c7e-98de-a0a8fec4a9dd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ddvb\" (UID: \"b52207bf-41ad-4c7e-98de-a0a8fec4a9dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" Jul 12 08:18:46.038757 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:46.038737 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b52207bf-41ad-4c7e-98de-a0a8fec4a9dd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ddvb\" (UID: \"b52207bf-41ad-4c7e-98de-a0a8fec4a9dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" Jul 12 08:18:46.040452 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:46.040423 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b52207bf-41ad-4c7e-98de-a0a8fec4a9dd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ddvb\" (UID: \"b52207bf-41ad-4c7e-98de-a0a8fec4a9dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" Jul 12 08:18:46.040759 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:46.040734 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b52207bf-41ad-4c7e-98de-a0a8fec4a9dd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ddvb\" (UID: \"b52207bf-41ad-4c7e-98de-a0a8fec4a9dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" Jul 12 08:18:46.053621 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:46.053558 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7d4n\" (UniqueName: \"kubernetes.io/projected/b52207bf-41ad-4c7e-98de-a0a8fec4a9dd-kube-api-access-n7d4n\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-5ddvb\" (UID: \"b52207bf-41ad-4c7e-98de-a0a8fec4a9dd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" Jul 12 08:18:46.108901 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:46.108864 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" Jul 12 08:18:46.255356 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:46.255330 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb"] Jul 12 08:18:46.257489 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:18:46.257463 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb52207bf_41ad_4c7e_98de_a0a8fec4a9dd.slice/crio-3119d0a0f0e273c9ec1374068cc30e84df4b493949b7d8ac65aec512366cfb73 WatchSource:0}: Error finding container 3119d0a0f0e273c9ec1374068cc30e84df4b493949b7d8ac65aec512366cfb73: Status 404 returned error can't find the container with id 3119d0a0f0e273c9ec1374068cc30e84df4b493949b7d8ac65aec512366cfb73 Jul 12 08:18:46.437371 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:46.437343 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" event={"ID":"b52207bf-41ad-4c7e-98de-a0a8fec4a9dd","Type":"ContainerStarted","Data":"3119d0a0f0e273c9ec1374068cc30e84df4b493949b7d8ac65aec512366cfb73"} Jul 12 08:18:47.444704 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:47.444669 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" event={"ID":"b52207bf-41ad-4c7e-98de-a0a8fec4a9dd","Type":"ContainerStarted","Data":"43e61010d0de6b06ee8cefc4e505c9419feaf103ab542c9a89d9fe7fe49257f6"} Jul 12 08:18:47.468690 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:47.468485 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" podStartSLOduration=2.312506165 podStartE2EDuration="2.46846662s" totalImagesPullingTime="155.960455ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:18:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:18:47.467748672 +0000 UTC m=+715.152559543" watchObservedRunningTime="2026-07-12 08:18:47.46846662 +0000 UTC m=+715.153277479" Jul 12 08:18:47.905889 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:47.905851 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:18:56.109744 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:56.109707 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" Jul 12 08:18:56.110317 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:56.109792 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" Jul 12 08:18:56.122582 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:56.122558 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" Jul 12 08:18:56.503263 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:56.503184 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-5ddvb" Jul 12 08:18:57.629576 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:18:57.629533 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:20:21.897257 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:20:21.897176 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:20:31.195900 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:20:31.195862 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:20:42.289354 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:20:42.289310 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:20:51.201001 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:20:51.200966 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:21:01.898608 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:21:01.898561 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:21:28.299019 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:21:28.298984 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:21:39.392894 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:21:39.392854 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:21:52.833582 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:21:52.833496 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kd8ct_00af3b5b-04d5-49be-8505-4116f740ae52/ovn-acl-logging/0.log" Jul 12 08:21:52.837865 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:21:52.837843 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kd8ct_00af3b5b-04d5-49be-8505-4116f740ae52/ovn-acl-logging/0.log" Jul 12 08:22:13.795821 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:22:13.795785 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:22:23.589656 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:22:23.589618 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:22:33.496254 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:22:33.496213 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:22:39.297550 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:22:39.297510 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:22:49.793141 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:22:49.793100 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:22:59.101513 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:22:59.101468 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:23:11.992246 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:23:11.992209 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:23:21.893579 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:23:21.893491 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:23:46.290654 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:23:46.290614 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:23:57.501859 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:23:57.501823 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:24:21.190809 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:24:21.190772 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:24:31.700921 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:24:31.700883 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:24:46.802713 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:24:46.802630 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:24:56.691722 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:24:56.691686 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:25:07.003623 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:25:07.003587 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:25:16.797131 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:25:16.797092 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:25:25.992952 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:25:25.992892 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:26:52.879611 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:26:52.879580 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kd8ct_00af3b5b-04d5-49be-8505-4116f740ae52/ovn-acl-logging/0.log" Jul 12 08:26:52.882591 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:26:52.882565 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kd8ct_00af3b5b-04d5-49be-8505-4116f740ae52/ovn-acl-logging/0.log" Jul 12 08:27:12.798333 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:27:12.798293 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:27:22.094235 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:27:22.094195 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:27:35.190430 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:27:35.190386 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:27:46.695805 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:27:46.695720 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:27:59.199618 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:27:59.199578 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:28:09.201513 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:28:09.201480 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:28:17.497184 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:28:17.497150 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:28:26.898413 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:28:26.898376 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:28:39.488070 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:28:39.488034 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:28:47.985358 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:28:47.985322 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:28:58.585883 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:28:58.585842 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:29:22.398645 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:29:22.398567 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:29:29.697523 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:29:29.697484 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:29:39.396827 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:29:39.396788 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:29:50.189221 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:29:50.189182 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:29:59.392698 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:29:59.392656 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:30:00.141314 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:30:00.141266 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29730750-4tfsv"] Jul 12 08:30:00.146235 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:30:00.146209 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730750-4tfsv" Jul 12 08:30:00.148811 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:30:00.148778 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 12 08:30:00.148811 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:30:00.148805 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mvgcp\"" Jul 12 08:30:00.150094 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:30:00.150077 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 12 08:30:00.158893 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:30:00.158866 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29730750-4tfsv"] Jul 12 08:30:00.197168 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:30:00.197135 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld9cm\" (UniqueName: \"kubernetes.io/projected/82c4e031-52b8-4dc8-a88d-c4e0a816990d-kube-api-access-ld9cm\") pod \"maas-api-key-cleanup-29730750-4tfsv\" (UID: \"82c4e031-52b8-4dc8-a88d-c4e0a816990d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730750-4tfsv" Jul 12 08:30:00.297829 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:30:00.297783 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld9cm\" (UniqueName: \"kubernetes.io/projected/82c4e031-52b8-4dc8-a88d-c4e0a816990d-kube-api-access-ld9cm\") pod \"maas-api-key-cleanup-29730750-4tfsv\" (UID: \"82c4e031-52b8-4dc8-a88d-c4e0a816990d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730750-4tfsv" Jul 12 08:30:00.307007 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:30:00.306971 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld9cm\" (UniqueName: \"kubernetes.io/projected/82c4e031-52b8-4dc8-a88d-c4e0a816990d-kube-api-access-ld9cm\") pod \"maas-api-key-cleanup-29730750-4tfsv\" (UID: \"82c4e031-52b8-4dc8-a88d-c4e0a816990d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730750-4tfsv" Jul 12 08:30:00.457193 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:30:00.457108 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730750-4tfsv" Jul 12 08:30:00.595822 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:30:00.595794 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29730750-4tfsv"] Jul 12 08:30:00.597909 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:30:00.597877 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82c4e031_52b8_4dc8_a88d_c4e0a816990d.slice/crio-ba924881823099bf3a7ef1e121fdb463ed21a7568ed302a381295d6cb0fd7ba0 WatchSource:0}: Error finding container ba924881823099bf3a7ef1e121fdb463ed21a7568ed302a381295d6cb0fd7ba0: Status 404 returned error can't find the container with id ba924881823099bf3a7ef1e121fdb463ed21a7568ed302a381295d6cb0fd7ba0 Jul 12 08:30:00.599959 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:30:00.599925 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 08:30:01.002355 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:30:01.002318 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730750-4tfsv" event={"ID":"82c4e031-52b8-4dc8-a88d-c4e0a816990d","Type":"ContainerStarted","Data":"ba924881823099bf3a7ef1e121fdb463ed21a7568ed302a381295d6cb0fd7ba0"} Jul 12 08:30:03.016790 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:30:03.016753 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730750-4tfsv" event={"ID":"82c4e031-52b8-4dc8-a88d-c4e0a816990d","Type":"ContainerStarted","Data":"8301eec78dfd84acf0e7aaeb84ade387f4161fe8aabdeaa297491eee74f2955a"} Jul 12 08:30:03.036110 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:30:03.036060 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730750-4tfsv" podStartSLOduration=0.992951163 podStartE2EDuration="3.036043895s" totalImagesPullingTime="2.043092732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:30:03.033460339 +0000 UTC m=+1390.718271197" watchObservedRunningTime="2026-07-12 08:30:03.036043895 +0000 UTC m=+1390.720854753" Jul 12 08:30:11.998251 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:30:11.998214 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:30:22.793999 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:30:22.793963 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:30:32.201751 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:30:32.201715 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:30:42.714375 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:30:42.714336 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:30:51.597567 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:30:51.597468 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:31:00.010531 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:31:00.010490 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29730750-4tfsv"] Jul 12 08:31:00.011059 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:31:00.010761 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730750-4tfsv" podUID="82c4e031-52b8-4dc8-a88d-c4e0a816990d" containerName="cleanup" containerID="cri-o://8301eec78dfd84acf0e7aaeb84ade387f4161fe8aabdeaa297491eee74f2955a" gracePeriod=30 Jul 12 08:31:01.084878 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:31:01.084844 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:31:14.627211 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:31:14.627172 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:31:23.900395 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:31:23.900349 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:31:30.190895 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:31:30.190864 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730750-4tfsv" Jul 12 08:31:30.298106 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:31:30.297993 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ld9cm\" (UniqueName: \"kubernetes.io/projected/82c4e031-52b8-4dc8-a88d-c4e0a816990d-kube-api-access-ld9cm\") pod \"82c4e031-52b8-4dc8-a88d-c4e0a816990d\" (UID: \"82c4e031-52b8-4dc8-a88d-c4e0a816990d\") " Jul 12 08:31:30.300154 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:31:30.300119 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82c4e031-52b8-4dc8-a88d-c4e0a816990d-kube-api-access-ld9cm" (OuterVolumeSpecName: "kube-api-access-ld9cm") pod "82c4e031-52b8-4dc8-a88d-c4e0a816990d" (UID: "82c4e031-52b8-4dc8-a88d-c4e0a816990d"). InnerVolumeSpecName "kube-api-access-ld9cm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 08:31:30.398778 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:31:30.398721 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ld9cm\" (UniqueName: \"kubernetes.io/projected/82c4e031-52b8-4dc8-a88d-c4e0a816990d-kube-api-access-ld9cm\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:31:30.486124 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:31:30.486086 2576 generic.go:356] "Generic (PLEG): container finished" podID="82c4e031-52b8-4dc8-a88d-c4e0a816990d" containerID="8301eec78dfd84acf0e7aaeb84ade387f4161fe8aabdeaa297491eee74f2955a" exitCode=137 Jul 12 08:31:30.486309 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:31:30.486134 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730750-4tfsv" Jul 12 08:31:30.486309 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:31:30.486169 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730750-4tfsv" event={"ID":"82c4e031-52b8-4dc8-a88d-c4e0a816990d","Type":"ContainerDied","Data":"8301eec78dfd84acf0e7aaeb84ade387f4161fe8aabdeaa297491eee74f2955a"} Jul 12 08:31:30.486309 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:31:30.486247 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29730750-4tfsv" event={"ID":"82c4e031-52b8-4dc8-a88d-c4e0a816990d","Type":"ContainerDied","Data":"ba924881823099bf3a7ef1e121fdb463ed21a7568ed302a381295d6cb0fd7ba0"} Jul 12 08:31:30.486309 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:31:30.486270 2576 scope.go:117] "RemoveContainer" containerID="8301eec78dfd84acf0e7aaeb84ade387f4161fe8aabdeaa297491eee74f2955a" Jul 12 08:31:30.495098 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:31:30.495078 2576 scope.go:117] "RemoveContainer" containerID="8301eec78dfd84acf0e7aaeb84ade387f4161fe8aabdeaa297491eee74f2955a" Jul 12 08:31:30.495355 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:31:30.495334 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8301eec78dfd84acf0e7aaeb84ade387f4161fe8aabdeaa297491eee74f2955a\": container with ID starting with 8301eec78dfd84acf0e7aaeb84ade387f4161fe8aabdeaa297491eee74f2955a not found: ID does not exist" containerID="8301eec78dfd84acf0e7aaeb84ade387f4161fe8aabdeaa297491eee74f2955a" Jul 12 08:31:30.495400 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:31:30.495371 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8301eec78dfd84acf0e7aaeb84ade387f4161fe8aabdeaa297491eee74f2955a"} err="failed to get container status \"8301eec78dfd84acf0e7aaeb84ade387f4161fe8aabdeaa297491eee74f2955a\": rpc error: code = NotFound desc = could not find container \"8301eec78dfd84acf0e7aaeb84ade387f4161fe8aabdeaa297491eee74f2955a\": container with ID starting with 8301eec78dfd84acf0e7aaeb84ade387f4161fe8aabdeaa297491eee74f2955a not found: ID does not exist" Jul 12 08:31:30.507820 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:31:30.507798 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29730750-4tfsv"] Jul 12 08:31:30.509862 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:31:30.509843 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29730750-4tfsv"] Jul 12 08:31:30.851991 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:31:30.851957 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82c4e031-52b8-4dc8-a88d-c4e0a816990d" path="/var/lib/kubelet/pods/82c4e031-52b8-4dc8-a88d-c4e0a816990d/volumes" Jul 12 08:31:33.492454 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:31:33.492416 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:31:44.888773 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:31:44.888738 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:31:52.916329 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:31:52.916301 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kd8ct_00af3b5b-04d5-49be-8505-4116f740ae52/ovn-acl-logging/0.log" Jul 12 08:31:52.920031 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:31:52.920007 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kd8ct_00af3b5b-04d5-49be-8505-4116f740ae52/ovn-acl-logging/0.log" Jul 12 08:31:57.190672 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:31:57.190639 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:32:05.097094 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:32:05.097058 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:32:16.690493 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:32:16.690414 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:32:28.106571 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:32:28.106535 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:32:39.388439 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:32:39.388401 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:32:55.198362 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:32:55.198324 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:33:04.203989 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:33:04.203924 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:33:26.005347 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:33:26.005298 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:33:34.822957 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:33:34.822897 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:34:57.199925 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:34:57.199892 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:35:06.988262 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:35:06.988221 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:35:18.201202 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:35:18.201114 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:35:26.588316 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:35:26.588274 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:35:57.490670 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:35:57.490625 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:36:08.994678 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:36:08.994641 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:36:20.595626 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:36:20.595588 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:36:33.889189 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:36:33.889148 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:36:52.951117 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:36:52.951065 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kd8ct_00af3b5b-04d5-49be-8505-4116f740ae52/ovn-acl-logging/0.log" Jul 12 08:36:52.956172 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:36:52.956149 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kd8ct_00af3b5b-04d5-49be-8505-4116f740ae52/ovn-acl-logging/0.log" Jul 12 08:37:13.497370 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:37:13.497337 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:37:22.899338 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:37:22.899298 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:37:35.195860 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:37:35.195826 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:38:22.394015 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:38:22.393980 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:38:33.399082 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:38:33.399044 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:38:45.698039 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:38:45.698002 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:39:10.400750 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:39:10.400710 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:39:23.994011 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:39:23.993976 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:39:39.583698 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:39:39.583663 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:40:13.592295 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:13.592215 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:40:28.898542 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:28.898501 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:40:31.170355 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:31.170317 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg"] Jul 12 08:40:31.170805 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:31.170691 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82c4e031-52b8-4dc8-a88d-c4e0a816990d" containerName="cleanup" Jul 12 08:40:31.170805 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:31.170702 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="82c4e031-52b8-4dc8-a88d-c4e0a816990d" containerName="cleanup" Jul 12 08:40:31.170805 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:31.170769 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="82c4e031-52b8-4dc8-a88d-c4e0a816990d" containerName="cleanup" Jul 12 08:40:31.174025 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:31.174002 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg" Jul 12 08:40:31.176439 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:31.176406 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-68ebf4-serving-cert\"" Jul 12 08:40:31.176599 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:31.176570 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 12 08:40:31.176688 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:31.176572 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 12 08:40:31.176688 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:31.176625 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mvgcp\"" Jul 12 08:40:31.183195 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:31.183169 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg"] Jul 12 08:40:31.251803 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:31.251777 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkq79\" (UniqueName: \"kubernetes.io/projected/ff682de5-3d23-4be0-851b-00fe999ced81-kube-api-access-vkq79\") pod \"maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg\" (UID: \"ff682de5-3d23-4be0-851b-00fe999ced81\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg" Jul 12 08:40:31.251990 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:31.251818 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff682de5-3d23-4be0-851b-00fe999ced81-openshift-service-ca\") pod \"maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg\" (UID: \"ff682de5-3d23-4be0-851b-00fe999ced81\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg" Jul 12 08:40:31.251990 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:31.251865 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff682de5-3d23-4be0-851b-00fe999ced81-maas-api-tls\") pod \"maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg\" (UID: \"ff682de5-3d23-4be0-851b-00fe999ced81\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg" Jul 12 08:40:31.352343 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:31.352306 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkq79\" (UniqueName: \"kubernetes.io/projected/ff682de5-3d23-4be0-851b-00fe999ced81-kube-api-access-vkq79\") pod \"maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg\" (UID: \"ff682de5-3d23-4be0-851b-00fe999ced81\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg" Jul 12 08:40:31.352504 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:31.352353 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff682de5-3d23-4be0-851b-00fe999ced81-openshift-service-ca\") pod \"maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg\" (UID: \"ff682de5-3d23-4be0-851b-00fe999ced81\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg" Jul 12 08:40:31.352504 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:31.352406 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff682de5-3d23-4be0-851b-00fe999ced81-maas-api-tls\") pod \"maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg\" (UID: \"ff682de5-3d23-4be0-851b-00fe999ced81\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg" Jul 12 08:40:31.353189 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:31.353162 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff682de5-3d23-4be0-851b-00fe999ced81-openshift-service-ca\") pod \"maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg\" (UID: \"ff682de5-3d23-4be0-851b-00fe999ced81\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg" Jul 12 08:40:31.354911 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:31.354887 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff682de5-3d23-4be0-851b-00fe999ced81-maas-api-tls\") pod \"maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg\" (UID: \"ff682de5-3d23-4be0-851b-00fe999ced81\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg" Jul 12 08:40:31.363211 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:31.363185 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkq79\" (UniqueName: \"kubernetes.io/projected/ff682de5-3d23-4be0-851b-00fe999ced81-kube-api-access-vkq79\") pod \"maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg\" (UID: \"ff682de5-3d23-4be0-851b-00fe999ced81\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg" Jul 12 08:40:31.486725 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:31.486640 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg" Jul 12 08:40:31.628399 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:31.628363 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg"] Jul 12 08:40:31.629271 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:40:31.629242 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff682de5_3d23_4be0_851b_00fe999ced81.slice/crio-2a197b07327120bdf7793182c38b2e1c0967f5addd5674bfc7cb05bfdcf96278 WatchSource:0}: Error finding container 2a197b07327120bdf7793182c38b2e1c0967f5addd5674bfc7cb05bfdcf96278: Status 404 returned error can't find the container with id 2a197b07327120bdf7793182c38b2e1c0967f5addd5674bfc7cb05bfdcf96278 Jul 12 08:40:31.630610 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:31.630590 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 08:40:32.383305 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:32.383260 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg" event={"ID":"ff682de5-3d23-4be0-851b-00fe999ced81","Type":"ContainerStarted","Data":"2a197b07327120bdf7793182c38b2e1c0967f5addd5674bfc7cb05bfdcf96278"} Jul 12 08:40:33.389643 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:33.389545 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg" event={"ID":"ff682de5-3d23-4be0-851b-00fe999ced81","Type":"ContainerStarted","Data":"5e7f0acce0ad6ece8963e2600224b9be8b93f5683706796163ed8bd97f1370e6"} Jul 12 08:40:33.389643 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:33.389614 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg" Jul 12 08:40:33.413363 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:33.413089 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg" podStartSLOduration=0.923703099 podStartE2EDuration="2.413066343s" totalImagesPullingTime="1.489363244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:40:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:40:33.406042202 +0000 UTC m=+2021.090853078" watchObservedRunningTime="2026-07-12 08:40:33.413066343 +0000 UTC m=+2021.097877202" Jul 12 08:40:39.401183 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:39.401151 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg" Jul 12 08:40:42.402791 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:42.402752 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:40:51.079316 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:51.079270 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg"] Jul 12 08:40:51.079921 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:51.079560 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg" podUID="ff682de5-3d23-4be0-851b-00fe999ced81" containerName="maas-api" containerID="cri-o://5e7f0acce0ad6ece8963e2600224b9be8b93f5683706796163ed8bd97f1370e6" gracePeriod=30 Jul 12 08:40:51.330641 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:51.330586 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg" Jul 12 08:40:51.432476 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:51.432443 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff682de5-3d23-4be0-851b-00fe999ced81-openshift-service-ca\") pod \"ff682de5-3d23-4be0-851b-00fe999ced81\" (UID: \"ff682de5-3d23-4be0-851b-00fe999ced81\") " Jul 12 08:40:51.432652 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:51.432481 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff682de5-3d23-4be0-851b-00fe999ced81-maas-api-tls\") pod \"ff682de5-3d23-4be0-851b-00fe999ced81\" (UID: \"ff682de5-3d23-4be0-851b-00fe999ced81\") " Jul 12 08:40:51.432652 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:51.432514 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkq79\" (UniqueName: \"kubernetes.io/projected/ff682de5-3d23-4be0-851b-00fe999ced81-kube-api-access-vkq79\") pod \"ff682de5-3d23-4be0-851b-00fe999ced81\" (UID: \"ff682de5-3d23-4be0-851b-00fe999ced81\") " Jul 12 08:40:51.432861 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:51.432840 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff682de5-3d23-4be0-851b-00fe999ced81-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ff682de5-3d23-4be0-851b-00fe999ced81" (UID: "ff682de5-3d23-4be0-851b-00fe999ced81"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 08:40:51.434566 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:51.434529 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff682de5-3d23-4be0-851b-00fe999ced81-kube-api-access-vkq79" (OuterVolumeSpecName: "kube-api-access-vkq79") pod "ff682de5-3d23-4be0-851b-00fe999ced81" (UID: "ff682de5-3d23-4be0-851b-00fe999ced81"). InnerVolumeSpecName "kube-api-access-vkq79". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 08:40:51.434566 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:51.434559 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff682de5-3d23-4be0-851b-00fe999ced81-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ff682de5-3d23-4be0-851b-00fe999ced81" (UID: "ff682de5-3d23-4be0-851b-00fe999ced81"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 08:40:51.486657 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:51.486627 2576 generic.go:356] "Generic (PLEG): container finished" podID="ff682de5-3d23-4be0-851b-00fe999ced81" containerID="5e7f0acce0ad6ece8963e2600224b9be8b93f5683706796163ed8bd97f1370e6" exitCode=0 Jul 12 08:40:51.486766 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:51.486675 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg" Jul 12 08:40:51.486766 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:51.486716 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg" event={"ID":"ff682de5-3d23-4be0-851b-00fe999ced81","Type":"ContainerDied","Data":"5e7f0acce0ad6ece8963e2600224b9be8b93f5683706796163ed8bd97f1370e6"} Jul 12 08:40:51.486844 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:51.486781 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg" event={"ID":"ff682de5-3d23-4be0-851b-00fe999ced81","Type":"ContainerDied","Data":"2a197b07327120bdf7793182c38b2e1c0967f5addd5674bfc7cb05bfdcf96278"} Jul 12 08:40:51.486844 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:51.486806 2576 scope.go:117] "RemoveContainer" containerID="5e7f0acce0ad6ece8963e2600224b9be8b93f5683706796163ed8bd97f1370e6" Jul 12 08:40:51.495855 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:51.495835 2576 scope.go:117] "RemoveContainer" containerID="5e7f0acce0ad6ece8963e2600224b9be8b93f5683706796163ed8bd97f1370e6" Jul 12 08:40:51.496159 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:40:51.496141 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e7f0acce0ad6ece8963e2600224b9be8b93f5683706796163ed8bd97f1370e6\": container with ID starting with 5e7f0acce0ad6ece8963e2600224b9be8b93f5683706796163ed8bd97f1370e6 not found: ID does not exist" containerID="5e7f0acce0ad6ece8963e2600224b9be8b93f5683706796163ed8bd97f1370e6" Jul 12 08:40:51.496222 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:51.496168 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e7f0acce0ad6ece8963e2600224b9be8b93f5683706796163ed8bd97f1370e6"} err="failed to get container status \"5e7f0acce0ad6ece8963e2600224b9be8b93f5683706796163ed8bd97f1370e6\": rpc error: code = NotFound desc = could not find container \"5e7f0acce0ad6ece8963e2600224b9be8b93f5683706796163ed8bd97f1370e6\": container with ID starting with 5e7f0acce0ad6ece8963e2600224b9be8b93f5683706796163ed8bd97f1370e6 not found: ID does not exist" Jul 12 08:40:51.506668 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:51.506642 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg"] Jul 12 08:40:51.510646 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:51.510625 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-68ebf4-b6f47bcc9-6kfbg"] Jul 12 08:40:51.533849 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:51.533828 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff682de5-3d23-4be0-851b-00fe999ced81-openshift-service-ca\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:40:51.533849 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:51.533848 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff682de5-3d23-4be0-851b-00fe999ced81-maas-api-tls\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:40:51.533991 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:51.533859 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkq79\" (UniqueName: \"kubernetes.io/projected/ff682de5-3d23-4be0-851b-00fe999ced81-kube-api-access-vkq79\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:40:52.851018 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:52.850986 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff682de5-3d23-4be0-851b-00fe999ced81" path="/var/lib/kubelet/pods/ff682de5-3d23-4be0-851b-00fe999ced81/volumes" Jul 12 08:40:54.596040 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:40:54.595993 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:41:07.999194 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:07.999148 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:41:08.606912 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:08.606880 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4"] Jul 12 08:41:08.607310 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:08.607294 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff682de5-3d23-4be0-851b-00fe999ced81" containerName="maas-api" Jul 12 08:41:08.607310 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:08.607311 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff682de5-3d23-4be0-851b-00fe999ced81" containerName="maas-api" Jul 12 08:41:08.607448 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:08.607390 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff682de5-3d23-4be0-851b-00fe999ced81" containerName="maas-api" Jul 12 08:41:08.610183 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:08.610163 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4" Jul 12 08:41:08.613597 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:08.613556 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mvgcp\"" Jul 12 08:41:08.613746 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:08.613718 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-b4359a-serving-cert\"" Jul 12 08:41:08.613746 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:08.613740 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 12 08:41:08.613951 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:08.613740 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 12 08:41:08.619940 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:08.619907 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4"] Jul 12 08:41:08.694816 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:08.694781 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsc7p\" (UniqueName: \"kubernetes.io/projected/881fec23-3a1d-46cc-99af-ca46cf6da933-kube-api-access-nsc7p\") pod \"maas-api-e2e-shared-b-b4359a-5f48667775-plpx4\" (UID: \"881fec23-3a1d-46cc-99af-ca46cf6da933\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4" Jul 12 08:41:08.695001 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:08.694918 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/881fec23-3a1d-46cc-99af-ca46cf6da933-maas-api-tls\") pod \"maas-api-e2e-shared-b-b4359a-5f48667775-plpx4\" (UID: \"881fec23-3a1d-46cc-99af-ca46cf6da933\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4" Jul 12 08:41:08.695001 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:08.694983 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/881fec23-3a1d-46cc-99af-ca46cf6da933-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b4359a-5f48667775-plpx4\" (UID: \"881fec23-3a1d-46cc-99af-ca46cf6da933\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4" Jul 12 08:41:08.796132 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:08.796098 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/881fec23-3a1d-46cc-99af-ca46cf6da933-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b4359a-5f48667775-plpx4\" (UID: \"881fec23-3a1d-46cc-99af-ca46cf6da933\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4" Jul 12 08:41:08.796309 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:08.796152 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsc7p\" (UniqueName: \"kubernetes.io/projected/881fec23-3a1d-46cc-99af-ca46cf6da933-kube-api-access-nsc7p\") pod \"maas-api-e2e-shared-b-b4359a-5f48667775-plpx4\" (UID: \"881fec23-3a1d-46cc-99af-ca46cf6da933\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4" Jul 12 08:41:08.796309 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:08.796212 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/881fec23-3a1d-46cc-99af-ca46cf6da933-maas-api-tls\") pod \"maas-api-e2e-shared-b-b4359a-5f48667775-plpx4\" (UID: \"881fec23-3a1d-46cc-99af-ca46cf6da933\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4" Jul 12 08:41:08.796413 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:41:08.796330 2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-serving-cert: secret "maas-api-e2e-shared-b-b4359a-serving-cert" not found Jul 12 08:41:08.796490 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:41:08.796419 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/881fec23-3a1d-46cc-99af-ca46cf6da933-maas-api-tls podName:881fec23-3a1d-46cc-99af-ca46cf6da933 nodeName:}" failed. No retries permitted until 2026-07-12 08:41:09.296402633 +0000 UTC m=+2056.981213469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/881fec23-3a1d-46cc-99af-ca46cf6da933-maas-api-tls") pod "maas-api-e2e-shared-b-b4359a-5f48667775-plpx4" (UID: "881fec23-3a1d-46cc-99af-ca46cf6da933") : secret "maas-api-e2e-shared-b-b4359a-serving-cert" not found Jul 12 08:41:08.796836 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:08.796813 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/881fec23-3a1d-46cc-99af-ca46cf6da933-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b4359a-5f48667775-plpx4\" (UID: \"881fec23-3a1d-46cc-99af-ca46cf6da933\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4" Jul 12 08:41:08.805319 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:08.805295 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsc7p\" (UniqueName: \"kubernetes.io/projected/881fec23-3a1d-46cc-99af-ca46cf6da933-kube-api-access-nsc7p\") pod \"maas-api-e2e-shared-b-b4359a-5f48667775-plpx4\" (UID: \"881fec23-3a1d-46cc-99af-ca46cf6da933\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4" Jul 12 08:41:09.301415 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:09.301364 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/881fec23-3a1d-46cc-99af-ca46cf6da933-maas-api-tls\") pod \"maas-api-e2e-shared-b-b4359a-5f48667775-plpx4\" (UID: \"881fec23-3a1d-46cc-99af-ca46cf6da933\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4" Jul 12 08:41:09.303828 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:09.303804 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/881fec23-3a1d-46cc-99af-ca46cf6da933-maas-api-tls\") pod \"maas-api-e2e-shared-b-b4359a-5f48667775-plpx4\" (UID: \"881fec23-3a1d-46cc-99af-ca46cf6da933\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4" Jul 12 08:41:09.522306 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:09.522263 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4" Jul 12 08:41:09.659918 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:09.659847 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4"] Jul 12 08:41:09.662437 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:41:09.662410 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod881fec23_3a1d_46cc_99af_ca46cf6da933.slice/crio-ccf0fc4696d09ad94cfa2289ba24e6ac31f1a7604a89b4bd1f17ca39c1bab9a4 WatchSource:0}: Error finding container ccf0fc4696d09ad94cfa2289ba24e6ac31f1a7604a89b4bd1f17ca39c1bab9a4: Status 404 returned error can't find the container with id ccf0fc4696d09ad94cfa2289ba24e6ac31f1a7604a89b4bd1f17ca39c1bab9a4 Jul 12 08:41:10.596797 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:10.596762 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4" event={"ID":"881fec23-3a1d-46cc-99af-ca46cf6da933","Type":"ContainerStarted","Data":"5c0b28f1af667d5b21f35b4b119d66771486934d9d2d3153b94129155e0846d7"} Jul 12 08:41:10.597196 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:10.596817 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4" event={"ID":"881fec23-3a1d-46cc-99af-ca46cf6da933","Type":"ContainerStarted","Data":"ccf0fc4696d09ad94cfa2289ba24e6ac31f1a7604a89b4bd1f17ca39c1bab9a4"} Jul 12 08:41:10.597196 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:10.596865 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4" Jul 12 08:41:10.616734 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:10.616677 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4" podStartSLOduration=2.215419228 podStartE2EDuration="2.616660915s" totalImagesPullingTime="401.241687ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 08:41:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:41:10.61386492 +0000 UTC m=+2058.298675793" watchObservedRunningTime="2026-07-12 08:41:10.616660915 +0000 UTC m=+2058.301471769" Jul 12 08:41:16.608462 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:16.608373 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4" Jul 12 08:41:18.891770 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:18.891731 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:41:52.990337 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:52.990305 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kd8ct_00af3b5b-04d5-49be-8505-4116f740ae52/ovn-acl-logging/0.log" Jul 12 08:41:52.997168 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:41:52.997148 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kd8ct_00af3b5b-04d5-49be-8505-4116f740ae52/ovn-acl-logging/0.log" Jul 12 08:44:21.790052 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:21.789966 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:44:25.300366 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:25.300315 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4"] Jul 12 08:44:25.300791 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:25.300598 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4" podUID="881fec23-3a1d-46cc-99af-ca46cf6da933" containerName="maas-api" containerID="cri-o://5c0b28f1af667d5b21f35b4b119d66771486934d9d2d3153b94129155e0846d7" gracePeriod=30 Jul 12 08:44:25.554680 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:25.554610 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4" Jul 12 08:44:25.634444 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:25.634410 2576 generic.go:356] "Generic (PLEG): container finished" podID="881fec23-3a1d-46cc-99af-ca46cf6da933" containerID="5c0b28f1af667d5b21f35b4b119d66771486934d9d2d3153b94129155e0846d7" exitCode=0 Jul 12 08:44:25.634612 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:25.634455 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4" Jul 12 08:44:25.634612 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:25.634495 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4" event={"ID":"881fec23-3a1d-46cc-99af-ca46cf6da933","Type":"ContainerDied","Data":"5c0b28f1af667d5b21f35b4b119d66771486934d9d2d3153b94129155e0846d7"} Jul 12 08:44:25.634612 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:25.634547 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4" event={"ID":"881fec23-3a1d-46cc-99af-ca46cf6da933","Type":"ContainerDied","Data":"ccf0fc4696d09ad94cfa2289ba24e6ac31f1a7604a89b4bd1f17ca39c1bab9a4"} Jul 12 08:44:25.634612 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:25.634571 2576 scope.go:117] "RemoveContainer" containerID="5c0b28f1af667d5b21f35b4b119d66771486934d9d2d3153b94129155e0846d7" Jul 12 08:44:25.643214 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:25.643195 2576 scope.go:117] "RemoveContainer" containerID="5c0b28f1af667d5b21f35b4b119d66771486934d9d2d3153b94129155e0846d7" Jul 12 08:44:25.643475 ip-10-0-128-184 kubenswrapper[2576]: E0712 08:44:25.643456 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c0b28f1af667d5b21f35b4b119d66771486934d9d2d3153b94129155e0846d7\": container with ID starting with 5c0b28f1af667d5b21f35b4b119d66771486934d9d2d3153b94129155e0846d7 not found: ID does not exist" containerID="5c0b28f1af667d5b21f35b4b119d66771486934d9d2d3153b94129155e0846d7" Jul 12 08:44:25.643548 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:25.643484 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c0b28f1af667d5b21f35b4b119d66771486934d9d2d3153b94129155e0846d7"} err="failed to get container status \"5c0b28f1af667d5b21f35b4b119d66771486934d9d2d3153b94129155e0846d7\": rpc error: code = NotFound desc = could not find container \"5c0b28f1af667d5b21f35b4b119d66771486934d9d2d3153b94129155e0846d7\": container with ID starting with 5c0b28f1af667d5b21f35b4b119d66771486934d9d2d3153b94129155e0846d7 not found: ID does not exist" Jul 12 08:44:25.659767 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:25.659749 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/881fec23-3a1d-46cc-99af-ca46cf6da933-openshift-service-ca\") pod \"881fec23-3a1d-46cc-99af-ca46cf6da933\" (UID: \"881fec23-3a1d-46cc-99af-ca46cf6da933\") " Jul 12 08:44:25.659856 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:25.659842 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsc7p\" (UniqueName: \"kubernetes.io/projected/881fec23-3a1d-46cc-99af-ca46cf6da933-kube-api-access-nsc7p\") pod \"881fec23-3a1d-46cc-99af-ca46cf6da933\" (UID: \"881fec23-3a1d-46cc-99af-ca46cf6da933\") " Jul 12 08:44:25.659920 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:25.659907 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/881fec23-3a1d-46cc-99af-ca46cf6da933-maas-api-tls\") pod \"881fec23-3a1d-46cc-99af-ca46cf6da933\" (UID: \"881fec23-3a1d-46cc-99af-ca46cf6da933\") " Jul 12 08:44:25.660089 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:25.660067 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/881fec23-3a1d-46cc-99af-ca46cf6da933-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "881fec23-3a1d-46cc-99af-ca46cf6da933" (UID: "881fec23-3a1d-46cc-99af-ca46cf6da933"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 08:44:25.661788 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:25.661766 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/881fec23-3a1d-46cc-99af-ca46cf6da933-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "881fec23-3a1d-46cc-99af-ca46cf6da933" (UID: "881fec23-3a1d-46cc-99af-ca46cf6da933"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 08:44:25.661864 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:25.661833 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/881fec23-3a1d-46cc-99af-ca46cf6da933-kube-api-access-nsc7p" (OuterVolumeSpecName: "kube-api-access-nsc7p") pod "881fec23-3a1d-46cc-99af-ca46cf6da933" (UID: "881fec23-3a1d-46cc-99af-ca46cf6da933"). InnerVolumeSpecName "kube-api-access-nsc7p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 08:44:25.760699 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:25.760673 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsc7p\" (UniqueName: \"kubernetes.io/projected/881fec23-3a1d-46cc-99af-ca46cf6da933-kube-api-access-nsc7p\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:44:25.760699 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:25.760697 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/881fec23-3a1d-46cc-99af-ca46cf6da933-maas-api-tls\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:44:25.760848 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:25.760711 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/881fec23-3a1d-46cc-99af-ca46cf6da933-openshift-service-ca\") on node \"ip-10-0-128-184.ec2.internal\" DevicePath \"\"" Jul 12 08:44:25.958299 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:25.958263 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4"] Jul 12 08:44:25.962182 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:25.962152 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b4359a-5f48667775-plpx4"] Jul 12 08:44:26.850805 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:26.850775 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="881fec23-3a1d-46cc-99af-ca46cf6da933" path="/var/lib/kubelet/pods/881fec23-3a1d-46cc-99af-ca46cf6da933/volumes" Jul 12 08:44:34.087851 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:34.087813 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7pzjm"] Jul 12 08:44:36.096700 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:36.096669 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-4nh4l_fbffebce-ec32-4aa2-bf19-15521ced0923/manager/0.log" Jul 12 08:44:36.213830 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:36.213794 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-hq6ds_2c6acf83-e3ee-482a-8eb1-c462ca1663d4/manager/0.log" Jul 12 08:44:36.663604 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:36.663574 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-595c444865-gcdjc_1629a10e-2a82-4cc2-adc8-e20d7bfb3b05/copy-manifests/0.log" Jul 12 08:44:36.681106 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:36.681078 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-595c444865-gcdjc_1629a10e-2a82-4cc2-adc8-e20d7bfb3b05/manager/0.log" Jul 12 08:44:37.701180 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:37.701142 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn_fbd04735-c0dc-4a54-8b75-3ab96b145cf9/util/0.log" Jul 12 08:44:37.707685 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:37.707656 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn_fbd04735-c0dc-4a54-8b75-3ab96b145cf9/pull/0.log" Jul 12 08:44:37.713500 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:37.713483 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn_fbd04735-c0dc-4a54-8b75-3ab96b145cf9/extract/0.log" Jul 12 08:44:37.817764 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:37.817710 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n_f82cfbb3-7e34-417a-b134-0ec921399861/extract/0.log" Jul 12 08:44:37.823343 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:37.823321 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n_f82cfbb3-7e34-417a-b134-0ec921399861/util/0.log" Jul 12 08:44:37.829207 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:37.829188 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n_f82cfbb3-7e34-417a-b134-0ec921399861/pull/0.log" Jul 12 08:44:37.935908 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:37.935882 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82_98ae7d70-c453-4217-80e8-5f4fc497ffe2/pull/0.log" Jul 12 08:44:37.943094 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:37.943075 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82_98ae7d70-c453-4217-80e8-5f4fc497ffe2/extract/0.log" Jul 12 08:44:37.948456 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:37.948435 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82_98ae7d70-c453-4217-80e8-5f4fc497ffe2/util/0.log" Jul 12 08:44:38.051741 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:38.051720 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5_7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c/util/0.log" Jul 12 08:44:38.059021 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:38.059003 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5_7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c/pull/0.log" Jul 12 08:44:38.064947 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:38.064891 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5_7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c/extract/0.log" Jul 12 08:44:38.849073 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:38.849044 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7pzjm_02215969-d7d4-4259-99a3-0d54450f7489/limitador/0.log" Jul 12 08:44:38.964725 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:38.964691 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zch2k_060c763a-3b7b-44b0-8ef9-be0c6c207031/manager/0.log" Jul 12 08:44:39.420822 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:39.420783 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-4fqrx_f271bd1d-ec4f-4b9f-aee0-16232f40a72a/discovery/0.log" Jul 12 08:44:39.525845 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:39.525815 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65cfff4589-b4nws_6138fabc-d22b-477c-9d28-0c35474e8f00/kube-auth-proxy/0.log" Jul 12 08:44:40.513799 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:40.513770 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-24269_88f33449-5b1a-4696-ad4c-6dc868b6951a/main/0.log" Jul 12 08:44:40.840622 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:40.840529 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-5ddvb_b52207bf-41ad-4c7e-98de-a0a8fec4a9dd/main/0.log" Jul 12 08:44:48.142037 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:48.141996 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hl94f_353ad383-9095-4c48-b3c8-5011b5519c48/global-pull-secret-syncer/0.log" Jul 12 08:44:48.265709 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:48.265677 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rccbv_ba18abe7-7175-41f7-9ba6-719d288e39c2/konnectivity-agent/0.log" Jul 12 08:44:48.313862 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:48.313836 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-184.ec2.internal_9c389db2de5a159deb11c2765258ec9e/haproxy/0.log" Jul 12 08:44:52.651176 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:52.651140 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn_fbd04735-c0dc-4a54-8b75-3ab96b145cf9/extract/0.log" Jul 12 08:44:52.670907 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:52.670879 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn_fbd04735-c0dc-4a54-8b75-3ab96b145cf9/util/0.log" Jul 12 08:44:52.693841 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:52.693817 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759k7wrn_fbd04735-c0dc-4a54-8b75-3ab96b145cf9/pull/0.log" Jul 12 08:44:52.717085 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:52.717062 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n_f82cfbb3-7e34-417a-b134-0ec921399861/extract/0.log" Jul 12 08:44:52.735096 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:52.735075 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n_f82cfbb3-7e34-417a-b134-0ec921399861/util/0.log" Jul 12 08:44:52.753828 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:52.753808 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07sv2n_f82cfbb3-7e34-417a-b134-0ec921399861/pull/0.log" Jul 12 08:44:52.777470 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:52.777450 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82_98ae7d70-c453-4217-80e8-5f4fc497ffe2/extract/0.log" Jul 12 08:44:52.795725 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:52.795699 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82_98ae7d70-c453-4217-80e8-5f4fc497ffe2/util/0.log" Jul 12 08:44:52.814508 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:52.814483 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735jc82_98ae7d70-c453-4217-80e8-5f4fc497ffe2/pull/0.log" Jul 12 08:44:52.856655 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:52.856617 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5_7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c/extract/0.log" Jul 12 08:44:52.882675 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:52.882652 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5_7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c/util/0.log" Jul 12 08:44:52.903195 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:52.903135 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d7fn5_7268afa5-6ab8-4ca2-a0bf-2e11e9c7d98c/pull/0.log" Jul 12 08:44:53.482514 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:53.482480 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7pzjm_02215969-d7d4-4259-99a3-0d54450f7489/limitador/0.log" Jul 12 08:44:53.567365 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:53.567336 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zch2k_060c763a-3b7b-44b0-8ef9-be0c6c207031/manager/0.log" Jul 12 08:44:55.406722 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:55.406648 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_92d9ce27-e309-4b19-b4e0-16a5d67326ed/alertmanager/0.log" Jul 12 08:44:55.449410 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:55.449381 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_92d9ce27-e309-4b19-b4e0-16a5d67326ed/config-reloader/0.log" Jul 12 08:44:55.511599 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:55.511577 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_92d9ce27-e309-4b19-b4e0-16a5d67326ed/kube-rbac-proxy-web/0.log" Jul 12 08:44:55.560792 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:55.560738 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_92d9ce27-e309-4b19-b4e0-16a5d67326ed/kube-rbac-proxy/0.log" Jul 12 08:44:55.606856 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:55.606831 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_92d9ce27-e309-4b19-b4e0-16a5d67326ed/kube-rbac-proxy-metric/0.log" Jul 12 08:44:55.628108 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:55.628086 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_92d9ce27-e309-4b19-b4e0-16a5d67326ed/prom-label-proxy/0.log" Jul 12 08:44:55.647793 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:55.647770 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_92d9ce27-e309-4b19-b4e0-16a5d67326ed/init-config-reloader/0.log" Jul 12 08:44:55.724522 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:55.724436 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-b5btx_b92aecde-082a-4a08-8c62-7c83695c896b/kube-state-metrics/0.log" Jul 12 08:44:55.739489 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:55.739464 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-b5btx_b92aecde-082a-4a08-8c62-7c83695c896b/kube-rbac-proxy-main/0.log" Jul 12 08:44:55.758885 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:55.758859 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-b5btx_b92aecde-082a-4a08-8c62-7c83695c896b/kube-rbac-proxy-self/0.log" Jul 12 08:44:55.850385 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:55.850357 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4fz9p_48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b/node-exporter/0.log" Jul 12 08:44:55.869720 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:55.869697 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4fz9p_48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b/kube-rbac-proxy/0.log" Jul 12 08:44:55.896545 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:55.896530 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4fz9p_48e11f97-2dc7-45ce-ad51-ea6cdc8bd27b/init-textfile/0.log" Jul 12 08:44:56.071582 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:56.071556 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-nl698_1ad878c8-4904-410c-b036-8ad5226f7e1c/kube-rbac-proxy-main/0.log" Jul 12 08:44:56.091647 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:56.091626 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-nl698_1ad878c8-4904-410c-b036-8ad5226f7e1c/kube-rbac-proxy-self/0.log" Jul 12 08:44:56.126651 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:56.126628 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-nl698_1ad878c8-4904-410c-b036-8ad5226f7e1c/openshift-state-metrics/0.log" Jul 12 08:44:56.347846 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:56.347754 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-w64qx_205176ff-afa8-4166-98af-968c7fb79620/prometheus-operator/0.log" Jul 12 08:44:56.364381 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:56.364357 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-w64qx_205176ff-afa8-4166-98af-968c7fb79620/kube-rbac-proxy/0.log" Jul 12 08:44:56.416449 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:56.416425 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-679d74b6b9-rmbvg_ba4aedf5-c822-4edd-827c-c18ec3b57ab4/telemeter-client/0.log" Jul 12 08:44:56.439825 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:56.439798 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-679d74b6b9-rmbvg_ba4aedf5-c822-4edd-827c-c18ec3b57ab4/reload/0.log" Jul 12 08:44:56.460445 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:56.460426 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-679d74b6b9-rmbvg_ba4aedf5-c822-4edd-827c-c18ec3b57ab4/kube-rbac-proxy/0.log" Jul 12 08:44:58.067850 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.067815 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5ndtc/perf-node-gather-daemonset-4fhv2"] Jul 12 08:44:58.068267 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.068237 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="881fec23-3a1d-46cc-99af-ca46cf6da933" containerName="maas-api" Jul 12 08:44:58.068267 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.068250 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="881fec23-3a1d-46cc-99af-ca46cf6da933" containerName="maas-api" Jul 12 08:44:58.068344 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.068321 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="881fec23-3a1d-46cc-99af-ca46cf6da933" containerName="maas-api" Jul 12 08:44:58.072802 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.072780 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-4fhv2" Jul 12 08:44:58.075039 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.075015 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5ndtc\"/\"kube-root-ca.crt\"" Jul 12 08:44:58.075904 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.075881 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5ndtc\"/\"default-dockercfg-9k25p\"" Jul 12 08:44:58.075904 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.075899 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5ndtc\"/\"openshift-service-ca.crt\"" Jul 12 08:44:58.081956 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.081915 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5ndtc/perf-node-gather-daemonset-4fhv2"] Jul 12 08:44:58.151152 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.151118 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6039091c-3e63-4a31-86ec-c2c0287de183-proc\") pod \"perf-node-gather-daemonset-4fhv2\" (UID: \"6039091c-3e63-4a31-86ec-c2c0287de183\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-4fhv2" Jul 12 08:44:58.151337 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.151192 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6039091c-3e63-4a31-86ec-c2c0287de183-sys\") pod \"perf-node-gather-daemonset-4fhv2\" (UID: \"6039091c-3e63-4a31-86ec-c2c0287de183\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-4fhv2" Jul 12 08:44:58.151337 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.151216 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6039091c-3e63-4a31-86ec-c2c0287de183-lib-modules\") pod \"perf-node-gather-daemonset-4fhv2\" (UID: \"6039091c-3e63-4a31-86ec-c2c0287de183\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-4fhv2" Jul 12 08:44:58.151337 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.151246 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6039091c-3e63-4a31-86ec-c2c0287de183-podres\") pod \"perf-node-gather-daemonset-4fhv2\" (UID: \"6039091c-3e63-4a31-86ec-c2c0287de183\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-4fhv2" Jul 12 08:44:58.151337 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.151290 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w995d\" (UniqueName: \"kubernetes.io/projected/6039091c-3e63-4a31-86ec-c2c0287de183-kube-api-access-w995d\") pod \"perf-node-gather-daemonset-4fhv2\" (UID: \"6039091c-3e63-4a31-86ec-c2c0287de183\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-4fhv2" Jul 12 08:44:58.252727 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.252687 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6039091c-3e63-4a31-86ec-c2c0287de183-sys\") pod \"perf-node-gather-daemonset-4fhv2\" (UID: \"6039091c-3e63-4a31-86ec-c2c0287de183\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-4fhv2" Jul 12 08:44:58.252727 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.252728 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6039091c-3e63-4a31-86ec-c2c0287de183-lib-modules\") pod \"perf-node-gather-daemonset-4fhv2\" (UID: \"6039091c-3e63-4a31-86ec-c2c0287de183\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-4fhv2" Jul 12 08:44:58.252985 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.252765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6039091c-3e63-4a31-86ec-c2c0287de183-podres\") pod \"perf-node-gather-daemonset-4fhv2\" (UID: \"6039091c-3e63-4a31-86ec-c2c0287de183\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-4fhv2" Jul 12 08:44:58.252985 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.252796 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w995d\" (UniqueName: \"kubernetes.io/projected/6039091c-3e63-4a31-86ec-c2c0287de183-kube-api-access-w995d\") pod \"perf-node-gather-daemonset-4fhv2\" (UID: \"6039091c-3e63-4a31-86ec-c2c0287de183\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-4fhv2" Jul 12 08:44:58.252985 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.252820 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6039091c-3e63-4a31-86ec-c2c0287de183-sys\") pod \"perf-node-gather-daemonset-4fhv2\" (UID: \"6039091c-3e63-4a31-86ec-c2c0287de183\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-4fhv2" Jul 12 08:44:58.252985 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.252866 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6039091c-3e63-4a31-86ec-c2c0287de183-proc\") pod \"perf-node-gather-daemonset-4fhv2\" (UID: \"6039091c-3e63-4a31-86ec-c2c0287de183\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-4fhv2" Jul 12 08:44:58.252985 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.252920 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6039091c-3e63-4a31-86ec-c2c0287de183-podres\") pod \"perf-node-gather-daemonset-4fhv2\" (UID: \"6039091c-3e63-4a31-86ec-c2c0287de183\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-4fhv2" Jul 12 08:44:58.252985 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.252964 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6039091c-3e63-4a31-86ec-c2c0287de183-lib-modules\") pod \"perf-node-gather-daemonset-4fhv2\" (UID: \"6039091c-3e63-4a31-86ec-c2c0287de183\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-4fhv2" Jul 12 08:44:58.253239 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.253015 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6039091c-3e63-4a31-86ec-c2c0287de183-proc\") pod \"perf-node-gather-daemonset-4fhv2\" (UID: \"6039091c-3e63-4a31-86ec-c2c0287de183\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-4fhv2" Jul 12 08:44:58.260643 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.260621 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w995d\" (UniqueName: \"kubernetes.io/projected/6039091c-3e63-4a31-86ec-c2c0287de183-kube-api-access-w995d\") pod \"perf-node-gather-daemonset-4fhv2\" (UID: \"6039091c-3e63-4a31-86ec-c2c0287de183\") " pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-4fhv2" Jul 12 08:44:58.383294 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.383217 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-4fhv2" Jul 12 08:44:58.518150 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.518121 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5ndtc/perf-node-gather-daemonset-4fhv2"] Jul 12 08:44:58.519608 ip-10-0-128-184 kubenswrapper[2576]: W0712 08:44:58.519576 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6039091c_3e63_4a31_86ec_c2c0287de183.slice/crio-396c0f90b1cb15a3788e59c568fb9e6204b28c3400e73f91c9b7c304b6014b6a WatchSource:0}: Error finding container 396c0f90b1cb15a3788e59c568fb9e6204b28c3400e73f91c9b7c304b6014b6a: Status 404 returned error can't find the container with id 396c0f90b1cb15a3788e59c568fb9e6204b28c3400e73f91c9b7c304b6014b6a Jul 12 08:44:58.811631 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.811592 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-4fhv2" event={"ID":"6039091c-3e63-4a31-86ec-c2c0287de183","Type":"ContainerStarted","Data":"f76ed00b6cff19f1c4e010c44ffc387ff74567c3573300013f46af3087d6ce70"} Jul 12 08:44:58.811819 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.811651 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-4fhv2" event={"ID":"6039091c-3e63-4a31-86ec-c2c0287de183","Type":"ContainerStarted","Data":"396c0f90b1cb15a3788e59c568fb9e6204b28c3400e73f91c9b7c304b6014b6a"} Jul 12 08:44:58.811819 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.811717 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-4fhv2" Jul 12 08:44:58.828956 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.828877 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-4fhv2" podStartSLOduration=0.828860006 podStartE2EDuration="828.860006ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 08:44:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 08:44:58.826734684 +0000 UTC m=+2286.511545559" watchObservedRunningTime="2026-07-12 08:44:58.828860006 +0000 UTC m=+2286.513670864" Jul 12 08:44:58.921872 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.921842 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5764bdbdbc-9rxhs_d9670afd-4d1e-4944-a293-86b49f2070ad/console/0.log" Jul 12 08:44:58.960755 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:44:58.960713 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-98xwj_a28b88f7-0a6d-455e-9f0a-eb03ba20cbdc/download-server/0.log" Jul 12 08:45:00.520050 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:00.520014 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wrbsq_46481969-347f-4259-8366-a376f786c9f3/dns/0.log" Jul 12 08:45:00.537725 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:00.537693 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wrbsq_46481969-347f-4259-8366-a376f786c9f3/kube-rbac-proxy/0.log" Jul 12 08:45:00.580688 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:00.580664 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rvmp5_778713dd-51aa-4f02-a6bd-2b3c26d176fc/dns-node-resolver/0.log" Jul 12 08:45:01.097657 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:01.097616 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-54cdcdcd88-vr4mf_62b60b7a-84e3-4502-997a-e238c1862381/registry/0.log" Jul 12 08:45:01.162262 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:01.162229 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wz95w_3b886eaf-a1aa-4e73-bf66-d8d0464561dc/node-ca/0.log" Jul 12 08:45:02.229399 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:02.229372 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-4fqrx_f271bd1d-ec4f-4b9f-aee0-16232f40a72a/discovery/0.log" Jul 12 08:45:02.248581 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:02.248558 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65cfff4589-b4nws_6138fabc-d22b-477c-9d28-0c35474e8f00/kube-auth-proxy/0.log" Jul 12 08:45:03.170193 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:03.170159 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n89k8_e291324a-b2bc-4bc5-b624-80fe7c0e5d7a/serve-healthcheck-canary/0.log" Jul 12 08:45:03.733686 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:03.733656 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fjjh5_43959b97-35ca-4a34-a6a8-9311bec3c904/kube-rbac-proxy/0.log" Jul 12 08:45:03.753382 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:03.753351 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fjjh5_43959b97-35ca-4a34-a6a8-9311bec3c904/exporter/0.log" Jul 12 08:45:03.773285 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:03.773260 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fjjh5_43959b97-35ca-4a34-a6a8-9311bec3c904/extractor/0.log" Jul 12 08:45:04.827628 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:04.827599 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5ndtc/perf-node-gather-daemonset-4fhv2" Jul 12 08:45:05.923807 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:05.923771 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-4nh4l_fbffebce-ec32-4aa2-bf19-15521ced0923/manager/0.log" Jul 12 08:45:06.089358 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:06.089323 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-hq6ds_2c6acf83-e3ee-482a-8eb1-c462ca1663d4/manager/0.log" Jul 12 08:45:06.368124 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:06.368091 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-595c444865-gcdjc_1629a10e-2a82-4cc2-adc8-e20d7bfb3b05/manager/0.log" Jul 12 08:45:06.384480 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:06.384456 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-595c444865-gcdjc_1629a10e-2a82-4cc2-adc8-e20d7bfb3b05/copy-manifests/0.log" Jul 12 08:45:07.945582 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:07.945554 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-rmdm5_00da6c87-f6c2-468c-8bdd-06461e34e833/openshift-lws-operator/0.log" Jul 12 08:45:08.580328 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:08.580277 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-4fqrx_f271bd1d-ec4f-4b9f-aee0-16232f40a72a/discovery/0.log" Jul 12 08:45:08.590719 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:08.590687 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65cfff4589-b4nws_6138fabc-d22b-477c-9d28-0c35474e8f00/kube-auth-proxy/0.log" Jul 12 08:45:10.090891 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:10.090850 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-4fqrx_f271bd1d-ec4f-4b9f-aee0-16232f40a72a/discovery/0.log" Jul 12 08:45:10.103450 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:10.103425 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65cfff4589-b4nws_6138fabc-d22b-477c-9d28-0c35474e8f00/kube-auth-proxy/0.log" Jul 12 08:45:14.219166 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:14.219136 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2bshp_a16f6071-4750-4de3-9b3b-4d9c559fcd8c/kube-multus/0.log" Jul 12 08:45:14.396129 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:14.396101 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fjqb_628c1d5e-923c-4cb5-bccb-3aa5dab35940/kube-multus-additional-cni-plugins/0.log" Jul 12 08:45:14.416648 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:14.416618 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fjqb_628c1d5e-923c-4cb5-bccb-3aa5dab35940/egress-router-binary-copy/0.log" Jul 12 08:45:14.439840 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:14.439809 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fjqb_628c1d5e-923c-4cb5-bccb-3aa5dab35940/cni-plugins/0.log" Jul 12 08:45:14.459447 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:14.459421 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fjqb_628c1d5e-923c-4cb5-bccb-3aa5dab35940/bond-cni-plugin/0.log" Jul 12 08:45:14.477999 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:14.477920 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fjqb_628c1d5e-923c-4cb5-bccb-3aa5dab35940/routeoverride-cni/0.log" Jul 12 08:45:14.495646 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:14.495628 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fjqb_628c1d5e-923c-4cb5-bccb-3aa5dab35940/whereabouts-cni-bincopy/0.log" Jul 12 08:45:14.514002 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:14.513984 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6fjqb_628c1d5e-923c-4cb5-bccb-3aa5dab35940/whereabouts-cni/0.log" Jul 12 08:45:14.741028 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:14.740923 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bnfwz_fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f/network-metrics-daemon/0.log" Jul 12 08:45:14.756999 ip-10-0-128-184 kubenswrapper[2576]: I0712 08:45:14.756975 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bnfwz_fa986cb0-0dc4-4fe1-9cf8-bbe8f5394c7f/kube-rbac-proxy/0.log"