Jul 13 14:18:54.285997 ip-10-0-138-70 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 13 14:18:54.286009 ip-10-0-138-70 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 13 14:18:54.286018 ip-10-0-138-70 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 13 14:18:54.286379 ip-10-0-138-70 systemd[1]: Failed to start Kubernetes Kubelet. Jul 13 14:19:05.787811 ip-10-0-138-70 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 13 14:19:05.787844 ip-10-0-138-70 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 820ccf06df1d4b06ad308d3d0391d96f -- Jul 13 14:20:47.564912 ip-10-0-138-70 systemd[1]: Starting Kubernetes Kubelet... Jul 13 14:20:48.227692 ip-10-0-138-70 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 14:20:48.227692 ip-10-0-138-70 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 13 14:20:48.227692 ip-10-0-138-70 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 14:20:48.227692 ip-10-0-138-70 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 13 14:20:48.227692 ip-10-0-138-70 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 14:20:48.227692 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.027995 2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 13 14:20:48.227692 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034294 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 14:20:48.227692 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034313 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 14:20:48.227692 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034316 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 14:20:48.227692 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034320 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 14:20:48.227692 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034323 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 14:20:48.227692 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034326 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 14:20:48.227692 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034329 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 14:20:48.227692 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034332 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 14:20:48.237520 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034336 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 14:20:48.237520 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034340 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 14:20:48.237520 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034343 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 14:20:48.237520 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034347 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 14:20:48.237520 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034350 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 14:20:48.237520 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034352 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 14:20:48.237520 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034355 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 14:20:48.237520 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034358 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 14:20:48.237520 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034361 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 14:20:48.237520 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034363 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 14:20:48.237520 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034366 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 14:20:48.237520 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034368 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 14:20:48.237520 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034373 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 14:20:48.237520 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034376 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 14:20:48.237520 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034379 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 14:20:48.237520 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034382 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 14:20:48.237520 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034385 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 14:20:48.237520 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034388 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 14:20:48.237520 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034391 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 14:20:48.110177 ip-10-0-138-70 systemd[1]: Started Kubernetes Kubelet. Jul 13 14:20:48.238339 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034394 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 14:20:48.238339 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034396 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 14:20:48.238339 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034399 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 14:20:48.238339 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034402 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 14:20:48.238339 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034405 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 14:20:48.238339 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034407 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 14:20:48.238339 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034410 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 14:20:48.238339 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034412 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 14:20:48.238339 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034415 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 14:20:48.238339 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034418 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 14:20:48.238339 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034421 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 14:20:48.238339 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034424 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 14:20:48.238339 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034426 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 14:20:48.238339 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034429 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 14:20:48.238339 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034431 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 14:20:48.238339 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034435 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 14:20:48.238339 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034438 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 14:20:48.238339 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034440 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 14:20:48.238339 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034443 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 14:20:48.238339 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034446 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 14:20:48.239055 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034449 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 14:20:48.239055 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034452 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 14:20:48.239055 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034454 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 14:20:48.239055 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034457 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 14:20:48.239055 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034462 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 14:20:48.239055 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034465 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 14:20:48.239055 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034469 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 14:20:48.239055 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034472 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 14:20:48.239055 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034475 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 14:20:48.239055 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034478 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 14:20:48.239055 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034481 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 14:20:48.239055 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034484 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 14:20:48.239055 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034487 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 14:20:48.239055 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034489 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 14:20:48.239055 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034492 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 14:20:48.239055 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034494 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 14:20:48.239055 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034497 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 14:20:48.239055 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034500 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 14:20:48.239055 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034502 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 13 14:20:48.239055 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034505 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 14:20:48.239681 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034507 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 14:20:48.239681 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034510 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 14:20:48.239681 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034513 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 14:20:48.239681 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034516 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 14:20:48.239681 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034518 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 14:20:48.239681 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034521 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 14:20:48.239681 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034524 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 14:20:48.239681 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034526 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 14:20:48.239681 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034529 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 14:20:48.239681 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034535 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 14:20:48.239681 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034538 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 14:20:48.239681 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034541 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 14:20:48.239681 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034545 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 14:20:48.239681 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034548 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 14:20:48.239681 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034551 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 14:20:48.239681 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034554 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 14:20:48.239681 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034557 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 14:20:48.239681 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034560 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 14:20:48.239681 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034563 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 14:20:48.240276 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034567 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 14:20:48.240276 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034570 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 14:20:48.240276 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034573 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 14:20:48.240276 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034575 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 14:20:48.240276 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034578 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 14:20:48.240276 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034595 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 14:20:48.240276 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034598 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 14:20:48.240276 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034601 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 14:20:48.240276 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034604 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 14:20:48.240276 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034606 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 14:20:48.240276 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034610 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 14:20:48.240276 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034612 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 14:20:48.240276 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.034615 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 14:20:48.240276 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035383 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 14:20:48.240276 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035390 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 14:20:48.240276 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035393 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 14:20:48.240276 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035397 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 14:20:48.240276 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035400 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 14:20:48.240276 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035403 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 14:20:48.240276 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035406 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 13 14:20:48.240883 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035409 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 14:20:48.240883 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035412 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 14:20:48.240883 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035415 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 14:20:48.240883 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035418 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 14:20:48.240883 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035421 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 14:20:48.240883 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035423 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 14:20:48.240883 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035426 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 14:20:48.240883 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035429 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 14:20:48.240883 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035431 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 14:20:48.240883 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035434 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 14:20:48.240883 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035437 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 14:20:48.240883 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035451 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 14:20:48.240883 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035455 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 14:20:48.240883 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035462 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 14:20:48.240883 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035465 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 14:20:48.240883 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035468 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 14:20:48.240883 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035471 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 14:20:48.240883 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035474 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 14:20:48.240883 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035478 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 14:20:48.240883 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035481 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 14:20:48.241502 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035484 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 14:20:48.241502 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035487 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 14:20:48.241502 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035490 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 14:20:48.241502 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035493 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 14:20:48.241502 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035495 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 14:20:48.241502 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035498 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 14:20:48.241502 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035501 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 14:20:48.241502 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035504 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 14:20:48.241502 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035507 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 14:20:48.241502 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035510 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 14:20:48.241502 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035513 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 14:20:48.241502 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035516 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 14:20:48.241502 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035519 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 14:20:48.241502 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035521 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 14:20:48.241502 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035523 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 14:20:48.241502 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035526 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 14:20:48.241502 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035529 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 14:20:48.241502 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035531 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 14:20:48.241502 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035533 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 14:20:48.242215 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035536 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 14:20:48.242215 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035538 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 14:20:48.242215 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035541 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 14:20:48.242215 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035543 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 14:20:48.242215 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035546 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 14:20:48.242215 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035548 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 14:20:48.242215 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035551 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 14:20:48.242215 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035562 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 14:20:48.242215 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035566 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 14:20:48.242215 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035569 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 14:20:48.242215 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035573 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 14:20:48.242215 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035576 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 14:20:48.242215 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035580 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 14:20:48.242215 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035600 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 14:20:48.242215 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035603 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 14:20:48.242215 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035606 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 14:20:48.242215 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035609 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 14:20:48.242215 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035612 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 14:20:48.242215 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035617 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 14:20:48.242817 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035620 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 14:20:48.242817 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035622 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 14:20:48.242817 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035625 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 14:20:48.242817 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035628 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 14:20:48.242817 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035630 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 14:20:48.242817 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035633 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 14:20:48.242817 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035636 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 14:20:48.242817 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035638 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 14:20:48.242817 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035641 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 14:20:48.242817 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035644 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 14:20:48.242817 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035647 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 14:20:48.242817 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035649 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 14:20:48.242817 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035651 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 14:20:48.242817 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035654 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 14:20:48.242817 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035657 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 14:20:48.242817 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035659 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 14:20:48.242817 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035663 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 14:20:48.242817 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035667 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 14:20:48.242817 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035669 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 14:20:48.243438 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035674 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 14:20:48.243438 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035677 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 14:20:48.243438 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035681 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 14:20:48.243438 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035685 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 14:20:48.243438 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035690 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 14:20:48.243438 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035693 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 14:20:48.243438 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035696 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 14:20:48.243438 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035699 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 14:20:48.243438 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035702 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 14:20:48.243438 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035704 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 14:20:48.243438 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035707 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 14:20:48.243438 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035710 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 14:20:48.243438 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035714 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 14:20:48.243438 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035717 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 14:20:48.243438 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.035720 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 14:20:48.243438 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036118 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 14:20:48.243438 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036124 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 14:20:48.243438 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036127 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 14:20:48.243438 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036130 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 14:20:48.244244 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036133 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 14:20:48.244244 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036136 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 14:20:48.244244 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036138 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 14:20:48.244244 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036141 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 14:20:48.244244 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036143 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 14:20:48.244244 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036146 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 14:20:48.244244 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036148 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 14:20:48.244244 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036151 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 14:20:48.244244 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036154 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 14:20:48.244244 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036157 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 14:20:48.244244 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036159 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 14:20:48.244244 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036162 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 14:20:48.244244 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036164 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 14:20:48.244244 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036167 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 14:20:48.244244 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036170 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 14:20:48.244244 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036173 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 14:20:48.244244 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036175 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 14:20:48.244244 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036180 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 14:20:48.244244 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036182 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 14:20:48.244807 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036185 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 14:20:48.244807 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036188 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 14:20:48.244807 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036190 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 14:20:48.244807 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036193 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 14:20:48.244807 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036195 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 14:20:48.244807 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036198 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 14:20:48.244807 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036202 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 14:20:48.244807 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036205 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 14:20:48.244807 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036207 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 14:20:48.244807 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036211 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 14:20:48.244807 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036213 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 14:20:48.244807 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036216 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 14:20:48.244807 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036218 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 14:20:48.244807 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036221 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 14:20:48.244807 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036223 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 14:20:48.244807 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036226 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 14:20:48.244807 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036228 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 14:20:48.244807 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036231 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 14:20:48.244807 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036235 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 14:20:48.245413 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036239 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 14:20:48.245413 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036243 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 14:20:48.245413 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036245 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 14:20:48.245413 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036248 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 14:20:48.245413 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036250 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 14:20:48.245413 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036253 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 14:20:48.245413 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036255 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 14:20:48.245413 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036257 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 14:20:48.245413 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036260 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 14:20:48.245413 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036263 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 14:20:48.245413 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036267 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 14:20:48.245413 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036271 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 14:20:48.245413 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036274 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 14:20:48.245413 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036276 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 14:20:48.245413 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036279 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 14:20:48.245413 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036281 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 14:20:48.245413 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036284 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 14:20:48.245413 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036287 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 14:20:48.245413 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036289 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 14:20:48.245413 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036293 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 14:20:48.245413 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036296 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 13 14:20:48.246047 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036298 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 14:20:48.246047 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036301 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 14:20:48.246047 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036303 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 14:20:48.246047 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036305 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 14:20:48.246047 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036308 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 14:20:48.246047 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036310 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 14:20:48.246047 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036313 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 14:20:48.246047 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036315 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 14:20:48.246047 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036318 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 14:20:48.246047 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036320 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 14:20:48.246047 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036322 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 14:20:48.246047 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036325 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 14:20:48.246047 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036327 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 14:20:48.246047 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036330 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 14:20:48.246047 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036333 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 14:20:48.246047 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036335 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 14:20:48.246047 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036338 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 14:20:48.246047 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036340 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 14:20:48.246047 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036343 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 14:20:48.246047 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036346 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 14:20:48.246620 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036349 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 14:20:48.246620 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036351 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 14:20:48.246620 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036356 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 14:20:48.246620 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036360 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 14:20:48.246620 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036363 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 14:20:48.246620 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036366 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 14:20:48.246620 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036369 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 14:20:48.246620 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036372 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 14:20:48.246620 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036374 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 14:20:48.246620 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036377 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 14:20:48.246620 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036382 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 14:20:48.246620 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036386 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 14:20:48.246620 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036388 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 14:20:48.246620 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036391 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 14:20:48.246620 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036394 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 14:20:48.246620 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.036396 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 14:20:48.246620 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036473 2568 flags.go:64] FLAG: --address="0.0.0.0" Jul 13 14:20:48.246620 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036484 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 13 14:20:48.246620 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036494 2568 flags.go:64] FLAG: --anonymous-auth="true" Jul 13 14:20:48.246620 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036500 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 13 14:20:48.247140 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036507 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 13 14:20:48.247140 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036510 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 13 14:20:48.247140 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036515 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 13 14:20:48.247140 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036519 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 13 14:20:48.247140 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036522 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 13 14:20:48.247140 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036525 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 13 14:20:48.247140 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036529 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 13 14:20:48.247140 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036532 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 13 14:20:48.247140 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036535 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 13 14:20:48.247140 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036539 2568 flags.go:64] FLAG: --cgroup-root="" Jul 13 14:20:48.247140 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036541 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 13 14:20:48.247140 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036544 2568 flags.go:64] FLAG: --client-ca-file="" Jul 13 14:20:48.247140 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036547 2568 flags.go:64] FLAG: --cloud-provider="external" Jul 13 14:20:48.247140 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036550 2568 flags.go:64] FLAG: --cluster-dns="[]" Jul 13 14:20:48.247140 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036558 2568 flags.go:64] FLAG: --cluster-domain="" Jul 13 14:20:48.247140 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036562 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 13 14:20:48.247140 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036565 2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 13 14:20:48.247140 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036568 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 13 14:20:48.247140 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036572 2568 flags.go:64] FLAG: --container-log-max-files="5" Jul 13 14:20:48.247140 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036576 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 13 14:20:48.247140 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036579 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 13 14:20:48.247140 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036594 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 13 14:20:48.247140 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036599 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 13 14:20:48.247777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036602 2568 flags.go:64] FLAG: --contention-profiling="false" Jul 13 14:20:48.247777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036605 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 13 14:20:48.247777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036608 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 13 14:20:48.247777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036612 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 13 14:20:48.247777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036615 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 13 14:20:48.247777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036619 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 13 14:20:48.247777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036622 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 13 14:20:48.247777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036625 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 13 14:20:48.247777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036628 2568 flags.go:64] FLAG: --enable-load-reader="false" Jul 13 14:20:48.247777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036631 2568 flags.go:64] FLAG: --enable-server="true" Jul 13 14:20:48.247777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036634 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 13 14:20:48.247777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036645 2568 flags.go:64] FLAG: --event-burst="100" Jul 13 14:20:48.247777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036648 2568 flags.go:64] FLAG: --event-qps="50" Jul 13 14:20:48.247777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036651 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 13 14:20:48.247777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036655 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 13 14:20:48.247777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036657 2568 flags.go:64] FLAG: --eviction-hard="" Jul 13 14:20:48.247777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036661 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 13 14:20:48.247777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036664 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 13 14:20:48.247777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036667 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 13 14:20:48.247777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036670 2568 flags.go:64] FLAG: --eviction-soft="" Jul 13 14:20:48.247777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036673 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 13 14:20:48.247777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036675 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 13 14:20:48.247777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036678 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 13 14:20:48.247777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036682 2568 flags.go:64] FLAG: --experimental-mounter-path="" Jul 13 14:20:48.247777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036685 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 13 14:20:48.248458 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036692 2568 flags.go:64] FLAG: --fail-swap-on="true" Jul 13 14:20:48.248458 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036695 2568 flags.go:64] FLAG: --feature-gates="" Jul 13 14:20:48.248458 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036699 2568 flags.go:64] FLAG: --file-check-frequency="20s" Jul 13 14:20:48.248458 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036702 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 13 14:20:48.248458 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036706 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 13 14:20:48.248458 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036709 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 13 14:20:48.248458 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036713 2568 flags.go:64] FLAG: --healthz-port="10248" Jul 13 14:20:48.248458 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036716 2568 flags.go:64] FLAG: --help="false" Jul 13 14:20:48.248458 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036719 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-138-70.ec2.internal" Jul 13 14:20:48.248458 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036722 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 13 14:20:48.248458 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036725 2568 flags.go:64] FLAG: --http-check-frequency="20s" Jul 13 14:20:48.248458 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036728 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 13 14:20:48.248458 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036732 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 13 14:20:48.248458 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036735 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 13 14:20:48.248458 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036738 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 13 14:20:48.248458 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036741 2568 flags.go:64] FLAG: --image-service-endpoint="" Jul 13 14:20:48.248458 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036744 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 13 14:20:48.248458 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036747 2568 flags.go:64] FLAG: --kube-api-burst="100" Jul 13 14:20:48.248458 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036750 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 13 14:20:48.248458 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036753 2568 flags.go:64] FLAG: --kube-api-qps="50" Jul 13 14:20:48.248458 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036756 2568 flags.go:64] FLAG: --kube-reserved="" Jul 13 14:20:48.248458 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036759 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 13 14:20:48.248458 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036762 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 13 14:20:48.248458 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036765 2568 flags.go:64] FLAG: --kubelet-cgroups="" Jul 13 14:20:48.249151 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036767 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 13 14:20:48.249151 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036770 2568 flags.go:64] FLAG: --lock-file="" Jul 13 14:20:48.249151 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036773 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 13 14:20:48.249151 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036776 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 13 14:20:48.249151 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036779 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 13 14:20:48.249151 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036785 2568 flags.go:64] FLAG: --log-json-split-stream="false" Jul 13 14:20:48.249151 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036789 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 13 14:20:48.249151 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036791 2568 flags.go:64] FLAG: --log-text-split-stream="false" Jul 13 14:20:48.249151 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036794 2568 flags.go:64] FLAG: --logging-format="text" Jul 13 14:20:48.249151 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036800 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 13 14:20:48.249151 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036804 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 13 14:20:48.249151 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036819 2568 flags.go:64] FLAG: --manifest-url="" Jul 13 14:20:48.249151 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036823 2568 flags.go:64] FLAG: --manifest-url-header="" Jul 13 14:20:48.249151 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036828 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 13 14:20:48.249151 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036833 2568 flags.go:64] FLAG: --max-open-files="1000000" Jul 13 14:20:48.249151 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036837 2568 flags.go:64] FLAG: --max-pods="110" Jul 13 14:20:48.249151 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036840 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 13 14:20:48.249151 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036843 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 13 14:20:48.249151 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036846 2568 flags.go:64] FLAG: --memory-manager-policy="None" Jul 13 14:20:48.249151 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036849 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 13 14:20:48.249151 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036852 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 13 14:20:48.249151 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036855 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 13 14:20:48.249151 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036858 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 13 14:20:48.249151 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036865 2568 flags.go:64] FLAG: --node-status-max-images="50" Jul 13 14:20:48.249151 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036868 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 13 14:20:48.250127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036871 2568 flags.go:64] FLAG: --oom-score-adj="-999" Jul 13 14:20:48.250127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036875 2568 flags.go:64] FLAG: --pod-cidr="" Jul 13 14:20:48.250127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036877 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 13 14:20:48.250127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036884 2568 flags.go:64] FLAG: --pod-manifest-path="" Jul 13 14:20:48.250127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036887 2568 flags.go:64] FLAG: --pod-max-pids="-1" Jul 13 14:20:48.250127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036891 2568 flags.go:64] FLAG: --pods-per-core="0" Jul 13 14:20:48.250127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036893 2568 flags.go:64] FLAG: --port="10250" Jul 13 14:20:48.250127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036897 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 13 14:20:48.250127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036900 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dcaddfd1f41c2e38" Jul 13 14:20:48.250127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036903 2568 flags.go:64] FLAG: --qos-reserved="" Jul 13 14:20:48.250127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036906 2568 flags.go:64] FLAG: --read-only-port="10255" Jul 13 14:20:48.250127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036909 2568 flags.go:64] FLAG: --register-node="true" Jul 13 14:20:48.250127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036912 2568 flags.go:64] FLAG: --register-with-taints="" Jul 13 14:20:48.250127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036915 2568 flags.go:64] FLAG: --registry-burst="10" Jul 13 14:20:48.250127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036920 2568 flags.go:64] FLAG: --registry-qps="5" Jul 13 14:20:48.250127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036922 2568 flags.go:64] FLAG: --reserved-cpus="" Jul 13 14:20:48.250127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036925 2568 flags.go:64] FLAG: --reserved-memory="" Jul 13 14:20:48.250127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036932 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 13 14:20:48.250127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036936 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 13 14:20:48.250127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036939 2568 flags.go:64] FLAG: --rotate-certificates="false" Jul 13 14:20:48.250127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036942 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 13 14:20:48.250127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036946 2568 flags.go:64] FLAG: --runonce="false" Jul 13 14:20:48.250127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036949 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 13 14:20:48.250127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036952 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 13 14:20:48.250127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036955 2568 flags.go:64] FLAG: --seccomp-default="false" Jul 13 14:20:48.250828 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036958 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 13 14:20:48.250828 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036961 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 13 14:20:48.250828 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036964 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 13 14:20:48.250828 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036967 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 13 14:20:48.250828 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036970 2568 flags.go:64] FLAG: --storage-driver-password="root" Jul 13 14:20:48.250828 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036973 2568 flags.go:64] FLAG: --storage-driver-secure="false" Jul 13 14:20:48.250828 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036976 2568 flags.go:64] FLAG: --storage-driver-table="stats" Jul 13 14:20:48.250828 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036978 2568 flags.go:64] FLAG: --storage-driver-user="root" Jul 13 14:20:48.250828 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036982 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 13 14:20:48.250828 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036985 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 13 14:20:48.250828 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036987 2568 flags.go:64] FLAG: --system-cgroups="" Jul 13 14:20:48.250828 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036990 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 13 14:20:48.250828 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036996 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 13 14:20:48.250828 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.036998 2568 flags.go:64] FLAG: --tls-cert-file="" Jul 13 14:20:48.250828 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.037001 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 13 14:20:48.250828 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.037005 2568 flags.go:64] FLAG: --tls-min-version="" Jul 13 14:20:48.250828 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.037008 2568 flags.go:64] FLAG: --tls-private-key-file="" Jul 13 14:20:48.250828 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.037011 2568 flags.go:64] FLAG: --topology-manager-policy="none" Jul 13 14:20:48.250828 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.037014 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 13 14:20:48.250828 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.037016 2568 flags.go:64] FLAG: --topology-manager-scope="container" Jul 13 14:20:48.250828 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.037019 2568 flags.go:64] FLAG: --v="2" Jul 13 14:20:48.250828 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.037025 2568 flags.go:64] FLAG: --version="false" Jul 13 14:20:48.250828 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.037030 2568 flags.go:64] FLAG: --vmodule="" Jul 13 14:20:48.250828 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.037036 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 13 14:20:48.250828 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.037040 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 13 14:20:48.492775 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037177 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 14:20:48.492775 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037182 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 14:20:48.492775 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037185 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 14:20:48.492775 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037192 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 14:20:48.492775 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037195 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 14:20:48.492775 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037198 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 14:20:48.492775 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037200 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 14:20:48.492775 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037203 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 14:20:48.492775 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037206 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 14:20:48.492775 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037209 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 14:20:48.492775 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037211 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 14:20:48.492775 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037214 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 14:20:48.492775 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037216 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 14:20:48.492775 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037219 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 14:20:48.492775 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037221 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 14:20:48.492775 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037224 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 14:20:48.492775 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037227 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 14:20:48.492775 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037230 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 14:20:48.492775 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037234 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 14:20:48.493448 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037237 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 14:20:48.493448 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037239 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 14:20:48.493448 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037242 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 14:20:48.493448 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037244 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 14:20:48.493448 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037247 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 14:20:48.493448 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037250 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 14:20:48.493448 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037252 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 14:20:48.493448 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037255 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 14:20:48.493448 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037258 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 14:20:48.493448 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037262 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 14:20:48.493448 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037264 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 14:20:48.493448 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037267 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 14:20:48.493448 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037269 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 14:20:48.493448 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037272 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 14:20:48.493448 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037281 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 14:20:48.493448 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037283 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 14:20:48.493448 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037287 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 14:20:48.493448 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037290 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 14:20:48.493448 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037292 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 14:20:48.493448 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037295 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 14:20:48.494108 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037298 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 14:20:48.494108 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037300 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 14:20:48.494108 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037303 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 14:20:48.494108 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037305 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 14:20:48.494108 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037308 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 14:20:48.494108 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037310 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 14:20:48.494108 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037313 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 14:20:48.494108 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037315 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 14:20:48.494108 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037318 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 14:20:48.494108 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037321 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 14:20:48.494108 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037324 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 14:20:48.494108 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037326 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 14:20:48.494108 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037329 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 14:20:48.494108 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037331 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 13 14:20:48.494108 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037334 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 14:20:48.494108 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037336 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 14:20:48.494108 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037339 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 14:20:48.494108 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037342 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 14:20:48.494108 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037344 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 14:20:48.494108 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037347 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 14:20:48.494696 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037350 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 14:20:48.494696 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037353 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 14:20:48.494696 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037356 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 14:20:48.494696 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037359 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 14:20:48.494696 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037361 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 14:20:48.494696 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037364 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 14:20:48.494696 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037366 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 14:20:48.494696 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037374 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 14:20:48.494696 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037378 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 14:20:48.494696 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037381 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 14:20:48.494696 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037383 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 14:20:48.494696 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037386 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 14:20:48.494696 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037389 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 14:20:48.494696 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037391 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 14:20:48.494696 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037394 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 14:20:48.494696 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037396 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 14:20:48.494696 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037399 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 14:20:48.494696 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037401 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 14:20:48.494696 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037404 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 14:20:48.494696 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037407 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 14:20:48.495225 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037409 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 14:20:48.495225 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037412 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 14:20:48.495225 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037414 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 14:20:48.495225 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037417 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 14:20:48.495225 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037419 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 14:20:48.495225 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037422 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 14:20:48.495225 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037424 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 14:20:48.495225 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037428 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 14:20:48.495225 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037432 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 14:20:48.495225 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037435 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 14:20:48.495225 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037438 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 14:20:48.495225 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037440 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 14:20:48.495225 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037443 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 14:20:48.495225 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037448 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 14:20:48.495225 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037451 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 14:20:48.495225 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037454 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 14:20:48.495225 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037457 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 14:20:48.495225 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037460 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 14:20:48.495225 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037463 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 14:20:48.495777 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.037466 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 14:20:48.495777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.038227 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 14:20:48.495777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.047735 2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 13 14:20:48.495777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.047754 2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 13 14:20:48.495777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.047774 2568 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 13 14:20:48.495777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.047780 2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 13 14:20:48.495777 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047843 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 14:20:48.495777 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047849 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 14:20:48.495777 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047852 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 14:20:48.495777 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047855 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 14:20:48.495777 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047858 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 14:20:48.495777 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047861 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 14:20:48.495777 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047864 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 14:20:48.495777 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047867 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 14:20:48.495777 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047870 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 14:20:48.496203 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047874 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 14:20:48.496203 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047877 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 14:20:48.496203 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047881 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 14:20:48.496203 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047885 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 14:20:48.496203 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047888 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 14:20:48.496203 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047891 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 14:20:48.496203 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047893 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 14:20:48.496203 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047896 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 14:20:48.496203 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047899 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 14:20:48.496203 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047902 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 14:20:48.496203 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047904 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 14:20:48.496203 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047907 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 14:20:48.496203 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047910 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 14:20:48.496203 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047913 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 14:20:48.496203 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047916 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 14:20:48.496203 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047919 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 14:20:48.496203 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047921 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 14:20:48.496203 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047924 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 14:20:48.496203 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047926 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 14:20:48.496768 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047929 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 14:20:48.496768 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047932 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 14:20:48.496768 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047935 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 14:20:48.496768 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047937 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 14:20:48.496768 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047940 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 14:20:48.496768 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047943 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 14:20:48.496768 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047946 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 14:20:48.496768 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047948 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 14:20:48.496768 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047951 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 14:20:48.496768 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047954 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 14:20:48.496768 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047961 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 14:20:48.496768 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047963 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 14:20:48.496768 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047966 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 14:20:48.496768 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047968 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 14:20:48.496768 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047971 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 14:20:48.496768 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047974 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 14:20:48.496768 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047977 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 14:20:48.496768 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047979 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 14:20:48.496768 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047982 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 14:20:48.496768 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047985 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 14:20:48.497293 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047988 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 14:20:48.497293 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047991 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 14:20:48.497293 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047994 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 14:20:48.497293 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047996 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 14:20:48.497293 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.047999 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 14:20:48.497293 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048002 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 14:20:48.497293 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048004 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 14:20:48.497293 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048007 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 14:20:48.497293 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048010 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 14:20:48.497293 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048013 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 14:20:48.497293 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048015 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 14:20:48.497293 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048018 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 14:20:48.497293 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048020 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 14:20:48.497293 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048023 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 14:20:48.497293 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048025 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 14:20:48.497293 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048029 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 14:20:48.497293 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048033 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 14:20:48.497293 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048036 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 14:20:48.497293 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048039 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 14:20:48.497293 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048041 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 14:20:48.497913 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048044 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 14:20:48.497913 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048047 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 14:20:48.497913 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048054 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 14:20:48.497913 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048057 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 14:20:48.497913 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048060 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 14:20:48.497913 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048062 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 14:20:48.497913 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048065 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 14:20:48.497913 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048068 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 14:20:48.497913 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048071 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 14:20:48.497913 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048073 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 14:20:48.497913 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048076 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 14:20:48.497913 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048079 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 14:20:48.497913 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048082 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 14:20:48.497913 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048085 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 14:20:48.497913 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048087 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 14:20:48.497913 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048090 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 14:20:48.497913 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048093 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 14:20:48.497913 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048095 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 13 14:20:48.497913 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048098 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 14:20:48.497913 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048100 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 14:20:48.498439 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048103 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 14:20:48.498439 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048105 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 14:20:48.498439 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048108 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 14:20:48.498439 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048111 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 14:20:48.498439 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048113 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 14:20:48.498439 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048116 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 14:20:48.498439 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048119 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 14:20:48.498439 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048123 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 14:20:48.498439 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048126 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 14:20:48.498439 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048128 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 14:20:48.498439 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048131 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 14:20:48.498439 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.048136 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 14:20:48.498439 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048277 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 14:20:48.498439 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048283 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 14:20:48.498439 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048288 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 14:20:48.498902 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048292 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 14:20:48.498902 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048295 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 14:20:48.498902 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048298 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 14:20:48.498902 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048301 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 14:20:48.498902 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048304 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 14:20:48.498902 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048307 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 14:20:48.498902 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048309 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 14:20:48.498902 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048312 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 14:20:48.498902 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048315 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 14:20:48.498902 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048318 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 14:20:48.498902 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048321 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 14:20:48.498902 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048324 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 14:20:48.498902 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048327 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 14:20:48.498902 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048329 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 14:20:48.498902 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048332 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 14:20:48.498902 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048335 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 14:20:48.498902 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048337 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 14:20:48.498902 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048340 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 14:20:48.498902 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048342 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 14:20:48.498902 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048345 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 14:20:48.499424 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048347 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 14:20:48.499424 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048350 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 14:20:48.499424 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048352 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 14:20:48.499424 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048357 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 14:20:48.499424 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048360 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 14:20:48.499424 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048363 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 14:20:48.499424 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048366 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 14:20:48.499424 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048369 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 14:20:48.499424 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048371 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 14:20:48.499424 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048374 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 14:20:48.499424 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048377 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 14:20:48.499424 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048380 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 14:20:48.499424 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048384 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 14:20:48.499424 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048387 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 14:20:48.499424 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048390 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 14:20:48.499424 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048392 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 14:20:48.499424 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048395 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 14:20:48.499424 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048397 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 14:20:48.499424 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048400 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 14:20:48.499980 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048402 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 14:20:48.499980 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048405 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 14:20:48.499980 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048408 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 14:20:48.499980 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048417 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 14:20:48.499980 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048420 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 14:20:48.499980 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048422 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 14:20:48.499980 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048425 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 14:20:48.499980 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048427 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 14:20:48.499980 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048430 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 14:20:48.499980 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048433 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 14:20:48.499980 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048435 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 14:20:48.499980 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048437 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 14:20:48.499980 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048440 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 14:20:48.499980 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048443 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 14:20:48.499980 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048445 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 14:20:48.499980 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048448 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 14:20:48.499980 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048450 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 14:20:48.499980 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048453 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 14:20:48.499980 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048456 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 14:20:48.499980 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048458 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 14:20:48.500490 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048461 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 14:20:48.500490 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048463 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 13 14:20:48.500490 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048466 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 14:20:48.500490 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048468 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 14:20:48.500490 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048472 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 14:20:48.500490 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048476 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 14:20:48.500490 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048479 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 14:20:48.500490 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048481 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 14:20:48.500490 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048485 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 14:20:48.500490 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048489 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 14:20:48.500490 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048492 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 14:20:48.500490 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048495 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 14:20:48.500490 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048498 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 14:20:48.500490 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048500 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 14:20:48.500490 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048503 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 14:20:48.500490 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048506 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 14:20:48.500490 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048510 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 14:20:48.500490 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048512 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 14:20:48.500490 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048515 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 14:20:48.501036 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048517 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 14:20:48.501036 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048520 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 14:20:48.501036 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048522 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 14:20:48.501036 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048525 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 14:20:48.501036 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048528 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 14:20:48.501036 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048530 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 14:20:48.501036 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048533 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 14:20:48.501036 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048535 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 14:20:48.501036 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048538 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 14:20:48.501036 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048541 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 14:20:48.501036 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048543 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 14:20:48.501036 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048546 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 14:20:48.501036 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048548 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 14:20:48.501036 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048551 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 14:20:48.501036 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048553 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 14:20:48.501036 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048556 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 14:20:48.501036 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048558 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 14:20:48.501036 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:48.048562 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 14:20:48.501543 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.048568 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 14:20:48.501543 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.048722 2568 server.go:962] "Client rotation is on, will bootstrap in background" Jul 13 14:20:48.501543 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.051240 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 13 14:20:48.501543 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.052965 2568 server.go:1019] "Starting client certificate rotation" Jul 13 14:20:48.501543 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.053067 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 14:20:48.501543 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.053107 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 14:20:48.501543 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.055872 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 14:20:48.501543 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.057091 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 14:20:48.501543 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.070842 2568 log.go:25] "Validated CRI v1 runtime API" Jul 13 14:20:48.501543 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.074758 2568 log.go:25] "Validated CRI v1 image API" Jul 13 14:20:48.501543 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.076027 2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 13 14:20:48.501543 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.078780 2568 fs.go:135] Filesystem UUIDs: map[0eb4603d-d87d-46ea-8719-042155572001:/dev/nvme0n1p3 60b61010-cf38-4bba-925e-c468f7fa6822:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 13 14:20:48.501958 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.078798 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 13 14:20:48.502031 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.084800 2568 manager.go:216] Machine: {Timestamp:2026-07-13 14:20:48.08309026 +0000 UTC m=+0.379093206 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101072 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec278dfe23bba9bc1e5a80c755f84c61 SystemUUID:ec278dfe-23bb-a9bc-1e5a-80c755f84c61 BootID:820ccf06-df1d-4b06-ad30-8d3d0391d96f Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:da:0a:90:89:5b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:da:0a:90:89:5b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:db:3e:06:3a:80 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 13 14:20:48.502031 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.086010 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 13 14:20:48.502031 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.086121 2568 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 13 14:20:48.502031 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.089907 2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 13 14:20:48.502031 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.089944 2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-70.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 13 14:20:48.502031 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.090785 2568 topology_manager.go:138] "Creating topology manager with none policy" Jul 13 14:20:48.502031 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.090794 2568 container_manager_linux.go:309] "Creating device plugin manager" Jul 13 14:20:48.502031 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.090803 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.090820 2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.092626 2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.097289 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.097605 2568 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.097634 2568 kubelet.go:486] "Attempting to sync node with API server" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.097645 2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.097659 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.097669 2568 kubelet.go:398] "Adding apiserver pod source" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.097684 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.098066 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.098088 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.100466 2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.102284 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.102771 2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.102799 2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.102982 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.102995 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.103001 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.103006 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.103015 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.103020 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.103618 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.103630 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.103640 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.103650 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.103674 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.103688 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.105529 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.105540 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.109222 2568 server.go:1268] "Started kubelet" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.109262 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.109365 2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.109437 2568 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.111570 2568 server.go:310] "Adding debug handlers to kubelet server" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.111694 2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-70.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.111759 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-70.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.111758 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.113596 2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 13 14:20:48.502343 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.116918 2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.116971 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-70.ec2.internal.18c1df4cbdbc0a90 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-70.ec2.internal,UID:ip-10-0-138-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-70.ec2.internal,},FirstTimestamp:2026-07-13 14:20:48.109152912 +0000 UTC m=+0.405155857,LastTimestamp:2026-07-13 14:20:48.109152912 +0000 UTC m=+0.405155857,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-70.ec2.internal,}" Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.121446 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.121452 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.121517 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-70.ec2.internal\" not found" Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.122182 2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.122254 2568 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.122272 2568 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.122356 2568 reconstruct.go:97] "Volume reconstruction finished" Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.122367 2568 reconciler.go:29] "Reconciler: start to sync state" Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.122610 2568 factory.go:55] Registering systemd factory Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.122624 2568 factory.go:223] Registration of the systemd container factory successfully Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.122863 2568 factory.go:153] Registering CRI-O factory Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.122879 2568 factory.go:223] Registration of the crio container factory successfully Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.122936 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.122963 2568 factory.go:103] Registering Raw factory Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.122979 2568 manager.go:1196] Started watching for new ooms in manager Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.123400 2568 manager.go:349] Starting recovery of all containers Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.125648 2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-70.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.133364 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.136239 2568 manager.go:354] Recovery completed Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.137715 2568 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.140954 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.143021 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientMemory" Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.143051 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.143066 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientPID" Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.143575 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.143599 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.143576 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.143617 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.144305 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientMemory" Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.144326 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.144336 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientPID" Jul 13 14:20:48.751498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.145745 2568 policy_none.go:49] "None policy: Start" Jul 13 14:20:48.753905 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.145762 2568 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 13 14:20:48.753905 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.145777 2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 13 14:20:48.753905 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.145778 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-70.ec2.internal.18c1df4cbfc10a3b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-70.ec2.internal,UID:ip-10-0-138-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-70.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-70.ec2.internal,},FirstTimestamp:2026-07-13 14:20:48.143034939 +0000 UTC m=+0.439037884,LastTimestamp:2026-07-13 14:20:48.143034939 +0000 UTC m=+0.439037884,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-70.ec2.internal,}" Jul 13 14:20:48.753905 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.147828 2568 policy_none.go:47] "Start" Jul 13 14:20:48.753905 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.155905 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-70.ec2.internal.18c1df4cbfc16479 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-70.ec2.internal,UID:ip-10-0-138-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-70.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-70.ec2.internal,},FirstTimestamp:2026-07-13 14:20:48.143058041 +0000 UTC m=+0.439060989,LastTimestamp:2026-07-13 14:20:48.143058041 +0000 UTC m=+0.439060989,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-70.ec2.internal,}" Jul 13 14:20:48.753905 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.166188 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-70.ec2.internal.18c1df4cbfc19a25 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-70.ec2.internal,UID:ip-10-0-138-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-70.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-70.ec2.internal,},FirstTimestamp:2026-07-13 14:20:48.143071781 +0000 UTC m=+0.439074725,LastTimestamp:2026-07-13 14:20:48.143071781 +0000 UTC m=+0.439074725,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-70.ec2.internal,}" Jul 13 14:20:48.753905 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.177748 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wg255" Jul 13 14:20:48.753905 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.178697 2568 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-70.ec2.internal.18c1df4cbfc10a3b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-70.ec2.internal.18c1df4cbfc10a3b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-70.ec2.internal,UID:ip-10-0-138-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-70.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-70.ec2.internal,},FirstTimestamp:2026-07-13 14:20:48.143034939 +0000 UTC m=+0.439037884,LastTimestamp:2026-07-13 14:20:48.144315036 +0000 UTC m=+0.440317981,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-70.ec2.internal,}" Jul 13 14:20:48.753905 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.185292 2568 manager.go:337] "Starting Device Plugin manager" Jul 13 14:20:48.753905 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.185331 2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 13 14:20:48.753905 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.185343 2568 server.go:87] "Starting device plugin registration server" Jul 13 14:20:48.753905 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.185641 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 13 14:20:48.753905 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.185652 2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.185744 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.185831 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.185841 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.186445 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.186493 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-70.ec2.internal\" not found" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.190164 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wg255" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.194737 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.195889 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.195956 2568 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.195986 2568 kubelet.go:2448] "Starting kubelet main sync loop" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.196026 2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.197016 2568 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-70.ec2.internal.18c1df4cbfc16479\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-70.ec2.internal.18c1df4cbfc16479 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-70.ec2.internal,UID:ip-10-0-138-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-70.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-70.ec2.internal,},FirstTimestamp:2026-07-13 14:20:48.143058041 +0000 UTC m=+0.439060989,LastTimestamp:2026-07-13 14:20:48.144330782 +0000 UTC m=+0.440333727,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-70.ec2.internal,}" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.207309 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.286215 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.288482 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientMemory" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.288521 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.288537 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientPID" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.288567 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-70.ec2.internal" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.296933 2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-70.ec2.internal"] Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.296995 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.298612 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientMemory" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.298638 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.298648 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientPID" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.300963 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.301094 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.301123 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.301983 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientMemory" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.302012 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 14:20:48.765617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.302022 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientPID" Jul 13 14:20:48.766920 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.301983 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientMemory" Jul 13 14:20:48.766920 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.302091 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 14:20:48.766920 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.302104 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientPID" Jul 13 14:20:48.766920 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.305942 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-70.ec2.internal" Jul 13 14:20:48.766920 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.305949 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-70.ec2.internal" Jul 13 14:20:48.766920 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.305967 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 14:20:48.766920 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.305974 2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-70.ec2.internal\": node \"ip-10-0-138-70.ec2.internal\" not found" Jul 13 14:20:48.766920 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.306779 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientMemory" Jul 13 14:20:48.766920 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.306816 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 14:20:48.766920 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.306827 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientPID" Jul 13 14:20:48.766920 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.324265 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b04179ee16bc51140974d528cab249f3-config\") pod \"kube-apiserver-proxy-ip-10-0-138-70.ec2.internal\" (UID: \"b04179ee16bc51140974d528cab249f3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-70.ec2.internal" Jul 13 14:20:48.766920 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.324287 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71fcd049ac89594ddba0d96bd90cd93b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal\" (UID: \"71fcd049ac89594ddba0d96bd90cd93b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal" Jul 13 14:20:48.766920 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.324343 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71fcd049ac89594ddba0d96bd90cd93b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal\" (UID: \"71fcd049ac89594ddba0d96bd90cd93b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal" Jul 13 14:20:48.766920 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.329234 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-70.ec2.internal\" not found" node="ip-10-0-138-70.ec2.internal" Jul 13 14:20:48.766920 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.332661 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-70.ec2.internal\" not found" node="ip-10-0-138-70.ec2.internal" Jul 13 14:20:48.766920 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.338191 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-70.ec2.internal\" not found" Jul 13 14:20:48.766920 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.425046 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71fcd049ac89594ddba0d96bd90cd93b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal\" (UID: \"71fcd049ac89594ddba0d96bd90cd93b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal" Jul 13 14:20:48.766920 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.425073 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71fcd049ac89594ddba0d96bd90cd93b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal\" (UID: \"71fcd049ac89594ddba0d96bd90cd93b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal" Jul 13 14:20:48.766920 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.425091 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b04179ee16bc51140974d528cab249f3-config\") pod \"kube-apiserver-proxy-ip-10-0-138-70.ec2.internal\" (UID: \"b04179ee16bc51140974d528cab249f3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-70.ec2.internal" Jul 13 14:20:48.766920 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.425130 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71fcd049ac89594ddba0d96bd90cd93b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal\" (UID: \"71fcd049ac89594ddba0d96bd90cd93b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal" Jul 13 14:20:48.767791 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.425137 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71fcd049ac89594ddba0d96bd90cd93b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal\" (UID: \"71fcd049ac89594ddba0d96bd90cd93b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal" Jul 13 14:20:48.767791 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.425185 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b04179ee16bc51140974d528cab249f3-config\") pod \"kube-apiserver-proxy-ip-10-0-138-70.ec2.internal\" (UID: \"b04179ee16bc51140974d528cab249f3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-70.ec2.internal" Jul 13 14:20:48.767791 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.438468 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-70.ec2.internal\" not found" Jul 13 14:20:48.767791 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.538650 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-70.ec2.internal\" not found" Jul 13 14:20:48.767791 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.631478 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal" Jul 13 14:20:48.767791 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:48.637387 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-70.ec2.internal" Jul 13 14:20:48.767791 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.639503 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-70.ec2.internal\" not found" Jul 13 14:20:48.767791 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.740553 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-70.ec2.internal\" not found" Jul 13 14:20:48.878717 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.841518 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-70.ec2.internal\" not found" Jul 13 14:20:49.005597 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:48.941691 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-70.ec2.internal\" not found" Jul 13 14:20:49.136029 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:49.042477 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-70.ec2.internal\" not found" Jul 13 14:20:49.136029 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:49.051636 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 13 14:20:49.136029 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:49.051807 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 14:20:49.136029 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:49.128580 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 14:20:49.144106 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:49.143484 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-70.ec2.internal\" not found" Jul 13 14:20:49.271461 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:49.194941 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 14:15:48 +0000 UTC" deadline="2028-04-09 17:12:03.980475458 +0000 UTC" Jul 13 14:20:49.271461 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:49.194969 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15266h51m14.785509632s" Jul 13 14:20:49.271461 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:49.201714 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 14:20:49.271461 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:49.222159 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-70.ec2.internal" Jul 13 14:20:49.271461 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:49.240646 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 14:20:49.271461 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:49.242803 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal" Jul 13 14:20:49.271461 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:49.260544 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 14:20:49.645825 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:49.592297 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 14:20:50.191174 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.101373 2568 apiserver.go:52] "Watching apiserver" Jul 13 14:20:50.191174 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.110633 2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 13 14:20:50.191174 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.111003 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-xng5s","kube-system/kube-apiserver-proxy-ip-10-0-138-70.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h","openshift-cluster-node-tuning-operator/tuned-bc97z","openshift-dns/node-resolver-s6dr2","openshift-image-registry/node-ca-mn8c6","openshift-multus/multus-additional-cni-plugins-dv99f","openshift-multus/multus-z7w5m","kube-system/global-pull-secret-syncer-4vn2v","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal","openshift-multus/network-metrics-daemon-hr8jp","openshift-network-diagnostics/network-check-target-dcxzw","openshift-network-operator/iptables-alerter-gxp9r","openshift-ovn-kubernetes/ovnkube-node-tbgpb"] Jul 13 14:20:50.191174 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.122712 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 13 14:20:50.191174 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.136484 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89fffe89-dde0-4d6b-941c-d4e037ea8364-system-cni-dir\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.191174 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.136514 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/89fffe89-dde0-4d6b-941c-d4e037ea8364-cnibin\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.191174 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.136531 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/89fffe89-dde0-4d6b-941c-d4e037ea8364-os-release\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.191174 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.136615 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/89fffe89-dde0-4d6b-941c-d4e037ea8364-cni-binary-copy\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.191174 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.136646 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/89fffe89-dde0-4d6b-941c-d4e037ea8364-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.191174 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.136683 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/89fffe89-dde0-4d6b-941c-d4e037ea8364-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.191174 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.136709 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/89fffe89-dde0-4d6b-941c-d4e037ea8364-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.191174 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.136728 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjmrg\" (UniqueName: \"kubernetes.io/projected/89fffe89-dde0-4d6b-941c-d4e037ea8364-kube-api-access-rjmrg\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.191174 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.137931 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 14:20:50.191174 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.168640 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-whdzl" Jul 13 14:20:50.191174 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.179211 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-whdzl" Jul 13 14:20:50.325326 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.237176 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/89fffe89-dde0-4d6b-941c-d4e037ea8364-cnibin\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.325326 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.237222 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/89fffe89-dde0-4d6b-941c-d4e037ea8364-os-release\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.325326 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.237259 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/89fffe89-dde0-4d6b-941c-d4e037ea8364-cni-binary-copy\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.325326 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.237287 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/89fffe89-dde0-4d6b-941c-d4e037ea8364-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.325326 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.237305 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/89fffe89-dde0-4d6b-941c-d4e037ea8364-cnibin\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.325326 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.237314 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/89fffe89-dde0-4d6b-941c-d4e037ea8364-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.325326 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.237332 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/89fffe89-dde0-4d6b-941c-d4e037ea8364-os-release\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.325326 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.237342 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/89fffe89-dde0-4d6b-941c-d4e037ea8364-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.325326 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.237377 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjmrg\" (UniqueName: \"kubernetes.io/projected/89fffe89-dde0-4d6b-941c-d4e037ea8364-kube-api-access-rjmrg\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.325326 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.237405 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89fffe89-dde0-4d6b-941c-d4e037ea8364-system-cni-dir\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.325326 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:50.237409 2568 configmap.go:193] Couldn't get configMap openshift-multus/cni-copy-resources: object "openshift-multus"/"cni-copy-resources" not registered Jul 13 14:20:50.325326 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:50.237437 2568 configmap.go:193] Couldn't get configMap openshift-multus/default-cni-sysctl-allowlist: object "openshift-multus"/"default-cni-sysctl-allowlist" not registered Jul 13 14:20:50.325326 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.237443 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89fffe89-dde0-4d6b-941c-d4e037ea8364-system-cni-dir\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.325326 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:50.237470 2568 configmap.go:193] Couldn't get configMap openshift-multus/whereabouts-flatfile-config: object "openshift-multus"/"whereabouts-flatfile-config" not registered Jul 13 14:20:50.329304 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:50.237514 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89fffe89-dde0-4d6b-941c-d4e037ea8364-cni-binary-copy podName:89fffe89-dde0-4d6b-941c-d4e037ea8364 nodeName:}" failed. No retries permitted until 2026-07-13 14:20:50.737468459 +0000 UTC m=+3.033471395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cni-binary-copy" (UniqueName: "kubernetes.io/configmap/89fffe89-dde0-4d6b-941c-d4e037ea8364-cni-binary-copy") pod "multus-additional-cni-plugins-dv99f" (UID: "89fffe89-dde0-4d6b-941c-d4e037ea8364") : object "openshift-multus"/"cni-copy-resources" not registered Jul 13 14:20:50.329304 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.237520 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/89fffe89-dde0-4d6b-941c-d4e037ea8364-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.329304 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:50.237545 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89fffe89-dde0-4d6b-941c-d4e037ea8364-cni-sysctl-allowlist podName:89fffe89-dde0-4d6b-941c-d4e037ea8364 nodeName:}" failed. No retries permitted until 2026-07-13 14:20:50.737524927 +0000 UTC m=+3.033527863 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cni-sysctl-allowlist" (UniqueName: "kubernetes.io/configmap/89fffe89-dde0-4d6b-941c-d4e037ea8364-cni-sysctl-allowlist") pod "multus-additional-cni-plugins-dv99f" (UID: "89fffe89-dde0-4d6b-941c-d4e037ea8364") : object "openshift-multus"/"default-cni-sysctl-allowlist" not registered Jul 13 14:20:50.329304 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:50.237579 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/89fffe89-dde0-4d6b-941c-d4e037ea8364-whereabouts-flatfile-configmap podName:89fffe89-dde0-4d6b-941c-d4e037ea8364 nodeName:}" failed. No retries permitted until 2026-07-13 14:20:50.73756556 +0000 UTC m=+3.033568495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "whereabouts-flatfile-configmap" (UniqueName: "kubernetes.io/configmap/89fffe89-dde0-4d6b-941c-d4e037ea8364-whereabouts-flatfile-configmap") pod "multus-additional-cni-plugins-dv99f" (UID: "89fffe89-dde0-4d6b-941c-d4e037ea8364") : object "openshift-multus"/"whereabouts-flatfile-config" not registered Jul 13 14:20:50.329304 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:50.248241 2568 projected.go:291] Couldn't get configMap openshift-multus/kube-root-ca.crt: object "openshift-multus"/"kube-root-ca.crt" not registered Jul 13 14:20:50.329304 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:50.248256 2568 projected.go:291] Couldn't get configMap openshift-multus/openshift-service-ca.crt: object "openshift-multus"/"openshift-service-ca.crt" not registered Jul 13 14:20:50.329304 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:50.248266 2568 projected.go:196] Error preparing data for projected volume kube-api-access-rjmrg for pod openshift-multus/multus-additional-cni-plugins-dv99f: [object "openshift-multus"/"kube-root-ca.crt" not registered, object "openshift-multus"/"openshift-service-ca.crt" not registered] Jul 13 14:20:50.329304 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:50.248319 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89fffe89-dde0-4d6b-941c-d4e037ea8364-kube-api-access-rjmrg podName:89fffe89-dde0-4d6b-941c-d4e037ea8364 nodeName:}" failed. No retries permitted until 2026-07-13 14:20:50.748303584 +0000 UTC m=+3.044306517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rjmrg" (UniqueName: "kubernetes.io/projected/89fffe89-dde0-4d6b-941c-d4e037ea8364-kube-api-access-rjmrg") pod "multus-additional-cni-plugins-dv99f" (UID: "89fffe89-dde0-4d6b-941c-d4e037ea8364") : [object "openshift-multus"/"kube-root-ca.crt" not registered, object "openshift-multus"/"openshift-service-ca.crt" not registered] Jul 13 14:20:50.573444 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.558758 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 14:20:50.644187 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.644161 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.657398 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.657364 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gxp9r" Jul 13 14:20:50.657577 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.657439 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jt5d6\"" Jul 13 14:20:50.658477 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.658454 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 13 14:20:50.658727 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.658642 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 13 14:20:50.659060 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.659032 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 13 14:20:50.659353 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.659196 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 13 14:20:50.660185 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.660157 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" Jul 13 14:20:50.661257 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.661240 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 13 14:20:50.662734 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.662718 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 13 14:20:50.663121 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.663078 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 13 14:20:50.664051 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.663394 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 13 14:20:50.664051 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.663506 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 13 14:20:50.664051 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.663610 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 13 14:20:50.664051 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.664021 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.664297 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.664194 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 13 14:20:50.664476 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.664455 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2l85v\"" Jul 13 14:20:50.664961 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.664936 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h2vrm\"" Jul 13 14:20:50.666805 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.666774 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s6dr2" Jul 13 14:20:50.668669 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.668636 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 13 14:20:50.670050 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.670030 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mn8c6" Jul 13 14:20:50.674257 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.674239 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:20:50.674355 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:50.674329 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vn2v" podUID="1612be17-dbf1-4d08-a9d8-fa7ec57fee55" Jul 13 14:20:50.674900 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.674880 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 13 14:20:50.674900 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.674893 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 13 14:20:50.675049 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.674894 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-d47gv\"" Jul 13 14:20:50.675049 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.674944 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p9zfj\"" Jul 13 14:20:50.675049 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.674988 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 13 14:20:50.675189 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.675139 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 13 14:20:50.675189 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.675168 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 13 14:20:50.675189 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.675184 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 13 14:20:50.675336 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.675224 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pbz8z\"" Jul 13 14:20:50.676675 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.676653 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xng5s" Jul 13 14:20:50.679226 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.679208 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 13 14:20:50.679566 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.679551 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-p2lm8\"" Jul 13 14:20:50.679652 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.679614 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 13 14:20:50.679652 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.679631 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.682170 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.682151 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.682386 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.682371 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4nsxt\"" Jul 13 14:20:50.682551 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.682537 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 13 14:20:50.683774 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.683751 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 13 14:20:50.683774 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.683770 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 13 14:20:50.683927 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.683770 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 13 14:20:50.683927 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.683823 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 13 14:20:50.683927 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.683856 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 13 14:20:50.684694 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.684625 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dnxgn\"" Jul 13 14:20:50.684778 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.684719 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:20:50.684823 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:50.684796 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr8jp" podUID="7a0432b9-4eb0-4e69-a3e3-e23edaafb44c" Jul 13 14:20:50.684947 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.684926 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 13 14:20:50.687437 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.687416 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:20:50.687544 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:50.687489 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dcxzw" podUID="0a464e5b-7939-4ebe-9819-1ec0da498f95" Jul 13 14:20:50.723515 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.723482 2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 13 14:20:50.740748 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.740715 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/74b3da28-f883-40d3-89a1-10381739a75d-ovn-node-metrics-cert\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.740905 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.740769 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-multus-conf-dir\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.740905 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.740821 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p2mb\" (UniqueName: \"kubernetes.io/projected/0a464e5b-7939-4ebe-9819-1ec0da498f95-kube-api-access-7p2mb\") pod \"network-check-target-dcxzw\" (UID: \"0a464e5b-7939-4ebe-9819-1ec0da498f95\") " pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:20:50.740905 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.740866 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/89fffe89-dde0-4d6b-941c-d4e037ea8364-cni-binary-copy\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.740905 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.740896 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.741203 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.740925 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2fa66b2c-e5f8-462d-84b7-f9af2663c682-etc-tuned\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.741203 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.740953 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fa66b2c-e5f8-462d-84b7-f9af2663c682-tmp\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.741203 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.741062 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-host-run-netns\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.741203 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.741094 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/89fffe89-dde0-4d6b-941c-d4e037ea8364-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.741203 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.741129 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/246a645d-b189-4ff8-97dd-64acd7551f8a-socket-dir\") pod \"aws-ebs-csi-driver-node-ntz9h\" (UID: \"246a645d-b189-4ff8-97dd-64acd7551f8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" Jul 13 14:20:50.741203 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.741159 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-var-lib-kubelet\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.741506 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.741373 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gnp5\" (UniqueName: \"kubernetes.io/projected/2fa66b2c-e5f8-462d-84b7-f9af2663c682-kube-api-access-8gnp5\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.741506 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.741390 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0c2dbfef-a3bc-424d-8010-f28cfea8fb4e-hosts-file\") pod \"node-resolver-s6dr2\" (UID: \"0c2dbfef-a3bc-424d-8010-f28cfea8fb4e\") " pod="openshift-dns/node-resolver-s6dr2" Jul 13 14:20:50.741506 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.741425 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-dbus\") pod \"global-pull-secret-syncer-4vn2v\" (UID: \"1612be17-dbf1-4d08-a9d8-fa7ec57fee55\") " pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:20:50.741506 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.741458 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-os-release\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.741506 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.741487 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdxp9\" (UniqueName: \"kubernetes.io/projected/297ea06e-b94d-4b46-82a4-d3134f30ded1-kube-api-access-wdxp9\") pod \"node-ca-mn8c6\" (UID: \"297ea06e-b94d-4b46-82a4-d3134f30ded1\") " pod="openshift-image-registry/node-ca-mn8c6" Jul 13 14:20:50.741912 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.741510 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-log-socket\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.741912 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.741534 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-sys\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.741912 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.741560 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88rrz\" (UniqueName: \"kubernetes.io/projected/0c2dbfef-a3bc-424d-8010-f28cfea8fb4e-kube-api-access-88rrz\") pod \"node-resolver-s6dr2\" (UID: \"0c2dbfef-a3bc-424d-8010-f28cfea8fb4e\") " pod="openshift-dns/node-resolver-s6dr2" Jul 13 14:20:50.741912 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.741610 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-cni-binary-copy\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.741912 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.741631 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/89fffe89-dde0-4d6b-941c-d4e037ea8364-cni-binary-copy\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.741912 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.741657 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndhhg\" (UniqueName: \"kubernetes.io/projected/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-kube-api-access-ndhhg\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.741912 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.741752 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-host-kubelet\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.741912 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.741793 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-host-cni-bin\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.741912 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.741816 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-metrics-certs\") pod \"network-metrics-daemon-hr8jp\" (UID: \"7a0432b9-4eb0-4e69-a3e3-e23edaafb44c\") " pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:20:50.741912 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.741849 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/246a645d-b189-4ff8-97dd-64acd7551f8a-registration-dir\") pod \"aws-ebs-csi-driver-node-ntz9h\" (UID: \"246a645d-b189-4ff8-97dd-64acd7551f8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" Jul 13 14:20:50.741912 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.741879 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/297ea06e-b94d-4b46-82a4-d3134f30ded1-host\") pod \"node-ca-mn8c6\" (UID: \"297ea06e-b94d-4b46-82a4-d3134f30ded1\") " pod="openshift-image-registry/node-ca-mn8c6" Jul 13 14:20:50.741912 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.741897 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/297ea06e-b94d-4b46-82a4-d3134f30ded1-serviceca\") pod \"node-ca-mn8c6\" (UID: \"297ea06e-b94d-4b46-82a4-d3134f30ded1\") " pod="openshift-image-registry/node-ca-mn8c6" Jul 13 14:20:50.741912 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.741911 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-run-openvswitch\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.742571 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.741949 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-host\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.742571 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.741974 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/53f28e70-42bd-44fd-9d7c-86a8627d7bfe-konnectivity-ca\") pod \"konnectivity-agent-xng5s\" (UID: \"53f28e70-42bd-44fd-9d7c-86a8627d7bfe\") " pod="kube-system/konnectivity-agent-xng5s" Jul 13 14:20:50.742571 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.741992 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-run-systemd\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.742571 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.742019 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/74b3da28-f883-40d3-89a1-10381739a75d-env-overrides\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.742571 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.742042 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/74b3da28-f883-40d3-89a1-10381739a75d-ovnkube-script-lib\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.742571 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.742060 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-original-pull-secret\") pod \"global-pull-secret-syncer-4vn2v\" (UID: \"1612be17-dbf1-4d08-a9d8-fa7ec57fee55\") " pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:20:50.742571 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.742078 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/950a6b21-cbbe-4177-99b3-94b905bdd5b7-host-slash\") pod \"iptables-alerter-gxp9r\" (UID: \"950a6b21-cbbe-4177-99b3-94b905bdd5b7\") " pod="openshift-network-operator/iptables-alerter-gxp9r" Jul 13 14:20:50.742571 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.742103 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-host-slash\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.742571 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.742133 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-etc-sysctl-d\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.742571 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.742169 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-etc-sysctl-conf\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.742571 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.742201 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-kubelet-config\") pod \"global-pull-secret-syncer-4vn2v\" (UID: \"1612be17-dbf1-4d08-a9d8-fa7ec57fee55\") " pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:20:50.742571 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.742216 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-multus-socket-dir-parent\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.742571 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.742245 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/89fffe89-dde0-4d6b-941c-d4e037ea8364-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.742571 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.742272 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/246a645d-b189-4ff8-97dd-64acd7551f8a-etc-selinux\") pod \"aws-ebs-csi-driver-node-ntz9h\" (UID: \"246a645d-b189-4ff8-97dd-64acd7551f8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" Jul 13 14:20:50.743295 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.742296 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-host-var-lib-kubelet\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.743295 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.742293 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/89fffe89-dde0-4d6b-941c-d4e037ea8364-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.743295 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.742323 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwc8n\" (UniqueName: \"kubernetes.io/projected/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-kube-api-access-rwc8n\") pod \"network-metrics-daemon-hr8jp\" (UID: \"7a0432b9-4eb0-4e69-a3e3-e23edaafb44c\") " pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:20:50.743295 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.742370 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/246a645d-b189-4ff8-97dd-64acd7551f8a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ntz9h\" (UID: \"246a645d-b189-4ff8-97dd-64acd7551f8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" Jul 13 14:20:50.743295 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.742407 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-system-cni-dir\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.743295 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.742437 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-multus-daemon-config\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.743295 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.742837 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-systemd-units\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.743295 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.742914 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-etc-openvswitch\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.743295 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.742951 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-etc-modprobe-d\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.743295 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.743000 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-etc-sysconfig\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.743295 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.743034 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-host-var-lib-cni-multus\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.743295 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.743060 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-hostroot\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.743295 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.743109 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwcxn\" (UniqueName: \"kubernetes.io/projected/950a6b21-cbbe-4177-99b3-94b905bdd5b7-kube-api-access-fwcxn\") pod \"iptables-alerter-gxp9r\" (UID: \"950a6b21-cbbe-4177-99b3-94b905bdd5b7\") " pod="openshift-network-operator/iptables-alerter-gxp9r" Jul 13 14:20:50.743295 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.743147 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/89fffe89-dde0-4d6b-941c-d4e037ea8364-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.743995 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.743239 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-host-run-ovn-kubernetes\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.743995 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.743293 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/74b3da28-f883-40d3-89a1-10381739a75d-ovnkube-config\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.743995 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.743330 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-run\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.743995 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.743379 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-multus-cni-dir\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.743995 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.743421 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-cnibin\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.743995 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.743470 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-host-run-netns\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.743995 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.743540 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-run-ovn\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.743995 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.743617 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwvx6\" (UniqueName: \"kubernetes.io/projected/74b3da28-f883-40d3-89a1-10381739a75d-kube-api-access-cwvx6\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.743995 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.743727 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp74w\" (UniqueName: \"kubernetes.io/projected/246a645d-b189-4ff8-97dd-64acd7551f8a-kube-api-access-rp74w\") pod \"aws-ebs-csi-driver-node-ntz9h\" (UID: \"246a645d-b189-4ff8-97dd-64acd7551f8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" Jul 13 14:20:50.743995 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.743785 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-etc-systemd\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.743995 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.743830 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-host-var-lib-cni-bin\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.743995 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.743892 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-etc-kubernetes\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.743995 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.743919 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-host-cni-netd\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.743995 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.743953 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/246a645d-b189-4ff8-97dd-64acd7551f8a-sys-fs\") pod \"aws-ebs-csi-driver-node-ntz9h\" (UID: \"246a645d-b189-4ff8-97dd-64acd7551f8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" Jul 13 14:20:50.744692 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.744022 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-host-run-k8s-cni-cncf-io\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.744692 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.744054 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/53f28e70-42bd-44fd-9d7c-86a8627d7bfe-agent-certs\") pod \"konnectivity-agent-xng5s\" (UID: \"53f28e70-42bd-44fd-9d7c-86a8627d7bfe\") " pod="kube-system/konnectivity-agent-xng5s" Jul 13 14:20:50.744692 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.744087 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-etc-kubernetes\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.744692 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.744118 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c2dbfef-a3bc-424d-8010-f28cfea8fb4e-tmp-dir\") pod \"node-resolver-s6dr2\" (UID: \"0c2dbfef-a3bc-424d-8010-f28cfea8fb4e\") " pod="openshift-dns/node-resolver-s6dr2" Jul 13 14:20:50.744692 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.744154 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-host-run-multus-certs\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.744692 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.744185 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-node-log\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.744692 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.744216 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/246a645d-b189-4ff8-97dd-64acd7551f8a-device-dir\") pod \"aws-ebs-csi-driver-node-ntz9h\" (UID: \"246a645d-b189-4ff8-97dd-64acd7551f8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" Jul 13 14:20:50.744692 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.744284 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-lib-modules\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.744692 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.744316 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/950a6b21-cbbe-4177-99b3-94b905bdd5b7-iptables-alerter-script\") pod \"iptables-alerter-gxp9r\" (UID: \"950a6b21-cbbe-4177-99b3-94b905bdd5b7\") " pod="openshift-network-operator/iptables-alerter-gxp9r" Jul 13 14:20:50.744692 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.744347 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-var-lib-openvswitch\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.827368 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:50.827298 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71fcd049ac89594ddba0d96bd90cd93b.slice/crio-b921703197d924f6a76bc9466ec5b02b7160efe0907ecf8d77dc497ca4afd460 WatchSource:0}: Error finding container b921703197d924f6a76bc9466ec5b02b7160efe0907ecf8d77dc497ca4afd460: Status 404 returned error can't find the container with id b921703197d924f6a76bc9466ec5b02b7160efe0907ecf8d77dc497ca4afd460 Jul 13 14:20:50.827594 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:50.827567 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb04179ee16bc51140974d528cab249f3.slice/crio-818b9a787cbcda4637b037296dd5dfb5cc30b4bda9591335b0b9a0e3ea0c2607 WatchSource:0}: Error finding container 818b9a787cbcda4637b037296dd5dfb5cc30b4bda9591335b0b9a0e3ea0c2607: Status 404 returned error can't find the container with id 818b9a787cbcda4637b037296dd5dfb5cc30b4bda9591335b0b9a0e3ea0c2607 Jul 13 14:20:50.831737 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.831719 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 14:20:50.845080 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845052 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-sys\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.845202 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845091 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88rrz\" (UniqueName: \"kubernetes.io/projected/0c2dbfef-a3bc-424d-8010-f28cfea8fb4e-kube-api-access-88rrz\") pod \"node-resolver-s6dr2\" (UID: \"0c2dbfef-a3bc-424d-8010-f28cfea8fb4e\") " pod="openshift-dns/node-resolver-s6dr2" Jul 13 14:20:50.845202 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845111 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-cni-binary-copy\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.845202 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845132 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndhhg\" (UniqueName: \"kubernetes.io/projected/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-kube-api-access-ndhhg\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.845202 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845192 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-sys\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.845516 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845291 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-host-kubelet\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.845516 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845324 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-host-cni-bin\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.845516 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845350 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-metrics-certs\") pod \"network-metrics-daemon-hr8jp\" (UID: \"7a0432b9-4eb0-4e69-a3e3-e23edaafb44c\") " pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:20:50.845516 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845405 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-host-kubelet\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.845516 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845439 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/246a645d-b189-4ff8-97dd-64acd7551f8a-registration-dir\") pod \"aws-ebs-csi-driver-node-ntz9h\" (UID: \"246a645d-b189-4ff8-97dd-64acd7551f8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" Jul 13 14:20:50.845516 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845420 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-host-cni-bin\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.845516 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:50.845456 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:20:50.845516 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845470 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/297ea06e-b94d-4b46-82a4-d3134f30ded1-host\") pod \"node-ca-mn8c6\" (UID: \"297ea06e-b94d-4b46-82a4-d3134f30ded1\") " pod="openshift-image-registry/node-ca-mn8c6" Jul 13 14:20:50.845516 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845498 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/297ea06e-b94d-4b46-82a4-d3134f30ded1-serviceca\") pod \"node-ca-mn8c6\" (UID: \"297ea06e-b94d-4b46-82a4-d3134f30ded1\") " pod="openshift-image-registry/node-ca-mn8c6" Jul 13 14:20:50.845945 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:50.845529 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-metrics-certs podName:7a0432b9-4eb0-4e69-a3e3-e23edaafb44c nodeName:}" failed. No retries permitted until 2026-07-13 14:20:51.345507664 +0000 UTC m=+3.641510611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-metrics-certs") pod "network-metrics-daemon-hr8jp" (UID: "7a0432b9-4eb0-4e69-a3e3-e23edaafb44c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:20:50.845945 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845543 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/246a645d-b189-4ff8-97dd-64acd7551f8a-registration-dir\") pod \"aws-ebs-csi-driver-node-ntz9h\" (UID: \"246a645d-b189-4ff8-97dd-64acd7551f8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" Jul 13 14:20:50.845945 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845550 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-run-openvswitch\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.845945 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845554 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/297ea06e-b94d-4b46-82a4-d3134f30ded1-host\") pod \"node-ca-mn8c6\" (UID: \"297ea06e-b94d-4b46-82a4-d3134f30ded1\") " pod="openshift-image-registry/node-ca-mn8c6" Jul 13 14:20:50.845945 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845580 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-host\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.845945 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845624 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-run-openvswitch\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.845945 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845662 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/53f28e70-42bd-44fd-9d7c-86a8627d7bfe-konnectivity-ca\") pod \"konnectivity-agent-xng5s\" (UID: \"53f28e70-42bd-44fd-9d7c-86a8627d7bfe\") " pod="kube-system/konnectivity-agent-xng5s" Jul 13 14:20:50.845945 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845676 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-host\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.845945 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845796 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-run-systemd\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.845945 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845827 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/74b3da28-f883-40d3-89a1-10381739a75d-env-overrides\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.845945 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845857 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/74b3da28-f883-40d3-89a1-10381739a75d-ovnkube-script-lib\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.845945 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845871 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-cni-binary-copy\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.845945 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845884 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-original-pull-secret\") pod \"global-pull-secret-syncer-4vn2v\" (UID: \"1612be17-dbf1-4d08-a9d8-fa7ec57fee55\") " pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:20:50.845945 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845926 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/950a6b21-cbbe-4177-99b3-94b905bdd5b7-host-slash\") pod \"iptables-alerter-gxp9r\" (UID: \"950a6b21-cbbe-4177-99b3-94b905bdd5b7\") " pod="openshift-network-operator/iptables-alerter-gxp9r" Jul 13 14:20:50.846550 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:50.845957 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 14:20:50.846550 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845968 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-host-slash\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.846550 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.845994 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-etc-sysctl-d\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.846550 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846020 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-run-systemd\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.846550 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846032 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-etc-sysctl-conf\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.846550 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846058 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-kubelet-config\") pod \"global-pull-secret-syncer-4vn2v\" (UID: \"1612be17-dbf1-4d08-a9d8-fa7ec57fee55\") " pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:20:50.846550 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846066 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/297ea06e-b94d-4b46-82a4-d3134f30ded1-serviceca\") pod \"node-ca-mn8c6\" (UID: \"297ea06e-b94d-4b46-82a4-d3134f30ded1\") " pod="openshift-image-registry/node-ca-mn8c6" Jul 13 14:20:50.846550 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846086 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-multus-socket-dir-parent\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.846550 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846117 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/246a645d-b189-4ff8-97dd-64acd7551f8a-etc-selinux\") pod \"aws-ebs-csi-driver-node-ntz9h\" (UID: \"246a645d-b189-4ff8-97dd-64acd7551f8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" Jul 13 14:20:50.846550 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846143 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-host-var-lib-kubelet\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.846550 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846170 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwc8n\" (UniqueName: \"kubernetes.io/projected/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-kube-api-access-rwc8n\") pod \"network-metrics-daemon-hr8jp\" (UID: \"7a0432b9-4eb0-4e69-a3e3-e23edaafb44c\") " pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:20:50.846550 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:50.846196 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-original-pull-secret podName:1612be17-dbf1-4d08-a9d8-fa7ec57fee55 nodeName:}" failed. No retries permitted until 2026-07-13 14:20:51.346170267 +0000 UTC m=+3.642173201 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-original-pull-secret") pod "global-pull-secret-syncer-4vn2v" (UID: "1612be17-dbf1-4d08-a9d8-fa7ec57fee55") : object "kube-system"/"original-pull-secret" not registered Jul 13 14:20:50.846550 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846209 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-host-slash\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.846550 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846238 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-host-var-lib-kubelet\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.847267 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846240 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/246a645d-b189-4ff8-97dd-64acd7551f8a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ntz9h\" (UID: \"246a645d-b189-4ff8-97dd-64acd7551f8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" Jul 13 14:20:50.847267 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846248 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/950a6b21-cbbe-4177-99b3-94b905bdd5b7-host-slash\") pod \"iptables-alerter-gxp9r\" (UID: \"950a6b21-cbbe-4177-99b3-94b905bdd5b7\") " pod="openshift-network-operator/iptables-alerter-gxp9r" Jul 13 14:20:50.847267 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846272 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-system-cni-dir\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.847267 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846298 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-kubelet-config\") pod \"global-pull-secret-syncer-4vn2v\" (UID: \"1612be17-dbf1-4d08-a9d8-fa7ec57fee55\") " pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:20:50.847267 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846305 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/53f28e70-42bd-44fd-9d7c-86a8627d7bfe-konnectivity-ca\") pod \"konnectivity-agent-xng5s\" (UID: \"53f28e70-42bd-44fd-9d7c-86a8627d7bfe\") " pod="kube-system/konnectivity-agent-xng5s" Jul 13 14:20:50.847267 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846301 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-multus-daemon-config\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.847267 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846320 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-etc-sysctl-d\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.847267 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846325 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/246a645d-b189-4ff8-97dd-64acd7551f8a-etc-selinux\") pod \"aws-ebs-csi-driver-node-ntz9h\" (UID: \"246a645d-b189-4ff8-97dd-64acd7551f8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" Jul 13 14:20:50.847267 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846367 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-multus-socket-dir-parent\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.847267 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846388 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-system-cni-dir\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.847267 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846371 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/246a645d-b189-4ff8-97dd-64acd7551f8a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ntz9h\" (UID: \"246a645d-b189-4ff8-97dd-64acd7551f8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" Jul 13 14:20:50.847267 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846422 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-systemd-units\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.847267 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846441 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-etc-openvswitch\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.847267 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846466 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-etc-modprobe-d\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.847267 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846469 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-etc-sysctl-conf\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.847978 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846491 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-systemd-units\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.847978 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846509 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-etc-sysconfig\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.847978 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846534 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-host-var-lib-cni-multus\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.847978 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846493 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-etc-openvswitch\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.847978 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846550 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-etc-modprobe-d\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.847978 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846552 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-etc-sysconfig\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.847978 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846586 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-host-var-lib-cni-multus\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.847978 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846557 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-hostroot\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.847978 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846637 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-hostroot\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.847978 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846651 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwcxn\" (UniqueName: \"kubernetes.io/projected/950a6b21-cbbe-4177-99b3-94b905bdd5b7-kube-api-access-fwcxn\") pod \"iptables-alerter-gxp9r\" (UID: \"950a6b21-cbbe-4177-99b3-94b905bdd5b7\") " pod="openshift-network-operator/iptables-alerter-gxp9r" Jul 13 14:20:50.847978 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846724 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-host-run-ovn-kubernetes\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.847978 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846753 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/74b3da28-f883-40d3-89a1-10381739a75d-ovnkube-config\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.847978 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846771 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-host-run-ovn-kubernetes\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.847978 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846790 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-run\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.847978 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846816 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-multus-cni-dir\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.848648 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846836 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-cnibin\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.848648 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846839 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-multus-daemon-config\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.848648 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846854 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-host-run-netns\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.848648 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846875 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-run-ovn\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.848648 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846900 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwvx6\" (UniqueName: \"kubernetes.io/projected/74b3da28-f883-40d3-89a1-10381739a75d-kube-api-access-cwvx6\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.848648 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846921 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp74w\" (UniqueName: \"kubernetes.io/projected/246a645d-b189-4ff8-97dd-64acd7551f8a-kube-api-access-rp74w\") pod \"aws-ebs-csi-driver-node-ntz9h\" (UID: \"246a645d-b189-4ff8-97dd-64acd7551f8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" Jul 13 14:20:50.848648 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846922 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-cnibin\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.848648 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846927 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-multus-cni-dir\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.848648 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846936 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-etc-systemd\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.848648 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846936 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/74b3da28-f883-40d3-89a1-10381739a75d-env-overrides\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.848648 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846956 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-host-var-lib-cni-bin\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.848648 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846978 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-host-run-netns\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.848648 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846993 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-run\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.848648 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847007 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-etc-systemd\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.848648 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847041 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-host-var-lib-cni-bin\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.849412 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847050 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-etc-kubernetes\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.849412 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.846999 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-etc-kubernetes\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.849412 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847125 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-run-ovn\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.849412 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847168 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-host-cni-netd\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.849412 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847198 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/246a645d-b189-4ff8-97dd-64acd7551f8a-sys-fs\") pod \"aws-ebs-csi-driver-node-ntz9h\" (UID: \"246a645d-b189-4ff8-97dd-64acd7551f8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" Jul 13 14:20:50.849412 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847237 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-host-run-k8s-cni-cncf-io\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.849412 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847248 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-host-cni-netd\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.849412 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847258 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/246a645d-b189-4ff8-97dd-64acd7551f8a-sys-fs\") pod \"aws-ebs-csi-driver-node-ntz9h\" (UID: \"246a645d-b189-4ff8-97dd-64acd7551f8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" Jul 13 14:20:50.849412 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847264 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/53f28e70-42bd-44fd-9d7c-86a8627d7bfe-agent-certs\") pod \"konnectivity-agent-xng5s\" (UID: \"53f28e70-42bd-44fd-9d7c-86a8627d7bfe\") " pod="kube-system/konnectivity-agent-xng5s" Jul 13 14:20:50.849412 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847288 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-etc-kubernetes\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.849412 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847307 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c2dbfef-a3bc-424d-8010-f28cfea8fb4e-tmp-dir\") pod \"node-resolver-s6dr2\" (UID: \"0c2dbfef-a3bc-424d-8010-f28cfea8fb4e\") " pod="openshift-dns/node-resolver-s6dr2" Jul 13 14:20:50.849412 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847322 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-host-run-multus-certs\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.849412 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847311 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-host-run-k8s-cni-cncf-io\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.849412 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847338 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-node-log\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.849412 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847364 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/246a645d-b189-4ff8-97dd-64acd7551f8a-device-dir\") pod \"aws-ebs-csi-driver-node-ntz9h\" (UID: \"246a645d-b189-4ff8-97dd-64acd7551f8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" Jul 13 14:20:50.850218 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847381 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-lib-modules\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.850218 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847400 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/950a6b21-cbbe-4177-99b3-94b905bdd5b7-iptables-alerter-script\") pod \"iptables-alerter-gxp9r\" (UID: \"950a6b21-cbbe-4177-99b3-94b905bdd5b7\") " pod="openshift-network-operator/iptables-alerter-gxp9r" Jul 13 14:20:50.850218 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847421 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-var-lib-openvswitch\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.850218 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847423 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-host-run-multus-certs\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.850218 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847447 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/74b3da28-f883-40d3-89a1-10381739a75d-ovn-node-metrics-cert\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.850218 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847471 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/246a645d-b189-4ff8-97dd-64acd7551f8a-device-dir\") pod \"aws-ebs-csi-driver-node-ntz9h\" (UID: \"246a645d-b189-4ff8-97dd-64acd7551f8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" Jul 13 14:20:50.850218 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847496 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-multus-conf-dir\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.850218 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847496 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-etc-kubernetes\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.850218 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847516 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-node-log\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.850218 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847523 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p2mb\" (UniqueName: \"kubernetes.io/projected/0a464e5b-7939-4ebe-9819-1ec0da498f95-kube-api-access-7p2mb\") pod \"network-check-target-dcxzw\" (UID: \"0a464e5b-7939-4ebe-9819-1ec0da498f95\") " pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:20:50.850218 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847547 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-lib-modules\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.850218 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847556 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-var-lib-openvswitch\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.850218 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847556 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.850218 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847599 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.850980 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847604 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-multus-conf-dir\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.850980 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847618 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2fa66b2c-e5f8-462d-84b7-f9af2663c682-etc-tuned\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.850980 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847571 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c2dbfef-a3bc-424d-8010-f28cfea8fb4e-tmp-dir\") pod \"node-resolver-s6dr2\" (UID: \"0c2dbfef-a3bc-424d-8010-f28cfea8fb4e\") " pod="openshift-dns/node-resolver-s6dr2" Jul 13 14:20:50.850980 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847648 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fa66b2c-e5f8-462d-84b7-f9af2663c682-tmp\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.850980 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847668 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-host-run-netns\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.850980 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847690 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjmrg\" (UniqueName: \"kubernetes.io/projected/89fffe89-dde0-4d6b-941c-d4e037ea8364-kube-api-access-rjmrg\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.850980 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847709 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/246a645d-b189-4ff8-97dd-64acd7551f8a-socket-dir\") pod \"aws-ebs-csi-driver-node-ntz9h\" (UID: \"246a645d-b189-4ff8-97dd-64acd7551f8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" Jul 13 14:20:50.850980 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847726 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-var-lib-kubelet\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.850980 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847749 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gnp5\" (UniqueName: \"kubernetes.io/projected/2fa66b2c-e5f8-462d-84b7-f9af2663c682-kube-api-access-8gnp5\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.850980 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847754 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-host-run-netns\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.850980 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847768 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0c2dbfef-a3bc-424d-8010-f28cfea8fb4e-hosts-file\") pod \"node-resolver-s6dr2\" (UID: \"0c2dbfef-a3bc-424d-8010-f28cfea8fb4e\") " pod="openshift-dns/node-resolver-s6dr2" Jul 13 14:20:50.850980 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847804 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0c2dbfef-a3bc-424d-8010-f28cfea8fb4e-hosts-file\") pod \"node-resolver-s6dr2\" (UID: \"0c2dbfef-a3bc-424d-8010-f28cfea8fb4e\") " pod="openshift-dns/node-resolver-s6dr2" Jul 13 14:20:50.850980 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847829 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fa66b2c-e5f8-462d-84b7-f9af2663c682-var-lib-kubelet\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.850980 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847866 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-dbus\") pod \"global-pull-secret-syncer-4vn2v\" (UID: \"1612be17-dbf1-4d08-a9d8-fa7ec57fee55\") " pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:20:50.850980 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847911 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/246a645d-b189-4ff8-97dd-64acd7551f8a-socket-dir\") pod \"aws-ebs-csi-driver-node-ntz9h\" (UID: \"246a645d-b189-4ff8-97dd-64acd7551f8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" Jul 13 14:20:50.851624 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847920 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 13 14:20:50.851624 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.847953 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-os-release\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.851624 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.848018 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdxp9\" (UniqueName: \"kubernetes.io/projected/297ea06e-b94d-4b46-82a4-d3134f30ded1-kube-api-access-wdxp9\") pod \"node-ca-mn8c6\" (UID: \"297ea06e-b94d-4b46-82a4-d3134f30ded1\") " pod="openshift-image-registry/node-ca-mn8c6" Jul 13 14:20:50.851624 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.848060 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-log-socket\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.851624 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.848080 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-dbus\") pod \"global-pull-secret-syncer-4vn2v\" (UID: \"1612be17-dbf1-4d08-a9d8-fa7ec57fee55\") " pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:20:50.851624 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.848117 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-os-release\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.851624 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.848139 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/74b3da28-f883-40d3-89a1-10381739a75d-log-socket\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.851624 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.848287 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/950a6b21-cbbe-4177-99b3-94b905bdd5b7-iptables-alerter-script\") pod \"iptables-alerter-gxp9r\" (UID: \"950a6b21-cbbe-4177-99b3-94b905bdd5b7\") " pod="openshift-network-operator/iptables-alerter-gxp9r" Jul 13 14:20:50.851624 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.848331 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/74b3da28-f883-40d3-89a1-10381739a75d-ovnkube-config\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.851624 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.848698 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/74b3da28-f883-40d3-89a1-10381739a75d-ovnkube-script-lib\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.851624 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.851278 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2fa66b2c-e5f8-462d-84b7-f9af2663c682-etc-tuned\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.851624 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.851314 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fa66b2c-e5f8-462d-84b7-f9af2663c682-tmp\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.851624 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.851467 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/74b3da28-f883-40d3-89a1-10381739a75d-ovn-node-metrics-cert\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.852098 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.851718 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/53f28e70-42bd-44fd-9d7c-86a8627d7bfe-agent-certs\") pod \"konnectivity-agent-xng5s\" (UID: \"53f28e70-42bd-44fd-9d7c-86a8627d7bfe\") " pod="kube-system/konnectivity-agent-xng5s" Jul 13 14:20:50.852098 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.851733 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjmrg\" (UniqueName: \"kubernetes.io/projected/89fffe89-dde0-4d6b-941c-d4e037ea8364-kube-api-access-rjmrg\") pod \"multus-additional-cni-plugins-dv99f\" (UID: \"89fffe89-dde0-4d6b-941c-d4e037ea8364\") " pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.864848 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:50.864821 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 14:20:50.864848 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:50.864846 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 14:20:50.864999 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:50.864858 2568 projected.go:196] Error preparing data for projected volume kube-api-access-7p2mb for pod openshift-network-diagnostics/network-check-target-dcxzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:20:50.864999 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:50.864911 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a464e5b-7939-4ebe-9819-1ec0da498f95-kube-api-access-7p2mb podName:0a464e5b-7939-4ebe-9819-1ec0da498f95 nodeName:}" failed. No retries permitted until 2026-07-13 14:20:51.364894254 +0000 UTC m=+3.660897208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7p2mb" (UniqueName: "kubernetes.io/projected/0a464e5b-7939-4ebe-9819-1ec0da498f95-kube-api-access-7p2mb") pod "network-check-target-dcxzw" (UID: "0a464e5b-7939-4ebe-9819-1ec0da498f95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:20:50.867767 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.867741 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp74w\" (UniqueName: \"kubernetes.io/projected/246a645d-b189-4ff8-97dd-64acd7551f8a-kube-api-access-rp74w\") pod \"aws-ebs-csi-driver-node-ntz9h\" (UID: \"246a645d-b189-4ff8-97dd-64acd7551f8a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" Jul 13 14:20:50.869643 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.869576 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88rrz\" (UniqueName: \"kubernetes.io/projected/0c2dbfef-a3bc-424d-8010-f28cfea8fb4e-kube-api-access-88rrz\") pod \"node-resolver-s6dr2\" (UID: \"0c2dbfef-a3bc-424d-8010-f28cfea8fb4e\") " pod="openshift-dns/node-resolver-s6dr2" Jul 13 14:20:50.870458 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.870360 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwcxn\" (UniqueName: \"kubernetes.io/projected/950a6b21-cbbe-4177-99b3-94b905bdd5b7-kube-api-access-fwcxn\") pod \"iptables-alerter-gxp9r\" (UID: \"950a6b21-cbbe-4177-99b3-94b905bdd5b7\") " pod="openshift-network-operator/iptables-alerter-gxp9r" Jul 13 14:20:50.870551 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.870460 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndhhg\" (UniqueName: \"kubernetes.io/projected/2f7f5e98-1d2e-4bb7-88e5-05e417aa1502-kube-api-access-ndhhg\") pod \"multus-z7w5m\" (UID: \"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502\") " pod="openshift-multus/multus-z7w5m" Jul 13 14:20:50.871496 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.871473 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gnp5\" (UniqueName: \"kubernetes.io/projected/2fa66b2c-e5f8-462d-84b7-f9af2663c682-kube-api-access-8gnp5\") pod \"tuned-bc97z\" (UID: \"2fa66b2c-e5f8-462d-84b7-f9af2663c682\") " pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:50.871583 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.871527 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwc8n\" (UniqueName: \"kubernetes.io/projected/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-kube-api-access-rwc8n\") pod \"network-metrics-daemon-hr8jp\" (UID: \"7a0432b9-4eb0-4e69-a3e3-e23edaafb44c\") " pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:20:50.872233 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.872215 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdxp9\" (UniqueName: \"kubernetes.io/projected/297ea06e-b94d-4b46-82a4-d3134f30ded1-kube-api-access-wdxp9\") pod \"node-ca-mn8c6\" (UID: \"297ea06e-b94d-4b46-82a4-d3134f30ded1\") " pod="openshift-image-registry/node-ca-mn8c6" Jul 13 14:20:50.872360 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.872343 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwvx6\" (UniqueName: \"kubernetes.io/projected/74b3da28-f883-40d3-89a1-10381739a75d-kube-api-access-cwvx6\") pod \"ovnkube-node-tbgpb\" (UID: \"74b3da28-f883-40d3-89a1-10381739a75d\") " pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:50.991645 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.991608 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dv99f" Jul 13 14:20:50.996798 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:50.996772 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gxp9r" Jul 13 14:20:51.004073 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:51.003772 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89fffe89_dde0_4d6b_941c_d4e037ea8364.slice/crio-316110139f6b1737788b7493b53f80e734cdfc08db0c564a44b6b26b23798e97 WatchSource:0}: Error finding container 316110139f6b1737788b7493b53f80e734cdfc08db0c564a44b6b26b23798e97: Status 404 returned error can't find the container with id 316110139f6b1737788b7493b53f80e734cdfc08db0c564a44b6b26b23798e97 Jul 13 14:20:51.006661 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:51.006640 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod950a6b21_cbbe_4177_99b3_94b905bdd5b7.slice/crio-35f7e6686ae115368bda93983fd28d6314d8dc5edfe64601a27741e87049ddc7 WatchSource:0}: Error finding container 35f7e6686ae115368bda93983fd28d6314d8dc5edfe64601a27741e87049ddc7: Status 404 returned error can't find the container with id 35f7e6686ae115368bda93983fd28d6314d8dc5edfe64601a27741e87049ddc7 Jul 13 14:20:51.025950 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:51.025927 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" Jul 13 14:20:51.035358 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:51.035334 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod246a645d_b189_4ff8_97dd_64acd7551f8a.slice/crio-614fc3b644faa8ef520a41f061419df72a90f8370b72cdc7962ef872da78693f WatchSource:0}: Error finding container 614fc3b644faa8ef520a41f061419df72a90f8370b72cdc7962ef872da78693f: Status 404 returned error can't find the container with id 614fc3b644faa8ef520a41f061419df72a90f8370b72cdc7962ef872da78693f Jul 13 14:20:51.038525 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:51.038501 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bc97z" Jul 13 14:20:51.046574 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:51.046551 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa66b2c_e5f8_462d_84b7_f9af2663c682.slice/crio-bed88cfdf3820d962fd869c6d2a67aca23c209b538e08aa0137a26b1e489657d WatchSource:0}: Error finding container bed88cfdf3820d962fd869c6d2a67aca23c209b538e08aa0137a26b1e489657d: Status 404 returned error can't find the container with id bed88cfdf3820d962fd869c6d2a67aca23c209b538e08aa0137a26b1e489657d Jul 13 14:20:51.056712 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:51.056693 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s6dr2" Jul 13 14:20:51.065530 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:51.065505 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c2dbfef_a3bc_424d_8010_f28cfea8fb4e.slice/crio-6d6bb67106cd328291fd7e1c55934a4853555003915c9fc0363665ffa327b218 WatchSource:0}: Error finding container 6d6bb67106cd328291fd7e1c55934a4853555003915c9fc0363665ffa327b218: Status 404 returned error can't find the container with id 6d6bb67106cd328291fd7e1c55934a4853555003915c9fc0363665ffa327b218 Jul 13 14:20:51.078478 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:51.078406 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mn8c6" Jul 13 14:20:51.087581 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:51.087559 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod297ea06e_b94d_4b46_82a4_d3134f30ded1.slice/crio-53c55ff0420c9d873d83d40c38f516fa8ce8a5f23467af56e96a893ef584a23f WatchSource:0}: Error finding container 53c55ff0420c9d873d83d40c38f516fa8ce8a5f23467af56e96a893ef584a23f: Status 404 returned error can't find the container with id 53c55ff0420c9d873d83d40c38f516fa8ce8a5f23467af56e96a893ef584a23f Jul 13 14:20:51.094839 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:51.094818 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xng5s" Jul 13 14:20:51.103373 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:51.103351 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53f28e70_42bd_44fd_9d7c_86a8627d7bfe.slice/crio-27d674fafbcd36d5ed1f8034b750c7d1945cc8543ba9200cd5f6248b5e68c4cf WatchSource:0}: Error finding container 27d674fafbcd36d5ed1f8034b750c7d1945cc8543ba9200cd5f6248b5e68c4cf: Status 404 returned error can't find the container with id 27d674fafbcd36d5ed1f8034b750c7d1945cc8543ba9200cd5f6248b5e68c4cf Jul 13 14:20:51.113479 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:51.113455 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:20:51.122081 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:51.122059 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z7w5m" Jul 13 14:20:51.122367 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:51.122341 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74b3da28_f883_40d3_89a1_10381739a75d.slice/crio-571ea83f7c08d5f8d0f395b08dee3f7db5a9cc5e41b2512e2611dec3cfdab1ea WatchSource:0}: Error finding container 571ea83f7c08d5f8d0f395b08dee3f7db5a9cc5e41b2512e2611dec3cfdab1ea: Status 404 returned error can't find the container with id 571ea83f7c08d5f8d0f395b08dee3f7db5a9cc5e41b2512e2611dec3cfdab1ea Jul 13 14:20:51.131640 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:20:51.131608 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f7f5e98_1d2e_4bb7_88e5_05e417aa1502.slice/crio-712edcfc0bca5960a415a6097726478bdc971d2e56ca0189d010c3aa5778217e WatchSource:0}: Error finding container 712edcfc0bca5960a415a6097726478bdc971d2e56ca0189d010c3aa5778217e: Status 404 returned error can't find the container with id 712edcfc0bca5960a415a6097726478bdc971d2e56ca0189d010c3aa5778217e Jul 13 14:20:51.212118 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:51.212066 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s6dr2" event={"ID":"0c2dbfef-a3bc-424d-8010-f28cfea8fb4e","Type":"ContainerStarted","Data":"6d6bb67106cd328291fd7e1c55934a4853555003915c9fc0363665ffa327b218"} Jul 13 14:20:51.213207 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:51.213177 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bc97z" event={"ID":"2fa66b2c-e5f8-462d-84b7-f9af2663c682","Type":"ContainerStarted","Data":"bed88cfdf3820d962fd869c6d2a67aca23c209b538e08aa0137a26b1e489657d"} Jul 13 14:20:51.214278 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:51.214256 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gxp9r" event={"ID":"950a6b21-cbbe-4177-99b3-94b905bdd5b7","Type":"ContainerStarted","Data":"35f7e6686ae115368bda93983fd28d6314d8dc5edfe64601a27741e87049ddc7"} Jul 13 14:20:51.215395 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:51.215372 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal" event={"ID":"71fcd049ac89594ddba0d96bd90cd93b","Type":"ContainerStarted","Data":"b921703197d924f6a76bc9466ec5b02b7160efe0907ecf8d77dc497ca4afd460"} Jul 13 14:20:51.216482 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:51.216457 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z7w5m" event={"ID":"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502","Type":"ContainerStarted","Data":"712edcfc0bca5960a415a6097726478bdc971d2e56ca0189d010c3aa5778217e"} Jul 13 14:20:51.217678 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:51.217658 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" event={"ID":"246a645d-b189-4ff8-97dd-64acd7551f8a","Type":"ContainerStarted","Data":"614fc3b644faa8ef520a41f061419df72a90f8370b72cdc7962ef872da78693f"} Jul 13 14:20:51.219384 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:51.219364 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dv99f" event={"ID":"89fffe89-dde0-4d6b-941c-d4e037ea8364","Type":"ContainerStarted","Data":"316110139f6b1737788b7493b53f80e734cdfc08db0c564a44b6b26b23798e97"} Jul 13 14:20:51.220449 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:51.220430 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-70.ec2.internal" event={"ID":"b04179ee16bc51140974d528cab249f3","Type":"ContainerStarted","Data":"818b9a787cbcda4637b037296dd5dfb5cc30b4bda9591335b0b9a0e3ea0c2607"} Jul 13 14:20:51.221632 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:51.221610 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" event={"ID":"74b3da28-f883-40d3-89a1-10381739a75d","Type":"ContainerStarted","Data":"571ea83f7c08d5f8d0f395b08dee3f7db5a9cc5e41b2512e2611dec3cfdab1ea"} Jul 13 14:20:51.222692 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:51.222669 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xng5s" event={"ID":"53f28e70-42bd-44fd-9d7c-86a8627d7bfe","Type":"ContainerStarted","Data":"27d674fafbcd36d5ed1f8034b750c7d1945cc8543ba9200cd5f6248b5e68c4cf"} Jul 13 14:20:51.223587 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:51.223567 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mn8c6" event={"ID":"297ea06e-b94d-4b46-82a4-d3134f30ded1","Type":"ContainerStarted","Data":"53c55ff0420c9d873d83d40c38f516fa8ce8a5f23467af56e96a893ef584a23f"} Jul 13 14:20:51.351635 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:51.351525 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-metrics-certs\") pod \"network-metrics-daemon-hr8jp\" (UID: \"7a0432b9-4eb0-4e69-a3e3-e23edaafb44c\") " pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:20:51.351635 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:51.351572 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-original-pull-secret\") pod \"global-pull-secret-syncer-4vn2v\" (UID: \"1612be17-dbf1-4d08-a9d8-fa7ec57fee55\") " pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:20:51.352031 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:51.351706 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 14:20:51.352031 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:51.351725 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:20:51.352031 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:51.351770 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-original-pull-secret podName:1612be17-dbf1-4d08-a9d8-fa7ec57fee55 nodeName:}" failed. No retries permitted until 2026-07-13 14:20:52.351751052 +0000 UTC m=+4.647754006 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-original-pull-secret") pod "global-pull-secret-syncer-4vn2v" (UID: "1612be17-dbf1-4d08-a9d8-fa7ec57fee55") : object "kube-system"/"original-pull-secret" not registered Jul 13 14:20:51.352031 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:51.351788 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-metrics-certs podName:7a0432b9-4eb0-4e69-a3e3-e23edaafb44c nodeName:}" failed. No retries permitted until 2026-07-13 14:20:52.351781263 +0000 UTC m=+4.647784197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-metrics-certs") pod "network-metrics-daemon-hr8jp" (UID: "7a0432b9-4eb0-4e69-a3e3-e23edaafb44c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:20:51.452958 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:51.452554 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p2mb\" (UniqueName: \"kubernetes.io/projected/0a464e5b-7939-4ebe-9819-1ec0da498f95-kube-api-access-7p2mb\") pod \"network-check-target-dcxzw\" (UID: \"0a464e5b-7939-4ebe-9819-1ec0da498f95\") " pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:20:51.452958 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:51.452753 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 14:20:51.452958 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:51.452777 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 14:20:51.452958 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:51.452791 2568 projected.go:196] Error preparing data for projected volume kube-api-access-7p2mb for pod openshift-network-diagnostics/network-check-target-dcxzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:20:51.452958 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:51.452861 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a464e5b-7939-4ebe-9819-1ec0da498f95-kube-api-access-7p2mb podName:0a464e5b-7939-4ebe-9819-1ec0da498f95 nodeName:}" failed. No retries permitted until 2026-07-13 14:20:52.452839912 +0000 UTC m=+4.748842861 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7p2mb" (UniqueName: "kubernetes.io/projected/0a464e5b-7939-4ebe-9819-1ec0da498f95-kube-api-access-7p2mb") pod "network-check-target-dcxzw" (UID: "0a464e5b-7939-4ebe-9819-1ec0da498f95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:20:51.643750 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:51.643546 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 14:15:50 +0000 UTC" deadline="2028-03-08 13:44:07.539729015 +0000 UTC" Jul 13 14:20:51.643750 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:51.643633 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14495h23m15.896102011s" Jul 13 14:20:52.199302 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:52.199238 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:20:52.199481 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:52.199381 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr8jp" podUID="7a0432b9-4eb0-4e69-a3e3-e23edaafb44c" Jul 13 14:20:52.199844 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:52.199813 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:20:52.199936 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:52.199915 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vn2v" podUID="1612be17-dbf1-4d08-a9d8-fa7ec57fee55" Jul 13 14:20:52.199990 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:52.199981 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:20:52.200085 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:52.200065 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dcxzw" podUID="0a464e5b-7939-4ebe-9819-1ec0da498f95" Jul 13 14:20:52.360004 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:52.359930 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-metrics-certs\") pod \"network-metrics-daemon-hr8jp\" (UID: \"7a0432b9-4eb0-4e69-a3e3-e23edaafb44c\") " pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:20:52.360004 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:52.359984 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-original-pull-secret\") pod \"global-pull-secret-syncer-4vn2v\" (UID: \"1612be17-dbf1-4d08-a9d8-fa7ec57fee55\") " pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:20:52.360622 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:52.360138 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 14:20:52.360622 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:52.360139 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:20:52.360622 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:52.360220 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-original-pull-secret podName:1612be17-dbf1-4d08-a9d8-fa7ec57fee55 nodeName:}" failed. No retries permitted until 2026-07-13 14:20:54.360181181 +0000 UTC m=+6.656184116 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-original-pull-secret") pod "global-pull-secret-syncer-4vn2v" (UID: "1612be17-dbf1-4d08-a9d8-fa7ec57fee55") : object "kube-system"/"original-pull-secret" not registered Jul 13 14:20:52.360622 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:52.360292 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-metrics-certs podName:7a0432b9-4eb0-4e69-a3e3-e23edaafb44c nodeName:}" failed. No retries permitted until 2026-07-13 14:20:54.36027082 +0000 UTC m=+6.656273756 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-metrics-certs") pod "network-metrics-daemon-hr8jp" (UID: "7a0432b9-4eb0-4e69-a3e3-e23edaafb44c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:20:52.461580 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:52.460845 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p2mb\" (UniqueName: \"kubernetes.io/projected/0a464e5b-7939-4ebe-9819-1ec0da498f95-kube-api-access-7p2mb\") pod \"network-check-target-dcxzw\" (UID: \"0a464e5b-7939-4ebe-9819-1ec0da498f95\") " pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:20:52.461580 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:52.461015 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 14:20:52.461580 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:52.461037 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 14:20:52.461580 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:52.461051 2568 projected.go:196] Error preparing data for projected volume kube-api-access-7p2mb for pod openshift-network-diagnostics/network-check-target-dcxzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:20:52.461580 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:52.461108 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a464e5b-7939-4ebe-9819-1ec0da498f95-kube-api-access-7p2mb podName:0a464e5b-7939-4ebe-9819-1ec0da498f95 nodeName:}" failed. No retries permitted until 2026-07-13 14:20:54.4610907 +0000 UTC m=+6.757093636 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7p2mb" (UniqueName: "kubernetes.io/projected/0a464e5b-7939-4ebe-9819-1ec0da498f95-kube-api-access-7p2mb") pod "network-check-target-dcxzw" (UID: "0a464e5b-7939-4ebe-9819-1ec0da498f95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:20:52.644245 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:52.644198 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 14:15:50 +0000 UTC" deadline="2028-03-29 11:37:41.40846224 +0000 UTC" Jul 13 14:20:52.644245 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:52.644244 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14997h16m48.764223343s" Jul 13 14:20:54.197763 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:54.197713 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:20:54.198274 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:54.197866 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr8jp" podUID="7a0432b9-4eb0-4e69-a3e3-e23edaafb44c" Jul 13 14:20:54.198372 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:54.198309 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:20:54.198445 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:54.198419 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vn2v" podUID="1612be17-dbf1-4d08-a9d8-fa7ec57fee55" Jul 13 14:20:54.198652 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:54.198630 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:20:54.198751 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:54.198727 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dcxzw" podUID="0a464e5b-7939-4ebe-9819-1ec0da498f95" Jul 13 14:20:54.379703 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:54.379665 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-metrics-certs\") pod \"network-metrics-daemon-hr8jp\" (UID: \"7a0432b9-4eb0-4e69-a3e3-e23edaafb44c\") " pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:20:54.379894 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:54.379726 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-original-pull-secret\") pod \"global-pull-secret-syncer-4vn2v\" (UID: \"1612be17-dbf1-4d08-a9d8-fa7ec57fee55\") " pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:20:54.379992 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:54.379892 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 14:20:54.379992 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:54.379958 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-original-pull-secret podName:1612be17-dbf1-4d08-a9d8-fa7ec57fee55 nodeName:}" failed. No retries permitted until 2026-07-13 14:20:58.379937788 +0000 UTC m=+10.675940723 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-original-pull-secret") pod "global-pull-secret-syncer-4vn2v" (UID: "1612be17-dbf1-4d08-a9d8-fa7ec57fee55") : object "kube-system"/"original-pull-secret" not registered Jul 13 14:20:54.380404 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:54.380365 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:20:54.380526 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:54.380421 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-metrics-certs podName:7a0432b9-4eb0-4e69-a3e3-e23edaafb44c nodeName:}" failed. No retries permitted until 2026-07-13 14:20:58.380403018 +0000 UTC m=+10.676405952 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-metrics-certs") pod "network-metrics-daemon-hr8jp" (UID: "7a0432b9-4eb0-4e69-a3e3-e23edaafb44c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:20:54.481073 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:54.480987 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p2mb\" (UniqueName: \"kubernetes.io/projected/0a464e5b-7939-4ebe-9819-1ec0da498f95-kube-api-access-7p2mb\") pod \"network-check-target-dcxzw\" (UID: \"0a464e5b-7939-4ebe-9819-1ec0da498f95\") " pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:20:54.481232 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:54.481181 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 14:20:54.481232 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:54.481200 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 14:20:54.481232 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:54.481211 2568 projected.go:196] Error preparing data for projected volume kube-api-access-7p2mb for pod openshift-network-diagnostics/network-check-target-dcxzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:20:54.481383 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:54.481264 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a464e5b-7939-4ebe-9819-1ec0da498f95-kube-api-access-7p2mb podName:0a464e5b-7939-4ebe-9819-1ec0da498f95 nodeName:}" failed. No retries permitted until 2026-07-13 14:20:58.481247123 +0000 UTC m=+10.777250058 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7p2mb" (UniqueName: "kubernetes.io/projected/0a464e5b-7939-4ebe-9819-1ec0da498f95-kube-api-access-7p2mb") pod "network-check-target-dcxzw" (UID: "0a464e5b-7939-4ebe-9819-1ec0da498f95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:20:56.197569 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:56.197064 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:20:56.197569 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:56.197213 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr8jp" podUID="7a0432b9-4eb0-4e69-a3e3-e23edaafb44c" Jul 13 14:20:56.197569 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:56.197347 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:20:56.197569 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:56.197536 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vn2v" podUID="1612be17-dbf1-4d08-a9d8-fa7ec57fee55" Jul 13 14:20:56.198201 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:56.197623 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:20:56.198201 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:56.197704 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dcxzw" podUID="0a464e5b-7939-4ebe-9819-1ec0da498f95" Jul 13 14:20:58.197216 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:58.197182 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:20:58.197820 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:58.197802 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:20:58.198091 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:58.197920 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr8jp" podUID="7a0432b9-4eb0-4e69-a3e3-e23edaafb44c" Jul 13 14:20:58.198091 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:58.197957 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vn2v" podUID="1612be17-dbf1-4d08-a9d8-fa7ec57fee55" Jul 13 14:20:58.198091 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:58.198009 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:20:58.198311 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:58.198123 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dcxzw" podUID="0a464e5b-7939-4ebe-9819-1ec0da498f95" Jul 13 14:20:58.414457 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:58.413711 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-metrics-certs\") pod \"network-metrics-daemon-hr8jp\" (UID: \"7a0432b9-4eb0-4e69-a3e3-e23edaafb44c\") " pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:20:58.414457 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:58.413771 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-original-pull-secret\") pod \"global-pull-secret-syncer-4vn2v\" (UID: \"1612be17-dbf1-4d08-a9d8-fa7ec57fee55\") " pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:20:58.414457 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:58.413943 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 14:20:58.414457 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:58.414009 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-original-pull-secret podName:1612be17-dbf1-4d08-a9d8-fa7ec57fee55 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:06.413989805 +0000 UTC m=+18.709992757 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-original-pull-secret") pod "global-pull-secret-syncer-4vn2v" (UID: "1612be17-dbf1-4d08-a9d8-fa7ec57fee55") : object "kube-system"/"original-pull-secret" not registered Jul 13 14:20:58.414457 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:58.414411 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:20:58.414457 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:58.414464 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-metrics-certs podName:7a0432b9-4eb0-4e69-a3e3-e23edaafb44c nodeName:}" failed. No retries permitted until 2026-07-13 14:21:06.414448159 +0000 UTC m=+18.710451091 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-metrics-certs") pod "network-metrics-daemon-hr8jp" (UID: "7a0432b9-4eb0-4e69-a3e3-e23edaafb44c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:20:58.514462 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:20:58.514361 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p2mb\" (UniqueName: \"kubernetes.io/projected/0a464e5b-7939-4ebe-9819-1ec0da498f95-kube-api-access-7p2mb\") pod \"network-check-target-dcxzw\" (UID: \"0a464e5b-7939-4ebe-9819-1ec0da498f95\") " pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:20:58.514658 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:58.514555 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 14:20:58.514658 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:58.514580 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 14:20:58.514658 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:58.514612 2568 projected.go:196] Error preparing data for projected volume kube-api-access-7p2mb for pod openshift-network-diagnostics/network-check-target-dcxzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:20:58.514809 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:20:58.514679 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a464e5b-7939-4ebe-9819-1ec0da498f95-kube-api-access-7p2mb podName:0a464e5b-7939-4ebe-9819-1ec0da498f95 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:06.514660765 +0000 UTC m=+18.810663711 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7p2mb" (UniqueName: "kubernetes.io/projected/0a464e5b-7939-4ebe-9819-1ec0da498f95-kube-api-access-7p2mb") pod "network-check-target-dcxzw" (UID: "0a464e5b-7939-4ebe-9819-1ec0da498f95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:21:00.196857 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:00.196826 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:21:00.197317 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:00.196965 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr8jp" podUID="7a0432b9-4eb0-4e69-a3e3-e23edaafb44c" Jul 13 14:21:00.197317 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:00.196826 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:21:00.197420 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:00.197390 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vn2v" podUID="1612be17-dbf1-4d08-a9d8-fa7ec57fee55" Jul 13 14:21:00.197684 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:00.197530 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:21:00.197684 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:00.197639 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dcxzw" podUID="0a464e5b-7939-4ebe-9819-1ec0da498f95" Jul 13 14:21:02.196525 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:02.196491 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:21:02.196525 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:02.196536 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:21:02.197072 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:02.196492 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:21:02.197072 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:02.196650 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr8jp" podUID="7a0432b9-4eb0-4e69-a3e3-e23edaafb44c" Jul 13 14:21:02.197072 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:02.196717 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vn2v" podUID="1612be17-dbf1-4d08-a9d8-fa7ec57fee55" Jul 13 14:21:02.197072 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:02.196778 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dcxzw" podUID="0a464e5b-7939-4ebe-9819-1ec0da498f95" Jul 13 14:21:04.196336 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:04.196297 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:21:04.196842 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:04.196297 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:21:04.196842 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:04.196442 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vn2v" podUID="1612be17-dbf1-4d08-a9d8-fa7ec57fee55" Jul 13 14:21:04.196842 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:04.196299 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:21:04.196842 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:04.196533 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dcxzw" podUID="0a464e5b-7939-4ebe-9819-1ec0da498f95" Jul 13 14:21:04.196842 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:04.196632 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr8jp" podUID="7a0432b9-4eb0-4e69-a3e3-e23edaafb44c" Jul 13 14:21:06.197113 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:06.197075 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:21:06.197571 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:06.197125 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:21:06.197571 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:06.197075 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:21:06.197571 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:06.197212 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vn2v" podUID="1612be17-dbf1-4d08-a9d8-fa7ec57fee55" Jul 13 14:21:06.197571 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:06.197318 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr8jp" podUID="7a0432b9-4eb0-4e69-a3e3-e23edaafb44c" Jul 13 14:21:06.197571 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:06.197383 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dcxzw" podUID="0a464e5b-7939-4ebe-9819-1ec0da498f95" Jul 13 14:21:06.473946 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:06.473858 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-metrics-certs\") pod \"network-metrics-daemon-hr8jp\" (UID: \"7a0432b9-4eb0-4e69-a3e3-e23edaafb44c\") " pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:21:06.473946 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:06.473906 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-original-pull-secret\") pod \"global-pull-secret-syncer-4vn2v\" (UID: \"1612be17-dbf1-4d08-a9d8-fa7ec57fee55\") " pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:21:06.474167 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:06.474015 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:21:06.474167 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:06.474027 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 14:21:06.474167 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:06.474081 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-metrics-certs podName:7a0432b9-4eb0-4e69-a3e3-e23edaafb44c nodeName:}" failed. No retries permitted until 2026-07-13 14:21:22.474064318 +0000 UTC m=+34.770067250 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-metrics-certs") pod "network-metrics-daemon-hr8jp" (UID: "7a0432b9-4eb0-4e69-a3e3-e23edaafb44c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:21:06.474167 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:06.474105 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-original-pull-secret podName:1612be17-dbf1-4d08-a9d8-fa7ec57fee55 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:22.474096165 +0000 UTC m=+34.770099097 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-original-pull-secret") pod "global-pull-secret-syncer-4vn2v" (UID: "1612be17-dbf1-4d08-a9d8-fa7ec57fee55") : object "kube-system"/"original-pull-secret" not registered Jul 13 14:21:06.574210 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:06.574166 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p2mb\" (UniqueName: \"kubernetes.io/projected/0a464e5b-7939-4ebe-9819-1ec0da498f95-kube-api-access-7p2mb\") pod \"network-check-target-dcxzw\" (UID: \"0a464e5b-7939-4ebe-9819-1ec0da498f95\") " pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:21:06.574379 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:06.574357 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 14:21:06.574434 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:06.574386 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 14:21:06.574434 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:06.574397 2568 projected.go:196] Error preparing data for projected volume kube-api-access-7p2mb for pod openshift-network-diagnostics/network-check-target-dcxzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:21:06.574497 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:06.574450 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a464e5b-7939-4ebe-9819-1ec0da498f95-kube-api-access-7p2mb podName:0a464e5b-7939-4ebe-9819-1ec0da498f95 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:22.574434567 +0000 UTC m=+34.870437509 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7p2mb" (UniqueName: "kubernetes.io/projected/0a464e5b-7939-4ebe-9819-1ec0da498f95-kube-api-access-7p2mb") pod "network-check-target-dcxzw" (UID: "0a464e5b-7939-4ebe-9819-1ec0da498f95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:21:08.198077 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:08.198012 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:21:08.198666 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:08.198106 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:21:08.198666 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:08.198158 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:21:08.198666 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:08.198151 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vn2v" podUID="1612be17-dbf1-4d08-a9d8-fa7ec57fee55" Jul 13 14:21:08.198666 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:08.198249 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr8jp" podUID="7a0432b9-4eb0-4e69-a3e3-e23edaafb44c" Jul 13 14:21:08.198666 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:08.198333 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dcxzw" podUID="0a464e5b-7939-4ebe-9819-1ec0da498f95" Jul 13 14:21:10.197127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:10.197086 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:21:10.197574 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:10.197086 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:21:10.197574 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:10.197223 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dcxzw" podUID="0a464e5b-7939-4ebe-9819-1ec0da498f95" Jul 13 14:21:10.197574 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:10.197312 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vn2v" podUID="1612be17-dbf1-4d08-a9d8-fa7ec57fee55" Jul 13 14:21:10.197574 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:10.197097 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:21:10.197574 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:10.197434 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr8jp" podUID="7a0432b9-4eb0-4e69-a3e3-e23edaafb44c" Jul 13 14:21:11.274242 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:11.274040 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bc97z" event={"ID":"2fa66b2c-e5f8-462d-84b7-f9af2663c682","Type":"ContainerStarted","Data":"b0486d954539808a53f818aa38af53f5f9d41b8152dbe477d6e2c0fdbdeb6911"} Jul 13 14:21:11.275633 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:11.275608 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z7w5m" event={"ID":"2f7f5e98-1d2e-4bb7-88e5-05e417aa1502","Type":"ContainerStarted","Data":"75e49aefe8dbdc104138c8015638e46d291403acd9a479c8a3dd64db48f18662"} Jul 13 14:21:11.277054 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:11.277032 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-70.ec2.internal" event={"ID":"b04179ee16bc51140974d528cab249f3","Type":"ContainerStarted","Data":"7e253a6d1dd55a9be22b4bdc5e429b1b5451a3551da5cf64d18c0c89938a73d4"} Jul 13 14:21:11.294601 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:11.294547 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bc97z" podStartSLOduration=3.483572507 podStartE2EDuration="23.294533215s" totalImagesPullingTime="19.810960708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:20:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:21:11.294462358 +0000 UTC m=+23.590465311" watchObservedRunningTime="2026-07-13 14:21:11.294533215 +0000 UTC m=+23.590536168" Jul 13 14:21:11.313888 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:11.313841 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-z7w5m" podStartSLOduration=3.541913331 podStartE2EDuration="23.313825503s" totalImagesPullingTime="19.771912172s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:20:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:21:11.313351487 +0000 UTC m=+23.609354441" watchObservedRunningTime="2026-07-13 14:21:11.313825503 +0000 UTC m=+23.609828457" Jul 13 14:21:11.338728 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:11.338637 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-70.ec2.internal" podStartSLOduration=22.338625563 podStartE2EDuration="22.338625563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:20:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:21:11.338486798 +0000 UTC m=+23.634489753" watchObservedRunningTime="2026-07-13 14:21:11.338625563 +0000 UTC m=+23.634628516" Jul 13 14:21:12.197350 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:12.197062 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:21:12.197350 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:12.197107 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:21:12.197550 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:12.197355 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dcxzw" podUID="0a464e5b-7939-4ebe-9819-1ec0da498f95" Jul 13 14:21:12.197550 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:12.197419 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr8jp" podUID="7a0432b9-4eb0-4e69-a3e3-e23edaafb44c" Jul 13 14:21:12.197550 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:12.197063 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:21:12.197550 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:12.197506 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vn2v" podUID="1612be17-dbf1-4d08-a9d8-fa7ec57fee55" Jul 13 14:21:12.280730 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:12.280692 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s6dr2" event={"ID":"0c2dbfef-a3bc-424d-8010-f28cfea8fb4e","Type":"ContainerStarted","Data":"5488827a986ffb1f0349ef080f01c507c676a1158fd18c28c56d2c0d8ba06c7c"} Jul 13 14:21:12.282075 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:12.282047 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gxp9r" event={"ID":"950a6b21-cbbe-4177-99b3-94b905bdd5b7","Type":"ContainerStarted","Data":"fb0f588c3ee3bcc9ad35053961ff9c59f1ccfaabb5c52e5a84cc77128f2425f4"} Jul 13 14:21:12.283516 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:12.283494 2568 generic.go:356] "Generic (PLEG): container finished" podID="71fcd049ac89594ddba0d96bd90cd93b" containerID="7016c9b2bf2d8c46c97cde24eb6975e6af329be102f57194dc37a8bfcad2eb7d" exitCode=0 Jul 13 14:21:12.283630 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:12.283563 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal" event={"ID":"71fcd049ac89594ddba0d96bd90cd93b","Type":"ContainerDied","Data":"7016c9b2bf2d8c46c97cde24eb6975e6af329be102f57194dc37a8bfcad2eb7d"} Jul 13 14:21:12.285079 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:12.285051 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" event={"ID":"246a645d-b189-4ff8-97dd-64acd7551f8a","Type":"ContainerStarted","Data":"84fa55e3bdb66194852d86ac966351af2d501a801d9f4ccd32f6e480c60bff4a"} Jul 13 14:21:12.286793 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:12.286771 2568 generic.go:356] "Generic (PLEG): container finished" podID="89fffe89-dde0-4d6b-941c-d4e037ea8364" containerID="fcf965abfd4f5fe9622764cf6d39ba8e29a731a51cafa388ea880381586e2ac5" exitCode=0 Jul 13 14:21:12.286898 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:12.286853 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dv99f" event={"ID":"89fffe89-dde0-4d6b-941c-d4e037ea8364","Type":"ContainerDied","Data":"fcf965abfd4f5fe9622764cf6d39ba8e29a731a51cafa388ea880381586e2ac5"} Jul 13 14:21:12.289813 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:12.289789 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbgpb_74b3da28-f883-40d3-89a1-10381739a75d/ovn-acl-logging/0.log" Jul 13 14:21:12.290174 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:12.290153 2568 generic.go:356] "Generic (PLEG): container finished" podID="74b3da28-f883-40d3-89a1-10381739a75d" containerID="24a3fc0a8b85951405032c1c50b5f6fc3c7018b9a470d97ba195915cce539283" exitCode=1 Jul 13 14:21:12.290261 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:12.290240 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" event={"ID":"74b3da28-f883-40d3-89a1-10381739a75d","Type":"ContainerStarted","Data":"28d0c55d256839d4c5fdc69ff9f05ae1d49c59765bd78d00108aa24883d9c050"} Jul 13 14:21:12.290342 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:12.290329 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" event={"ID":"74b3da28-f883-40d3-89a1-10381739a75d","Type":"ContainerStarted","Data":"3a52b83608cdc45c2bf36a767bd9b573de991a5489298c383a23e636dae052d7"} Jul 13 14:21:12.290408 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:12.290385 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" event={"ID":"74b3da28-f883-40d3-89a1-10381739a75d","Type":"ContainerStarted","Data":"8894a2c2327a80bcf2fcd367470492d13ab5a10dac4fb10c921f68db284a9c9d"} Jul 13 14:21:12.290459 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:12.290436 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" event={"ID":"74b3da28-f883-40d3-89a1-10381739a75d","Type":"ContainerStarted","Data":"178d8ecb74391c2fc7175a02161d8fa7442bbcc3ea6d3e2e4a0ff5e1ff97867f"} Jul 13 14:21:12.290512 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:12.290486 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" event={"ID":"74b3da28-f883-40d3-89a1-10381739a75d","Type":"ContainerDied","Data":"24a3fc0a8b85951405032c1c50b5f6fc3c7018b9a470d97ba195915cce539283"} Jul 13 14:21:12.290567 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:12.290539 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" event={"ID":"74b3da28-f883-40d3-89a1-10381739a75d","Type":"ContainerStarted","Data":"a9c14987d5b6d69a037d5665b06a06ce60a15a476dde0933f3343c7809f37416"} Jul 13 14:21:12.291558 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:12.291539 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xng5s" event={"ID":"53f28e70-42bd-44fd-9d7c-86a8627d7bfe","Type":"ContainerStarted","Data":"4b89fe623a505b88694d531fef0b3cd7bad54761dd3145f8328dc54d77ef0973"} Jul 13 14:21:12.292891 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:12.292869 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mn8c6" event={"ID":"297ea06e-b94d-4b46-82a4-d3134f30ded1","Type":"ContainerStarted","Data":"08a200ec050212388caa9ae826155b96ac22006554920fd086ca4417e5ad9d9f"} Jul 13 14:21:12.299578 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:12.299543 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-s6dr2" podStartSLOduration=4.559051118 podStartE2EDuration="24.299531991s" totalImagesPullingTime="19.740480873s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:20:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:21:12.299459571 +0000 UTC m=+24.595462524" watchObservedRunningTime="2026-07-13 14:21:12.299531991 +0000 UTC m=+24.595534944" Jul 13 14:21:12.320370 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:12.320321 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gxp9r" podStartSLOduration=4.521107607 podStartE2EDuration="24.320302992s" totalImagesPullingTime="19.799195385s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:20:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:21:12.319768181 +0000 UTC m=+24.615771135" watchObservedRunningTime="2026-07-13 14:21:12.320302992 +0000 UTC m=+24.616305949" Jul 13 14:21:12.342711 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:12.342665 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mn8c6" podStartSLOduration=4.576867203 podStartE2EDuration="24.342654535s" totalImagesPullingTime="19.765787332s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:20:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:21:12.342644943 +0000 UTC m=+24.638647894" watchObservedRunningTime="2026-07-13 14:21:12.342654535 +0000 UTC m=+24.638657490" Jul 13 14:21:12.359708 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:12.359656 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xng5s" podStartSLOduration=4.609332719 podStartE2EDuration="24.359643525s" totalImagesPullingTime="19.750310806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:20:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:21:12.359535438 +0000 UTC m=+24.655538393" watchObservedRunningTime="2026-07-13 14:21:12.359643525 +0000 UTC m=+24.655646478" Jul 13 14:21:12.942940 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:12.942736 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 13 14:21:13.200887 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:13.200708 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T14:21:12.94293487Z","UUID":"64353e06-5a19-4994-b423-11ba658542d2","Handler":null,"Name":"","Endpoint":""} Jul 13 14:21:13.202342 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:13.202319 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 13 14:21:13.202466 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:13.202352 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 13 14:21:13.296685 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:13.296649 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal" event={"ID":"71fcd049ac89594ddba0d96bd90cd93b","Type":"ContainerStarted","Data":"5ee951f92f313137dc4b47c752cfcf7135f77f2c7ffde868bdf05a3ad6947041"} Jul 13 14:21:13.298442 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:13.298415 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" event={"ID":"246a645d-b189-4ff8-97dd-64acd7551f8a","Type":"ContainerStarted","Data":"c243939033221fced29bd6a4c7f2910640257960eb40455f0340f239dfe4e6a5"} Jul 13 14:21:13.316022 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:13.315979 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal" podStartSLOduration=24.315965988 podStartE2EDuration="24.315965988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:20:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:21:13.31552661 +0000 UTC m=+25.611529574" watchObservedRunningTime="2026-07-13 14:21:13.315965988 +0000 UTC m=+25.611968943" Jul 13 14:21:14.102538 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:14.102497 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xng5s" Jul 13 14:21:14.103071 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:14.103055 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xng5s" Jul 13 14:21:14.196450 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:14.196417 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:21:14.196450 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:14.196457 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:21:14.196701 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:14.196417 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:21:14.196701 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:14.196603 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr8jp" podUID="7a0432b9-4eb0-4e69-a3e3-e23edaafb44c" Jul 13 14:21:14.196701 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:14.196663 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vn2v" podUID="1612be17-dbf1-4d08-a9d8-fa7ec57fee55" Jul 13 14:21:14.196836 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:14.196737 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dcxzw" podUID="0a464e5b-7939-4ebe-9819-1ec0da498f95" Jul 13 14:21:14.301543 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:14.301517 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xng5s" Jul 13 14:21:14.302127 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:14.302117 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xng5s" Jul 13 14:21:15.307077 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:15.307037 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" event={"ID":"246a645d-b189-4ff8-97dd-64acd7551f8a","Type":"ContainerStarted","Data":"79e246b407f160011bb47349da01cf080245c20c50aeb92584284511970532e1"} Jul 13 14:21:15.310479 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:15.310457 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbgpb_74b3da28-f883-40d3-89a1-10381739a75d/ovn-acl-logging/0.log" Jul 13 14:21:15.311100 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:15.311074 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" event={"ID":"74b3da28-f883-40d3-89a1-10381739a75d","Type":"ContainerStarted","Data":"88f3c79d1ce7df795284409576031f3fbe9fda68602dfb2f2ad5a2032fad96bf"} Jul 13 14:21:15.328267 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:15.328195 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ntz9h" podStartSLOduration=4.945368572 podStartE2EDuration="27.328179229s" totalImagesPullingTime="22.382810657s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:20:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:21:15.327786933 +0000 UTC m=+27.623789889" watchObservedRunningTime="2026-07-13 14:21:15.328179229 +0000 UTC m=+27.624182182" Jul 13 14:21:16.197067 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:16.197029 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:21:16.197067 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:16.197047 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:21:16.197067 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:16.197057 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:21:16.197342 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:16.197140 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr8jp" podUID="7a0432b9-4eb0-4e69-a3e3-e23edaafb44c" Jul 13 14:21:16.197342 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:16.197201 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vn2v" podUID="1612be17-dbf1-4d08-a9d8-fa7ec57fee55" Jul 13 14:21:16.197342 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:16.197278 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dcxzw" podUID="0a464e5b-7939-4ebe-9819-1ec0da498f95" Jul 13 14:21:17.320577 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:17.320258 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbgpb_74b3da28-f883-40d3-89a1-10381739a75d/ovn-acl-logging/0.log" Jul 13 14:21:17.321536 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:17.320934 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" event={"ID":"74b3da28-f883-40d3-89a1-10381739a75d","Type":"ContainerStarted","Data":"749a5415acf1b0c86d8b724916ccb46c3af356697320877f740b5ec105a00298"} Jul 13 14:21:17.321536 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:17.321226 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:21:17.321536 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:17.321414 2568 scope.go:117] "RemoveContainer" containerID="24a3fc0a8b85951405032c1c50b5f6fc3c7018b9a470d97ba195915cce539283" Jul 13 14:21:17.338005 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:17.337981 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:21:18.199871 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:18.198753 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:21:18.199871 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:18.198894 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vn2v" podUID="1612be17-dbf1-4d08-a9d8-fa7ec57fee55" Jul 13 14:21:18.199871 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:18.199324 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:21:18.199871 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:18.199471 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dcxzw" podUID="0a464e5b-7939-4ebe-9819-1ec0da498f95" Jul 13 14:21:18.199871 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:18.199540 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:21:18.200164 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:18.199888 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr8jp" podUID="7a0432b9-4eb0-4e69-a3e3-e23edaafb44c" Jul 13 14:21:18.325194 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:18.325159 2568 generic.go:356] "Generic (PLEG): container finished" podID="89fffe89-dde0-4d6b-941c-d4e037ea8364" containerID="166dec444dfdf8ea4a2581f19a381419ab9d5032aec39291f9e15fc68c25b1bc" exitCode=0 Jul 13 14:21:18.325669 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:18.325246 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dv99f" event={"ID":"89fffe89-dde0-4d6b-941c-d4e037ea8364","Type":"ContainerDied","Data":"166dec444dfdf8ea4a2581f19a381419ab9d5032aec39291f9e15fc68c25b1bc"} Jul 13 14:21:18.329135 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:18.329111 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbgpb_74b3da28-f883-40d3-89a1-10381739a75d/ovn-acl-logging/0.log" Jul 13 14:21:18.329480 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:18.329452 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" event={"ID":"74b3da28-f883-40d3-89a1-10381739a75d","Type":"ContainerStarted","Data":"e5ac49857272b1a652f2fd5c39fe909d2576242a38d6c15d20dcceada4927fca"} Jul 13 14:21:18.329732 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:18.329708 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:21:18.329843 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:18.329791 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:21:18.346126 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:18.346106 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:21:18.387038 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:18.386990 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" podStartSLOduration=10.108879217 podStartE2EDuration="30.386975173s" totalImagesPullingTime="20.278095956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:20:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:21:18.386506501 +0000 UTC m=+30.682509454" watchObservedRunningTime="2026-07-13 14:21:18.386975173 +0000 UTC m=+30.682978127" Jul 13 14:21:19.219880 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:19.219707 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4vn2v"] Jul 13 14:21:19.220048 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:19.219946 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:21:19.220048 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:19.220031 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vn2v" podUID="1612be17-dbf1-4d08-a9d8-fa7ec57fee55" Jul 13 14:21:19.221751 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:19.221726 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hr8jp"] Jul 13 14:21:19.221858 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:19.221823 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:21:19.221930 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:19.221913 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr8jp" podUID="7a0432b9-4eb0-4e69-a3e3-e23edaafb44c" Jul 13 14:21:19.236038 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:19.236007 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dcxzw"] Jul 13 14:21:19.236180 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:19.236107 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:21:19.236240 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:19.236195 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dcxzw" podUID="0a464e5b-7939-4ebe-9819-1ec0da498f95" Jul 13 14:21:21.196967 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:21.196881 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:21:21.196967 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:21.196913 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:21:21.196967 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:21.196913 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:21:21.197618 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:21.196984 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vn2v" podUID="1612be17-dbf1-4d08-a9d8-fa7ec57fee55" Jul 13 14:21:21.197618 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:21.197068 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dcxzw" podUID="0a464e5b-7939-4ebe-9819-1ec0da498f95" Jul 13 14:21:21.197618 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:21.197139 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr8jp" podUID="7a0432b9-4eb0-4e69-a3e3-e23edaafb44c" Jul 13 14:21:21.338725 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:21.338693 2568 generic.go:356] "Generic (PLEG): container finished" podID="89fffe89-dde0-4d6b-941c-d4e037ea8364" containerID="7d300b306cf657cdaab95eff9b6cfcdd75af9c8d0cc74b284597336637ce87e2" exitCode=0 Jul 13 14:21:21.338902 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:21.338732 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dv99f" event={"ID":"89fffe89-dde0-4d6b-941c-d4e037ea8364","Type":"ContainerDied","Data":"7d300b306cf657cdaab95eff9b6cfcdd75af9c8d0cc74b284597336637ce87e2"} Jul 13 14:21:22.495552 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:22.495518 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-metrics-certs\") pod \"network-metrics-daemon-hr8jp\" (UID: \"7a0432b9-4eb0-4e69-a3e3-e23edaafb44c\") " pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:21:22.496041 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:22.495566 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-original-pull-secret\") pod \"global-pull-secret-syncer-4vn2v\" (UID: \"1612be17-dbf1-4d08-a9d8-fa7ec57fee55\") " pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:21:22.496041 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:22.495686 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 14:21:22.496041 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:22.495695 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:21:22.496041 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:22.495739 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-original-pull-secret podName:1612be17-dbf1-4d08-a9d8-fa7ec57fee55 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:54.495726664 +0000 UTC m=+66.791729596 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-original-pull-secret") pod "global-pull-secret-syncer-4vn2v" (UID: "1612be17-dbf1-4d08-a9d8-fa7ec57fee55") : object "kube-system"/"original-pull-secret" not registered Jul 13 14:21:22.496041 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:22.495765 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-metrics-certs podName:7a0432b9-4eb0-4e69-a3e3-e23edaafb44c nodeName:}" failed. No retries permitted until 2026-07-13 14:21:54.495744539 +0000 UTC m=+66.791747471 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-metrics-certs") pod "network-metrics-daemon-hr8jp" (UID: "7a0432b9-4eb0-4e69-a3e3-e23edaafb44c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 14:21:22.596711 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:22.596665 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p2mb\" (UniqueName: \"kubernetes.io/projected/0a464e5b-7939-4ebe-9819-1ec0da498f95-kube-api-access-7p2mb\") pod \"network-check-target-dcxzw\" (UID: \"0a464e5b-7939-4ebe-9819-1ec0da498f95\") " pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:21:22.596888 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:22.596843 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 14:21:22.596888 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:22.596866 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 14:21:22.596888 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:22.596876 2568 projected.go:196] Error preparing data for projected volume kube-api-access-7p2mb for pod openshift-network-diagnostics/network-check-target-dcxzw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:21:22.597046 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:22.596940 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a464e5b-7939-4ebe-9819-1ec0da498f95-kube-api-access-7p2mb podName:0a464e5b-7939-4ebe-9819-1ec0da498f95 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:54.596924289 +0000 UTC m=+66.892927225 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7p2mb" (UniqueName: "kubernetes.io/projected/0a464e5b-7939-4ebe-9819-1ec0da498f95-kube-api-access-7p2mb") pod "network-check-target-dcxzw" (UID: "0a464e5b-7939-4ebe-9819-1ec0da498f95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 14:21:23.197327 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:23.197149 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:21:23.197498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:23.197188 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:21:23.197498 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:23.197412 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4vn2v" podUID="1612be17-dbf1-4d08-a9d8-fa7ec57fee55" Jul 13 14:21:23.197568 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:23.197511 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dcxzw" podUID="0a464e5b-7939-4ebe-9819-1ec0da498f95" Jul 13 14:21:23.197568 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:23.197219 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:21:23.197653 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:23.197621 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr8jp" podUID="7a0432b9-4eb0-4e69-a3e3-e23edaafb44c" Jul 13 14:21:23.346731 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:23.346695 2568 generic.go:356] "Generic (PLEG): container finished" podID="89fffe89-dde0-4d6b-941c-d4e037ea8364" containerID="5818d6c9e324e933bf8c5e6e2fd684cc4f1bc3e78169ffe533126d8bcde89e23" exitCode=0 Jul 13 14:21:23.346923 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:23.346753 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dv99f" event={"ID":"89fffe89-dde0-4d6b-941c-d4e037ea8364","Type":"ContainerDied","Data":"5818d6c9e324e933bf8c5e6e2fd684cc4f1bc3e78169ffe533126d8bcde89e23"} Jul 13 14:21:23.986148 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:23.986119 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeReady" Jul 13 14:21:23.986632 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:23.986292 2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 13 14:21:24.036612 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.036501 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7595b9689d-f94p9"] Jul 13 14:21:24.040190 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.040160 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:24.044338 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.044313 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 13 14:21:24.045866 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.045694 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 13 14:21:24.045866 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.045735 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 13 14:21:24.045866 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.045760 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fdc44\"" Jul 13 14:21:24.052847 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.052820 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 13 14:21:24.053953 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.053931 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7595b9689d-f94p9"] Jul 13 14:21:24.058259 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.057988 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9wm7s"] Jul 13 14:21:24.062488 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.062469 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8chnn"] Jul 13 14:21:24.062629 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.062613 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9wm7s" Jul 13 14:21:24.066436 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.066414 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8chnn" Jul 13 14:21:24.068200 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.068179 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 13 14:21:24.068852 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.068831 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6lrx7\"" Jul 13 14:21:24.069069 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.069046 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 13 14:21:24.070112 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.070094 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9jbjr\"" Jul 13 14:21:24.070181 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.070135 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 13 14:21:24.071112 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.070946 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 13 14:21:24.071112 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.071019 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 13 14:21:24.072697 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.072678 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9wm7s"] Jul 13 14:21:24.079786 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.079419 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8chnn"] Jul 13 14:21:24.207883 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.207851 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf7f13a3-6730-4087-8d83-7af27db5e836-trusted-ca\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:24.208060 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.207889 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c42d2b9c-d394-4e63-b1f2-b38552d30bef-metrics-tls\") pod \"dns-default-9wm7s\" (UID: \"c42d2b9c-d394-4e63-b1f2-b38552d30bef\") " pod="openshift-dns/dns-default-9wm7s" Jul 13 14:21:24.208060 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.207950 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-tls\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:24.208060 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.207979 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-bound-sa-token\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:24.208060 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.208005 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79vcd\" (UniqueName: \"kubernetes.io/projected/036cc3ac-9400-462a-99f7-1e31413ddd0c-kube-api-access-79vcd\") pod \"ingress-canary-8chnn\" (UID: \"036cc3ac-9400-462a-99f7-1e31413ddd0c\") " pod="openshift-ingress-canary/ingress-canary-8chnn" Jul 13 14:21:24.208060 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.208021 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf7f13a3-6730-4087-8d83-7af27db5e836-image-registry-private-configuration\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:24.208060 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.208050 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndcqx\" (UniqueName: \"kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-kube-api-access-ndcqx\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:24.208379 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.208102 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c42d2b9c-d394-4e63-b1f2-b38552d30bef-config-volume\") pod \"dns-default-9wm7s\" (UID: \"c42d2b9c-d394-4e63-b1f2-b38552d30bef\") " pod="openshift-dns/dns-default-9wm7s" Jul 13 14:21:24.208379 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.208137 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c42d2b9c-d394-4e63-b1f2-b38552d30bef-tmp-dir\") pod \"dns-default-9wm7s\" (UID: \"c42d2b9c-d394-4e63-b1f2-b38552d30bef\") " pod="openshift-dns/dns-default-9wm7s" Jul 13 14:21:24.208379 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.208157 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gnqz\" (UniqueName: \"kubernetes.io/projected/c42d2b9c-d394-4e63-b1f2-b38552d30bef-kube-api-access-8gnqz\") pod \"dns-default-9wm7s\" (UID: \"c42d2b9c-d394-4e63-b1f2-b38552d30bef\") " pod="openshift-dns/dns-default-9wm7s" Jul 13 14:21:24.208379 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.208176 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/036cc3ac-9400-462a-99f7-1e31413ddd0c-cert\") pod \"ingress-canary-8chnn\" (UID: \"036cc3ac-9400-462a-99f7-1e31413ddd0c\") " pod="openshift-ingress-canary/ingress-canary-8chnn" Jul 13 14:21:24.208379 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.208209 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-certificates\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:24.208379 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.208231 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf7f13a3-6730-4087-8d83-7af27db5e836-installation-pull-secrets\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:24.208379 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.208294 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf7f13a3-6730-4087-8d83-7af27db5e836-ca-trust-extracted\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:24.308996 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.308913 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf7f13a3-6730-4087-8d83-7af27db5e836-ca-trust-extracted\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:24.308996 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.308965 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf7f13a3-6730-4087-8d83-7af27db5e836-trusted-ca\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:24.308996 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.308987 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c42d2b9c-d394-4e63-b1f2-b38552d30bef-metrics-tls\") pod \"dns-default-9wm7s\" (UID: \"c42d2b9c-d394-4e63-b1f2-b38552d30bef\") " pod="openshift-dns/dns-default-9wm7s" Jul 13 14:21:24.309276 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.309030 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-tls\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:24.309276 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.309052 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-bound-sa-token\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:24.309276 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.309096 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79vcd\" (UniqueName: \"kubernetes.io/projected/036cc3ac-9400-462a-99f7-1e31413ddd0c-kube-api-access-79vcd\") pod \"ingress-canary-8chnn\" (UID: \"036cc3ac-9400-462a-99f7-1e31413ddd0c\") " pod="openshift-ingress-canary/ingress-canary-8chnn" Jul 13 14:21:24.309276 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.309123 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf7f13a3-6730-4087-8d83-7af27db5e836-image-registry-private-configuration\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:24.309276 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.309167 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndcqx\" (UniqueName: \"kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-kube-api-access-ndcqx\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:24.309276 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:24.309181 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 14:21:24.309276 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:24.309211 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 14:21:24.309276 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:24.309231 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7595b9689d-f94p9: secret "image-registry-tls" not found Jul 13 14:21:24.309646 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:24.309285 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-tls podName:cf7f13a3-6730-4087-8d83-7af27db5e836 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:24.809265487 +0000 UTC m=+37.105268420 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-tls") pod "image-registry-7595b9689d-f94p9" (UID: "cf7f13a3-6730-4087-8d83-7af27db5e836") : secret "image-registry-tls" not found Jul 13 14:21:24.309646 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.309188 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c42d2b9c-d394-4e63-b1f2-b38552d30bef-config-volume\") pod \"dns-default-9wm7s\" (UID: \"c42d2b9c-d394-4e63-b1f2-b38552d30bef\") " pod="openshift-dns/dns-default-9wm7s" Jul 13 14:21:24.309646 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.309327 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c42d2b9c-d394-4e63-b1f2-b38552d30bef-tmp-dir\") pod \"dns-default-9wm7s\" (UID: \"c42d2b9c-d394-4e63-b1f2-b38552d30bef\") " pod="openshift-dns/dns-default-9wm7s" Jul 13 14:21:24.309646 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.309359 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gnqz\" (UniqueName: \"kubernetes.io/projected/c42d2b9c-d394-4e63-b1f2-b38552d30bef-kube-api-access-8gnqz\") pod \"dns-default-9wm7s\" (UID: \"c42d2b9c-d394-4e63-b1f2-b38552d30bef\") " pod="openshift-dns/dns-default-9wm7s" Jul 13 14:21:24.309646 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.309382 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf7f13a3-6730-4087-8d83-7af27db5e836-ca-trust-extracted\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:24.309646 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.309390 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/036cc3ac-9400-462a-99f7-1e31413ddd0c-cert\") pod \"ingress-canary-8chnn\" (UID: \"036cc3ac-9400-462a-99f7-1e31413ddd0c\") " pod="openshift-ingress-canary/ingress-canary-8chnn" Jul 13 14:21:24.309646 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:24.309427 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c42d2b9c-d394-4e63-b1f2-b38552d30bef-metrics-tls podName:c42d2b9c-d394-4e63-b1f2-b38552d30bef nodeName:}" failed. No retries permitted until 2026-07-13 14:21:24.809413413 +0000 UTC m=+37.105416359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c42d2b9c-d394-4e63-b1f2-b38552d30bef-metrics-tls") pod "dns-default-9wm7s" (UID: "c42d2b9c-d394-4e63-b1f2-b38552d30bef") : secret "dns-default-metrics-tls" not found Jul 13 14:21:24.309646 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.309452 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-certificates\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:24.309646 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.309479 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf7f13a3-6730-4087-8d83-7af27db5e836-installation-pull-secrets\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:24.310079 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.309723 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c42d2b9c-d394-4e63-b1f2-b38552d30bef-config-volume\") pod \"dns-default-9wm7s\" (UID: \"c42d2b9c-d394-4e63-b1f2-b38552d30bef\") " pod="openshift-dns/dns-default-9wm7s" Jul 13 14:21:24.310079 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.309772 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c42d2b9c-d394-4e63-b1f2-b38552d30bef-tmp-dir\") pod \"dns-default-9wm7s\" (UID: \"c42d2b9c-d394-4e63-b1f2-b38552d30bef\") " pod="openshift-dns/dns-default-9wm7s" Jul 13 14:21:24.310079 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.310060 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf7f13a3-6730-4087-8d83-7af27db5e836-trusted-ca\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:24.310974 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.310466 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-certificates\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:24.314270 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.314235 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf7f13a3-6730-4087-8d83-7af27db5e836-image-registry-private-configuration\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:24.314413 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.314239 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf7f13a3-6730-4087-8d83-7af27db5e836-installation-pull-secrets\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:24.314413 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.314345 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/036cc3ac-9400-462a-99f7-1e31413ddd0c-cert\") pod \"ingress-canary-8chnn\" (UID: \"036cc3ac-9400-462a-99f7-1e31413ddd0c\") " pod="openshift-ingress-canary/ingress-canary-8chnn" Jul 13 14:21:24.322113 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.322047 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndcqx\" (UniqueName: \"kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-kube-api-access-ndcqx\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:24.323148 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.323103 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79vcd\" (UniqueName: \"kubernetes.io/projected/036cc3ac-9400-462a-99f7-1e31413ddd0c-kube-api-access-79vcd\") pod \"ingress-canary-8chnn\" (UID: \"036cc3ac-9400-462a-99f7-1e31413ddd0c\") " pod="openshift-ingress-canary/ingress-canary-8chnn" Jul 13 14:21:24.323259 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.323230 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gnqz\" (UniqueName: \"kubernetes.io/projected/c42d2b9c-d394-4e63-b1f2-b38552d30bef-kube-api-access-8gnqz\") pod \"dns-default-9wm7s\" (UID: \"c42d2b9c-d394-4e63-b1f2-b38552d30bef\") " pod="openshift-dns/dns-default-9wm7s" Jul 13 14:21:24.323916 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.323894 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-bound-sa-token\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:24.387274 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.387239 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8chnn" Jul 13 14:21:24.554508 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.554447 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8chnn"] Jul 13 14:21:24.559432 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:21:24.559368 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod036cc3ac_9400_462a_99f7_1e31413ddd0c.slice/crio-2ea7f86ea9be8b5dc7b07233c8545b7b2f57df42dcbd011c3b21e6bfe681936e WatchSource:0}: Error finding container 2ea7f86ea9be8b5dc7b07233c8545b7b2f57df42dcbd011c3b21e6bfe681936e: Status 404 returned error can't find the container with id 2ea7f86ea9be8b5dc7b07233c8545b7b2f57df42dcbd011c3b21e6bfe681936e Jul 13 14:21:24.814372 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.814280 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c42d2b9c-d394-4e63-b1f2-b38552d30bef-metrics-tls\") pod \"dns-default-9wm7s\" (UID: \"c42d2b9c-d394-4e63-b1f2-b38552d30bef\") " pod="openshift-dns/dns-default-9wm7s" Jul 13 14:21:24.814372 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:24.814336 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-tls\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:24.814661 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:24.814453 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 14:21:24.814661 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:24.814479 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 14:21:24.814661 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:24.814490 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7595b9689d-f94p9: secret "image-registry-tls" not found Jul 13 14:21:24.814661 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:24.814536 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c42d2b9c-d394-4e63-b1f2-b38552d30bef-metrics-tls podName:c42d2b9c-d394-4e63-b1f2-b38552d30bef nodeName:}" failed. No retries permitted until 2026-07-13 14:21:25.814514939 +0000 UTC m=+38.110517873 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c42d2b9c-d394-4e63-b1f2-b38552d30bef-metrics-tls") pod "dns-default-9wm7s" (UID: "c42d2b9c-d394-4e63-b1f2-b38552d30bef") : secret "dns-default-metrics-tls" not found Jul 13 14:21:24.814661 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:24.814558 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-tls podName:cf7f13a3-6730-4087-8d83-7af27db5e836 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:25.814548169 +0000 UTC m=+38.110551107 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-tls") pod "image-registry-7595b9689d-f94p9" (UID: "cf7f13a3-6730-4087-8d83-7af27db5e836") : secret "image-registry-tls" not found Jul 13 14:21:25.196424 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.196359 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:21:25.196424 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.196387 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:21:25.196424 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.196398 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:21:25.201036 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.201008 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 14:21:25.201163 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.201042 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 14:21:25.202283 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.202025 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 14:21:25.202283 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.202074 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 14:21:25.202283 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.202085 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hslvn\"" Jul 13 14:21:25.202283 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.202034 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5z6w6\"" Jul 13 14:21:25.353536 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.353492 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8chnn" event={"ID":"036cc3ac-9400-462a-99f7-1e31413ddd0c","Type":"ContainerStarted","Data":"2ea7f86ea9be8b5dc7b07233c8545b7b2f57df42dcbd011c3b21e6bfe681936e"} Jul 13 14:21:25.421868 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.421520 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-p6ch2"] Jul 13 14:21:25.425829 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.425793 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kdz7l"] Jul 13 14:21:25.426133 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.426101 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-p6ch2" Jul 13 14:21:25.428829 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.428807 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-g27j9\"" Jul 13 14:21:25.429002 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.428983 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-j7xs5"] Jul 13 14:21:25.429106 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.429088 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kdz7l" Jul 13 14:21:25.431715 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.431692 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 13 14:21:25.432020 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.432001 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jv7fc"] Jul 13 14:21:25.432113 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.432097 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 13 14:21:25.432187 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.432097 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-swfms\"" Jul 13 14:21:25.432259 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.432237 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-j7xs5" Jul 13 14:21:25.434738 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.434721 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fgts2\"" Jul 13 14:21:25.441935 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.436042 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-nm6zq"] Jul 13 14:21:25.441935 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.438005 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 13 14:21:25.441935 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.438716 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 13 14:21:25.441935 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.438963 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 13 14:21:25.441935 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.439335 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jv7fc" Jul 13 14:21:25.441935 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.439786 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-nm6zq" Jul 13 14:21:25.444078 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.444051 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 13 14:21:25.445235 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.445210 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-p6ch2"] Jul 13 14:21:25.446750 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.446686 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jv7fc"] Jul 13 14:21:25.449501 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.449483 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-j7xs5"] Jul 13 14:21:25.450392 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.450352 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 13 14:21:25.450813 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.450793 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 13 14:21:25.450906 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.450855 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 13 14:21:25.451054 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.451035 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xf9p7\"" Jul 13 14:21:25.451247 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.451142 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-c7d7n\"" Jul 13 14:21:25.451489 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.451470 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 13 14:21:25.451686 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.451668 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 13 14:21:25.451764 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.451197 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-nm6zq"] Jul 13 14:21:25.451932 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.451916 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 13 14:21:25.452334 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.452291 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 13 14:21:25.452623 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.451463 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 13 14:21:25.454925 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.454900 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 13 14:21:25.456411 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.456389 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kdz7l"] Jul 13 14:21:25.520640 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.520578 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/438d0107-45d7-482f-8ee7-da3e9dafb3e7-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-j7xs5\" (UID: \"438d0107-45d7-482f-8ee7-da3e9dafb3e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-j7xs5" Jul 13 14:21:25.520810 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.520649 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbbmq\" (UniqueName: \"kubernetes.io/projected/e855d2f8-93c3-44a2-990e-173213d93499-kube-api-access-nbbmq\") pod \"insights-operator-68d9dd94cf-nm6zq\" (UID: \"e855d2f8-93c3-44a2-990e-173213d93499\") " pod="openshift-insights/insights-operator-68d9dd94cf-nm6zq" Jul 13 14:21:25.520810 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.520680 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vrv6\" (UniqueName: \"kubernetes.io/projected/55e1a48a-1dac-4918-bf4e-37ddef118aa5-kube-api-access-6vrv6\") pod \"service-ca-operator-7695fc6c8c-jv7fc\" (UID: \"55e1a48a-1dac-4918-bf4e-37ddef118aa5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jv7fc" Jul 13 14:21:25.520810 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.520742 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7wtt\" (UniqueName: \"kubernetes.io/projected/aff8e8d8-6f56-4c8e-8cec-310e90c4fd5a-kube-api-access-s7wtt\") pod \"volume-data-source-validator-78495597f6-kdz7l\" (UID: \"aff8e8d8-6f56-4c8e-8cec-310e90c4fd5a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kdz7l" Jul 13 14:21:25.520810 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.520775 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55e1a48a-1dac-4918-bf4e-37ddef118aa5-serving-cert\") pod \"service-ca-operator-7695fc6c8c-jv7fc\" (UID: \"55e1a48a-1dac-4918-bf4e-37ddef118aa5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jv7fc" Jul 13 14:21:25.521039 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.520850 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55e1a48a-1dac-4918-bf4e-37ddef118aa5-config\") pod \"service-ca-operator-7695fc6c8c-jv7fc\" (UID: \"55e1a48a-1dac-4918-bf4e-37ddef118aa5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jv7fc" Jul 13 14:21:25.521039 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.520881 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf4n4\" (UniqueName: \"kubernetes.io/projected/2d3160b9-84e9-4848-8f67-1913c1a6eeb1-kube-api-access-tf4n4\") pod \"network-check-source-869dcfcdcd-p6ch2\" (UID: \"2d3160b9-84e9-4848-8f67-1913c1a6eeb1\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-p6ch2" Jul 13 14:21:25.521039 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.520962 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e855d2f8-93c3-44a2-990e-173213d93499-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-nm6zq\" (UID: \"e855d2f8-93c3-44a2-990e-173213d93499\") " pod="openshift-insights/insights-operator-68d9dd94cf-nm6zq" Jul 13 14:21:25.521039 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.521010 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5s8x\" (UniqueName: \"kubernetes.io/projected/438d0107-45d7-482f-8ee7-da3e9dafb3e7-kube-api-access-w5s8x\") pod \"kube-storage-version-migrator-operator-799cb7f958-j7xs5\" (UID: \"438d0107-45d7-482f-8ee7-da3e9dafb3e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-j7xs5" Jul 13 14:21:25.521237 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.521063 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e855d2f8-93c3-44a2-990e-173213d93499-serving-cert\") pod \"insights-operator-68d9dd94cf-nm6zq\" (UID: \"e855d2f8-93c3-44a2-990e-173213d93499\") " pod="openshift-insights/insights-operator-68d9dd94cf-nm6zq" Jul 13 14:21:25.521237 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.521140 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e855d2f8-93c3-44a2-990e-173213d93499-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-nm6zq\" (UID: \"e855d2f8-93c3-44a2-990e-173213d93499\") " pod="openshift-insights/insights-operator-68d9dd94cf-nm6zq" Jul 13 14:21:25.521237 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.521173 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e855d2f8-93c3-44a2-990e-173213d93499-tmp\") pod \"insights-operator-68d9dd94cf-nm6zq\" (UID: \"e855d2f8-93c3-44a2-990e-173213d93499\") " pod="openshift-insights/insights-operator-68d9dd94cf-nm6zq" Jul 13 14:21:25.521237 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.521200 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e855d2f8-93c3-44a2-990e-173213d93499-snapshots\") pod \"insights-operator-68d9dd94cf-nm6zq\" (UID: \"e855d2f8-93c3-44a2-990e-173213d93499\") " pod="openshift-insights/insights-operator-68d9dd94cf-nm6zq" Jul 13 14:21:25.521434 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.521293 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/438d0107-45d7-482f-8ee7-da3e9dafb3e7-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-j7xs5\" (UID: \"438d0107-45d7-482f-8ee7-da3e9dafb3e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-j7xs5" Jul 13 14:21:25.526859 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.526796 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mhprm"] Jul 13 14:21:25.530409 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.530389 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mhprm" Jul 13 14:21:25.531912 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.531886 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-66xjj"] Jul 13 14:21:25.534956 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.534935 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8v2dl"] Jul 13 14:21:25.535129 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.535108 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-66xjj" Jul 13 14:21:25.537559 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.537538 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 13 14:21:25.537680 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.537538 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4gc6f\"" Jul 13 14:21:25.539103 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.539081 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-dbcbf69c6-pxjzx"] Jul 13 14:21:25.539216 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.539200 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8v2dl" Jul 13 14:21:25.541194 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.540902 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 13 14:21:25.542452 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.542305 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 13 14:21:25.542452 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.542354 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 13 14:21:25.542984 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.542967 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:25.544157 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.544137 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 13 14:21:25.544242 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.544205 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 13 14:21:25.544371 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.544347 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 13 14:21:25.544515 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.544494 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hzvfq\"" Jul 13 14:21:25.544636 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.544615 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-grvhk\"" Jul 13 14:21:25.546781 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.546763 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 13 14:21:25.549025 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.549004 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 13 14:21:25.549222 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.549207 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 13 14:21:25.549641 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.549621 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-b4sx8\"" Jul 13 14:21:25.550623 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.550603 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-66xjj"] Jul 13 14:21:25.551263 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.551244 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 13 14:21:25.551263 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.551257 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 13 14:21:25.551395 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.551299 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 13 14:21:25.551615 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.551574 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 13 14:21:25.552050 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.552031 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8v2dl"] Jul 13 14:21:25.552773 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.552753 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 13 14:21:25.557571 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.557522 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mhprm"] Jul 13 14:21:25.562897 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.562875 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-dbcbf69c6-pxjzx"] Jul 13 14:21:25.621892 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.621861 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/763621c1-55cf-4798-a6a2-f75362fc8d46-nginx-conf\") pod \"networking-console-plugin-6cf856758c-66xjj\" (UID: \"763621c1-55cf-4798-a6a2-f75362fc8d46\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-66xjj" Jul 13 14:21:25.622050 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.621902 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c99e821-79c3-439a-b51b-46cd0ad8b03c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-mhprm\" (UID: \"7c99e821-79c3-439a-b51b-46cd0ad8b03c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mhprm" Jul 13 14:21:25.622050 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.621995 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e855d2f8-93c3-44a2-990e-173213d93499-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-nm6zq\" (UID: \"e855d2f8-93c3-44a2-990e-173213d93499\") " pod="openshift-insights/insights-operator-68d9dd94cf-nm6zq" Jul 13 14:21:25.622050 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.622035 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e855d2f8-93c3-44a2-990e-173213d93499-tmp\") pod \"insights-operator-68d9dd94cf-nm6zq\" (UID: \"e855d2f8-93c3-44a2-990e-173213d93499\") " pod="openshift-insights/insights-operator-68d9dd94cf-nm6zq" Jul 13 14:21:25.622227 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.622061 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e855d2f8-93c3-44a2-990e-173213d93499-snapshots\") pod \"insights-operator-68d9dd94cf-nm6zq\" (UID: \"e855d2f8-93c3-44a2-990e-173213d93499\") " pod="openshift-insights/insights-operator-68d9dd94cf-nm6zq" Jul 13 14:21:25.622227 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.622103 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/438d0107-45d7-482f-8ee7-da3e9dafb3e7-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-j7xs5\" (UID: \"438d0107-45d7-482f-8ee7-da3e9dafb3e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-j7xs5" Jul 13 14:21:25.622227 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.622139 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-service-ca-bundle\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:25.622227 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.622184 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7dddf921-be00-47b1-8827-f312b3b96497-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8v2dl\" (UID: \"7dddf921-be00-47b1-8827-f312b3b96497\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8v2dl" Jul 13 14:21:25.623553 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.623431 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e855d2f8-93c3-44a2-990e-173213d93499-snapshots\") pod \"insights-operator-68d9dd94cf-nm6zq\" (UID: \"e855d2f8-93c3-44a2-990e-173213d93499\") " pod="openshift-insights/insights-operator-68d9dd94cf-nm6zq" Jul 13 14:21:25.625110 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.625080 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e855d2f8-93c3-44a2-990e-173213d93499-tmp\") pod \"insights-operator-68d9dd94cf-nm6zq\" (UID: \"e855d2f8-93c3-44a2-990e-173213d93499\") " pod="openshift-insights/insights-operator-68d9dd94cf-nm6zq" Jul 13 14:21:25.625237 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.625160 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/438d0107-45d7-482f-8ee7-da3e9dafb3e7-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-j7xs5\" (UID: \"438d0107-45d7-482f-8ee7-da3e9dafb3e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-j7xs5" Jul 13 14:21:25.625237 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.625215 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbbmq\" (UniqueName: \"kubernetes.io/projected/e855d2f8-93c3-44a2-990e-173213d93499-kube-api-access-nbbmq\") pod \"insights-operator-68d9dd94cf-nm6zq\" (UID: \"e855d2f8-93c3-44a2-990e-173213d93499\") " pod="openshift-insights/insights-operator-68d9dd94cf-nm6zq" Jul 13 14:21:25.625360 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.625255 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vrv6\" (UniqueName: \"kubernetes.io/projected/55e1a48a-1dac-4918-bf4e-37ddef118aa5-kube-api-access-6vrv6\") pod \"service-ca-operator-7695fc6c8c-jv7fc\" (UID: \"55e1a48a-1dac-4918-bf4e-37ddef118aa5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jv7fc" Jul 13 14:21:25.625360 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.625295 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-stats-auth\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:25.625360 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.625339 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/763621c1-55cf-4798-a6a2-f75362fc8d46-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-66xjj\" (UID: \"763621c1-55cf-4798-a6a2-f75362fc8d46\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-66xjj" Jul 13 14:21:25.625506 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.625374 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cwt9\" (UniqueName: \"kubernetes.io/projected/7c99e821-79c3-439a-b51b-46cd0ad8b03c-kube-api-access-4cwt9\") pod \"cluster-monitoring-operator-5f7f494dd4-mhprm\" (UID: \"7c99e821-79c3-439a-b51b-46cd0ad8b03c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mhprm" Jul 13 14:21:25.625506 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.625403 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm9dp\" (UniqueName: \"kubernetes.io/projected/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-kube-api-access-qm9dp\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:25.625506 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.625450 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7wtt\" (UniqueName: \"kubernetes.io/projected/aff8e8d8-6f56-4c8e-8cec-310e90c4fd5a-kube-api-access-s7wtt\") pod \"volume-data-source-validator-78495597f6-kdz7l\" (UID: \"aff8e8d8-6f56-4c8e-8cec-310e90c4fd5a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kdz7l" Jul 13 14:21:25.625506 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.625487 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2smw\" (UniqueName: \"kubernetes.io/projected/7dddf921-be00-47b1-8827-f312b3b96497-kube-api-access-j2smw\") pod \"cluster-samples-operator-65db858894-8v2dl\" (UID: \"7dddf921-be00-47b1-8827-f312b3b96497\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8v2dl" Jul 13 14:21:25.625719 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.625523 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55e1a48a-1dac-4918-bf4e-37ddef118aa5-serving-cert\") pod \"service-ca-operator-7695fc6c8c-jv7fc\" (UID: \"55e1a48a-1dac-4918-bf4e-37ddef118aa5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jv7fc" Jul 13 14:21:25.625719 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.625572 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55e1a48a-1dac-4918-bf4e-37ddef118aa5-config\") pod \"service-ca-operator-7695fc6c8c-jv7fc\" (UID: \"55e1a48a-1dac-4918-bf4e-37ddef118aa5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jv7fc" Jul 13 14:21:25.625719 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.625638 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf4n4\" (UniqueName: \"kubernetes.io/projected/2d3160b9-84e9-4848-8f67-1913c1a6eeb1-kube-api-access-tf4n4\") pod \"network-check-source-869dcfcdcd-p6ch2\" (UID: \"2d3160b9-84e9-4848-8f67-1913c1a6eeb1\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-p6ch2" Jul 13 14:21:25.625719 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.625680 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-metrics-certs\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:25.625902 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.625754 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e855d2f8-93c3-44a2-990e-173213d93499-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-nm6zq\" (UID: \"e855d2f8-93c3-44a2-990e-173213d93499\") " pod="openshift-insights/insights-operator-68d9dd94cf-nm6zq" Jul 13 14:21:25.625902 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.625795 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5s8x\" (UniqueName: \"kubernetes.io/projected/438d0107-45d7-482f-8ee7-da3e9dafb3e7-kube-api-access-w5s8x\") pod \"kube-storage-version-migrator-operator-799cb7f958-j7xs5\" (UID: \"438d0107-45d7-482f-8ee7-da3e9dafb3e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-j7xs5" Jul 13 14:21:25.625902 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.625865 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e855d2f8-93c3-44a2-990e-173213d93499-serving-cert\") pod \"insights-operator-68d9dd94cf-nm6zq\" (UID: \"e855d2f8-93c3-44a2-990e-173213d93499\") " pod="openshift-insights/insights-operator-68d9dd94cf-nm6zq" Jul 13 14:21:25.626032 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.625898 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-default-certificate\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:25.626032 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.625944 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7c99e821-79c3-439a-b51b-46cd0ad8b03c-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-mhprm\" (UID: \"7c99e821-79c3-439a-b51b-46cd0ad8b03c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mhprm" Jul 13 14:21:25.626470 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.626444 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e855d2f8-93c3-44a2-990e-173213d93499-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-nm6zq\" (UID: \"e855d2f8-93c3-44a2-990e-173213d93499\") " pod="openshift-insights/insights-operator-68d9dd94cf-nm6zq" Jul 13 14:21:25.629611 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.626553 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-qhxl5"] Jul 13 14:21:25.629611 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.627195 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55e1a48a-1dac-4918-bf4e-37ddef118aa5-config\") pod \"service-ca-operator-7695fc6c8c-jv7fc\" (UID: \"55e1a48a-1dac-4918-bf4e-37ddef118aa5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jv7fc" Jul 13 14:21:25.629611 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.627384 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e855d2f8-93c3-44a2-990e-173213d93499-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-nm6zq\" (UID: \"e855d2f8-93c3-44a2-990e-173213d93499\") " pod="openshift-insights/insights-operator-68d9dd94cf-nm6zq" Jul 13 14:21:25.629611 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.628364 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/438d0107-45d7-482f-8ee7-da3e9dafb3e7-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-j7xs5\" (UID: \"438d0107-45d7-482f-8ee7-da3e9dafb3e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-j7xs5" Jul 13 14:21:25.632924 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.632902 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-qhxl5" Jul 13 14:21:25.633938 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.633914 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55e1a48a-1dac-4918-bf4e-37ddef118aa5-serving-cert\") pod \"service-ca-operator-7695fc6c8c-jv7fc\" (UID: \"55e1a48a-1dac-4918-bf4e-37ddef118aa5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jv7fc" Jul 13 14:21:25.634629 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.634607 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e855d2f8-93c3-44a2-990e-173213d93499-serving-cert\") pod \"insights-operator-68d9dd94cf-nm6zq\" (UID: \"e855d2f8-93c3-44a2-990e-173213d93499\") " pod="openshift-insights/insights-operator-68d9dd94cf-nm6zq" Jul 13 14:21:25.634840 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.634822 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/438d0107-45d7-482f-8ee7-da3e9dafb3e7-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-j7xs5\" (UID: \"438d0107-45d7-482f-8ee7-da3e9dafb3e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-j7xs5" Jul 13 14:21:25.637038 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.636911 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 13 14:21:25.637038 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.636911 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 13 14:21:25.637777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.637470 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 13 14:21:25.637777 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.637606 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-265mc\"" Jul 13 14:21:25.637995 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.637977 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 13 14:21:25.645379 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.645358 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 13 14:21:25.657805 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.654831 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbbmq\" (UniqueName: \"kubernetes.io/projected/e855d2f8-93c3-44a2-990e-173213d93499-kube-api-access-nbbmq\") pod \"insights-operator-68d9dd94cf-nm6zq\" (UID: \"e855d2f8-93c3-44a2-990e-173213d93499\") " pod="openshift-insights/insights-operator-68d9dd94cf-nm6zq" Jul 13 14:21:25.657805 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.655264 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vrv6\" (UniqueName: \"kubernetes.io/projected/55e1a48a-1dac-4918-bf4e-37ddef118aa5-kube-api-access-6vrv6\") pod \"service-ca-operator-7695fc6c8c-jv7fc\" (UID: \"55e1a48a-1dac-4918-bf4e-37ddef118aa5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jv7fc" Jul 13 14:21:25.658324 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.658248 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-qhxl5"] Jul 13 14:21:25.661098 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.661075 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5s8x\" (UniqueName: \"kubernetes.io/projected/438d0107-45d7-482f-8ee7-da3e9dafb3e7-kube-api-access-w5s8x\") pod \"kube-storage-version-migrator-operator-799cb7f958-j7xs5\" (UID: \"438d0107-45d7-482f-8ee7-da3e9dafb3e7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-j7xs5" Jul 13 14:21:25.661190 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.661104 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf4n4\" (UniqueName: \"kubernetes.io/projected/2d3160b9-84e9-4848-8f67-1913c1a6eeb1-kube-api-access-tf4n4\") pod \"network-check-source-869dcfcdcd-p6ch2\" (UID: \"2d3160b9-84e9-4848-8f67-1913c1a6eeb1\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-p6ch2" Jul 13 14:21:25.661661 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.661624 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7wtt\" (UniqueName: \"kubernetes.io/projected/aff8e8d8-6f56-4c8e-8cec-310e90c4fd5a-kube-api-access-s7wtt\") pod \"volume-data-source-validator-78495597f6-kdz7l\" (UID: \"aff8e8d8-6f56-4c8e-8cec-310e90c4fd5a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kdz7l" Jul 13 14:21:25.727182 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.727089 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/763621c1-55cf-4798-a6a2-f75362fc8d46-nginx-conf\") pod \"networking-console-plugin-6cf856758c-66xjj\" (UID: \"763621c1-55cf-4798-a6a2-f75362fc8d46\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-66xjj" Jul 13 14:21:25.727474 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.727440 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c99e821-79c3-439a-b51b-46cd0ad8b03c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-mhprm\" (UID: \"7c99e821-79c3-439a-b51b-46cd0ad8b03c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mhprm" Jul 13 14:21:25.727630 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.727517 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80da8d62-eca0-42fe-b858-813173b67f1a-trusted-ca\") pod \"console-operator-7866497494-qhxl5\" (UID: \"80da8d62-eca0-42fe-b858-813173b67f1a\") " pod="openshift-console-operator/console-operator-7866497494-qhxl5" Jul 13 14:21:25.727630 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.727576 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-service-ca-bundle\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:25.727630 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:25.727622 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 14:21:25.727798 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.727657 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7dddf921-be00-47b1-8827-f312b3b96497-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8v2dl\" (UID: \"7dddf921-be00-47b1-8827-f312b3b96497\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8v2dl" Jul 13 14:21:25.727798 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.727719 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80da8d62-eca0-42fe-b858-813173b67f1a-config\") pod \"console-operator-7866497494-qhxl5\" (UID: \"80da8d62-eca0-42fe-b858-813173b67f1a\") " pod="openshift-console-operator/console-operator-7866497494-qhxl5" Jul 13 14:21:25.727798 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:25.727731 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-service-ca-bundle podName:7e7fe954-9a11-4bc8-a29f-c8d9a04b833f nodeName:}" failed. No retries permitted until 2026-07-13 14:21:26.227711434 +0000 UTC m=+38.523714379 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-service-ca-bundle") pod "router-default-dbcbf69c6-pxjzx" (UID: "7e7fe954-9a11-4bc8-a29f-c8d9a04b833f") : configmap references non-existent config key: service-ca.crt Jul 13 14:21:25.727798 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:25.727763 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c99e821-79c3-439a-b51b-46cd0ad8b03c-cluster-monitoring-operator-tls podName:7c99e821-79c3-439a-b51b-46cd0ad8b03c nodeName:}" failed. No retries permitted until 2026-07-13 14:21:26.227751628 +0000 UTC m=+38.523754566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7c99e821-79c3-439a-b51b-46cd0ad8b03c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-mhprm" (UID: "7c99e821-79c3-439a-b51b-46cd0ad8b03c") : secret "cluster-monitoring-operator-tls" not found Jul 13 14:21:25.727798 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:25.727781 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 14:21:25.727798 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.727797 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-stats-auth\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:25.728092 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:25.727823 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dddf921-be00-47b1-8827-f312b3b96497-samples-operator-tls podName:7dddf921-be00-47b1-8827-f312b3b96497 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:26.227806558 +0000 UTC m=+38.523809490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7dddf921-be00-47b1-8827-f312b3b96497-samples-operator-tls") pod "cluster-samples-operator-65db858894-8v2dl" (UID: "7dddf921-be00-47b1-8827-f312b3b96497") : secret "samples-operator-tls" not found Jul 13 14:21:25.728092 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.727855 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/763621c1-55cf-4798-a6a2-f75362fc8d46-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-66xjj\" (UID: \"763621c1-55cf-4798-a6a2-f75362fc8d46\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-66xjj" Jul 13 14:21:25.728092 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.727876 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/763621c1-55cf-4798-a6a2-f75362fc8d46-nginx-conf\") pod \"networking-console-plugin-6cf856758c-66xjj\" (UID: \"763621c1-55cf-4798-a6a2-f75362fc8d46\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-66xjj" Jul 13 14:21:25.728092 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.727885 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cwt9\" (UniqueName: \"kubernetes.io/projected/7c99e821-79c3-439a-b51b-46cd0ad8b03c-kube-api-access-4cwt9\") pod \"cluster-monitoring-operator-5f7f494dd4-mhprm\" (UID: \"7c99e821-79c3-439a-b51b-46cd0ad8b03c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mhprm" Jul 13 14:21:25.728092 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.727913 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm9dp\" (UniqueName: \"kubernetes.io/projected/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-kube-api-access-qm9dp\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:25.728092 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.727949 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2smw\" (UniqueName: \"kubernetes.io/projected/7dddf921-be00-47b1-8827-f312b3b96497-kube-api-access-j2smw\") pod \"cluster-samples-operator-65db858894-8v2dl\" (UID: \"7dddf921-be00-47b1-8827-f312b3b96497\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8v2dl" Jul 13 14:21:25.728092 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:25.727960 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 14:21:25.728092 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.727993 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-metrics-certs\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:25.728092 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:25.728001 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/763621c1-55cf-4798-a6a2-f75362fc8d46-networking-console-plugin-cert podName:763621c1-55cf-4798-a6a2-f75362fc8d46 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:26.227988389 +0000 UTC m=+38.523991335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/763621c1-55cf-4798-a6a2-f75362fc8d46-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-66xjj" (UID: "763621c1-55cf-4798-a6a2-f75362fc8d46") : secret "networking-console-plugin-cert" not found Jul 13 14:21:25.728092 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:25.728058 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 14:21:25.728092 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.728064 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80da8d62-eca0-42fe-b858-813173b67f1a-serving-cert\") pod \"console-operator-7866497494-qhxl5\" (UID: \"80da8d62-eca0-42fe-b858-813173b67f1a\") " pod="openshift-console-operator/console-operator-7866497494-qhxl5" Jul 13 14:21:25.728092 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:25.728096 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-metrics-certs podName:7e7fe954-9a11-4bc8-a29f-c8d9a04b833f nodeName:}" failed. No retries permitted until 2026-07-13 14:21:26.228083232 +0000 UTC m=+38.524086168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-metrics-certs") pod "router-default-dbcbf69c6-pxjzx" (UID: "7e7fe954-9a11-4bc8-a29f-c8d9a04b833f") : secret "router-metrics-certs-default" not found Jul 13 14:21:25.728706 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.728202 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7pgf\" (UniqueName: \"kubernetes.io/projected/80da8d62-eca0-42fe-b858-813173b67f1a-kube-api-access-m7pgf\") pod \"console-operator-7866497494-qhxl5\" (UID: \"80da8d62-eca0-42fe-b858-813173b67f1a\") " pod="openshift-console-operator/console-operator-7866497494-qhxl5" Jul 13 14:21:25.728706 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.728258 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-default-certificate\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:25.728706 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.728291 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7c99e821-79c3-439a-b51b-46cd0ad8b03c-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-mhprm\" (UID: \"7c99e821-79c3-439a-b51b-46cd0ad8b03c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mhprm" Jul 13 14:21:25.729246 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.729217 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7c99e821-79c3-439a-b51b-46cd0ad8b03c-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-mhprm\" (UID: \"7c99e821-79c3-439a-b51b-46cd0ad8b03c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mhprm" Jul 13 14:21:25.730994 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.730953 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-default-certificate\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:25.731612 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.731570 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-stats-auth\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:25.744858 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.744644 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-p6ch2" Jul 13 14:21:25.745636 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.745263 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm9dp\" (UniqueName: \"kubernetes.io/projected/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-kube-api-access-qm9dp\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:25.745636 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.745573 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2smw\" (UniqueName: \"kubernetes.io/projected/7dddf921-be00-47b1-8827-f312b3b96497-kube-api-access-j2smw\") pod \"cluster-samples-operator-65db858894-8v2dl\" (UID: \"7dddf921-be00-47b1-8827-f312b3b96497\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8v2dl" Jul 13 14:21:25.747160 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.747133 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cwt9\" (UniqueName: \"kubernetes.io/projected/7c99e821-79c3-439a-b51b-46cd0ad8b03c-kube-api-access-4cwt9\") pod \"cluster-monitoring-operator-5f7f494dd4-mhprm\" (UID: \"7c99e821-79c3-439a-b51b-46cd0ad8b03c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mhprm" Jul 13 14:21:25.764346 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.764087 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kdz7l" Jul 13 14:21:25.774256 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.774224 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-j7xs5" Jul 13 14:21:25.781717 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.781688 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jv7fc" Jul 13 14:21:25.786938 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.786916 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-nm6zq" Jul 13 14:21:25.832907 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.830749 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80da8d62-eca0-42fe-b858-813173b67f1a-config\") pod \"console-operator-7866497494-qhxl5\" (UID: \"80da8d62-eca0-42fe-b858-813173b67f1a\") " pod="openshift-console-operator/console-operator-7866497494-qhxl5" Jul 13 14:21:25.832907 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.830872 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80da8d62-eca0-42fe-b858-813173b67f1a-serving-cert\") pod \"console-operator-7866497494-qhxl5\" (UID: \"80da8d62-eca0-42fe-b858-813173b67f1a\") " pod="openshift-console-operator/console-operator-7866497494-qhxl5" Jul 13 14:21:25.832907 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.830909 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7pgf\" (UniqueName: \"kubernetes.io/projected/80da8d62-eca0-42fe-b858-813173b67f1a-kube-api-access-m7pgf\") pod \"console-operator-7866497494-qhxl5\" (UID: \"80da8d62-eca0-42fe-b858-813173b67f1a\") " pod="openshift-console-operator/console-operator-7866497494-qhxl5" Jul 13 14:21:25.832907 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.830948 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c42d2b9c-d394-4e63-b1f2-b38552d30bef-metrics-tls\") pod \"dns-default-9wm7s\" (UID: \"c42d2b9c-d394-4e63-b1f2-b38552d30bef\") " pod="openshift-dns/dns-default-9wm7s" Jul 13 14:21:25.832907 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.831002 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-tls\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:25.832907 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.831028 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80da8d62-eca0-42fe-b858-813173b67f1a-trusted-ca\") pod \"console-operator-7866497494-qhxl5\" (UID: \"80da8d62-eca0-42fe-b858-813173b67f1a\") " pod="openshift-console-operator/console-operator-7866497494-qhxl5" Jul 13 14:21:25.832907 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:25.833639 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 14:21:25.832907 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:25.833662 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7595b9689d-f94p9: secret "image-registry-tls" not found Jul 13 14:21:25.832907 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:25.833731 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-tls podName:cf7f13a3-6730-4087-8d83-7af27db5e836 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:27.833707536 +0000 UTC m=+40.129710490 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-tls") pod "image-registry-7595b9689d-f94p9" (UID: "cf7f13a3-6730-4087-8d83-7af27db5e836") : secret "image-registry-tls" not found Jul 13 14:21:25.835802 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.835064 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80da8d62-eca0-42fe-b858-813173b67f1a-trusted-ca\") pod \"console-operator-7866497494-qhxl5\" (UID: \"80da8d62-eca0-42fe-b858-813173b67f1a\") " pod="openshift-console-operator/console-operator-7866497494-qhxl5" Jul 13 14:21:25.835802 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:25.835292 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 14:21:25.835802 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:25.835370 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c42d2b9c-d394-4e63-b1f2-b38552d30bef-metrics-tls podName:c42d2b9c-d394-4e63-b1f2-b38552d30bef nodeName:}" failed. No retries permitted until 2026-07-13 14:21:27.835347023 +0000 UTC m=+40.131349958 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c42d2b9c-d394-4e63-b1f2-b38552d30bef-metrics-tls") pod "dns-default-9wm7s" (UID: "c42d2b9c-d394-4e63-b1f2-b38552d30bef") : secret "dns-default-metrics-tls" not found Jul 13 14:21:25.837532 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.837129 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/80da8d62-eca0-42fe-b858-813173b67f1a-config\") pod \"console-operator-7866497494-qhxl5\" (UID: \"80da8d62-eca0-42fe-b858-813173b67f1a\") " pod="openshift-console-operator/console-operator-7866497494-qhxl5" Jul 13 14:21:25.842663 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.842604 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80da8d62-eca0-42fe-b858-813173b67f1a-serving-cert\") pod \"console-operator-7866497494-qhxl5\" (UID: \"80da8d62-eca0-42fe-b858-813173b67f1a\") " pod="openshift-console-operator/console-operator-7866497494-qhxl5" Jul 13 14:21:25.851563 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.851363 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7pgf\" (UniqueName: \"kubernetes.io/projected/80da8d62-eca0-42fe-b858-813173b67f1a-kube-api-access-m7pgf\") pod \"console-operator-7866497494-qhxl5\" (UID: \"80da8d62-eca0-42fe-b858-813173b67f1a\") " pod="openshift-console-operator/console-operator-7866497494-qhxl5" Jul 13 14:21:25.957455 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.957196 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-qhxl5" Jul 13 14:21:25.983787 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:25.983695 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-p6ch2"] Jul 13 14:21:26.017768 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:26.017694 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kdz7l"] Jul 13 14:21:26.022371 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:21:26.022333 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaff8e8d8_6f56_4c8e_8cec_310e90c4fd5a.slice/crio-a60120f6b3e8b35ded5ab23b9ae828ac37e1d25d2762676fe2f3ce5bfc7f6246 WatchSource:0}: Error finding container a60120f6b3e8b35ded5ab23b9ae828ac37e1d25d2762676fe2f3ce5bfc7f6246: Status 404 returned error can't find the container with id a60120f6b3e8b35ded5ab23b9ae828ac37e1d25d2762676fe2f3ce5bfc7f6246 Jul 13 14:21:26.048747 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:26.048716 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jv7fc"] Jul 13 14:21:26.049529 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:26.049478 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-nm6zq"] Jul 13 14:21:26.050751 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:26.050727 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-j7xs5"] Jul 13 14:21:26.055475 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:21:26.055437 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode855d2f8_93c3_44a2_990e_173213d93499.slice/crio-17be4791f027d9e94bd206211f6e2a95e0b80c8fb31b4a667b2a7ec990c3d900 WatchSource:0}: Error finding container 17be4791f027d9e94bd206211f6e2a95e0b80c8fb31b4a667b2a7ec990c3d900: Status 404 returned error can't find the container with id 17be4791f027d9e94bd206211f6e2a95e0b80c8fb31b4a667b2a7ec990c3d900 Jul 13 14:21:26.056479 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:21:26.056337 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55e1a48a_1dac_4918_bf4e_37ddef118aa5.slice/crio-3bfc6f7a7471e279a855b9f564bd5d725f09ddab0fca2b53ff2882569691d367 WatchSource:0}: Error finding container 3bfc6f7a7471e279a855b9f564bd5d725f09ddab0fca2b53ff2882569691d367: Status 404 returned error can't find the container with id 3bfc6f7a7471e279a855b9f564bd5d725f09ddab0fca2b53ff2882569691d367 Jul 13 14:21:26.057685 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:21:26.057460 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod438d0107_45d7_482f_8ee7_da3e9dafb3e7.slice/crio-e0779cb41d462b44a38b147c8b295316a6b6d2b1ec3387f32ee219799251b4e9 WatchSource:0}: Error finding container e0779cb41d462b44a38b147c8b295316a6b6d2b1ec3387f32ee219799251b4e9: Status 404 returned error can't find the container with id e0779cb41d462b44a38b147c8b295316a6b6d2b1ec3387f32ee219799251b4e9 Jul 13 14:21:26.153210 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:26.153129 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-qhxl5"] Jul 13 14:21:26.163728 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:21:26.163696 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80da8d62_eca0_42fe_b858_813173b67f1a.slice/crio-a2a47f40a7d77937f88b1412b4cf4eac37c969509a0f4ba98891d8e94e3562b4 WatchSource:0}: Error finding container a2a47f40a7d77937f88b1412b4cf4eac37c969509a0f4ba98891d8e94e3562b4: Status 404 returned error can't find the container with id a2a47f40a7d77937f88b1412b4cf4eac37c969509a0f4ba98891d8e94e3562b4 Jul 13 14:21:26.237139 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:26.237049 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-metrics-certs\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:26.237638 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:26.237158 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c99e821-79c3-439a-b51b-46cd0ad8b03c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-mhprm\" (UID: \"7c99e821-79c3-439a-b51b-46cd0ad8b03c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mhprm" Jul 13 14:21:26.237638 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:26.237214 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 14:21:26.237638 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:26.237300 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-metrics-certs podName:7e7fe954-9a11-4bc8-a29f-c8d9a04b833f nodeName:}" failed. No retries permitted until 2026-07-13 14:21:27.237278235 +0000 UTC m=+39.533281168 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-metrics-certs") pod "router-default-dbcbf69c6-pxjzx" (UID: "7e7fe954-9a11-4bc8-a29f-c8d9a04b833f") : secret "router-metrics-certs-default" not found Jul 13 14:21:26.237638 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:26.237227 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-service-ca-bundle\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:26.237638 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:26.237327 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 14:21:26.237638 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:26.237348 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7dddf921-be00-47b1-8827-f312b3b96497-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8v2dl\" (UID: \"7dddf921-be00-47b1-8827-f312b3b96497\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8v2dl" Jul 13 14:21:26.237638 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:26.237388 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c99e821-79c3-439a-b51b-46cd0ad8b03c-cluster-monitoring-operator-tls podName:7c99e821-79c3-439a-b51b-46cd0ad8b03c nodeName:}" failed. No retries permitted until 2026-07-13 14:21:27.237369823 +0000 UTC m=+39.533372759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7c99e821-79c3-439a-b51b-46cd0ad8b03c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-mhprm" (UID: "7c99e821-79c3-439a-b51b-46cd0ad8b03c") : secret "cluster-monitoring-operator-tls" not found Jul 13 14:21:26.237638 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:26.237428 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 14:21:26.237638 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:26.237440 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/763621c1-55cf-4798-a6a2-f75362fc8d46-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-66xjj\" (UID: \"763621c1-55cf-4798-a6a2-f75362fc8d46\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-66xjj" Jul 13 14:21:26.237638 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:26.237475 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dddf921-be00-47b1-8827-f312b3b96497-samples-operator-tls podName:7dddf921-be00-47b1-8827-f312b3b96497 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:27.237458612 +0000 UTC m=+39.533461547 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7dddf921-be00-47b1-8827-f312b3b96497-samples-operator-tls") pod "cluster-samples-operator-65db858894-8v2dl" (UID: "7dddf921-be00-47b1-8827-f312b3b96497") : secret "samples-operator-tls" not found Jul 13 14:21:26.237638 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:26.237504 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-service-ca-bundle podName:7e7fe954-9a11-4bc8-a29f-c8d9a04b833f nodeName:}" failed. No retries permitted until 2026-07-13 14:21:27.237494471 +0000 UTC m=+39.533497412 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-service-ca-bundle") pod "router-default-dbcbf69c6-pxjzx" (UID: "7e7fe954-9a11-4bc8-a29f-c8d9a04b833f") : configmap references non-existent config key: service-ca.crt Jul 13 14:21:26.237638 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:26.237511 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 14:21:26.238118 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:26.237546 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/763621c1-55cf-4798-a6a2-f75362fc8d46-networking-console-plugin-cert podName:763621c1-55cf-4798-a6a2-f75362fc8d46 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:27.237534653 +0000 UTC m=+39.533537588 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/763621c1-55cf-4798-a6a2-f75362fc8d46-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-66xjj" (UID: "763621c1-55cf-4798-a6a2-f75362fc8d46") : secret "networking-console-plugin-cert" not found Jul 13 14:21:26.357928 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:26.357886 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kdz7l" event={"ID":"aff8e8d8-6f56-4c8e-8cec-310e90c4fd5a","Type":"ContainerStarted","Data":"a60120f6b3e8b35ded5ab23b9ae828ac37e1d25d2762676fe2f3ce5bfc7f6246"} Jul 13 14:21:26.359229 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:26.359197 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-qhxl5" event={"ID":"80da8d62-eca0-42fe-b858-813173b67f1a","Type":"ContainerStarted","Data":"a2a47f40a7d77937f88b1412b4cf4eac37c969509a0f4ba98891d8e94e3562b4"} Jul 13 14:21:26.360704 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:26.360679 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-nm6zq" event={"ID":"e855d2f8-93c3-44a2-990e-173213d93499","Type":"ContainerStarted","Data":"17be4791f027d9e94bd206211f6e2a95e0b80c8fb31b4a667b2a7ec990c3d900"} Jul 13 14:21:26.365792 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:26.365759 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jv7fc" event={"ID":"55e1a48a-1dac-4918-bf4e-37ddef118aa5","Type":"ContainerStarted","Data":"3bfc6f7a7471e279a855b9f564bd5d725f09ddab0fca2b53ff2882569691d367"} Jul 13 14:21:26.367396 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:26.367369 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-j7xs5" event={"ID":"438d0107-45d7-482f-8ee7-da3e9dafb3e7","Type":"ContainerStarted","Data":"e0779cb41d462b44a38b147c8b295316a6b6d2b1ec3387f32ee219799251b4e9"} Jul 13 14:21:26.368739 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:26.368707 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-p6ch2" event={"ID":"2d3160b9-84e9-4848-8f67-1913c1a6eeb1","Type":"ContainerStarted","Data":"8fd8b4ed626a25abdfa079219eecd4284a223d96ea9998d50445c8c7985dd385"} Jul 13 14:21:27.247694 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:27.247652 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7dddf921-be00-47b1-8827-f312b3b96497-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8v2dl\" (UID: \"7dddf921-be00-47b1-8827-f312b3b96497\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8v2dl" Jul 13 14:21:27.248240 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:27.247726 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/763621c1-55cf-4798-a6a2-f75362fc8d46-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-66xjj\" (UID: \"763621c1-55cf-4798-a6a2-f75362fc8d46\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-66xjj" Jul 13 14:21:27.248240 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:27.247782 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-metrics-certs\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:27.248240 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:27.247817 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 14:21:27.248240 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:27.247874 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c99e821-79c3-439a-b51b-46cd0ad8b03c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-mhprm\" (UID: \"7c99e821-79c3-439a-b51b-46cd0ad8b03c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mhprm" Jul 13 14:21:27.248240 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:27.247885 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 14:21:27.248240 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:27.247897 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 14:21:27.248240 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:27.247900 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dddf921-be00-47b1-8827-f312b3b96497-samples-operator-tls podName:7dddf921-be00-47b1-8827-f312b3b96497 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:29.247877409 +0000 UTC m=+41.543880346 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7dddf921-be00-47b1-8827-f312b3b96497-samples-operator-tls") pod "cluster-samples-operator-65db858894-8v2dl" (UID: "7dddf921-be00-47b1-8827-f312b3b96497") : secret "samples-operator-tls" not found Jul 13 14:21:27.248240 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:27.247969 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-metrics-certs podName:7e7fe954-9a11-4bc8-a29f-c8d9a04b833f nodeName:}" failed. No retries permitted until 2026-07-13 14:21:29.247953593 +0000 UTC m=+41.543956532 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-metrics-certs") pod "router-default-dbcbf69c6-pxjzx" (UID: "7e7fe954-9a11-4bc8-a29f-c8d9a04b833f") : secret "router-metrics-certs-default" not found Jul 13 14:21:27.248240 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:27.247976 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 14:21:27.248240 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:27.247983 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/763621c1-55cf-4798-a6a2-f75362fc8d46-networking-console-plugin-cert podName:763621c1-55cf-4798-a6a2-f75362fc8d46 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:29.24797678 +0000 UTC m=+41.543979712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/763621c1-55cf-4798-a6a2-f75362fc8d46-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-66xjj" (UID: "763621c1-55cf-4798-a6a2-f75362fc8d46") : secret "networking-console-plugin-cert" not found Jul 13 14:21:27.248240 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:27.248021 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c99e821-79c3-439a-b51b-46cd0ad8b03c-cluster-monitoring-operator-tls podName:7c99e821-79c3-439a-b51b-46cd0ad8b03c nodeName:}" failed. No retries permitted until 2026-07-13 14:21:29.248012456 +0000 UTC m=+41.544015387 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7c99e821-79c3-439a-b51b-46cd0ad8b03c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-mhprm" (UID: "7c99e821-79c3-439a-b51b-46cd0ad8b03c") : secret "cluster-monitoring-operator-tls" not found Jul 13 14:21:27.248240 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:27.248072 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-service-ca-bundle\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:27.248769 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:27.248207 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-service-ca-bundle podName:7e7fe954-9a11-4bc8-a29f-c8d9a04b833f nodeName:}" failed. No retries permitted until 2026-07-13 14:21:29.248189842 +0000 UTC m=+41.544192789 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-service-ca-bundle") pod "router-default-dbcbf69c6-pxjzx" (UID: "7e7fe954-9a11-4bc8-a29f-c8d9a04b833f") : configmap references non-existent config key: service-ca.crt Jul 13 14:21:27.854361 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:27.854323 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c42d2b9c-d394-4e63-b1f2-b38552d30bef-metrics-tls\") pod \"dns-default-9wm7s\" (UID: \"c42d2b9c-d394-4e63-b1f2-b38552d30bef\") " pod="openshift-dns/dns-default-9wm7s" Jul 13 14:21:27.854542 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:27.854413 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-tls\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:27.854542 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:27.854493 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 14:21:27.854683 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:27.854570 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 14:21:27.854683 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:27.854603 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7595b9689d-f94p9: secret "image-registry-tls" not found Jul 13 14:21:27.854683 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:27.854574 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c42d2b9c-d394-4e63-b1f2-b38552d30bef-metrics-tls podName:c42d2b9c-d394-4e63-b1f2-b38552d30bef nodeName:}" failed. No retries permitted until 2026-07-13 14:21:31.854552882 +0000 UTC m=+44.150555816 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c42d2b9c-d394-4e63-b1f2-b38552d30bef-metrics-tls") pod "dns-default-9wm7s" (UID: "c42d2b9c-d394-4e63-b1f2-b38552d30bef") : secret "dns-default-metrics-tls" not found Jul 13 14:21:27.854683 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:27.854676 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-tls podName:cf7f13a3-6730-4087-8d83-7af27db5e836 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:31.854658536 +0000 UTC m=+44.150661475 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-tls") pod "image-registry-7595b9689d-f94p9" (UID: "cf7f13a3-6730-4087-8d83-7af27db5e836") : secret "image-registry-tls" not found Jul 13 14:21:29.267999 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:29.267951 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-metrics-certs\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:29.268739 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:29.268074 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c99e821-79c3-439a-b51b-46cd0ad8b03c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-mhprm\" (UID: \"7c99e821-79c3-439a-b51b-46cd0ad8b03c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mhprm" Jul 13 14:21:29.268739 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:29.268153 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-service-ca-bundle\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:29.268739 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:29.268192 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7dddf921-be00-47b1-8827-f312b3b96497-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8v2dl\" (UID: \"7dddf921-be00-47b1-8827-f312b3b96497\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8v2dl" Jul 13 14:21:29.268739 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:29.268250 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/763621c1-55cf-4798-a6a2-f75362fc8d46-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-66xjj\" (UID: \"763621c1-55cf-4798-a6a2-f75362fc8d46\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-66xjj" Jul 13 14:21:29.268739 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:29.268410 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 14:21:29.268739 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:29.268481 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/763621c1-55cf-4798-a6a2-f75362fc8d46-networking-console-plugin-cert podName:763621c1-55cf-4798-a6a2-f75362fc8d46 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:33.268460591 +0000 UTC m=+45.564463537 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/763621c1-55cf-4798-a6a2-f75362fc8d46-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-66xjj" (UID: "763621c1-55cf-4798-a6a2-f75362fc8d46") : secret "networking-console-plugin-cert" not found Jul 13 14:21:29.268739 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:29.268702 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 14:21:29.268739 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:29.268736 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-service-ca-bundle podName:7e7fe954-9a11-4bc8-a29f-c8d9a04b833f nodeName:}" failed. No retries permitted until 2026-07-13 14:21:33.268714526 +0000 UTC m=+45.564717471 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-service-ca-bundle") pod "router-default-dbcbf69c6-pxjzx" (UID: "7e7fe954-9a11-4bc8-a29f-c8d9a04b833f") : configmap references non-existent config key: service-ca.crt Jul 13 14:21:29.269173 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:29.268764 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c99e821-79c3-439a-b51b-46cd0ad8b03c-cluster-monitoring-operator-tls podName:7c99e821-79c3-439a-b51b-46cd0ad8b03c nodeName:}" failed. No retries permitted until 2026-07-13 14:21:33.26875438 +0000 UTC m=+45.564757312 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7c99e821-79c3-439a-b51b-46cd0ad8b03c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-mhprm" (UID: "7c99e821-79c3-439a-b51b-46cd0ad8b03c") : secret "cluster-monitoring-operator-tls" not found Jul 13 14:21:29.269173 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:29.268791 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 14:21:29.269173 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:29.268828 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-metrics-certs podName:7e7fe954-9a11-4bc8-a29f-c8d9a04b833f nodeName:}" failed. No retries permitted until 2026-07-13 14:21:33.268813249 +0000 UTC m=+45.564816206 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-metrics-certs") pod "router-default-dbcbf69c6-pxjzx" (UID: "7e7fe954-9a11-4bc8-a29f-c8d9a04b833f") : secret "router-metrics-certs-default" not found Jul 13 14:21:29.269173 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:29.268846 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 14:21:29.269173 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:29.268883 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dddf921-be00-47b1-8827-f312b3b96497-samples-operator-tls podName:7dddf921-be00-47b1-8827-f312b3b96497 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:33.268871719 +0000 UTC m=+45.564874673 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7dddf921-be00-47b1-8827-f312b3b96497-samples-operator-tls") pod "cluster-samples-operator-65db858894-8v2dl" (UID: "7dddf921-be00-47b1-8827-f312b3b96497") : secret "samples-operator-tls" not found Jul 13 14:21:31.892938 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:31.892858 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c42d2b9c-d394-4e63-b1f2-b38552d30bef-metrics-tls\") pod \"dns-default-9wm7s\" (UID: \"c42d2b9c-d394-4e63-b1f2-b38552d30bef\") " pod="openshift-dns/dns-default-9wm7s" Jul 13 14:21:31.892938 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:31.892931 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-tls\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:31.893372 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:31.893034 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 14:21:31.893372 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:31.893097 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c42d2b9c-d394-4e63-b1f2-b38552d30bef-metrics-tls podName:c42d2b9c-d394-4e63-b1f2-b38552d30bef nodeName:}" failed. No retries permitted until 2026-07-13 14:21:39.893082384 +0000 UTC m=+52.189085319 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c42d2b9c-d394-4e63-b1f2-b38552d30bef-metrics-tls") pod "dns-default-9wm7s" (UID: "c42d2b9c-d394-4e63-b1f2-b38552d30bef") : secret "dns-default-metrics-tls" not found Jul 13 14:21:31.893372 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:31.893037 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 14:21:31.893372 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:31.893132 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7595b9689d-f94p9: secret "image-registry-tls" not found Jul 13 14:21:31.893372 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:31.893169 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-tls podName:cf7f13a3-6730-4087-8d83-7af27db5e836 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:39.893157225 +0000 UTC m=+52.189160174 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-tls") pod "image-registry-7595b9689d-f94p9" (UID: "cf7f13a3-6730-4087-8d83-7af27db5e836") : secret "image-registry-tls" not found Jul 13 14:21:33.306645 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:33.306540 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c99e821-79c3-439a-b51b-46cd0ad8b03c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-mhprm\" (UID: \"7c99e821-79c3-439a-b51b-46cd0ad8b03c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mhprm" Jul 13 14:21:33.307077 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:33.306653 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-service-ca-bundle\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:33.307077 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:33.306688 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7dddf921-be00-47b1-8827-f312b3b96497-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8v2dl\" (UID: \"7dddf921-be00-47b1-8827-f312b3b96497\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8v2dl" Jul 13 14:21:33.307077 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:33.306725 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 14:21:33.307077 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:33.306795 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 14:21:33.307077 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:33.306800 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c99e821-79c3-439a-b51b-46cd0ad8b03c-cluster-monitoring-operator-tls podName:7c99e821-79c3-439a-b51b-46cd0ad8b03c nodeName:}" failed. No retries permitted until 2026-07-13 14:21:41.306780088 +0000 UTC m=+53.602783020 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7c99e821-79c3-439a-b51b-46cd0ad8b03c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-mhprm" (UID: "7c99e821-79c3-439a-b51b-46cd0ad8b03c") : secret "cluster-monitoring-operator-tls" not found Jul 13 14:21:33.307077 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:33.306823 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-service-ca-bundle podName:7e7fe954-9a11-4bc8-a29f-c8d9a04b833f nodeName:}" failed. No retries permitted until 2026-07-13 14:21:41.306813559 +0000 UTC m=+53.602816491 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-service-ca-bundle") pod "router-default-dbcbf69c6-pxjzx" (UID: "7e7fe954-9a11-4bc8-a29f-c8d9a04b833f") : configmap references non-existent config key: service-ca.crt Jul 13 14:21:33.307077 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:33.306844 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dddf921-be00-47b1-8827-f312b3b96497-samples-operator-tls podName:7dddf921-be00-47b1-8827-f312b3b96497 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:41.306831986 +0000 UTC m=+53.602834932 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7dddf921-be00-47b1-8827-f312b3b96497-samples-operator-tls") pod "cluster-samples-operator-65db858894-8v2dl" (UID: "7dddf921-be00-47b1-8827-f312b3b96497") : secret "samples-operator-tls" not found Jul 13 14:21:33.307077 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:33.306841 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/763621c1-55cf-4798-a6a2-f75362fc8d46-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-66xjj\" (UID: \"763621c1-55cf-4798-a6a2-f75362fc8d46\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-66xjj" Jul 13 14:21:33.307077 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:33.306939 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-metrics-certs\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:33.307077 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:33.307011 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 14:21:33.307077 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:33.307046 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 14:21:33.307077 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:33.307067 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/763621c1-55cf-4798-a6a2-f75362fc8d46-networking-console-plugin-cert podName:763621c1-55cf-4798-a6a2-f75362fc8d46 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:41.307053073 +0000 UTC m=+53.603056019 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/763621c1-55cf-4798-a6a2-f75362fc8d46-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-66xjj" (UID: "763621c1-55cf-4798-a6a2-f75362fc8d46") : secret "networking-console-plugin-cert" not found Jul 13 14:21:33.307622 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:33.307085 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-metrics-certs podName:7e7fe954-9a11-4bc8-a29f-c8d9a04b833f nodeName:}" failed. No retries permitted until 2026-07-13 14:21:41.307077927 +0000 UTC m=+53.603080859 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-metrics-certs") pod "router-default-dbcbf69c6-pxjzx" (UID: "7e7fe954-9a11-4bc8-a29f-c8d9a04b833f") : secret "router-metrics-certs-default" not found Jul 13 14:21:35.398080 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.398035 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-nm6zq" event={"ID":"e855d2f8-93c3-44a2-990e-173213d93499","Type":"ContainerStarted","Data":"e84f3e61b0695b756b20d2e2b5f602cec7c80e7917200ee0b49053eab6eaeecc"} Jul 13 14:21:35.399996 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.399967 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jv7fc" event={"ID":"55e1a48a-1dac-4918-bf4e-37ddef118aa5","Type":"ContainerStarted","Data":"ffe8962c62154890d676c891cdb49a7a703801bbf1696804b4aae6c1557277f5"} Jul 13 14:21:35.402533 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.402117 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-j7xs5" event={"ID":"438d0107-45d7-482f-8ee7-da3e9dafb3e7","Type":"ContainerStarted","Data":"c8c66faf70befc6e0670ee6fe507414fc43ff847d155d26a143a2474af2baed3"} Jul 13 14:21:35.403971 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.403937 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-p6ch2" event={"ID":"2d3160b9-84e9-4848-8f67-1913c1a6eeb1","Type":"ContainerStarted","Data":"ae20f7b2c905ac4c6c430d45f6e545976810b9576b2a388232629a6bee5b0553"} Jul 13 14:21:35.407202 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.407177 2568 generic.go:356] "Generic (PLEG): container finished" podID="89fffe89-dde0-4d6b-941c-d4e037ea8364" containerID="664abe3e4f4659ea1dd6cdff41060033c8b79b4cb52177750695619195914e78" exitCode=0 Jul 13 14:21:35.407321 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.407261 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dv99f" event={"ID":"89fffe89-dde0-4d6b-941c-d4e037ea8364","Type":"ContainerDied","Data":"664abe3e4f4659ea1dd6cdff41060033c8b79b4cb52177750695619195914e78"} Jul 13 14:21:35.409097 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.409075 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8chnn" event={"ID":"036cc3ac-9400-462a-99f7-1e31413ddd0c","Type":"ContainerStarted","Data":"e1ca5e12da0d640fbb7ccea8f7a8e82d59452c3378b2c8f737250b2334f34c4a"} Jul 13 14:21:35.411012 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.410806 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kdz7l" event={"ID":"aff8e8d8-6f56-4c8e-8cec-310e90c4fd5a","Type":"ContainerStarted","Data":"b2cb675d718c6263ee684889becd9df27dd724eb8b0a048d2129979d7f743b02"} Jul 13 14:21:35.412835 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.412814 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qhxl5_80da8d62-eca0-42fe-b858-813173b67f1a/console-operator/0.log" Jul 13 14:21:35.412929 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.412852 2568 generic.go:356] "Generic (PLEG): container finished" podID="80da8d62-eca0-42fe-b858-813173b67f1a" containerID="765a40a569838c47021849f9af77e9b4d070cf538ec6cc816c6f0c6044dbfc8b" exitCode=255 Jul 13 14:21:35.412929 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.412885 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-qhxl5" event={"ID":"80da8d62-eca0-42fe-b858-813173b67f1a","Type":"ContainerDied","Data":"765a40a569838c47021849f9af77e9b4d070cf538ec6cc816c6f0c6044dbfc8b"} Jul 13 14:21:35.413178 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.413163 2568 scope.go:117] "RemoveContainer" containerID="765a40a569838c47021849f9af77e9b4d070cf538ec6cc816c6f0c6044dbfc8b" Jul 13 14:21:35.432621 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.432241 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-nm6zq" podStartSLOduration=1.9511573389999999 podStartE2EDuration="10.43222178s" totalImagesPullingTime="8.481064441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:21:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:21:35.431744922 +0000 UTC m=+47.727747897" watchObservedRunningTime="2026-07-13 14:21:35.43222178 +0000 UTC m=+47.728224735" Jul 13 14:21:35.473497 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.471907 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8chnn" podStartSLOduration=1.5368832239999999 podStartE2EDuration="11.471886149s" totalImagesPullingTime="9.935002925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:21:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:21:35.470536949 +0000 UTC m=+47.766539929" watchObservedRunningTime="2026-07-13 14:21:35.471886149 +0000 UTC m=+47.767889105" Jul 13 14:21:35.512233 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.512183 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kdz7l" podStartSLOduration=1.999652084 podStartE2EDuration="10.512162394s" totalImagesPullingTime="8.51251031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:21:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:21:35.51148263 +0000 UTC m=+47.807485584" watchObservedRunningTime="2026-07-13 14:21:35.512162394 +0000 UTC m=+47.808165352" Jul 13 14:21:35.552762 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.552665 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-j7xs5" podStartSLOduration=2.072370593 podStartE2EDuration="10.552644205s" totalImagesPullingTime="8.480273612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:21:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:21:35.551661829 +0000 UTC m=+47.847664784" watchObservedRunningTime="2026-07-13 14:21:35.552644205 +0000 UTC m=+47.848647160" Jul 13 14:21:35.596674 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.595693 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-p6ch2" podStartSLOduration=2.046399654 podStartE2EDuration="10.595670396s" totalImagesPullingTime="8.549270742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:21:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:21:35.595038683 +0000 UTC m=+47.891041641" watchObservedRunningTime="2026-07-13 14:21:35.595670396 +0000 UTC m=+47.891673351" Jul 13 14:21:35.687922 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.687862 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jv7fc" podStartSLOduration=2.207982495 podStartE2EDuration="10.687828291s" totalImagesPullingTime="8.479845796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:21:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:21:35.687193543 +0000 UTC m=+47.983196496" watchObservedRunningTime="2026-07-13 14:21:35.687828291 +0000 UTC m=+47.983831246" Jul 13 14:21:35.853427 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.853389 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ctwq6"] Jul 13 14:21:35.875684 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.875642 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ctwq6"] Jul 13 14:21:35.875859 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.875765 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ctwq6" Jul 13 14:21:35.878714 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.878686 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 13 14:21:35.878859 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.878811 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mcjrd\"" Jul 13 14:21:35.878957 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.878941 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 13 14:21:35.936107 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.936015 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/60f5db48-d091-4d0f-b896-0eab77775965-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctwq6\" (UID: \"60f5db48-d091-4d0f-b896-0eab77775965\") " pod="openshift-insights/insights-runtime-extractor-ctwq6" Jul 13 14:21:35.936274 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.936140 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/60f5db48-d091-4d0f-b896-0eab77775965-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctwq6\" (UID: \"60f5db48-d091-4d0f-b896-0eab77775965\") " pod="openshift-insights/insights-runtime-extractor-ctwq6" Jul 13 14:21:35.936274 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.936174 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/60f5db48-d091-4d0f-b896-0eab77775965-crio-socket\") pod \"insights-runtime-extractor-ctwq6\" (UID: \"60f5db48-d091-4d0f-b896-0eab77775965\") " pod="openshift-insights/insights-runtime-extractor-ctwq6" Jul 13 14:21:35.936274 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.936229 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mbx6\" (UniqueName: \"kubernetes.io/projected/60f5db48-d091-4d0f-b896-0eab77775965-kube-api-access-5mbx6\") pod \"insights-runtime-extractor-ctwq6\" (UID: \"60f5db48-d091-4d0f-b896-0eab77775965\") " pod="openshift-insights/insights-runtime-extractor-ctwq6" Jul 13 14:21:35.936432 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.936283 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/60f5db48-d091-4d0f-b896-0eab77775965-data-volume\") pod \"insights-runtime-extractor-ctwq6\" (UID: \"60f5db48-d091-4d0f-b896-0eab77775965\") " pod="openshift-insights/insights-runtime-extractor-ctwq6" Jul 13 14:21:35.957863 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.957824 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-qhxl5" Jul 13 14:21:35.958036 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:35.957878 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-qhxl5" Jul 13 14:21:36.036958 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:36.036913 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/60f5db48-d091-4d0f-b896-0eab77775965-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctwq6\" (UID: \"60f5db48-d091-4d0f-b896-0eab77775965\") " pod="openshift-insights/insights-runtime-extractor-ctwq6" Jul 13 14:21:36.036958 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:36.036958 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/60f5db48-d091-4d0f-b896-0eab77775965-crio-socket\") pod \"insights-runtime-extractor-ctwq6\" (UID: \"60f5db48-d091-4d0f-b896-0eab77775965\") " pod="openshift-insights/insights-runtime-extractor-ctwq6" Jul 13 14:21:36.037170 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:36.037004 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mbx6\" (UniqueName: \"kubernetes.io/projected/60f5db48-d091-4d0f-b896-0eab77775965-kube-api-access-5mbx6\") pod \"insights-runtime-extractor-ctwq6\" (UID: \"60f5db48-d091-4d0f-b896-0eab77775965\") " pod="openshift-insights/insights-runtime-extractor-ctwq6" Jul 13 14:21:36.037170 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:36.037031 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/60f5db48-d091-4d0f-b896-0eab77775965-data-volume\") pod \"insights-runtime-extractor-ctwq6\" (UID: \"60f5db48-d091-4d0f-b896-0eab77775965\") " pod="openshift-insights/insights-runtime-extractor-ctwq6" Jul 13 14:21:36.037170 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:36.037051 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 14:21:36.037170 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:36.037123 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/60f5db48-d091-4d0f-b896-0eab77775965-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctwq6\" (UID: \"60f5db48-d091-4d0f-b896-0eab77775965\") " pod="openshift-insights/insights-runtime-extractor-ctwq6" Jul 13 14:21:36.037368 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:36.037195 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60f5db48-d091-4d0f-b896-0eab77775965-kube-rbac-proxy-cm podName:60f5db48-d091-4d0f-b896-0eab77775965 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:36.537169949 +0000 UTC m=+48.833172883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/60f5db48-d091-4d0f-b896-0eab77775965-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ctwq6" (UID: "60f5db48-d091-4d0f-b896-0eab77775965") : configmap "kube-rbac-proxy" not found Jul 13 14:21:36.037368 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:36.037231 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/60f5db48-d091-4d0f-b896-0eab77775965-crio-socket\") pod \"insights-runtime-extractor-ctwq6\" (UID: \"60f5db48-d091-4d0f-b896-0eab77775965\") " pod="openshift-insights/insights-runtime-extractor-ctwq6" Jul 13 14:21:36.037368 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:36.037302 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 14:21:36.037368 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:36.037340 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60f5db48-d091-4d0f-b896-0eab77775965-insights-runtime-extractor-tls podName:60f5db48-d091-4d0f-b896-0eab77775965 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:36.537329876 +0000 UTC m=+48.833332808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/60f5db48-d091-4d0f-b896-0eab77775965-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ctwq6" (UID: "60f5db48-d091-4d0f-b896-0eab77775965") : secret "insights-runtime-extractor-tls" not found Jul 13 14:21:36.037559 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:36.037483 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/60f5db48-d091-4d0f-b896-0eab77775965-data-volume\") pod \"insights-runtime-extractor-ctwq6\" (UID: \"60f5db48-d091-4d0f-b896-0eab77775965\") " pod="openshift-insights/insights-runtime-extractor-ctwq6" Jul 13 14:21:36.061268 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:36.061240 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mbx6\" (UniqueName: \"kubernetes.io/projected/60f5db48-d091-4d0f-b896-0eab77775965-kube-api-access-5mbx6\") pod \"insights-runtime-extractor-ctwq6\" (UID: \"60f5db48-d091-4d0f-b896-0eab77775965\") " pod="openshift-insights/insights-runtime-extractor-ctwq6" Jul 13 14:21:36.417940 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:36.417910 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qhxl5_80da8d62-eca0-42fe-b858-813173b67f1a/console-operator/1.log" Jul 13 14:21:36.418311 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:36.418285 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qhxl5_80da8d62-eca0-42fe-b858-813173b67f1a/console-operator/0.log" Jul 13 14:21:36.418366 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:36.418324 2568 generic.go:356] "Generic (PLEG): container finished" podID="80da8d62-eca0-42fe-b858-813173b67f1a" containerID="366c3dec325175a9c6bb9b917e98f84a5e7d52ce0d6586b009560abb129cb948" exitCode=255 Jul 13 14:21:36.418434 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:36.418406 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-qhxl5" event={"ID":"80da8d62-eca0-42fe-b858-813173b67f1a","Type":"ContainerDied","Data":"366c3dec325175a9c6bb9b917e98f84a5e7d52ce0d6586b009560abb129cb948"} Jul 13 14:21:36.418484 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:36.418474 2568 scope.go:117] "RemoveContainer" containerID="765a40a569838c47021849f9af77e9b4d070cf538ec6cc816c6f0c6044dbfc8b" Jul 13 14:21:36.418732 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:36.418711 2568 scope.go:117] "RemoveContainer" containerID="366c3dec325175a9c6bb9b917e98f84a5e7d52ce0d6586b009560abb129cb948" Jul 13 14:21:36.418954 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:36.418932 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-qhxl5_openshift-console-operator(80da8d62-eca0-42fe-b858-813173b67f1a)\"" pod="openshift-console-operator/console-operator-7866497494-qhxl5" podUID="80da8d62-eca0-42fe-b858-813173b67f1a" Jul 13 14:21:36.421659 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:36.421638 2568 generic.go:356] "Generic (PLEG): container finished" podID="89fffe89-dde0-4d6b-941c-d4e037ea8364" containerID="664dc4356afac6e9353acfcdd203ab0d0d1c433263bb27d8c1013098911fd61d" exitCode=0 Jul 13 14:21:36.421754 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:36.421733 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dv99f" event={"ID":"89fffe89-dde0-4d6b-941c-d4e037ea8364","Type":"ContainerDied","Data":"664dc4356afac6e9353acfcdd203ab0d0d1c433263bb27d8c1013098911fd61d"} Jul 13 14:21:36.542456 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:36.542428 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/60f5db48-d091-4d0f-b896-0eab77775965-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctwq6\" (UID: \"60f5db48-d091-4d0f-b896-0eab77775965\") " pod="openshift-insights/insights-runtime-extractor-ctwq6" Jul 13 14:21:36.542572 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:36.542522 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/60f5db48-d091-4d0f-b896-0eab77775965-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctwq6\" (UID: \"60f5db48-d091-4d0f-b896-0eab77775965\") " pod="openshift-insights/insights-runtime-extractor-ctwq6" Jul 13 14:21:36.542572 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:36.542529 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 14:21:36.542714 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:36.542613 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60f5db48-d091-4d0f-b896-0eab77775965-insights-runtime-extractor-tls podName:60f5db48-d091-4d0f-b896-0eab77775965 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:37.542574448 +0000 UTC m=+49.838577393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/60f5db48-d091-4d0f-b896-0eab77775965-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ctwq6" (UID: "60f5db48-d091-4d0f-b896-0eab77775965") : secret "insights-runtime-extractor-tls" not found Jul 13 14:21:36.543624 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:36.543606 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 14:21:36.543719 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:36.543655 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60f5db48-d091-4d0f-b896-0eab77775965-kube-rbac-proxy-cm podName:60f5db48-d091-4d0f-b896-0eab77775965 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:37.54364063 +0000 UTC m=+49.839643567 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/60f5db48-d091-4d0f-b896-0eab77775965-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ctwq6" (UID: "60f5db48-d091-4d0f-b896-0eab77775965") : configmap "kube-rbac-proxy" not found Jul 13 14:21:37.226904 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:37.226877 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s6dr2_0c2dbfef-a3bc-424d-8010-f28cfea8fb4e/dns-node-resolver/0.log" Jul 13 14:21:37.424687 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:37.424652 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b885b748-mz8fv"] Jul 13 14:21:37.436830 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:37.436805 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qhxl5_80da8d62-eca0-42fe-b858-813173b67f1a/console-operator/1.log" Jul 13 14:21:37.437080 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:37.437067 2568 scope.go:117] "RemoveContainer" containerID="366c3dec325175a9c6bb9b917e98f84a5e7d52ce0d6586b009560abb129cb948" Jul 13 14:21:37.437229 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:37.437211 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-qhxl5_openshift-console-operator(80da8d62-eca0-42fe-b858-813173b67f1a)\"" pod="openshift-console-operator/console-operator-7866497494-qhxl5" podUID="80da8d62-eca0-42fe-b858-813173b67f1a" Jul 13 14:21:37.458600 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:37.458558 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b885b748-mz8fv"] Jul 13 14:21:37.458730 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:37.458614 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dv99f" event={"ID":"89fffe89-dde0-4d6b-941c-d4e037ea8364","Type":"ContainerStarted","Data":"cc120662e726f413d93b2ca8ebf67212c1c228939d8b53dfcdc277f1893b46ec"} Jul 13 14:21:37.458730 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:37.458680 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b885b748-mz8fv" Jul 13 14:21:37.462595 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:37.462550 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 13 14:21:37.463547 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:37.463531 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 13 14:21:37.463687 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:37.463530 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-7drxr\"" Jul 13 14:21:37.463687 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:37.463553 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 13 14:21:37.463687 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:37.463573 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 13 14:21:37.470453 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:37.470411 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dv99f" podStartSLOduration=11.784160836 podStartE2EDuration="49.470396899s" totalImagesPullingTime="37.686236063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:20:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:21:37.469453697 +0000 UTC m=+49.765456679" watchObservedRunningTime="2026-07-13 14:21:37.470396899 +0000 UTC m=+49.766399878" Jul 13 14:21:37.553259 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:37.553158 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlfrs\" (UniqueName: \"kubernetes.io/projected/a4537580-e293-4b3e-8695-4d6e7f6cdf37-kube-api-access-hlfrs\") pod \"managed-serviceaccount-addon-agent-7b885b748-mz8fv\" (UID: \"a4537580-e293-4b3e-8695-4d6e7f6cdf37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b885b748-mz8fv" Jul 13 14:21:37.553259 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:37.553206 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/60f5db48-d091-4d0f-b896-0eab77775965-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctwq6\" (UID: \"60f5db48-d091-4d0f-b896-0eab77775965\") " pod="openshift-insights/insights-runtime-extractor-ctwq6" Jul 13 14:21:37.553480 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:37.553292 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/60f5db48-d091-4d0f-b896-0eab77775965-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctwq6\" (UID: \"60f5db48-d091-4d0f-b896-0eab77775965\") " pod="openshift-insights/insights-runtime-extractor-ctwq6" Jul 13 14:21:37.553480 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:37.553372 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 14:21:37.553480 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:37.553428 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 14:21:37.553650 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:37.553448 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60f5db48-d091-4d0f-b896-0eab77775965-insights-runtime-extractor-tls podName:60f5db48-d091-4d0f-b896-0eab77775965 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:39.553428119 +0000 UTC m=+51.849431059 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/60f5db48-d091-4d0f-b896-0eab77775965-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ctwq6" (UID: "60f5db48-d091-4d0f-b896-0eab77775965") : secret "insights-runtime-extractor-tls" not found Jul 13 14:21:37.553650 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:37.553519 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a4537580-e293-4b3e-8695-4d6e7f6cdf37-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b885b748-mz8fv\" (UID: \"a4537580-e293-4b3e-8695-4d6e7f6cdf37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b885b748-mz8fv" Jul 13 14:21:37.553650 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:37.553620 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60f5db48-d091-4d0f-b896-0eab77775965-kube-rbac-proxy-cm podName:60f5db48-d091-4d0f-b896-0eab77775965 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:39.553574779 +0000 UTC m=+51.849577711 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/60f5db48-d091-4d0f-b896-0eab77775965-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ctwq6" (UID: "60f5db48-d091-4d0f-b896-0eab77775965") : configmap "kube-rbac-proxy" not found Jul 13 14:21:37.654359 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:37.654321 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlfrs\" (UniqueName: \"kubernetes.io/projected/a4537580-e293-4b3e-8695-4d6e7f6cdf37-kube-api-access-hlfrs\") pod \"managed-serviceaccount-addon-agent-7b885b748-mz8fv\" (UID: \"a4537580-e293-4b3e-8695-4d6e7f6cdf37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b885b748-mz8fv" Jul 13 14:21:37.654636 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:37.654612 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a4537580-e293-4b3e-8695-4d6e7f6cdf37-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b885b748-mz8fv\" (UID: \"a4537580-e293-4b3e-8695-4d6e7f6cdf37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b885b748-mz8fv" Jul 13 14:21:37.657012 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:37.656988 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a4537580-e293-4b3e-8695-4d6e7f6cdf37-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b885b748-mz8fv\" (UID: \"a4537580-e293-4b3e-8695-4d6e7f6cdf37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b885b748-mz8fv" Jul 13 14:21:37.671349 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:37.671326 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlfrs\" (UniqueName: \"kubernetes.io/projected/a4537580-e293-4b3e-8695-4d6e7f6cdf37-kube-api-access-hlfrs\") pod \"managed-serviceaccount-addon-agent-7b885b748-mz8fv\" (UID: \"a4537580-e293-4b3e-8695-4d6e7f6cdf37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b885b748-mz8fv" Jul 13 14:21:37.783178 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:37.783143 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b885b748-mz8fv" Jul 13 14:21:37.937665 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:37.937634 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b885b748-mz8fv"] Jul 13 14:21:37.941549 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:21:37.941521 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4537580_e293_4b3e_8695_4d6e7f6cdf37.slice/crio-44853720d18f21a3409722e1ace71df4ce829596f6bdb8519b75446d894daced WatchSource:0}: Error finding container 44853720d18f21a3409722e1ace71df4ce829596f6bdb8519b75446d894daced: Status 404 returned error can't find the container with id 44853720d18f21a3409722e1ace71df4ce829596f6bdb8519b75446d894daced Jul 13 14:21:38.425843 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:38.425814 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mn8c6_297ea06e-b94d-4b46-82a4-d3134f30ded1/node-ca/0.log" Jul 13 14:21:38.443078 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:38.443026 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b885b748-mz8fv" event={"ID":"a4537580-e293-4b3e-8695-4d6e7f6cdf37","Type":"ContainerStarted","Data":"44853720d18f21a3409722e1ace71df4ce829596f6bdb8519b75446d894daced"} Jul 13 14:21:38.585842 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:38.585809 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-jffdr"] Jul 13 14:21:38.599528 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:38.599505 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-jffdr" Jul 13 14:21:38.606948 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:38.606926 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 13 14:21:38.607072 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:38.606984 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 13 14:21:38.607663 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:38.607472 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 13 14:21:38.607663 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:38.607631 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 13 14:21:38.608165 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:38.608130 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-zgvjv\"" Jul 13 14:21:38.608314 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:38.608291 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-jffdr"] Jul 13 14:21:38.663347 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:38.663309 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/814a2fa5-07a5-42e0-b304-85f56da72b45-signing-key\") pod \"service-ca-79f68b9f4f-jffdr\" (UID: \"814a2fa5-07a5-42e0-b304-85f56da72b45\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jffdr" Jul 13 14:21:38.663536 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:38.663364 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/814a2fa5-07a5-42e0-b304-85f56da72b45-signing-cabundle\") pod \"service-ca-79f68b9f4f-jffdr\" (UID: \"814a2fa5-07a5-42e0-b304-85f56da72b45\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jffdr" Jul 13 14:21:38.663536 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:38.663481 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rtvs\" (UniqueName: \"kubernetes.io/projected/814a2fa5-07a5-42e0-b304-85f56da72b45-kube-api-access-2rtvs\") pod \"service-ca-79f68b9f4f-jffdr\" (UID: \"814a2fa5-07a5-42e0-b304-85f56da72b45\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jffdr" Jul 13 14:21:38.764703 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:38.764572 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rtvs\" (UniqueName: \"kubernetes.io/projected/814a2fa5-07a5-42e0-b304-85f56da72b45-kube-api-access-2rtvs\") pod \"service-ca-79f68b9f4f-jffdr\" (UID: \"814a2fa5-07a5-42e0-b304-85f56da72b45\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jffdr" Jul 13 14:21:38.764884 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:38.764766 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/814a2fa5-07a5-42e0-b304-85f56da72b45-signing-key\") pod \"service-ca-79f68b9f4f-jffdr\" (UID: \"814a2fa5-07a5-42e0-b304-85f56da72b45\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jffdr" Jul 13 14:21:38.764884 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:38.764812 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/814a2fa5-07a5-42e0-b304-85f56da72b45-signing-cabundle\") pod \"service-ca-79f68b9f4f-jffdr\" (UID: \"814a2fa5-07a5-42e0-b304-85f56da72b45\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jffdr" Jul 13 14:21:38.765538 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:38.765511 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/814a2fa5-07a5-42e0-b304-85f56da72b45-signing-cabundle\") pod \"service-ca-79f68b9f4f-jffdr\" (UID: \"814a2fa5-07a5-42e0-b304-85f56da72b45\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jffdr" Jul 13 14:21:38.767360 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:38.767334 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/814a2fa5-07a5-42e0-b304-85f56da72b45-signing-key\") pod \"service-ca-79f68b9f4f-jffdr\" (UID: \"814a2fa5-07a5-42e0-b304-85f56da72b45\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jffdr" Jul 13 14:21:38.777337 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:38.777308 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rtvs\" (UniqueName: \"kubernetes.io/projected/814a2fa5-07a5-42e0-b304-85f56da72b45-kube-api-access-2rtvs\") pod \"service-ca-79f68b9f4f-jffdr\" (UID: \"814a2fa5-07a5-42e0-b304-85f56da72b45\") " pod="openshift-service-ca/service-ca-79f68b9f4f-jffdr" Jul 13 14:21:38.910567 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:38.910536 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-jffdr" Jul 13 14:21:39.051704 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:39.051626 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-jffdr"] Jul 13 14:21:39.054529 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:21:39.054497 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod814a2fa5_07a5_42e0_b304_85f56da72b45.slice/crio-9e118419aefb25b95e241e5e09c4216b5203b6d269f2f4af0dc9b58fd2511666 WatchSource:0}: Error finding container 9e118419aefb25b95e241e5e09c4216b5203b6d269f2f4af0dc9b58fd2511666: Status 404 returned error can't find the container with id 9e118419aefb25b95e241e5e09c4216b5203b6d269f2f4af0dc9b58fd2511666 Jul 13 14:21:39.226212 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:39.226162 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8chnn_036cc3ac-9400-462a-99f7-1e31413ddd0c/serve-healthcheck-canary/0.log" Jul 13 14:21:39.446876 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:39.446835 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-jffdr" event={"ID":"814a2fa5-07a5-42e0-b304-85f56da72b45","Type":"ContainerStarted","Data":"e22c2887568ecd8bdf0cd6ea7df5e344d8e2e8f19bc3a7b3272af69d6d9f43a6"} Jul 13 14:21:39.447351 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:39.446893 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-jffdr" event={"ID":"814a2fa5-07a5-42e0-b304-85f56da72b45","Type":"ContainerStarted","Data":"9e118419aefb25b95e241e5e09c4216b5203b6d269f2f4af0dc9b58fd2511666"} Jul 13 14:21:39.469541 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:39.469488 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-jffdr" podStartSLOduration=1.469470151 podStartE2EDuration="1.469470151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:21:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:21:39.468196794 +0000 UTC m=+51.764199747" watchObservedRunningTime="2026-07-13 14:21:39.469470151 +0000 UTC m=+51.765473104" Jul 13 14:21:39.573847 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:39.573806 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/60f5db48-d091-4d0f-b896-0eab77775965-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctwq6\" (UID: \"60f5db48-d091-4d0f-b896-0eab77775965\") " pod="openshift-insights/insights-runtime-extractor-ctwq6" Jul 13 14:21:39.574044 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:39.573897 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/60f5db48-d091-4d0f-b896-0eab77775965-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctwq6\" (UID: \"60f5db48-d091-4d0f-b896-0eab77775965\") " pod="openshift-insights/insights-runtime-extractor-ctwq6" Jul 13 14:21:39.574044 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:39.573923 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 14:21:39.574044 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:39.573997 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60f5db48-d091-4d0f-b896-0eab77775965-insights-runtime-extractor-tls podName:60f5db48-d091-4d0f-b896-0eab77775965 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:43.57397681 +0000 UTC m=+55.869979765 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/60f5db48-d091-4d0f-b896-0eab77775965-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ctwq6" (UID: "60f5db48-d091-4d0f-b896-0eab77775965") : secret "insights-runtime-extractor-tls" not found Jul 13 14:21:39.574044 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:39.574012 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 14:21:39.574201 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:39.574057 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60f5db48-d091-4d0f-b896-0eab77775965-kube-rbac-proxy-cm podName:60f5db48-d091-4d0f-b896-0eab77775965 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:43.574042423 +0000 UTC m=+55.870045370 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/60f5db48-d091-4d0f-b896-0eab77775965-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ctwq6" (UID: "60f5db48-d091-4d0f-b896-0eab77775965") : configmap "kube-rbac-proxy" not found Jul 13 14:21:39.977750 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:39.977708 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c42d2b9c-d394-4e63-b1f2-b38552d30bef-metrics-tls\") pod \"dns-default-9wm7s\" (UID: \"c42d2b9c-d394-4e63-b1f2-b38552d30bef\") " pod="openshift-dns/dns-default-9wm7s" Jul 13 14:21:39.977963 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:39.977769 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-tls\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:39.977963 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:39.977880 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 14:21:39.977963 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:39.977900 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7595b9689d-f94p9: secret "image-registry-tls" not found Jul 13 14:21:39.977963 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:39.977913 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 14:21:39.978164 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:39.977976 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c42d2b9c-d394-4e63-b1f2-b38552d30bef-metrics-tls podName:c42d2b9c-d394-4e63-b1f2-b38552d30bef nodeName:}" failed. No retries permitted until 2026-07-13 14:21:55.977955038 +0000 UTC m=+68.273957974 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c42d2b9c-d394-4e63-b1f2-b38552d30bef-metrics-tls") pod "dns-default-9wm7s" (UID: "c42d2b9c-d394-4e63-b1f2-b38552d30bef") : secret "dns-default-metrics-tls" not found Jul 13 14:21:39.978164 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:39.977993 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-tls podName:cf7f13a3-6730-4087-8d83-7af27db5e836 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:55.977985341 +0000 UTC m=+68.273988274 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-tls") pod "image-registry-7595b9689d-f94p9" (UID: "cf7f13a3-6730-4087-8d83-7af27db5e836") : secret "image-registry-tls" not found Jul 13 14:21:41.392716 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:41.392655 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c99e821-79c3-439a-b51b-46cd0ad8b03c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-mhprm\" (UID: \"7c99e821-79c3-439a-b51b-46cd0ad8b03c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mhprm" Jul 13 14:21:41.393224 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:41.392775 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-service-ca-bundle\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:41.393224 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:41.392813 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7dddf921-be00-47b1-8827-f312b3b96497-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8v2dl\" (UID: \"7dddf921-be00-47b1-8827-f312b3b96497\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8v2dl" Jul 13 14:21:41.393224 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:41.392839 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 14:21:41.393224 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:41.392878 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/763621c1-55cf-4798-a6a2-f75362fc8d46-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-66xjj\" (UID: \"763621c1-55cf-4798-a6a2-f75362fc8d46\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-66xjj" Jul 13 14:21:41.393224 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:41.392917 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c99e821-79c3-439a-b51b-46cd0ad8b03c-cluster-monitoring-operator-tls podName:7c99e821-79c3-439a-b51b-46cd0ad8b03c nodeName:}" failed. No retries permitted until 2026-07-13 14:21:57.392896139 +0000 UTC m=+69.688899074 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7c99e821-79c3-439a-b51b-46cd0ad8b03c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-mhprm" (UID: "7c99e821-79c3-439a-b51b-46cd0ad8b03c") : secret "cluster-monitoring-operator-tls" not found Jul 13 14:21:41.393224 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:41.392978 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 13 14:21:41.393224 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:41.393035 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 13 14:21:41.393224 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:41.393037 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/763621c1-55cf-4798-a6a2-f75362fc8d46-networking-console-plugin-cert podName:763621c1-55cf-4798-a6a2-f75362fc8d46 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:57.393020454 +0000 UTC m=+69.689023401 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/763621c1-55cf-4798-a6a2-f75362fc8d46-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-66xjj" (UID: "763621c1-55cf-4798-a6a2-f75362fc8d46") : secret "networking-console-plugin-cert" not found Jul 13 14:21:41.393224 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:41.393073 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-metrics-certs podName:7e7fe954-9a11-4bc8-a29f-c8d9a04b833f nodeName:}" failed. No retries permitted until 2026-07-13 14:21:57.393062853 +0000 UTC m=+69.689065791 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-metrics-certs") pod "router-default-dbcbf69c6-pxjzx" (UID: "7e7fe954-9a11-4bc8-a29f-c8d9a04b833f") : secret "router-metrics-certs-default" not found Jul 13 14:21:41.393224 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:41.393104 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-service-ca-bundle podName:7e7fe954-9a11-4bc8-a29f-c8d9a04b833f nodeName:}" failed. No retries permitted until 2026-07-13 14:21:57.393093185 +0000 UTC m=+69.689096131 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-service-ca-bundle") pod "router-default-dbcbf69c6-pxjzx" (UID: "7e7fe954-9a11-4bc8-a29f-c8d9a04b833f") : configmap references non-existent config key: service-ca.crt Jul 13 14:21:41.393224 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:41.393181 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 14:21:41.393224 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:41.393211 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dddf921-be00-47b1-8827-f312b3b96497-samples-operator-tls podName:7dddf921-be00-47b1-8827-f312b3b96497 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:57.393202188 +0000 UTC m=+69.689205134 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7dddf921-be00-47b1-8827-f312b3b96497-samples-operator-tls") pod "cluster-samples-operator-65db858894-8v2dl" (UID: "7dddf921-be00-47b1-8827-f312b3b96497") : secret "samples-operator-tls" not found Jul 13 14:21:41.393875 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:41.392975 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-metrics-certs\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:43.615448 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:43.615400 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/60f5db48-d091-4d0f-b896-0eab77775965-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctwq6\" (UID: \"60f5db48-d091-4d0f-b896-0eab77775965\") " pod="openshift-insights/insights-runtime-extractor-ctwq6" Jul 13 14:21:43.616058 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:43.615502 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/60f5db48-d091-4d0f-b896-0eab77775965-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctwq6\" (UID: \"60f5db48-d091-4d0f-b896-0eab77775965\") " pod="openshift-insights/insights-runtime-extractor-ctwq6" Jul 13 14:21:43.616058 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:43.615600 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 14:21:43.616058 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:21:43.615723 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60f5db48-d091-4d0f-b896-0eab77775965-insights-runtime-extractor-tls podName:60f5db48-d091-4d0f-b896-0eab77775965 nodeName:}" failed. No retries permitted until 2026-07-13 14:21:51.615698257 +0000 UTC m=+63.911701206 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/60f5db48-d091-4d0f-b896-0eab77775965-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ctwq6" (UID: "60f5db48-d091-4d0f-b896-0eab77775965") : secret "insights-runtime-extractor-tls" not found Jul 13 14:21:43.616058 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:43.616018 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/60f5db48-d091-4d0f-b896-0eab77775965-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctwq6\" (UID: \"60f5db48-d091-4d0f-b896-0eab77775965\") " pod="openshift-insights/insights-runtime-extractor-ctwq6" Jul 13 14:21:45.958489 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:45.958446 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-qhxl5" Jul 13 14:21:45.958987 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:45.958511 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-qhxl5" Jul 13 14:21:45.959075 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:45.958990 2568 scope.go:117] "RemoveContainer" containerID="366c3dec325175a9c6bb9b917e98f84a5e7d52ce0d6586b009560abb129cb948" Jul 13 14:21:46.472099 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:46.472067 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qhxl5_80da8d62-eca0-42fe-b858-813173b67f1a/console-operator/1.log" Jul 13 14:21:46.472288 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:46.472187 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-qhxl5" event={"ID":"80da8d62-eca0-42fe-b858-813173b67f1a","Type":"ContainerStarted","Data":"2b6ecf02c45905fa90f58d4fc4de6631a374ccaca852a20879df41ba2776e7b8"} Jul 13 14:21:46.472664 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:46.472636 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-qhxl5" Jul 13 14:21:46.479004 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:46.478943 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-qhxl5" Jul 13 14:21:46.494955 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:46.494900 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-qhxl5" podStartSLOduration=13.114088367 podStartE2EDuration="21.494883378s" totalImagesPullingTime="8.380795011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:21:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:21:46.49461819 +0000 UTC m=+58.790621141" watchObservedRunningTime="2026-07-13 14:21:46.494883378 +0000 UTC m=+58.790886332" Jul 13 14:21:50.348898 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:50.348867 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tbgpb" Jul 13 14:21:51.690324 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:51.690272 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/60f5db48-d091-4d0f-b896-0eab77775965-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctwq6\" (UID: \"60f5db48-d091-4d0f-b896-0eab77775965\") " pod="openshift-insights/insights-runtime-extractor-ctwq6" Jul 13 14:21:51.692823 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:51.692791 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/60f5db48-d091-4d0f-b896-0eab77775965-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctwq6\" (UID: \"60f5db48-d091-4d0f-b896-0eab77775965\") " pod="openshift-insights/insights-runtime-extractor-ctwq6" Jul 13 14:21:51.789338 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:51.789301 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mcjrd\"" Jul 13 14:21:51.796802 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:51.796769 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ctwq6" Jul 13 14:21:52.473209 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:52.473173 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ctwq6"] Jul 13 14:21:52.476597 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:21:52.476549 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60f5db48_d091_4d0f_b896_0eab77775965.slice/crio-788de773955304fb4f19cee5eb781cc03bf65d92c371b3963eb4eea9ed744db6 WatchSource:0}: Error finding container 788de773955304fb4f19cee5eb781cc03bf65d92c371b3963eb4eea9ed744db6: Status 404 returned error can't find the container with id 788de773955304fb4f19cee5eb781cc03bf65d92c371b3963eb4eea9ed744db6 Jul 13 14:21:52.494161 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:52.494124 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b885b748-mz8fv" event={"ID":"a4537580-e293-4b3e-8695-4d6e7f6cdf37","Type":"ContainerStarted","Data":"5b74802c7da8070623185fc4a0b2056e75f1cbd36d5b1f7b9b25a3113af3f353"} Jul 13 14:21:52.495250 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:52.495223 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ctwq6" event={"ID":"60f5db48-d091-4d0f-b896-0eab77775965","Type":"ContainerStarted","Data":"788de773955304fb4f19cee5eb781cc03bf65d92c371b3963eb4eea9ed744db6"} Jul 13 14:21:52.515779 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:52.515726 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b885b748-mz8fv" podStartSLOduration=1.071093318 podStartE2EDuration="15.515709686s" totalImagesPullingTime="14.444616368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:21:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:21:52.514022863 +0000 UTC m=+64.810025822" watchObservedRunningTime="2026-07-13 14:21:52.515709686 +0000 UTC m=+64.811712639" Jul 13 14:21:54.522114 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:54.522080 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-metrics-certs\") pod \"network-metrics-daemon-hr8jp\" (UID: \"7a0432b9-4eb0-4e69-a3e3-e23edaafb44c\") " pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:21:54.522601 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:54.522207 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-original-pull-secret\") pod \"global-pull-secret-syncer-4vn2v\" (UID: \"1612be17-dbf1-4d08-a9d8-fa7ec57fee55\") " pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:21:54.525647 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:54.525625 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 14:21:54.526868 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:54.526777 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 14:21:54.535867 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:54.535845 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1612be17-dbf1-4d08-a9d8-fa7ec57fee55-original-pull-secret\") pod \"global-pull-secret-syncer-4vn2v\" (UID: \"1612be17-dbf1-4d08-a9d8-fa7ec57fee55\") " pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:21:54.536002 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:54.535985 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a0432b9-4eb0-4e69-a3e3-e23edaafb44c-metrics-certs\") pod \"network-metrics-daemon-hr8jp\" (UID: \"7a0432b9-4eb0-4e69-a3e3-e23edaafb44c\") " pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:21:54.616511 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:54.616444 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4vn2v" Jul 13 14:21:54.622902 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:54.622867 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p2mb\" (UniqueName: \"kubernetes.io/projected/0a464e5b-7939-4ebe-9819-1ec0da498f95-kube-api-access-7p2mb\") pod \"network-check-target-dcxzw\" (UID: \"0a464e5b-7939-4ebe-9819-1ec0da498f95\") " pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:21:54.625813 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:54.625786 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p2mb\" (UniqueName: \"kubernetes.io/projected/0a464e5b-7939-4ebe-9819-1ec0da498f95-kube-api-access-7p2mb\") pod \"network-check-target-dcxzw\" (UID: \"0a464e5b-7939-4ebe-9819-1ec0da498f95\") " pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:21:54.626000 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:54.625976 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5z6w6\"" Jul 13 14:21:54.632816 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:54.632796 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr8jp" Jul 13 14:21:54.912704 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:54.912673 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hslvn\"" Jul 13 14:21:54.920431 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:54.920399 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:21:56.036917 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:56.036874 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c42d2b9c-d394-4e63-b1f2-b38552d30bef-metrics-tls\") pod \"dns-default-9wm7s\" (UID: \"c42d2b9c-d394-4e63-b1f2-b38552d30bef\") " pod="openshift-dns/dns-default-9wm7s" Jul 13 14:21:56.037361 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:56.036944 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-tls\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:56.039527 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:56.039500 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c42d2b9c-d394-4e63-b1f2-b38552d30bef-metrics-tls\") pod \"dns-default-9wm7s\" (UID: \"c42d2b9c-d394-4e63-b1f2-b38552d30bef\") " pod="openshift-dns/dns-default-9wm7s" Jul 13 14:21:56.039685 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:56.039608 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-tls\") pod \"image-registry-7595b9689d-f94p9\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:56.155620 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:56.155576 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fdc44\"" Jul 13 14:21:56.162740 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:56.162674 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:56.178991 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:56.178959 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6lrx7\"" Jul 13 14:21:56.185769 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:56.185731 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9wm7s" Jul 13 14:21:56.344865 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:56.344829 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4vn2v"] Jul 13 14:21:56.349691 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:21:56.349664 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1612be17_dbf1_4d08_a9d8_fa7ec57fee55.slice/crio-492a90c9e1264a665eb0880b19c3b8c6ed1e21d87dea0226a620a7984b6bcf26 WatchSource:0}: Error finding container 492a90c9e1264a665eb0880b19c3b8c6ed1e21d87dea0226a620a7984b6bcf26: Status 404 returned error can't find the container with id 492a90c9e1264a665eb0880b19c3b8c6ed1e21d87dea0226a620a7984b6bcf26 Jul 13 14:21:56.385273 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:56.385238 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hr8jp"] Jul 13 14:21:56.388833 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:21:56.388804 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a0432b9_4eb0_4e69_a3e3_e23edaafb44c.slice/crio-db50ce48aee9483edfd9ced6dca28cb682697eae31a0e3649fdd076e3429eddf WatchSource:0}: Error finding container db50ce48aee9483edfd9ced6dca28cb682697eae31a0e3649fdd076e3429eddf: Status 404 returned error can't find the container with id db50ce48aee9483edfd9ced6dca28cb682697eae31a0e3649fdd076e3429eddf Jul 13 14:21:56.401100 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:56.401021 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9wm7s"] Jul 13 14:21:56.403811 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:21:56.403787 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc42d2b9c_d394_4e63_b1f2_b38552d30bef.slice/crio-f468be548341f1dbc014392a4d2e53a8f437f1f04489cd34814ca9044e27795e WatchSource:0}: Error finding container f468be548341f1dbc014392a4d2e53a8f437f1f04489cd34814ca9044e27795e: Status 404 returned error can't find the container with id f468be548341f1dbc014392a4d2e53a8f437f1f04489cd34814ca9044e27795e Jul 13 14:21:56.421404 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:56.421375 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7595b9689d-f94p9"] Jul 13 14:21:56.424444 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:21:56.424421 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf7f13a3_6730_4087_8d83_7af27db5e836.slice/crio-9a1b09ac09d2d10a14c79a456f0aaa64f5baf23878a1283f9ce5638fe6ed5775 WatchSource:0}: Error finding container 9a1b09ac09d2d10a14c79a456f0aaa64f5baf23878a1283f9ce5638fe6ed5775: Status 404 returned error can't find the container with id 9a1b09ac09d2d10a14c79a456f0aaa64f5baf23878a1283f9ce5638fe6ed5775 Jul 13 14:21:56.513287 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:56.513250 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ctwq6" event={"ID":"60f5db48-d091-4d0f-b896-0eab77775965","Type":"ContainerStarted","Data":"baa1c2b3852c715f2bec5ddc6f5e751ef01718f6750253c0d31449a5e1ef3a76"} Jul 13 14:21:56.514418 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:56.514392 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9wm7s" event={"ID":"c42d2b9c-d394-4e63-b1f2-b38552d30bef","Type":"ContainerStarted","Data":"f468be548341f1dbc014392a4d2e53a8f437f1f04489cd34814ca9044e27795e"} Jul 13 14:21:56.515881 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:56.515859 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7595b9689d-f94p9" event={"ID":"cf7f13a3-6730-4087-8d83-7af27db5e836","Type":"ContainerStarted","Data":"de2e70e998404d2647548915578a1669ebd1fe1294a4282bf2f88f3a4556967e"} Jul 13 14:21:56.515986 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:56.515904 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7595b9689d-f94p9" event={"ID":"cf7f13a3-6730-4087-8d83-7af27db5e836","Type":"ContainerStarted","Data":"9a1b09ac09d2d10a14c79a456f0aaa64f5baf23878a1283f9ce5638fe6ed5775"} Jul 13 14:21:56.515986 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:56.515947 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:21:56.517044 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:56.517024 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4vn2v" event={"ID":"1612be17-dbf1-4d08-a9d8-fa7ec57fee55","Type":"ContainerStarted","Data":"492a90c9e1264a665eb0880b19c3b8c6ed1e21d87dea0226a620a7984b6bcf26"} Jul 13 14:21:56.518112 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:56.518093 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hr8jp" event={"ID":"7a0432b9-4eb0-4e69-a3e3-e23edaafb44c","Type":"ContainerStarted","Data":"db50ce48aee9483edfd9ced6dca28cb682697eae31a0e3649fdd076e3429eddf"} Jul 13 14:21:56.540427 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:56.540377 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7595b9689d-f94p9" podStartSLOduration=67.540359143 podStartE2EDuration="1m7.540359143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:20:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:21:56.539578835 +0000 UTC m=+68.835581790" watchObservedRunningTime="2026-07-13 14:21:56.540359143 +0000 UTC m=+68.836362075" Jul 13 14:21:56.553631 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:56.553598 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dcxzw"] Jul 13 14:21:56.556842 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:21:56.556815 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a464e5b_7939_4ebe_9819_1ec0da498f95.slice/crio-e03a312332be2b949b3c70856820cde3b33d0655dd128e4bb5c30d545ec82a99 WatchSource:0}: Error finding container e03a312332be2b949b3c70856820cde3b33d0655dd128e4bb5c30d545ec82a99: Status 404 returned error can't find the container with id e03a312332be2b949b3c70856820cde3b33d0655dd128e4bb5c30d545ec82a99 Jul 13 14:21:57.453130 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:57.452520 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c99e821-79c3-439a-b51b-46cd0ad8b03c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-mhprm\" (UID: \"7c99e821-79c3-439a-b51b-46cd0ad8b03c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mhprm" Jul 13 14:21:57.453130 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:57.452630 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-service-ca-bundle\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:57.453130 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:57.452666 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7dddf921-be00-47b1-8827-f312b3b96497-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8v2dl\" (UID: \"7dddf921-be00-47b1-8827-f312b3b96497\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8v2dl" Jul 13 14:21:57.453130 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:57.452707 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/763621c1-55cf-4798-a6a2-f75362fc8d46-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-66xjj\" (UID: \"763621c1-55cf-4798-a6a2-f75362fc8d46\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-66xjj" Jul 13 14:21:57.453130 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:57.452754 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-metrics-certs\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:57.454021 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:57.453996 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-service-ca-bundle\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:57.457793 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:57.456776 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/763621c1-55cf-4798-a6a2-f75362fc8d46-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-66xjj\" (UID: \"763621c1-55cf-4798-a6a2-f75362fc8d46\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-66xjj" Jul 13 14:21:57.457793 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:57.456803 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7dddf921-be00-47b1-8827-f312b3b96497-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8v2dl\" (UID: \"7dddf921-be00-47b1-8827-f312b3b96497\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8v2dl" Jul 13 14:21:57.457793 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:57.457200 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e7fe954-9a11-4bc8-a29f-c8d9a04b833f-metrics-certs\") pod \"router-default-dbcbf69c6-pxjzx\" (UID: \"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f\") " pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:57.457793 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:57.457727 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7c99e821-79c3-439a-b51b-46cd0ad8b03c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-mhprm\" (UID: \"7c99e821-79c3-439a-b51b-46cd0ad8b03c\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mhprm" Jul 13 14:21:57.525411 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:57.525368 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dcxzw" event={"ID":"0a464e5b-7939-4ebe-9819-1ec0da498f95","Type":"ContainerStarted","Data":"b83d767edff70479cce08d44c406e9a5fa2d9116689a97c65ca97599f810c717"} Jul 13 14:21:57.525620 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:57.525433 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dcxzw" event={"ID":"0a464e5b-7939-4ebe-9819-1ec0da498f95","Type":"ContainerStarted","Data":"e03a312332be2b949b3c70856820cde3b33d0655dd128e4bb5c30d545ec82a99"} Jul 13 14:21:57.525705 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:57.525687 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:21:57.528838 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:57.528809 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ctwq6" event={"ID":"60f5db48-d091-4d0f-b896-0eab77775965","Type":"ContainerStarted","Data":"11bf8c867b5007d169a6d25172fcf1e74dcf1314858891073a0aba778d42c71c"} Jul 13 14:21:57.545760 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:57.545708 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dcxzw" podStartSLOduration=69.545338281 podStartE2EDuration="1m9.545338281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:20:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:21:57.545211529 +0000 UTC m=+69.841214491" watchObservedRunningTime="2026-07-13 14:21:57.545338281 +0000 UTC m=+69.841341238" Jul 13 14:21:57.650033 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:57.649997 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4gc6f\"" Jul 13 14:21:57.656171 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:57.656144 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mhprm" Jul 13 14:21:57.656907 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:57.656795 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hzvfq\"" Jul 13 14:21:57.665076 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:57.665039 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-66xjj" Jul 13 14:21:57.669524 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:57.669486 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-grvhk\"" Jul 13 14:21:57.674799 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:57.674776 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-b4sx8\"" Jul 13 14:21:57.676784 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:57.676763 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8v2dl" Jul 13 14:21:57.682809 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:57.682778 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:58.719180 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:58.718840 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-dbcbf69c6-pxjzx"] Jul 13 14:21:58.722720 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:21:58.722676 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e7fe954_9a11_4bc8_a29f_c8d9a04b833f.slice/crio-89ac95ac562b7b3c296935d733e9721671bb83b38bb0886d761055444124784d WatchSource:0}: Error finding container 89ac95ac562b7b3c296935d733e9721671bb83b38bb0886d761055444124784d: Status 404 returned error can't find the container with id 89ac95ac562b7b3c296935d733e9721671bb83b38bb0886d761055444124784d Jul 13 14:21:58.737472 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:58.737362 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8v2dl"] Jul 13 14:21:58.760532 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:58.760098 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-66xjj"] Jul 13 14:21:58.765049 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:58.764599 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mhprm"] Jul 13 14:21:58.767157 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:21:58.766382 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod763621c1_55cf_4798_a6a2_f75362fc8d46.slice/crio-a212179efc01091ad2556263e2a66deed65fd03840a485ccf47ba1f0e397dd01 WatchSource:0}: Error finding container a212179efc01091ad2556263e2a66deed65fd03840a485ccf47ba1f0e397dd01: Status 404 returned error can't find the container with id a212179efc01091ad2556263e2a66deed65fd03840a485ccf47ba1f0e397dd01 Jul 13 14:21:58.784222 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:21:58.783281 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c99e821_79c3_439a_b51b_46cd0ad8b03c.slice/crio-f0995066243ae67ac95fe76b0cea4b1ea90ae4b40f9a22d77c26fc94661874d3 WatchSource:0}: Error finding container f0995066243ae67ac95fe76b0cea4b1ea90ae4b40f9a22d77c26fc94661874d3: Status 404 returned error can't find the container with id f0995066243ae67ac95fe76b0cea4b1ea90ae4b40f9a22d77c26fc94661874d3 Jul 13 14:21:59.547940 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:59.547896 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-66xjj" event={"ID":"763621c1-55cf-4798-a6a2-f75362fc8d46","Type":"ContainerStarted","Data":"a212179efc01091ad2556263e2a66deed65fd03840a485ccf47ba1f0e397dd01"} Jul 13 14:21:59.549802 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:59.549768 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" event={"ID":"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f","Type":"ContainerStarted","Data":"b00f517fffe3765afa306a4322addd7078b2ab47361bc3e68e8ebcc000d3ed20"} Jul 13 14:21:59.549944 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:59.549823 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" event={"ID":"7e7fe954-9a11-4bc8-a29f-c8d9a04b833f","Type":"ContainerStarted","Data":"89ac95ac562b7b3c296935d733e9721671bb83b38bb0886d761055444124784d"} Jul 13 14:21:59.552090 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:59.552062 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hr8jp" event={"ID":"7a0432b9-4eb0-4e69-a3e3-e23edaafb44c","Type":"ContainerStarted","Data":"22c8a16c8154aabb4f1ac1abcd80ce7217984c935d87c9e3732f120171b074c9"} Jul 13 14:21:59.552203 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:59.552120 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hr8jp" event={"ID":"7a0432b9-4eb0-4e69-a3e3-e23edaafb44c","Type":"ContainerStarted","Data":"0c200c4c7e3f659f7d40d4cdc224ece0ca0f4e7a2ca20f51d04c64f6d79c4a44"} Jul 13 14:21:59.553385 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:59.553360 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8v2dl" event={"ID":"7dddf921-be00-47b1-8827-f312b3b96497","Type":"ContainerStarted","Data":"abaf73aa81fe82a28ab4fa0192d73038eb0f504f6c9dc273dcf19cab12e0f438"} Jul 13 14:21:59.555753 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:59.555722 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9wm7s" event={"ID":"c42d2b9c-d394-4e63-b1f2-b38552d30bef","Type":"ContainerStarted","Data":"4f0b0b6bccb6f795981e24e626b38f905c4410061c22a2d396b0f83fd11cca2d"} Jul 13 14:21:59.555860 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:59.555769 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9wm7s" event={"ID":"c42d2b9c-d394-4e63-b1f2-b38552d30bef","Type":"ContainerStarted","Data":"06c8e7211f78b68fce00734e9ce712ba1b7fcaf34cfe3dfd13ed6164f1d09560"} Jul 13 14:21:59.555860 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:59.555798 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9wm7s" Jul 13 14:21:59.557569 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:59.557549 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mhprm" event={"ID":"7c99e821-79c3-439a-b51b-46cd0ad8b03c","Type":"ContainerStarted","Data":"f0995066243ae67ac95fe76b0cea4b1ea90ae4b40f9a22d77c26fc94661874d3"} Jul 13 14:21:59.575114 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:59.575049 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" podStartSLOduration=34.575026129 podStartE2EDuration="34.575026129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:21:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:21:59.574083712 +0000 UTC m=+71.870086664" watchObservedRunningTime="2026-07-13 14:21:59.575026129 +0000 UTC m=+71.871029082" Jul 13 14:21:59.594727 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:59.594666 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hr8jp" podStartSLOduration=69.486938026 podStartE2EDuration="1m11.594642223s" totalImagesPullingTime="2.107704197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:20:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:21:59.594236323 +0000 UTC m=+71.890239279" watchObservedRunningTime="2026-07-13 14:21:59.594642223 +0000 UTC m=+71.890645191" Jul 13 14:21:59.615744 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:59.615609 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9wm7s" podStartSLOduration=33.512711593 podStartE2EDuration="35.615569566s" totalImagesPullingTime="2.102857973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:21:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:21:59.615294206 +0000 UTC m=+71.911297161" watchObservedRunningTime="2026-07-13 14:21:59.615569566 +0000 UTC m=+71.911572523" Jul 13 14:21:59.683923 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:59.683884 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:21:59.687137 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:21:59.687109 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:22:00.562264 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:00.562230 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:22:00.563850 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:00.563823 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-dbcbf69c6-pxjzx" Jul 13 14:22:00.980911 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:00.980871 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-hcctc"] Jul 13 14:22:00.986760 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:00.986733 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-hcctc" Jul 13 14:22:00.997693 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:00.997665 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-7vnxq\"" Jul 13 14:22:00.998766 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:00.998558 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 13 14:22:00.998766 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:00.998646 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 13 14:22:01.004915 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.004887 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-hcctc"] Jul 13 14:22:01.087465 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.087430 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zxzm\" (UniqueName: \"kubernetes.io/projected/de30738d-0b8e-4291-a423-7402c02d805c-kube-api-access-9zxzm\") pod \"downloads-68c9cbb497-hcctc\" (UID: \"de30738d-0b8e-4291-a423-7402c02d805c\") " pod="openshift-console/downloads-68c9cbb497-hcctc" Jul 13 14:22:01.106297 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.106259 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6ffb6c9d5d-lzcbw"] Jul 13 14:22:01.111764 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.111733 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:01.115186 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.115146 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 13 14:22:01.115868 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.115845 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 13 14:22:01.115985 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.115912 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 13 14:22:01.116161 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.116120 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 13 14:22:01.117617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.117501 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-d5w6n\"" Jul 13 14:22:01.117617 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.117512 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 13 14:22:01.129119 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.128927 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ffb6c9d5d-lzcbw"] Jul 13 14:22:01.130157 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.130136 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 13 14:22:01.188283 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.188194 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/359deec3-ec25-4470-8e51-763942f169c2-console-config\") pod \"console-6ffb6c9d5d-lzcbw\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:01.188283 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.188238 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/359deec3-ec25-4470-8e51-763942f169c2-service-ca\") pod \"console-6ffb6c9d5d-lzcbw\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:01.188510 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.188360 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz2dl\" (UniqueName: \"kubernetes.io/projected/359deec3-ec25-4470-8e51-763942f169c2-kube-api-access-rz2dl\") pod \"console-6ffb6c9d5d-lzcbw\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:01.188510 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.188407 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/359deec3-ec25-4470-8e51-763942f169c2-trusted-ca-bundle\") pod \"console-6ffb6c9d5d-lzcbw\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:01.188510 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.188437 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/359deec3-ec25-4470-8e51-763942f169c2-oauth-serving-cert\") pod \"console-6ffb6c9d5d-lzcbw\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:01.188510 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.188473 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zxzm\" (UniqueName: \"kubernetes.io/projected/de30738d-0b8e-4291-a423-7402c02d805c-kube-api-access-9zxzm\") pod \"downloads-68c9cbb497-hcctc\" (UID: \"de30738d-0b8e-4291-a423-7402c02d805c\") " pod="openshift-console/downloads-68c9cbb497-hcctc" Jul 13 14:22:01.188718 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.188543 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/359deec3-ec25-4470-8e51-763942f169c2-console-serving-cert\") pod \"console-6ffb6c9d5d-lzcbw\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:01.188718 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.188633 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/359deec3-ec25-4470-8e51-763942f169c2-console-oauth-config\") pod \"console-6ffb6c9d5d-lzcbw\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:01.207774 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.207744 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zxzm\" (UniqueName: \"kubernetes.io/projected/de30738d-0b8e-4291-a423-7402c02d805c-kube-api-access-9zxzm\") pod \"downloads-68c9cbb497-hcctc\" (UID: \"de30738d-0b8e-4291-a423-7402c02d805c\") " pod="openshift-console/downloads-68c9cbb497-hcctc" Jul 13 14:22:01.289445 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.289398 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/359deec3-ec25-4470-8e51-763942f169c2-console-oauth-config\") pod \"console-6ffb6c9d5d-lzcbw\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:01.289640 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.289463 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/359deec3-ec25-4470-8e51-763942f169c2-console-config\") pod \"console-6ffb6c9d5d-lzcbw\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:01.289640 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.289484 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/359deec3-ec25-4470-8e51-763942f169c2-service-ca\") pod \"console-6ffb6c9d5d-lzcbw\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:01.289640 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.289566 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz2dl\" (UniqueName: \"kubernetes.io/projected/359deec3-ec25-4470-8e51-763942f169c2-kube-api-access-rz2dl\") pod \"console-6ffb6c9d5d-lzcbw\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:01.289640 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.289615 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/359deec3-ec25-4470-8e51-763942f169c2-trusted-ca-bundle\") pod \"console-6ffb6c9d5d-lzcbw\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:01.289865 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.289641 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/359deec3-ec25-4470-8e51-763942f169c2-oauth-serving-cert\") pod \"console-6ffb6c9d5d-lzcbw\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:01.289865 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.289670 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/359deec3-ec25-4470-8e51-763942f169c2-console-serving-cert\") pod \"console-6ffb6c9d5d-lzcbw\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:01.290662 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.290631 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/359deec3-ec25-4470-8e51-763942f169c2-oauth-serving-cert\") pod \"console-6ffb6c9d5d-lzcbw\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:01.290662 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.290647 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/359deec3-ec25-4470-8e51-763942f169c2-service-ca\") pod \"console-6ffb6c9d5d-lzcbw\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:01.290833 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.290750 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/359deec3-ec25-4470-8e51-763942f169c2-console-config\") pod \"console-6ffb6c9d5d-lzcbw\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:01.291025 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.291002 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/359deec3-ec25-4470-8e51-763942f169c2-trusted-ca-bundle\") pod \"console-6ffb6c9d5d-lzcbw\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:01.292447 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.292422 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/359deec3-ec25-4470-8e51-763942f169c2-console-oauth-config\") pod \"console-6ffb6c9d5d-lzcbw\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:01.292545 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.292531 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/359deec3-ec25-4470-8e51-763942f169c2-console-serving-cert\") pod \"console-6ffb6c9d5d-lzcbw\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:01.299370 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.299350 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz2dl\" (UniqueName: \"kubernetes.io/projected/359deec3-ec25-4470-8e51-763942f169c2-kube-api-access-rz2dl\") pod \"console-6ffb6c9d5d-lzcbw\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:01.299481 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.299462 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-hcctc" Jul 13 14:22:01.424986 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:01.424941 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:04.475412 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:04.475384 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-hcctc"] Jul 13 14:22:04.480415 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:22:04.480388 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde30738d_0b8e_4291_a423_7402c02d805c.slice/crio-e7ebe5b7d02ea1a075b1a70e4791262830644366da8b17d7b09a64d6c0d3a6b8 WatchSource:0}: Error finding container e7ebe5b7d02ea1a075b1a70e4791262830644366da8b17d7b09a64d6c0d3a6b8: Status 404 returned error can't find the container with id e7ebe5b7d02ea1a075b1a70e4791262830644366da8b17d7b09a64d6c0d3a6b8 Jul 13 14:22:04.492931 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:04.492378 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ffb6c9d5d-lzcbw"] Jul 13 14:22:04.496231 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:22:04.496188 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod359deec3_ec25_4470_8e51_763942f169c2.slice/crio-bec73166a61bf662b841ad614b25ac6e40e278b0502518f9c9f4078f6212f2c0 WatchSource:0}: Error finding container bec73166a61bf662b841ad614b25ac6e40e278b0502518f9c9f4078f6212f2c0: Status 404 returned error can't find the container with id bec73166a61bf662b841ad614b25ac6e40e278b0502518f9c9f4078f6212f2c0 Jul 13 14:22:04.583147 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:04.583056 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4vn2v" event={"ID":"1612be17-dbf1-4d08-a9d8-fa7ec57fee55","Type":"ContainerStarted","Data":"e748762aae8d55be4ff1db1760ec9be5bb39aabaddcd9d8fce1963ae0176562b"} Jul 13 14:22:04.585704 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:04.585627 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mhprm" event={"ID":"7c99e821-79c3-439a-b51b-46cd0ad8b03c","Type":"ContainerStarted","Data":"9a03b83fac7a30cb99fa27b9981a0febd2f89487935cf05927e2e75b69bab885"} Jul 13 14:22:04.587737 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:04.587708 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-66xjj" event={"ID":"763621c1-55cf-4798-a6a2-f75362fc8d46","Type":"ContainerStarted","Data":"35d58a732c7b7275dd6e7574cbb0616a88b0d246c3b41a20b66b12b24a84a784"} Jul 13 14:22:04.589457 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:04.589431 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ffb6c9d5d-lzcbw" event={"ID":"359deec3-ec25-4470-8e51-763942f169c2","Type":"ContainerStarted","Data":"bec73166a61bf662b841ad614b25ac6e40e278b0502518f9c9f4078f6212f2c0"} Jul 13 14:22:04.601770 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:04.601737 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-hcctc" event={"ID":"de30738d-0b8e-4291-a423-7402c02d805c","Type":"ContainerStarted","Data":"e7ebe5b7d02ea1a075b1a70e4791262830644366da8b17d7b09a64d6c0d3a6b8"} Jul 13 14:22:04.604160 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:04.604137 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ctwq6" event={"ID":"60f5db48-d091-4d0f-b896-0eab77775965","Type":"ContainerStarted","Data":"96ff00a9e40f0289d83b591b4c49cef9421c129b6b78059f74b9009f36e8fcae"} Jul 13 14:22:04.612472 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:04.612419 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4vn2v" podStartSLOduration=68.645387362 podStartE2EDuration="1m16.612400474s" totalImagesPullingTime="7.967013112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:20:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:22:04.610970412 +0000 UTC m=+76.906973379" watchObservedRunningTime="2026-07-13 14:22:04.612400474 +0000 UTC m=+76.908403430" Jul 13 14:22:04.638052 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:04.637992 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mhprm" podStartSLOduration=34.108187781 podStartE2EDuration="39.637973428s" totalImagesPullingTime="5.529785647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:21:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:22:04.637909916 +0000 UTC m=+76.933912871" watchObservedRunningTime="2026-07-13 14:22:04.637973428 +0000 UTC m=+76.933976383" Jul 13 14:22:04.661838 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:04.661785 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ctwq6" podStartSLOduration=18.027955944 podStartE2EDuration="29.661768086s" totalImagesPullingTime="11.633812142s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 14:21:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:22:04.661260395 +0000 UTC m=+76.957263350" watchObservedRunningTime="2026-07-13 14:22:04.661768086 +0000 UTC m=+76.957771037" Jul 13 14:22:04.682727 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:04.682678 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-66xjj" podStartSLOduration=34.140195239 podStartE2EDuration="39.682658892s" totalImagesPullingTime="5.542463653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:21:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:22:04.681536302 +0000 UTC m=+76.977539268" watchObservedRunningTime="2026-07-13 14:22:04.682658892 +0000 UTC m=+76.978661847" Jul 13 14:22:05.611531 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:05.611490 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8v2dl" event={"ID":"7dddf921-be00-47b1-8827-f312b3b96497","Type":"ContainerStarted","Data":"1c690a9a5aeebc906a5de904b897160ef520a9fe1ea4252153fc430a05e9d06d"} Jul 13 14:22:05.612047 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:05.611564 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8v2dl" event={"ID":"7dddf921-be00-47b1-8827-f312b3b96497","Type":"ContainerStarted","Data":"6d3822e3e756dd597f785d21802963778d3d945b03ee7984b7f43f93aa46f32d"} Jul 13 14:22:05.633032 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:05.632933 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8v2dl" podStartSLOduration=34.710487382 podStartE2EDuration="40.6328921s" totalImagesPullingTime="5.922404718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:21:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:22:05.63122258 +0000 UTC m=+77.927225534" watchObservedRunningTime="2026-07-13 14:22:05.6328921 +0000 UTC m=+77.928895058" Jul 13 14:22:08.628530 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:08.628479 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ffb6c9d5d-lzcbw" event={"ID":"359deec3-ec25-4470-8e51-763942f169c2","Type":"ContainerStarted","Data":"0c74f0df28d385b426af9e638f31fbe270eb8168c2a56fb4fdddebefb6ea47bf"} Jul 13 14:22:08.651362 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:08.651309 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6ffb6c9d5d-lzcbw" podStartSLOduration=3.888030886 podStartE2EDuration="7.651261312s" totalImagesPullingTime="3.763230426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:22:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:22:08.649810614 +0000 UTC m=+80.945813572" watchObservedRunningTime="2026-07-13 14:22:08.651261312 +0000 UTC m=+80.947264296" Jul 13 14:22:09.565237 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:09.565209 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9wm7s" Jul 13 14:22:11.426171 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:11.426131 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:11.426654 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:11.426211 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:11.432155 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:11.432129 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:11.648122 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:11.648092 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:22:17.534351 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:17.534316 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:22:22.691807 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:22.691772 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mhprm_7c99e821-79c3-439a-b51b-46cd0ad8b03c/cluster-monitoring-operator/0.log" Jul 13 14:22:22.692292 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:22.691824 2568 generic.go:356] "Generic (PLEG): container finished" podID="7c99e821-79c3-439a-b51b-46cd0ad8b03c" containerID="9a03b83fac7a30cb99fa27b9981a0febd2f89487935cf05927e2e75b69bab885" exitCode=2 Jul 13 14:22:22.692292 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:22.691920 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mhprm" event={"ID":"7c99e821-79c3-439a-b51b-46cd0ad8b03c","Type":"ContainerDied","Data":"9a03b83fac7a30cb99fa27b9981a0febd2f89487935cf05927e2e75b69bab885"} Jul 13 14:22:22.692401 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:22.692373 2568 scope.go:117] "RemoveContainer" containerID="9a03b83fac7a30cb99fa27b9981a0febd2f89487935cf05927e2e75b69bab885" Jul 13 14:22:22.693929 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:22.693883 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-hcctc" event={"ID":"de30738d-0b8e-4291-a423-7402c02d805c","Type":"ContainerStarted","Data":"0d86e7ddfddea8d1144bbdbc85a66ce7218d4a0c3f0bc1d39f35257fec3b229d"} Jul 13 14:22:22.694003 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:22.693935 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-hcctc" Jul 13 14:22:22.707138 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:22.707115 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-hcctc" Jul 13 14:22:22.733824 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:22.733768 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-hcctc" podStartSLOduration=4.945448434 podStartE2EDuration="22.73375165s" totalImagesPullingTime="17.788303216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:22:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:22:22.732896721 +0000 UTC m=+95.028899688" watchObservedRunningTime="2026-07-13 14:22:22.73375165 +0000 UTC m=+95.029754604" Jul 13 14:22:23.209921 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:23.209882 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7595b9689d-f94p9"] Jul 13 14:22:23.701013 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:23.700982 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mhprm_7c99e821-79c3-439a-b51b-46cd0ad8b03c/cluster-monitoring-operator/0.log" Jul 13 14:22:23.701484 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:23.701153 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-mhprm" event={"ID":"7c99e821-79c3-439a-b51b-46cd0ad8b03c","Type":"ContainerStarted","Data":"abbe7a3e11dcfac2725b1a468a0b80bff4434b2da4e0496ed385c67a3bae09c1"} Jul 13 14:22:26.500025 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.499984 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bjhgf"] Jul 13 14:22:26.534781 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.534745 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:26.537898 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.537875 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 13 14:22:26.538125 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.537878 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 13 14:22:26.538203 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.537925 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 13 14:22:26.538203 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.537963 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 13 14:22:26.538826 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.538804 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p5shv\"" Jul 13 14:22:26.630376 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.630338 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm9fg\" (UniqueName: \"kubernetes.io/projected/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-kube-api-access-fm9fg\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:26.630569 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.630402 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-node-exporter-tls\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:26.630569 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.630446 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-node-exporter-textfile\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:26.630569 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.630484 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-node-exporter-accelerators-collector-config\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:26.630569 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.630540 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:26.630569 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.630567 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-root\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:26.630863 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.630627 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-sys\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:26.630863 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.630680 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-metrics-client-ca\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:26.630863 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.630742 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-node-exporter-wtmp\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:26.731341 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.731299 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-node-exporter-wtmp\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:26.731534 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.731354 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm9fg\" (UniqueName: \"kubernetes.io/projected/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-kube-api-access-fm9fg\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:26.731534 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.731401 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-node-exporter-tls\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:26.731534 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.731429 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-node-exporter-textfile\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:26.731534 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.731469 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-node-exporter-accelerators-collector-config\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:26.731534 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.731513 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:26.731811 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.731542 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-root\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:26.731811 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.731605 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-sys\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:26.731811 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.731635 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-metrics-client-ca\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:26.731985 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.731962 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-node-exporter-wtmp\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:26.732275 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.732251 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-metrics-client-ca\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:26.732494 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.732473 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-root\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:26.732637 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.732615 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-node-exporter-accelerators-collector-config\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:26.733303 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:22:26.733275 2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 13 14:22:26.733395 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:22:26.733339 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-node-exporter-tls podName:9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a nodeName:}" failed. No retries permitted until 2026-07-13 14:22:27.233320927 +0000 UTC m=+99.529323859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-node-exporter-tls") pod "node-exporter-bjhgf" (UID: "9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a") : secret "node-exporter-tls" not found Jul 13 14:22:26.733929 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.733903 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-node-exporter-textfile\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:26.734011 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.733966 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-sys\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:26.736542 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.736518 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:26.742029 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:26.742004 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm9fg\" (UniqueName: \"kubernetes.io/projected/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-kube-api-access-fm9fg\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:27.236637 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:27.236572 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-node-exporter-tls\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:27.239302 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:27.239267 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a-node-exporter-tls\") pod \"node-exporter-bjhgf\" (UID: \"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a\") " pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:27.448035 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:27.447994 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bjhgf" Jul 13 14:22:27.477192 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:22:27.477159 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d2b0ebe_002c_4dbe_9626_18a6a2b18c5a.slice/crio-43b2cc2b74b6314a1a70cef7c446fb529d19dd9f9e22973b5772b11e305f46ff WatchSource:0}: Error finding container 43b2cc2b74b6314a1a70cef7c446fb529d19dd9f9e22973b5772b11e305f46ff: Status 404 returned error can't find the container with id 43b2cc2b74b6314a1a70cef7c446fb529d19dd9f9e22973b5772b11e305f46ff Jul 13 14:22:27.720282 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:27.720242 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bjhgf" event={"ID":"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a","Type":"ContainerStarted","Data":"43b2cc2b74b6314a1a70cef7c446fb529d19dd9f9e22973b5772b11e305f46ff"} Jul 13 14:22:28.545577 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:28.544924 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dcxzw" Jul 13 14:22:29.733217 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:29.733182 2568 generic.go:356] "Generic (PLEG): container finished" podID="9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a" containerID="57aafd89260150bd74c629911c480ab072575482d9e44aa11678d97dbf92df86" exitCode=0 Jul 13 14:22:29.733710 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:29.733265 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bjhgf" event={"ID":"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a","Type":"ContainerDied","Data":"57aafd89260150bd74c629911c480ab072575482d9e44aa11678d97dbf92df86"} Jul 13 14:22:30.740877 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:30.740838 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bjhgf" event={"ID":"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a","Type":"ContainerStarted","Data":"e99ca2833321a5937c65c03fedec825a20e2d4537b91b6b526a2ae7243be7d7b"} Jul 13 14:22:30.741323 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:30.740903 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bjhgf" event={"ID":"9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a","Type":"ContainerStarted","Data":"518e80e4b3da995094358aca9f0717845c9cb9d0fe091a2adb19c28252435646"} Jul 13 14:22:31.257699 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.257621 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bjhgf" podStartSLOduration=3.274185902 podStartE2EDuration="5.257579055s" totalImagesPullingTime="1.879007213s" totalInitContainerRuntime="104.38594ms" isStatefulPod=true podCreationTimestamp="2026-07-13 14:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:22:30.772126871 +0000 UTC m=+103.068129825" watchObservedRunningTime="2026-07-13 14:22:31.257579055 +0000 UTC m=+103.553582011" Jul 13 14:22:31.258430 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.258398 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64dd899b5b-jcxdn"] Jul 13 14:22:31.278066 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.278027 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64dd899b5b-jcxdn"] Jul 13 14:22:31.278251 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.278163 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64dd899b5b-jcxdn" Jul 13 14:22:31.377608 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.377541 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnt2p\" (UniqueName: \"kubernetes.io/projected/fd6e6a39-c3b4-4b22-b56b-011fed783723-kube-api-access-pnt2p\") pod \"console-64dd899b5b-jcxdn\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " pod="openshift-console/console-64dd899b5b-jcxdn" Jul 13 14:22:31.377827 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.377630 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd6e6a39-c3b4-4b22-b56b-011fed783723-trusted-ca-bundle\") pod \"console-64dd899b5b-jcxdn\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " pod="openshift-console/console-64dd899b5b-jcxdn" Jul 13 14:22:31.377827 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.377701 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd6e6a39-c3b4-4b22-b56b-011fed783723-service-ca\") pod \"console-64dd899b5b-jcxdn\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " pod="openshift-console/console-64dd899b5b-jcxdn" Jul 13 14:22:31.377827 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.377744 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd6e6a39-c3b4-4b22-b56b-011fed783723-console-oauth-config\") pod \"console-64dd899b5b-jcxdn\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " pod="openshift-console/console-64dd899b5b-jcxdn" Jul 13 14:22:31.377827 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.377802 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd6e6a39-c3b4-4b22-b56b-011fed783723-console-serving-cert\") pod \"console-64dd899b5b-jcxdn\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " pod="openshift-console/console-64dd899b5b-jcxdn" Jul 13 14:22:31.378052 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.377861 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd6e6a39-c3b4-4b22-b56b-011fed783723-oauth-serving-cert\") pod \"console-64dd899b5b-jcxdn\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " pod="openshift-console/console-64dd899b5b-jcxdn" Jul 13 14:22:31.378052 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.377889 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd6e6a39-c3b4-4b22-b56b-011fed783723-console-config\") pod \"console-64dd899b5b-jcxdn\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " pod="openshift-console/console-64dd899b5b-jcxdn" Jul 13 14:22:31.479030 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.478992 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd6e6a39-c3b4-4b22-b56b-011fed783723-trusted-ca-bundle\") pod \"console-64dd899b5b-jcxdn\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " pod="openshift-console/console-64dd899b5b-jcxdn" Jul 13 14:22:31.479225 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.479065 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd6e6a39-c3b4-4b22-b56b-011fed783723-service-ca\") pod \"console-64dd899b5b-jcxdn\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " pod="openshift-console/console-64dd899b5b-jcxdn" Jul 13 14:22:31.479225 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.479106 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd6e6a39-c3b4-4b22-b56b-011fed783723-console-oauth-config\") pod \"console-64dd899b5b-jcxdn\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " pod="openshift-console/console-64dd899b5b-jcxdn" Jul 13 14:22:31.479225 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.479167 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd6e6a39-c3b4-4b22-b56b-011fed783723-console-serving-cert\") pod \"console-64dd899b5b-jcxdn\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " pod="openshift-console/console-64dd899b5b-jcxdn" Jul 13 14:22:31.479225 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.479212 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd6e6a39-c3b4-4b22-b56b-011fed783723-oauth-serving-cert\") pod \"console-64dd899b5b-jcxdn\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " pod="openshift-console/console-64dd899b5b-jcxdn" Jul 13 14:22:31.479436 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.479385 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd6e6a39-c3b4-4b22-b56b-011fed783723-console-config\") pod \"console-64dd899b5b-jcxdn\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " pod="openshift-console/console-64dd899b5b-jcxdn" Jul 13 14:22:31.479486 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.479437 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnt2p\" (UniqueName: \"kubernetes.io/projected/fd6e6a39-c3b4-4b22-b56b-011fed783723-kube-api-access-pnt2p\") pod \"console-64dd899b5b-jcxdn\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " pod="openshift-console/console-64dd899b5b-jcxdn" Jul 13 14:22:31.479964 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.479935 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd6e6a39-c3b4-4b22-b56b-011fed783723-service-ca\") pod \"console-64dd899b5b-jcxdn\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " pod="openshift-console/console-64dd899b5b-jcxdn" Jul 13 14:22:31.480169 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.480145 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd6e6a39-c3b4-4b22-b56b-011fed783723-trusted-ca-bundle\") pod \"console-64dd899b5b-jcxdn\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " pod="openshift-console/console-64dd899b5b-jcxdn" Jul 13 14:22:31.480275 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.480191 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd6e6a39-c3b4-4b22-b56b-011fed783723-oauth-serving-cert\") pod \"console-64dd899b5b-jcxdn\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " pod="openshift-console/console-64dd899b5b-jcxdn" Jul 13 14:22:31.480522 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.480496 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd6e6a39-c3b4-4b22-b56b-011fed783723-console-config\") pod \"console-64dd899b5b-jcxdn\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " pod="openshift-console/console-64dd899b5b-jcxdn" Jul 13 14:22:31.482001 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.481976 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd6e6a39-c3b4-4b22-b56b-011fed783723-console-oauth-config\") pod \"console-64dd899b5b-jcxdn\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " pod="openshift-console/console-64dd899b5b-jcxdn" Jul 13 14:22:31.482863 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.482838 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd6e6a39-c3b4-4b22-b56b-011fed783723-console-serving-cert\") pod \"console-64dd899b5b-jcxdn\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " pod="openshift-console/console-64dd899b5b-jcxdn" Jul 13 14:22:31.492143 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.492120 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnt2p\" (UniqueName: \"kubernetes.io/projected/fd6e6a39-c3b4-4b22-b56b-011fed783723-kube-api-access-pnt2p\") pod \"console-64dd899b5b-jcxdn\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " pod="openshift-console/console-64dd899b5b-jcxdn" Jul 13 14:22:31.590407 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.590369 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64dd899b5b-jcxdn" Jul 13 14:22:31.787302 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:31.787279 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64dd899b5b-jcxdn"] Jul 13 14:22:31.789293 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:22:31.789260 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd6e6a39_c3b4_4b22_b56b_011fed783723.slice/crio-2936e6ac5882e75348e74aa450e3666672cdda3a6fa858b6cc640cd845b47448 WatchSource:0}: Error finding container 2936e6ac5882e75348e74aa450e3666672cdda3a6fa858b6cc640cd845b47448: Status 404 returned error can't find the container with id 2936e6ac5882e75348e74aa450e3666672cdda3a6fa858b6cc640cd845b47448 Jul 13 14:22:32.751541 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:32.751503 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64dd899b5b-jcxdn" event={"ID":"fd6e6a39-c3b4-4b22-b56b-011fed783723","Type":"ContainerStarted","Data":"52c04925593ad1e812060a7a1e72910047b473392993fd833233391e4af0f487"} Jul 13 14:22:32.751736 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:32.751560 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64dd899b5b-jcxdn" event={"ID":"fd6e6a39-c3b4-4b22-b56b-011fed783723","Type":"ContainerStarted","Data":"2936e6ac5882e75348e74aa450e3666672cdda3a6fa858b6cc640cd845b47448"} Jul 13 14:22:32.774787 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:32.774728 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64dd899b5b-jcxdn" podStartSLOduration=1.774709957 podStartE2EDuration="1.774709957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:22:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:22:32.774340823 +0000 UTC m=+105.070343802" watchObservedRunningTime="2026-07-13 14:22:32.774709957 +0000 UTC m=+105.070712912" Jul 13 14:22:36.628185 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:36.625608 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64dd899b5b-jcxdn"] Jul 13 14:22:36.655510 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:36.655481 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57b8c5dff9-v4qd4"] Jul 13 14:22:36.721242 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:36.721207 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57b8c5dff9-v4qd4"] Jul 13 14:22:36.721412 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:36.721302 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:36.831168 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:36.831132 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d472e9c3-c982-4783-922f-7dd4a8db31d3-trusted-ca-bundle\") pod \"console-57b8c5dff9-v4qd4\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:36.831168 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:36.831175 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d472e9c3-c982-4783-922f-7dd4a8db31d3-oauth-serving-cert\") pod \"console-57b8c5dff9-v4qd4\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:36.831372 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:36.831246 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d472e9c3-c982-4783-922f-7dd4a8db31d3-console-config\") pod \"console-57b8c5dff9-v4qd4\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:36.831372 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:36.831310 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sglll\" (UniqueName: \"kubernetes.io/projected/d472e9c3-c982-4783-922f-7dd4a8db31d3-kube-api-access-sglll\") pod \"console-57b8c5dff9-v4qd4\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:36.831372 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:36.831329 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d472e9c3-c982-4783-922f-7dd4a8db31d3-console-oauth-config\") pod \"console-57b8c5dff9-v4qd4\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:36.831476 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:36.831375 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d472e9c3-c982-4783-922f-7dd4a8db31d3-service-ca\") pod \"console-57b8c5dff9-v4qd4\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:36.831476 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:36.831433 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d472e9c3-c982-4783-922f-7dd4a8db31d3-console-serving-cert\") pod \"console-57b8c5dff9-v4qd4\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:36.932066 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:36.931988 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d472e9c3-c982-4783-922f-7dd4a8db31d3-console-serving-cert\") pod \"console-57b8c5dff9-v4qd4\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:36.932066 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:36.932038 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d472e9c3-c982-4783-922f-7dd4a8db31d3-trusted-ca-bundle\") pod \"console-57b8c5dff9-v4qd4\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:36.932330 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:36.932077 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d472e9c3-c982-4783-922f-7dd4a8db31d3-oauth-serving-cert\") pod \"console-57b8c5dff9-v4qd4\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:36.932330 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:36.932125 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d472e9c3-c982-4783-922f-7dd4a8db31d3-console-config\") pod \"console-57b8c5dff9-v4qd4\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:36.932330 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:36.932159 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sglll\" (UniqueName: \"kubernetes.io/projected/d472e9c3-c982-4783-922f-7dd4a8db31d3-kube-api-access-sglll\") pod \"console-57b8c5dff9-v4qd4\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:36.932330 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:36.932183 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d472e9c3-c982-4783-922f-7dd4a8db31d3-console-oauth-config\") pod \"console-57b8c5dff9-v4qd4\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:36.932330 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:36.932220 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d472e9c3-c982-4783-922f-7dd4a8db31d3-service-ca\") pod \"console-57b8c5dff9-v4qd4\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:36.932967 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:36.932941 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d472e9c3-c982-4783-922f-7dd4a8db31d3-console-config\") pod \"console-57b8c5dff9-v4qd4\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:36.933089 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:36.932973 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d472e9c3-c982-4783-922f-7dd4a8db31d3-oauth-serving-cert\") pod \"console-57b8c5dff9-v4qd4\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:36.933089 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:36.933053 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d472e9c3-c982-4783-922f-7dd4a8db31d3-trusted-ca-bundle\") pod \"console-57b8c5dff9-v4qd4\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:36.933201 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:36.933085 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d472e9c3-c982-4783-922f-7dd4a8db31d3-service-ca\") pod \"console-57b8c5dff9-v4qd4\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:36.934534 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:36.934510 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d472e9c3-c982-4783-922f-7dd4a8db31d3-console-oauth-config\") pod \"console-57b8c5dff9-v4qd4\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:36.934734 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:36.934715 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d472e9c3-c982-4783-922f-7dd4a8db31d3-console-serving-cert\") pod \"console-57b8c5dff9-v4qd4\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:36.942000 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:36.941977 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sglll\" (UniqueName: \"kubernetes.io/projected/d472e9c3-c982-4783-922f-7dd4a8db31d3-kube-api-access-sglll\") pod \"console-57b8c5dff9-v4qd4\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:37.030902 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:37.030867 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:37.188248 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:37.188178 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57b8c5dff9-v4qd4"] Jul 13 14:22:37.191670 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:22:37.191639 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd472e9c3_c982_4783_922f_7dd4a8db31d3.slice/crio-26e39afa6df2f1ea7ca2b2703b18f812ebff7bb5944a07546e9894a993081c79 WatchSource:0}: Error finding container 26e39afa6df2f1ea7ca2b2703b18f812ebff7bb5944a07546e9894a993081c79: Status 404 returned error can't find the container with id 26e39afa6df2f1ea7ca2b2703b18f812ebff7bb5944a07546e9894a993081c79 Jul 13 14:22:37.774126 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:37.774091 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b8c5dff9-v4qd4" event={"ID":"d472e9c3-c982-4783-922f-7dd4a8db31d3","Type":"ContainerStarted","Data":"8c89e080cd2e0c188ab906b7cf8e8b2a3df6fd1750c7e45513f04141c1b87c65"} Jul 13 14:22:37.774524 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:37.774139 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b8c5dff9-v4qd4" event={"ID":"d472e9c3-c982-4783-922f-7dd4a8db31d3","Type":"ContainerStarted","Data":"26e39afa6df2f1ea7ca2b2703b18f812ebff7bb5944a07546e9894a993081c79"} Jul 13 14:22:37.804579 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:37.804513 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57b8c5dff9-v4qd4" podStartSLOduration=1.804488445 podStartE2EDuration="1.804488445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:22:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:22:37.803820608 +0000 UTC m=+110.099823565" watchObservedRunningTime="2026-07-13 14:22:37.804488445 +0000 UTC m=+110.100491400" Jul 13 14:22:41.591417 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:41.591378 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64dd899b5b-jcxdn" Jul 13 14:22:45.807745 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:45.807707 2568 generic.go:356] "Generic (PLEG): container finished" podID="e855d2f8-93c3-44a2-990e-173213d93499" containerID="e84f3e61b0695b756b20d2e2b5f602cec7c80e7917200ee0b49053eab6eaeecc" exitCode=0 Jul 13 14:22:45.808169 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:45.807777 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-nm6zq" event={"ID":"e855d2f8-93c3-44a2-990e-173213d93499","Type":"ContainerDied","Data":"e84f3e61b0695b756b20d2e2b5f602cec7c80e7917200ee0b49053eab6eaeecc"} Jul 13 14:22:45.808169 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:45.808138 2568 scope.go:117] "RemoveContainer" containerID="e84f3e61b0695b756b20d2e2b5f602cec7c80e7917200ee0b49053eab6eaeecc" Jul 13 14:22:46.815066 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:46.815025 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-nm6zq" event={"ID":"e855d2f8-93c3-44a2-990e-173213d93499","Type":"ContainerStarted","Data":"8dca4c762e8cb97eae06f7e59e49cf6a03bc49d3c9509d15358c8afe7172e3e8"} Jul 13 14:22:47.031455 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:47.031416 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:47.031679 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:47.031483 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:47.036193 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:47.036174 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:47.822821 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:47.822790 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:22:47.876310 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:47.876274 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ffb6c9d5d-lzcbw"] Jul 13 14:22:48.241631 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.241511 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7595b9689d-f94p9" podUID="cf7f13a3-6730-4087-8d83-7af27db5e836" containerName="registry" containerID="cri-o://de2e70e998404d2647548915578a1669ebd1fe1294a4282bf2f88f3a4556967e" gracePeriod=30 Jul 13 14:22:48.515729 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.515661 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:22:48.531993 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.531956 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndcqx\" (UniqueName: \"kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-kube-api-access-ndcqx\") pod \"cf7f13a3-6730-4087-8d83-7af27db5e836\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " Jul 13 14:22:48.532171 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.532033 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf7f13a3-6730-4087-8d83-7af27db5e836-trusted-ca\") pod \"cf7f13a3-6730-4087-8d83-7af27db5e836\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " Jul 13 14:22:48.532171 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.532071 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf7f13a3-6730-4087-8d83-7af27db5e836-installation-pull-secrets\") pod \"cf7f13a3-6730-4087-8d83-7af27db5e836\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " Jul 13 14:22:48.532171 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.532103 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-certificates\") pod \"cf7f13a3-6730-4087-8d83-7af27db5e836\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " Jul 13 14:22:48.532171 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.532134 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-bound-sa-token\") pod \"cf7f13a3-6730-4087-8d83-7af27db5e836\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " Jul 13 14:22:48.532379 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.532226 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-tls\") pod \"cf7f13a3-6730-4087-8d83-7af27db5e836\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " Jul 13 14:22:48.532379 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.532256 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf7f13a3-6730-4087-8d83-7af27db5e836-ca-trust-extracted\") pod \"cf7f13a3-6730-4087-8d83-7af27db5e836\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " Jul 13 14:22:48.532379 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.532288 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf7f13a3-6730-4087-8d83-7af27db5e836-image-registry-private-configuration\") pod \"cf7f13a3-6730-4087-8d83-7af27db5e836\" (UID: \"cf7f13a3-6730-4087-8d83-7af27db5e836\") " Jul 13 14:22:48.532728 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.532673 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf7f13a3-6730-4087-8d83-7af27db5e836-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "cf7f13a3-6730-4087-8d83-7af27db5e836" (UID: "cf7f13a3-6730-4087-8d83-7af27db5e836"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:22:48.532728 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.532715 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "cf7f13a3-6730-4087-8d83-7af27db5e836" (UID: "cf7f13a3-6730-4087-8d83-7af27db5e836"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:22:48.534996 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.534964 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf7f13a3-6730-4087-8d83-7af27db5e836-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "cf7f13a3-6730-4087-8d83-7af27db5e836" (UID: "cf7f13a3-6730-4087-8d83-7af27db5e836"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:22:48.534996 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.534976 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-kube-api-access-ndcqx" (OuterVolumeSpecName: "kube-api-access-ndcqx") pod "cf7f13a3-6730-4087-8d83-7af27db5e836" (UID: "cf7f13a3-6730-4087-8d83-7af27db5e836"). InnerVolumeSpecName "kube-api-access-ndcqx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:22:48.535187 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.535050 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "cf7f13a3-6730-4087-8d83-7af27db5e836" (UID: "cf7f13a3-6730-4087-8d83-7af27db5e836"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:22:48.535187 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.535064 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf7f13a3-6730-4087-8d83-7af27db5e836-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "cf7f13a3-6730-4087-8d83-7af27db5e836" (UID: "cf7f13a3-6730-4087-8d83-7af27db5e836"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:22:48.535187 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.535150 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cf7f13a3-6730-4087-8d83-7af27db5e836" (UID: "cf7f13a3-6730-4087-8d83-7af27db5e836"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:22:48.543102 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.543071 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf7f13a3-6730-4087-8d83-7af27db5e836-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "cf7f13a3-6730-4087-8d83-7af27db5e836" (UID: "cf7f13a3-6730-4087-8d83-7af27db5e836"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 14:22:48.633949 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.633903 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-tls\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:22:48.633949 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.633941 2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cf7f13a3-6730-4087-8d83-7af27db5e836-ca-trust-extracted\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:22:48.633949 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.633952 2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cf7f13a3-6730-4087-8d83-7af27db5e836-image-registry-private-configuration\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:22:48.634187 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.633962 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndcqx\" (UniqueName: \"kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-kube-api-access-ndcqx\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:22:48.634187 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.633971 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cf7f13a3-6730-4087-8d83-7af27db5e836-trusted-ca\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:22:48.634187 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.633979 2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cf7f13a3-6730-4087-8d83-7af27db5e836-installation-pull-secrets\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:22:48.634187 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.633989 2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cf7f13a3-6730-4087-8d83-7af27db5e836-registry-certificates\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:22:48.634187 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.633997 2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cf7f13a3-6730-4087-8d83-7af27db5e836-bound-sa-token\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:22:48.823782 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.823727 2568 generic.go:356] "Generic (PLEG): container finished" podID="cf7f13a3-6730-4087-8d83-7af27db5e836" containerID="de2e70e998404d2647548915578a1669ebd1fe1294a4282bf2f88f3a4556967e" exitCode=0 Jul 13 14:22:48.823782 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.823783 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7595b9689d-f94p9" Jul 13 14:22:48.824209 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.823820 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7595b9689d-f94p9" event={"ID":"cf7f13a3-6730-4087-8d83-7af27db5e836","Type":"ContainerDied","Data":"de2e70e998404d2647548915578a1669ebd1fe1294a4282bf2f88f3a4556967e"} Jul 13 14:22:48.824209 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.823895 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7595b9689d-f94p9" event={"ID":"cf7f13a3-6730-4087-8d83-7af27db5e836","Type":"ContainerDied","Data":"9a1b09ac09d2d10a14c79a456f0aaa64f5baf23878a1283f9ce5638fe6ed5775"} Jul 13 14:22:48.824209 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.823917 2568 scope.go:117] "RemoveContainer" containerID="de2e70e998404d2647548915578a1669ebd1fe1294a4282bf2f88f3a4556967e" Jul 13 14:22:48.832678 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.832659 2568 scope.go:117] "RemoveContainer" containerID="de2e70e998404d2647548915578a1669ebd1fe1294a4282bf2f88f3a4556967e" Jul 13 14:22:48.832958 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:22:48.832937 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de2e70e998404d2647548915578a1669ebd1fe1294a4282bf2f88f3a4556967e\": container with ID starting with de2e70e998404d2647548915578a1669ebd1fe1294a4282bf2f88f3a4556967e not found: ID does not exist" containerID="de2e70e998404d2647548915578a1669ebd1fe1294a4282bf2f88f3a4556967e" Jul 13 14:22:48.833017 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.832968 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de2e70e998404d2647548915578a1669ebd1fe1294a4282bf2f88f3a4556967e"} err="failed to get container status \"de2e70e998404d2647548915578a1669ebd1fe1294a4282bf2f88f3a4556967e\": rpc error: code = NotFound desc = could not find container \"de2e70e998404d2647548915578a1669ebd1fe1294a4282bf2f88f3a4556967e\": container with ID starting with de2e70e998404d2647548915578a1669ebd1fe1294a4282bf2f88f3a4556967e not found: ID does not exist" Jul 13 14:22:48.847867 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.847839 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7595b9689d-f94p9"] Jul 13 14:22:48.854134 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:48.854114 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7595b9689d-f94p9"] Jul 13 14:22:50.202191 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:50.202155 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf7f13a3-6730-4087-8d83-7af27db5e836" path="/var/lib/kubelet/pods/cf7f13a3-6730-4087-8d83-7af27db5e836/volumes" Jul 13 14:22:55.856230 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:55.856193 2568 generic.go:356] "Generic (PLEG): container finished" podID="55e1a48a-1dac-4918-bf4e-37ddef118aa5" containerID="ffe8962c62154890d676c891cdb49a7a703801bbf1696804b4aae6c1557277f5" exitCode=0 Jul 13 14:22:55.856780 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:55.856271 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jv7fc" event={"ID":"55e1a48a-1dac-4918-bf4e-37ddef118aa5","Type":"ContainerDied","Data":"ffe8962c62154890d676c891cdb49a7a703801bbf1696804b4aae6c1557277f5"} Jul 13 14:22:55.856780 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:55.856730 2568 scope.go:117] "RemoveContainer" containerID="ffe8962c62154890d676c891cdb49a7a703801bbf1696804b4aae6c1557277f5" Jul 13 14:22:56.862404 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:22:56.862371 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-jv7fc" event={"ID":"55e1a48a-1dac-4918-bf4e-37ddef118aa5","Type":"ContainerStarted","Data":"49f0ee74e7d9f3754dd43d43b6163158f2d403389d78e996b805a54874a27538"} Jul 13 14:23:01.647454 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:01.647388 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-64dd899b5b-jcxdn" podUID="fd6e6a39-c3b4-4b22-b56b-011fed783723" containerName="console" containerID="cri-o://52c04925593ad1e812060a7a1e72910047b473392993fd833233391e4af0f487" gracePeriod=15 Jul 13 14:23:01.884336 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:01.884301 2568 generic.go:356] "Generic (PLEG): container finished" podID="fd6e6a39-c3b4-4b22-b56b-011fed783723" containerID="52c04925593ad1e812060a7a1e72910047b473392993fd833233391e4af0f487" exitCode=0 Jul 13 14:23:01.884520 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:01.884334 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64dd899b5b-jcxdn" event={"ID":"fd6e6a39-c3b4-4b22-b56b-011fed783723","Type":"ContainerDied","Data":"52c04925593ad1e812060a7a1e72910047b473392993fd833233391e4af0f487"} Jul 13 14:23:01.943546 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:01.943514 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64dd899b5b-jcxdn" Jul 13 14:23:02.048496 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:02.048450 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd6e6a39-c3b4-4b22-b56b-011fed783723-console-serving-cert\") pod \"fd6e6a39-c3b4-4b22-b56b-011fed783723\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " Jul 13 14:23:02.048496 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:02.048499 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd6e6a39-c3b4-4b22-b56b-011fed783723-service-ca\") pod \"fd6e6a39-c3b4-4b22-b56b-011fed783723\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " Jul 13 14:23:02.048778 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:02.048533 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd6e6a39-c3b4-4b22-b56b-011fed783723-console-config\") pod \"fd6e6a39-c3b4-4b22-b56b-011fed783723\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " Jul 13 14:23:02.048778 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:02.048559 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd6e6a39-c3b4-4b22-b56b-011fed783723-trusted-ca-bundle\") pod \"fd6e6a39-c3b4-4b22-b56b-011fed783723\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " Jul 13 14:23:02.048778 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:02.048617 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnt2p\" (UniqueName: \"kubernetes.io/projected/fd6e6a39-c3b4-4b22-b56b-011fed783723-kube-api-access-pnt2p\") pod \"fd6e6a39-c3b4-4b22-b56b-011fed783723\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " Jul 13 14:23:02.048778 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:02.048652 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd6e6a39-c3b4-4b22-b56b-011fed783723-oauth-serving-cert\") pod \"fd6e6a39-c3b4-4b22-b56b-011fed783723\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " Jul 13 14:23:02.048778 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:02.048698 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd6e6a39-c3b4-4b22-b56b-011fed783723-console-oauth-config\") pod \"fd6e6a39-c3b4-4b22-b56b-011fed783723\" (UID: \"fd6e6a39-c3b4-4b22-b56b-011fed783723\") " Jul 13 14:23:02.049054 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:02.049010 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd6e6a39-c3b4-4b22-b56b-011fed783723-console-config" (OuterVolumeSpecName: "console-config") pod "fd6e6a39-c3b4-4b22-b56b-011fed783723" (UID: "fd6e6a39-c3b4-4b22-b56b-011fed783723"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:23:02.049122 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:02.049092 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd6e6a39-c3b4-4b22-b56b-011fed783723-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fd6e6a39-c3b4-4b22-b56b-011fed783723" (UID: "fd6e6a39-c3b4-4b22-b56b-011fed783723"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:23:02.049175 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:02.049105 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd6e6a39-c3b4-4b22-b56b-011fed783723-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fd6e6a39-c3b4-4b22-b56b-011fed783723" (UID: "fd6e6a39-c3b4-4b22-b56b-011fed783723"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:23:02.049175 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:02.049018 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd6e6a39-c3b4-4b22-b56b-011fed783723-service-ca" (OuterVolumeSpecName: "service-ca") pod "fd6e6a39-c3b4-4b22-b56b-011fed783723" (UID: "fd6e6a39-c3b4-4b22-b56b-011fed783723"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:23:02.050960 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:02.050933 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd6e6a39-c3b4-4b22-b56b-011fed783723-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fd6e6a39-c3b4-4b22-b56b-011fed783723" (UID: "fd6e6a39-c3b4-4b22-b56b-011fed783723"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:23:02.051043 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:02.051014 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd6e6a39-c3b4-4b22-b56b-011fed783723-kube-api-access-pnt2p" (OuterVolumeSpecName: "kube-api-access-pnt2p") pod "fd6e6a39-c3b4-4b22-b56b-011fed783723" (UID: "fd6e6a39-c3b4-4b22-b56b-011fed783723"). InnerVolumeSpecName "kube-api-access-pnt2p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:23:02.051083 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:02.051040 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd6e6a39-c3b4-4b22-b56b-011fed783723-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fd6e6a39-c3b4-4b22-b56b-011fed783723" (UID: "fd6e6a39-c3b4-4b22-b56b-011fed783723"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:23:02.149615 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:02.149544 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd6e6a39-c3b4-4b22-b56b-011fed783723-trusted-ca-bundle\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:23:02.149615 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:02.149579 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnt2p\" (UniqueName: \"kubernetes.io/projected/fd6e6a39-c3b4-4b22-b56b-011fed783723-kube-api-access-pnt2p\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:23:02.149615 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:02.149623 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd6e6a39-c3b4-4b22-b56b-011fed783723-oauth-serving-cert\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:23:02.149853 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:02.149636 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd6e6a39-c3b4-4b22-b56b-011fed783723-console-oauth-config\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:23:02.149853 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:02.149649 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd6e6a39-c3b4-4b22-b56b-011fed783723-console-serving-cert\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:23:02.149853 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:02.149661 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd6e6a39-c3b4-4b22-b56b-011fed783723-service-ca\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:23:02.149853 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:02.149672 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd6e6a39-c3b4-4b22-b56b-011fed783723-console-config\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:23:02.889742 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:02.889703 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64dd899b5b-jcxdn" event={"ID":"fd6e6a39-c3b4-4b22-b56b-011fed783723","Type":"ContainerDied","Data":"2936e6ac5882e75348e74aa450e3666672cdda3a6fa858b6cc640cd845b47448"} Jul 13 14:23:02.889742 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:02.889729 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64dd899b5b-jcxdn" Jul 13 14:23:02.890261 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:02.889772 2568 scope.go:117] "RemoveContainer" containerID="52c04925593ad1e812060a7a1e72910047b473392993fd833233391e4af0f487" Jul 13 14:23:02.909204 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:02.909174 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64dd899b5b-jcxdn"] Jul 13 14:23:02.916688 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:02.916663 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64dd899b5b-jcxdn"] Jul 13 14:23:04.201222 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:04.201189 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd6e6a39-c3b4-4b22-b56b-011fed783723" path="/var/lib/kubelet/pods/fd6e6a39-c3b4-4b22-b56b-011fed783723/volumes" Jul 13 14:23:05.903199 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:05.903166 2568 generic.go:356] "Generic (PLEG): container finished" podID="438d0107-45d7-482f-8ee7-da3e9dafb3e7" containerID="c8c66faf70befc6e0670ee6fe507414fc43ff847d155d26a143a2474af2baed3" exitCode=0 Jul 13 14:23:05.903669 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:05.903244 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-j7xs5" event={"ID":"438d0107-45d7-482f-8ee7-da3e9dafb3e7","Type":"ContainerDied","Data":"c8c66faf70befc6e0670ee6fe507414fc43ff847d155d26a143a2474af2baed3"} Jul 13 14:23:05.903669 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:05.903559 2568 scope.go:117] "RemoveContainer" containerID="c8c66faf70befc6e0670ee6fe507414fc43ff847d155d26a143a2474af2baed3" Jul 13 14:23:06.909014 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:06.908975 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-j7xs5" event={"ID":"438d0107-45d7-482f-8ee7-da3e9dafb3e7","Type":"ContainerStarted","Data":"6b550e41ed8e4032b982031eb09d0921fe6549733401733c225db422bccf0b40"} Jul 13 14:23:12.901821 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:12.901755 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6ffb6c9d5d-lzcbw" podUID="359deec3-ec25-4470-8e51-763942f169c2" containerName="console" containerID="cri-o://0c74f0df28d385b426af9e638f31fbe270eb8168c2a56fb4fdddebefb6ea47bf" gracePeriod=15 Jul 13 14:23:13.143261 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.143235 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:23:13.241741 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.241641 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/359deec3-ec25-4470-8e51-763942f169c2-service-ca\") pod \"359deec3-ec25-4470-8e51-763942f169c2\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " Jul 13 14:23:13.241741 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.241694 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/359deec3-ec25-4470-8e51-763942f169c2-console-config\") pod \"359deec3-ec25-4470-8e51-763942f169c2\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " Jul 13 14:23:13.241936 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.241818 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/359deec3-ec25-4470-8e51-763942f169c2-oauth-serving-cert\") pod \"359deec3-ec25-4470-8e51-763942f169c2\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " Jul 13 14:23:13.241936 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.241865 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/359deec3-ec25-4470-8e51-763942f169c2-console-oauth-config\") pod \"359deec3-ec25-4470-8e51-763942f169c2\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " Jul 13 14:23:13.241936 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.241900 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/359deec3-ec25-4470-8e51-763942f169c2-console-serving-cert\") pod \"359deec3-ec25-4470-8e51-763942f169c2\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " Jul 13 14:23:13.241936 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.241927 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rz2dl\" (UniqueName: \"kubernetes.io/projected/359deec3-ec25-4470-8e51-763942f169c2-kube-api-access-rz2dl\") pod \"359deec3-ec25-4470-8e51-763942f169c2\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " Jul 13 14:23:13.242125 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.241958 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/359deec3-ec25-4470-8e51-763942f169c2-trusted-ca-bundle\") pod \"359deec3-ec25-4470-8e51-763942f169c2\" (UID: \"359deec3-ec25-4470-8e51-763942f169c2\") " Jul 13 14:23:13.242188 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.242122 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/359deec3-ec25-4470-8e51-763942f169c2-service-ca" (OuterVolumeSpecName: "service-ca") pod "359deec3-ec25-4470-8e51-763942f169c2" (UID: "359deec3-ec25-4470-8e51-763942f169c2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:23:13.242247 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.242191 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/359deec3-ec25-4470-8e51-763942f169c2-console-config" (OuterVolumeSpecName: "console-config") pod "359deec3-ec25-4470-8e51-763942f169c2" (UID: "359deec3-ec25-4470-8e51-763942f169c2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:23:13.242247 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.242236 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/359deec3-ec25-4470-8e51-763942f169c2-service-ca\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:23:13.242416 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.242381 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/359deec3-ec25-4470-8e51-763942f169c2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "359deec3-ec25-4470-8e51-763942f169c2" (UID: "359deec3-ec25-4470-8e51-763942f169c2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:23:13.242525 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.242507 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/359deec3-ec25-4470-8e51-763942f169c2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "359deec3-ec25-4470-8e51-763942f169c2" (UID: "359deec3-ec25-4470-8e51-763942f169c2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:23:13.244164 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.244127 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/359deec3-ec25-4470-8e51-763942f169c2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "359deec3-ec25-4470-8e51-763942f169c2" (UID: "359deec3-ec25-4470-8e51-763942f169c2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:23:13.244292 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.244224 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/359deec3-ec25-4470-8e51-763942f169c2-kube-api-access-rz2dl" (OuterVolumeSpecName: "kube-api-access-rz2dl") pod "359deec3-ec25-4470-8e51-763942f169c2" (UID: "359deec3-ec25-4470-8e51-763942f169c2"). InnerVolumeSpecName "kube-api-access-rz2dl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:23:13.244292 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.244239 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/359deec3-ec25-4470-8e51-763942f169c2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "359deec3-ec25-4470-8e51-763942f169c2" (UID: "359deec3-ec25-4470-8e51-763942f169c2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:23:13.343223 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.343188 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/359deec3-ec25-4470-8e51-763942f169c2-console-config\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:23:13.343223 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.343216 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/359deec3-ec25-4470-8e51-763942f169c2-oauth-serving-cert\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:23:13.343223 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.343226 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/359deec3-ec25-4470-8e51-763942f169c2-console-oauth-config\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:23:13.343442 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.343234 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/359deec3-ec25-4470-8e51-763942f169c2-console-serving-cert\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:23:13.343442 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.343244 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rz2dl\" (UniqueName: \"kubernetes.io/projected/359deec3-ec25-4470-8e51-763942f169c2-kube-api-access-rz2dl\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:23:13.343442 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.343253 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/359deec3-ec25-4470-8e51-763942f169c2-trusted-ca-bundle\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:23:13.938317 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.938277 2568 generic.go:356] "Generic (PLEG): container finished" podID="359deec3-ec25-4470-8e51-763942f169c2" containerID="0c74f0df28d385b426af9e638f31fbe270eb8168c2a56fb4fdddebefb6ea47bf" exitCode=0 Jul 13 14:23:13.938836 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.938332 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ffb6c9d5d-lzcbw" Jul 13 14:23:13.938836 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.938362 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ffb6c9d5d-lzcbw" event={"ID":"359deec3-ec25-4470-8e51-763942f169c2","Type":"ContainerDied","Data":"0c74f0df28d385b426af9e638f31fbe270eb8168c2a56fb4fdddebefb6ea47bf"} Jul 13 14:23:13.938836 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.938419 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ffb6c9d5d-lzcbw" event={"ID":"359deec3-ec25-4470-8e51-763942f169c2","Type":"ContainerDied","Data":"bec73166a61bf662b841ad614b25ac6e40e278b0502518f9c9f4078f6212f2c0"} Jul 13 14:23:13.938836 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.938439 2568 scope.go:117] "RemoveContainer" containerID="0c74f0df28d385b426af9e638f31fbe270eb8168c2a56fb4fdddebefb6ea47bf" Jul 13 14:23:13.946891 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.946874 2568 scope.go:117] "RemoveContainer" containerID="0c74f0df28d385b426af9e638f31fbe270eb8168c2a56fb4fdddebefb6ea47bf" Jul 13 14:23:13.947141 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:23:13.947122 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c74f0df28d385b426af9e638f31fbe270eb8168c2a56fb4fdddebefb6ea47bf\": container with ID starting with 0c74f0df28d385b426af9e638f31fbe270eb8168c2a56fb4fdddebefb6ea47bf not found: ID does not exist" containerID="0c74f0df28d385b426af9e638f31fbe270eb8168c2a56fb4fdddebefb6ea47bf" Jul 13 14:23:13.947185 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.947151 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c74f0df28d385b426af9e638f31fbe270eb8168c2a56fb4fdddebefb6ea47bf"} err="failed to get container status \"0c74f0df28d385b426af9e638f31fbe270eb8168c2a56fb4fdddebefb6ea47bf\": rpc error: code = NotFound desc = could not find container \"0c74f0df28d385b426af9e638f31fbe270eb8168c2a56fb4fdddebefb6ea47bf\": container with ID starting with 0c74f0df28d385b426af9e638f31fbe270eb8168c2a56fb4fdddebefb6ea47bf not found: ID does not exist" Jul 13 14:23:13.962833 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.962810 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ffb6c9d5d-lzcbw"] Jul 13 14:23:13.969081 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:13.969061 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6ffb6c9d5d-lzcbw"] Jul 13 14:23:14.201495 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:14.201413 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="359deec3-ec25-4470-8e51-763942f169c2" path="/var/lib/kubelet/pods/359deec3-ec25-4470-8e51-763942f169c2/volumes" Jul 13 14:23:46.516382 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.516284 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bbb5b9fbf-d9lcf"] Jul 13 14:23:46.516830 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.516572 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="359deec3-ec25-4470-8e51-763942f169c2" containerName="console" Jul 13 14:23:46.516830 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.516597 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="359deec3-ec25-4470-8e51-763942f169c2" containerName="console" Jul 13 14:23:46.516830 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.516615 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd6e6a39-c3b4-4b22-b56b-011fed783723" containerName="console" Jul 13 14:23:46.516830 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.516622 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd6e6a39-c3b4-4b22-b56b-011fed783723" containerName="console" Jul 13 14:23:46.516830 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.516636 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf7f13a3-6730-4087-8d83-7af27db5e836" containerName="registry" Jul 13 14:23:46.516830 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.516641 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf7f13a3-6730-4087-8d83-7af27db5e836" containerName="registry" Jul 13 14:23:46.516830 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.516687 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd6e6a39-c3b4-4b22-b56b-011fed783723" containerName="console" Jul 13 14:23:46.516830 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.516695 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf7f13a3-6730-4087-8d83-7af27db5e836" containerName="registry" Jul 13 14:23:46.516830 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.516702 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="359deec3-ec25-4470-8e51-763942f169c2" containerName="console" Jul 13 14:23:46.519843 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.519815 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:46.530726 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.530701 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bbb5b9fbf-d9lcf"] Jul 13 14:23:46.626367 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.626325 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/387b6167-883a-4e74-a30a-0f7c99829e36-oauth-serving-cert\") pod \"console-5bbb5b9fbf-d9lcf\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:46.626367 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.626364 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxrg9\" (UniqueName: \"kubernetes.io/projected/387b6167-883a-4e74-a30a-0f7c99829e36-kube-api-access-hxrg9\") pod \"console-5bbb5b9fbf-d9lcf\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:46.626629 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.626436 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/387b6167-883a-4e74-a30a-0f7c99829e36-console-config\") pod \"console-5bbb5b9fbf-d9lcf\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:46.626629 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.626484 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/387b6167-883a-4e74-a30a-0f7c99829e36-console-oauth-config\") pod \"console-5bbb5b9fbf-d9lcf\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:46.626629 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.626510 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/387b6167-883a-4e74-a30a-0f7c99829e36-trusted-ca-bundle\") pod \"console-5bbb5b9fbf-d9lcf\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:46.626629 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.626550 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/387b6167-883a-4e74-a30a-0f7c99829e36-console-serving-cert\") pod \"console-5bbb5b9fbf-d9lcf\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:46.626629 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.626572 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/387b6167-883a-4e74-a30a-0f7c99829e36-service-ca\") pod \"console-5bbb5b9fbf-d9lcf\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:46.727847 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.727804 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/387b6167-883a-4e74-a30a-0f7c99829e36-console-config\") pod \"console-5bbb5b9fbf-d9lcf\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:46.728049 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.727870 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/387b6167-883a-4e74-a30a-0f7c99829e36-console-oauth-config\") pod \"console-5bbb5b9fbf-d9lcf\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:46.728049 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.727907 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/387b6167-883a-4e74-a30a-0f7c99829e36-trusted-ca-bundle\") pod \"console-5bbb5b9fbf-d9lcf\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:46.728049 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.727942 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/387b6167-883a-4e74-a30a-0f7c99829e36-console-serving-cert\") pod \"console-5bbb5b9fbf-d9lcf\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:46.728049 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.727976 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/387b6167-883a-4e74-a30a-0f7c99829e36-service-ca\") pod \"console-5bbb5b9fbf-d9lcf\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:46.728049 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.728017 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/387b6167-883a-4e74-a30a-0f7c99829e36-oauth-serving-cert\") pod \"console-5bbb5b9fbf-d9lcf\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:46.728049 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.728037 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxrg9\" (UniqueName: \"kubernetes.io/projected/387b6167-883a-4e74-a30a-0f7c99829e36-kube-api-access-hxrg9\") pod \"console-5bbb5b9fbf-d9lcf\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:46.728683 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.728645 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/387b6167-883a-4e74-a30a-0f7c99829e36-console-config\") pod \"console-5bbb5b9fbf-d9lcf\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:46.728929 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.728904 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/387b6167-883a-4e74-a30a-0f7c99829e36-service-ca\") pod \"console-5bbb5b9fbf-d9lcf\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:46.728992 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.728965 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/387b6167-883a-4e74-a30a-0f7c99829e36-oauth-serving-cert\") pod \"console-5bbb5b9fbf-d9lcf\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:46.729049 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.729033 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/387b6167-883a-4e74-a30a-0f7c99829e36-trusted-ca-bundle\") pod \"console-5bbb5b9fbf-d9lcf\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:46.730506 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.730482 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/387b6167-883a-4e74-a30a-0f7c99829e36-console-serving-cert\") pod \"console-5bbb5b9fbf-d9lcf\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:46.730663 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.730644 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/387b6167-883a-4e74-a30a-0f7c99829e36-console-oauth-config\") pod \"console-5bbb5b9fbf-d9lcf\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:46.738491 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.738466 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxrg9\" (UniqueName: \"kubernetes.io/projected/387b6167-883a-4e74-a30a-0f7c99829e36-kube-api-access-hxrg9\") pod \"console-5bbb5b9fbf-d9lcf\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:46.830847 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.830808 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:46.965635 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:46.965597 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bbb5b9fbf-d9lcf"] Jul 13 14:23:46.969371 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:23:46.969340 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod387b6167_883a_4e74_a30a_0f7c99829e36.slice/crio-a0c1f8f4654a0203e289f82d63bf9fdff4a5b5d4d89728c0265ae866a16cf6f6 WatchSource:0}: Error finding container a0c1f8f4654a0203e289f82d63bf9fdff4a5b5d4d89728c0265ae866a16cf6f6: Status 404 returned error can't find the container with id a0c1f8f4654a0203e289f82d63bf9fdff4a5b5d4d89728c0265ae866a16cf6f6 Jul 13 14:23:47.066567 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:47.066531 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bbb5b9fbf-d9lcf" event={"ID":"387b6167-883a-4e74-a30a-0f7c99829e36","Type":"ContainerStarted","Data":"e721e74ef9870fcfd45b72d7872192690fc027bda74ca24b591d6b7cbc6edc65"} Jul 13 14:23:47.066775 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:47.066605 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bbb5b9fbf-d9lcf" event={"ID":"387b6167-883a-4e74-a30a-0f7c99829e36","Type":"ContainerStarted","Data":"a0c1f8f4654a0203e289f82d63bf9fdff4a5b5d4d89728c0265ae866a16cf6f6"} Jul 13 14:23:47.090963 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:47.090857 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bbb5b9fbf-d9lcf" podStartSLOduration=1.090839269 podStartE2EDuration="1.090839269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:23:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:23:47.090031127 +0000 UTC m=+179.386034105" watchObservedRunningTime="2026-07-13 14:23:47.090839269 +0000 UTC m=+179.386842222" Jul 13 14:23:56.831730 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:56.831692 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:56.832146 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:56.831842 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:56.837571 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:56.837549 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:57.107770 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:57.107689 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:23:57.153697 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:23:57.153666 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57b8c5dff9-v4qd4"] Jul 13 14:24:22.176277 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:22.176206 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57b8c5dff9-v4qd4" podUID="d472e9c3-c982-4783-922f-7dd4a8db31d3" containerName="console" containerID="cri-o://8c89e080cd2e0c188ab906b7cf8e8b2a3df6fd1750c7e45513f04141c1b87c65" gracePeriod=15 Jul 13 14:24:22.428848 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:22.428776 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:24:22.537500 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:22.537457 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d472e9c3-c982-4783-922f-7dd4a8db31d3-trusted-ca-bundle\") pod \"d472e9c3-c982-4783-922f-7dd4a8db31d3\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " Jul 13 14:24:22.537726 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:22.537514 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d472e9c3-c982-4783-922f-7dd4a8db31d3-service-ca\") pod \"d472e9c3-c982-4783-922f-7dd4a8db31d3\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " Jul 13 14:24:22.537726 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:22.537551 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d472e9c3-c982-4783-922f-7dd4a8db31d3-console-serving-cert\") pod \"d472e9c3-c982-4783-922f-7dd4a8db31d3\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " Jul 13 14:24:22.537726 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:22.537645 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d472e9c3-c982-4783-922f-7dd4a8db31d3-console-oauth-config\") pod \"d472e9c3-c982-4783-922f-7dd4a8db31d3\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " Jul 13 14:24:22.537726 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:22.537692 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d472e9c3-c982-4783-922f-7dd4a8db31d3-oauth-serving-cert\") pod \"d472e9c3-c982-4783-922f-7dd4a8db31d3\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " Jul 13 14:24:22.537726 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:22.537716 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d472e9c3-c982-4783-922f-7dd4a8db31d3-console-config\") pod \"d472e9c3-c982-4783-922f-7dd4a8db31d3\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " Jul 13 14:24:22.537994 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:22.537739 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sglll\" (UniqueName: \"kubernetes.io/projected/d472e9c3-c982-4783-922f-7dd4a8db31d3-kube-api-access-sglll\") pod \"d472e9c3-c982-4783-922f-7dd4a8db31d3\" (UID: \"d472e9c3-c982-4783-922f-7dd4a8db31d3\") " Jul 13 14:24:22.538051 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:22.537990 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d472e9c3-c982-4783-922f-7dd4a8db31d3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d472e9c3-c982-4783-922f-7dd4a8db31d3" (UID: "d472e9c3-c982-4783-922f-7dd4a8db31d3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:24:22.538051 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:22.537959 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d472e9c3-c982-4783-922f-7dd4a8db31d3-service-ca" (OuterVolumeSpecName: "service-ca") pod "d472e9c3-c982-4783-922f-7dd4a8db31d3" (UID: "d472e9c3-c982-4783-922f-7dd4a8db31d3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:24:22.538160 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:22.538104 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d472e9c3-c982-4783-922f-7dd4a8db31d3-console-config" (OuterVolumeSpecName: "console-config") pod "d472e9c3-c982-4783-922f-7dd4a8db31d3" (UID: "d472e9c3-c982-4783-922f-7dd4a8db31d3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:24:22.538287 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:22.538262 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d472e9c3-c982-4783-922f-7dd4a8db31d3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d472e9c3-c982-4783-922f-7dd4a8db31d3" (UID: "d472e9c3-c982-4783-922f-7dd4a8db31d3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:24:22.539983 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:22.539953 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d472e9c3-c982-4783-922f-7dd4a8db31d3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d472e9c3-c982-4783-922f-7dd4a8db31d3" (UID: "d472e9c3-c982-4783-922f-7dd4a8db31d3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:24:22.540112 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:22.540057 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d472e9c3-c982-4783-922f-7dd4a8db31d3-kube-api-access-sglll" (OuterVolumeSpecName: "kube-api-access-sglll") pod "d472e9c3-c982-4783-922f-7dd4a8db31d3" (UID: "d472e9c3-c982-4783-922f-7dd4a8db31d3"). InnerVolumeSpecName "kube-api-access-sglll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:24:22.540184 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:22.540113 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d472e9c3-c982-4783-922f-7dd4a8db31d3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d472e9c3-c982-4783-922f-7dd4a8db31d3" (UID: "d472e9c3-c982-4783-922f-7dd4a8db31d3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:24:22.638289 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:22.638255 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d472e9c3-c982-4783-922f-7dd4a8db31d3-oauth-serving-cert\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:24:22.638289 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:22.638281 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d472e9c3-c982-4783-922f-7dd4a8db31d3-console-config\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:24:22.638289 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:22.638292 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sglll\" (UniqueName: \"kubernetes.io/projected/d472e9c3-c982-4783-922f-7dd4a8db31d3-kube-api-access-sglll\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:24:22.638289 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:22.638301 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d472e9c3-c982-4783-922f-7dd4a8db31d3-trusted-ca-bundle\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:24:22.638549 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:22.638310 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d472e9c3-c982-4783-922f-7dd4a8db31d3-service-ca\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:24:22.638549 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:22.638319 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d472e9c3-c982-4783-922f-7dd4a8db31d3-console-serving-cert\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:24:22.638549 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:22.638327 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d472e9c3-c982-4783-922f-7dd4a8db31d3-console-oauth-config\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:24:23.211615 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:23.211562 2568 generic.go:356] "Generic (PLEG): container finished" podID="d472e9c3-c982-4783-922f-7dd4a8db31d3" containerID="8c89e080cd2e0c188ab906b7cf8e8b2a3df6fd1750c7e45513f04141c1b87c65" exitCode=0 Jul 13 14:24:23.212029 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:23.211639 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b8c5dff9-v4qd4" Jul 13 14:24:23.212029 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:23.211649 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b8c5dff9-v4qd4" event={"ID":"d472e9c3-c982-4783-922f-7dd4a8db31d3","Type":"ContainerDied","Data":"8c89e080cd2e0c188ab906b7cf8e8b2a3df6fd1750c7e45513f04141c1b87c65"} Jul 13 14:24:23.212029 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:23.211706 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b8c5dff9-v4qd4" event={"ID":"d472e9c3-c982-4783-922f-7dd4a8db31d3","Type":"ContainerDied","Data":"26e39afa6df2f1ea7ca2b2703b18f812ebff7bb5944a07546e9894a993081c79"} Jul 13 14:24:23.212029 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:23.211727 2568 scope.go:117] "RemoveContainer" containerID="8c89e080cd2e0c188ab906b7cf8e8b2a3df6fd1750c7e45513f04141c1b87c65" Jul 13 14:24:23.222478 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:23.222446 2568 scope.go:117] "RemoveContainer" containerID="8c89e080cd2e0c188ab906b7cf8e8b2a3df6fd1750c7e45513f04141c1b87c65" Jul 13 14:24:23.222834 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:24:23.222812 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c89e080cd2e0c188ab906b7cf8e8b2a3df6fd1750c7e45513f04141c1b87c65\": container with ID starting with 8c89e080cd2e0c188ab906b7cf8e8b2a3df6fd1750c7e45513f04141c1b87c65 not found: ID does not exist" containerID="8c89e080cd2e0c188ab906b7cf8e8b2a3df6fd1750c7e45513f04141c1b87c65" Jul 13 14:24:23.222894 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:23.222845 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c89e080cd2e0c188ab906b7cf8e8b2a3df6fd1750c7e45513f04141c1b87c65"} err="failed to get container status \"8c89e080cd2e0c188ab906b7cf8e8b2a3df6fd1750c7e45513f04141c1b87c65\": rpc error: code = NotFound desc = could not find container \"8c89e080cd2e0c188ab906b7cf8e8b2a3df6fd1750c7e45513f04141c1b87c65\": container with ID starting with 8c89e080cd2e0c188ab906b7cf8e8b2a3df6fd1750c7e45513f04141c1b87c65 not found: ID does not exist" Jul 13 14:24:23.237046 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:23.237011 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57b8c5dff9-v4qd4"] Jul 13 14:24:23.240703 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:23.240680 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57b8c5dff9-v4qd4"] Jul 13 14:24:24.202150 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:24:24.202115 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d472e9c3-c982-4783-922f-7dd4a8db31d3" path="/var/lib/kubelet/pods/d472e9c3-c982-4783-922f-7dd4a8db31d3/volumes" Jul 13 14:25:30.961741 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:30.961698 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lnwmv"] Jul 13 14:25:30.962168 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:30.961986 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d472e9c3-c982-4783-922f-7dd4a8db31d3" containerName="console" Jul 13 14:25:30.962168 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:30.961997 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d472e9c3-c982-4783-922f-7dd4a8db31d3" containerName="console" Jul 13 14:25:30.962168 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:30.962052 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d472e9c3-c982-4783-922f-7dd4a8db31d3" containerName="console" Jul 13 14:25:30.964926 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:30.964907 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lnwmv" Jul 13 14:25:30.968520 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:30.968499 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-rzwqk\"" Jul 13 14:25:30.968872 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:30.968857 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 13 14:25:30.988352 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:30.988330 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 13 14:25:30.998782 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:30.998760 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lnwmv"] Jul 13 14:25:31.087113 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:31.087070 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7596645e-eaa3-4963-ae04-e024554e86e1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lnwmv\" (UID: \"7596645e-eaa3-4963-ae04-e024554e86e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lnwmv" Jul 13 14:25:31.087277 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:31.087179 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2wms\" (UniqueName: \"kubernetes.io/projected/7596645e-eaa3-4963-ae04-e024554e86e1-kube-api-access-j2wms\") pod \"cert-manager-operator-controller-manager-55c444bf86-lnwmv\" (UID: \"7596645e-eaa3-4963-ae04-e024554e86e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lnwmv" Jul 13 14:25:31.188488 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:31.188441 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7596645e-eaa3-4963-ae04-e024554e86e1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lnwmv\" (UID: \"7596645e-eaa3-4963-ae04-e024554e86e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lnwmv" Jul 13 14:25:31.188665 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:31.188527 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2wms\" (UniqueName: \"kubernetes.io/projected/7596645e-eaa3-4963-ae04-e024554e86e1-kube-api-access-j2wms\") pod \"cert-manager-operator-controller-manager-55c444bf86-lnwmv\" (UID: \"7596645e-eaa3-4963-ae04-e024554e86e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lnwmv" Jul 13 14:25:31.188885 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:31.188864 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7596645e-eaa3-4963-ae04-e024554e86e1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lnwmv\" (UID: \"7596645e-eaa3-4963-ae04-e024554e86e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lnwmv" Jul 13 14:25:31.220245 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:31.220175 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2wms\" (UniqueName: \"kubernetes.io/projected/7596645e-eaa3-4963-ae04-e024554e86e1-kube-api-access-j2wms\") pod \"cert-manager-operator-controller-manager-55c444bf86-lnwmv\" (UID: \"7596645e-eaa3-4963-ae04-e024554e86e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lnwmv" Jul 13 14:25:31.274237 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:31.274209 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lnwmv" Jul 13 14:25:31.421469 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:31.421440 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lnwmv"] Jul 13 14:25:31.424398 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:25:31.424371 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7596645e_eaa3_4963_ae04_e024554e86e1.slice/crio-4f59c07f105c92c959726a9fd0927d85b590202f5dbeffbcbaf605bbeb7765c1 WatchSource:0}: Error finding container 4f59c07f105c92c959726a9fd0927d85b590202f5dbeffbcbaf605bbeb7765c1: Status 404 returned error can't find the container with id 4f59c07f105c92c959726a9fd0927d85b590202f5dbeffbcbaf605bbeb7765c1 Jul 13 14:25:31.476036 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:31.475955 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lnwmv" event={"ID":"7596645e-eaa3-4963-ae04-e024554e86e1","Type":"ContainerStarted","Data":"4f59c07f105c92c959726a9fd0927d85b590202f5dbeffbcbaf605bbeb7765c1"} Jul 13 14:25:34.494776 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:34.494735 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lnwmv" event={"ID":"7596645e-eaa3-4963-ae04-e024554e86e1","Type":"ContainerStarted","Data":"07b2cee1a267af12e9f66366932aed68ed39403266ceccb2699f3c9caa8d7134"} Jul 13 14:25:34.529059 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:34.528987 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lnwmv" podStartSLOduration=1.962628405 podStartE2EDuration="4.528968043s" totalImagesPullingTime="2.566339638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:25:34.523001813 +0000 UTC m=+286.819004767" watchObservedRunningTime="2026-07-13 14:25:34.528968043 +0000 UTC m=+286.824970996" Jul 13 14:25:37.373708 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:37.373671 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-496rd"] Jul 13 14:25:37.377057 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:37.377040 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-496rd" Jul 13 14:25:37.386338 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:37.386317 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 13 14:25:37.386448 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:37.386353 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-6bqkp\"" Jul 13 14:25:37.392515 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:37.392499 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 13 14:25:37.417514 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:37.417487 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-496rd"] Jul 13 14:25:37.440126 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:37.440099 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z5x9\" (UniqueName: \"kubernetes.io/projected/e5af99c4-26a4-47a9-ae1c-f8cf6eec008c-kube-api-access-4z5x9\") pod \"cert-manager-cainjector-559cdd8c87-496rd\" (UID: \"e5af99c4-26a4-47a9-ae1c-f8cf6eec008c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-496rd" Jul 13 14:25:37.440253 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:37.440137 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5af99c4-26a4-47a9-ae1c-f8cf6eec008c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-496rd\" (UID: \"e5af99c4-26a4-47a9-ae1c-f8cf6eec008c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-496rd" Jul 13 14:25:37.541247 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:37.541212 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z5x9\" (UniqueName: \"kubernetes.io/projected/e5af99c4-26a4-47a9-ae1c-f8cf6eec008c-kube-api-access-4z5x9\") pod \"cert-manager-cainjector-559cdd8c87-496rd\" (UID: \"e5af99c4-26a4-47a9-ae1c-f8cf6eec008c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-496rd" Jul 13 14:25:37.541445 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:37.541275 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5af99c4-26a4-47a9-ae1c-f8cf6eec008c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-496rd\" (UID: \"e5af99c4-26a4-47a9-ae1c-f8cf6eec008c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-496rd" Jul 13 14:25:37.558424 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:37.558396 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z5x9\" (UniqueName: \"kubernetes.io/projected/e5af99c4-26a4-47a9-ae1c-f8cf6eec008c-kube-api-access-4z5x9\") pod \"cert-manager-cainjector-559cdd8c87-496rd\" (UID: \"e5af99c4-26a4-47a9-ae1c-f8cf6eec008c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-496rd" Jul 13 14:25:37.561507 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:37.561480 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5af99c4-26a4-47a9-ae1c-f8cf6eec008c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-496rd\" (UID: \"e5af99c4-26a4-47a9-ae1c-f8cf6eec008c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-496rd" Jul 13 14:25:37.686004 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:37.685922 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-496rd" Jul 13 14:25:37.847388 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:25:37.847352 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5af99c4_26a4_47a9_ae1c_f8cf6eec008c.slice/crio-d2d0f778e843af4e597f1c9dc150e20afb007748b7d035ac3b4158556f6a25b9 WatchSource:0}: Error finding container d2d0f778e843af4e597f1c9dc150e20afb007748b7d035ac3b4158556f6a25b9: Status 404 returned error can't find the container with id d2d0f778e843af4e597f1c9dc150e20afb007748b7d035ac3b4158556f6a25b9 Jul 13 14:25:37.850136 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:37.850113 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-496rd"] Jul 13 14:25:38.517498 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:38.517464 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-496rd" event={"ID":"e5af99c4-26a4-47a9-ae1c-f8cf6eec008c","Type":"ContainerStarted","Data":"d2d0f778e843af4e597f1c9dc150e20afb007748b7d035ac3b4158556f6a25b9"} Jul 13 14:25:41.532348 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:41.532309 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-496rd" event={"ID":"e5af99c4-26a4-47a9-ae1c-f8cf6eec008c","Type":"ContainerStarted","Data":"a24c91ba8377373f8ab33ce344c72d099ab81d331398cd7ce5cd03c90adc79f0"} Jul 13 14:25:41.566906 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:41.566849 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-496rd" podStartSLOduration=1.7338935530000001 podStartE2EDuration="4.566828606s" totalImagesPullingTime="2.832935053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:25:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:25:41.56190108 +0000 UTC m=+293.857904047" watchObservedRunningTime="2026-07-13 14:25:41.566828606 +0000 UTC m=+293.862831561" Jul 13 14:25:47.834275 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:47.834243 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4wmz"] Jul 13 14:25:47.837623 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:47.837602 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4wmz" Jul 13 14:25:47.842954 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:47.842933 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 13 14:25:47.843057 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:47.842931 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-9w9jg\"" Jul 13 14:25:47.843099 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:47.842937 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 13 14:25:47.863723 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:47.863696 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4wmz"] Jul 13 14:25:47.932893 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:47.932859 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7scvm\" (UniqueName: \"kubernetes.io/projected/e1248384-82d5-4dd3-aa6c-f1dfa5c25770-kube-api-access-7scvm\") pod \"openshift-lws-operator-fd8ccff4c-z4wmz\" (UID: \"e1248384-82d5-4dd3-aa6c-f1dfa5c25770\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4wmz" Jul 13 14:25:47.933052 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:47.932940 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1248384-82d5-4dd3-aa6c-f1dfa5c25770-tmp\") pod \"openshift-lws-operator-fd8ccff4c-z4wmz\" (UID: \"e1248384-82d5-4dd3-aa6c-f1dfa5c25770\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4wmz" Jul 13 14:25:48.033697 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:48.033658 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7scvm\" (UniqueName: \"kubernetes.io/projected/e1248384-82d5-4dd3-aa6c-f1dfa5c25770-kube-api-access-7scvm\") pod \"openshift-lws-operator-fd8ccff4c-z4wmz\" (UID: \"e1248384-82d5-4dd3-aa6c-f1dfa5c25770\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4wmz" Jul 13 14:25:48.033892 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:48.033751 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1248384-82d5-4dd3-aa6c-f1dfa5c25770-tmp\") pod \"openshift-lws-operator-fd8ccff4c-z4wmz\" (UID: \"e1248384-82d5-4dd3-aa6c-f1dfa5c25770\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4wmz" Jul 13 14:25:48.034134 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:48.034115 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1248384-82d5-4dd3-aa6c-f1dfa5c25770-tmp\") pod \"openshift-lws-operator-fd8ccff4c-z4wmz\" (UID: \"e1248384-82d5-4dd3-aa6c-f1dfa5c25770\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4wmz" Jul 13 14:25:48.046569 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:48.046536 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7scvm\" (UniqueName: \"kubernetes.io/projected/e1248384-82d5-4dd3-aa6c-f1dfa5c25770-kube-api-access-7scvm\") pod \"openshift-lws-operator-fd8ccff4c-z4wmz\" (UID: \"e1248384-82d5-4dd3-aa6c-f1dfa5c25770\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4wmz" Jul 13 14:25:48.128774 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:48.128693 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mhprm_7c99e821-79c3-439a-b51b-46cd0ad8b03c/cluster-monitoring-operator/0.log" Jul 13 14:25:48.132435 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:48.132408 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mhprm_7c99e821-79c3-439a-b51b-46cd0ad8b03c/cluster-monitoring-operator/0.log" Jul 13 14:25:48.133091 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:48.133070 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qhxl5_80da8d62-eca0-42fe-b858-813173b67f1a/console-operator/1.log" Jul 13 14:25:48.136989 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:48.136967 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qhxl5_80da8d62-eca0-42fe-b858-813173b67f1a/console-operator/1.log" Jul 13 14:25:48.138387 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:48.138368 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbgpb_74b3da28-f883-40d3-89a1-10381739a75d/ovn-acl-logging/0.log" Jul 13 14:25:48.142366 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:48.142337 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbgpb_74b3da28-f883-40d3-89a1-10381739a75d/ovn-acl-logging/0.log" Jul 13 14:25:48.146184 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:48.146164 2568 kubelet.go:1648] "Image garbage collection succeeded" Jul 13 14:25:48.149661 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:48.149643 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-9w9jg\"" Jul 13 14:25:48.156050 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:48.156032 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4wmz" Jul 13 14:25:48.304052 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:48.304024 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4wmz"] Jul 13 14:25:48.306552 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:25:48.306526 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1248384_82d5_4dd3_aa6c_f1dfa5c25770.slice/crio-5f3ce45b963c7dbf6fd7ef77eaebcf4b0bd78096dcb37492530d773d1f61a52a WatchSource:0}: Error finding container 5f3ce45b963c7dbf6fd7ef77eaebcf4b0bd78096dcb37492530d773d1f61a52a: Status 404 returned error can't find the container with id 5f3ce45b963c7dbf6fd7ef77eaebcf4b0bd78096dcb37492530d773d1f61a52a Jul 13 14:25:48.566002 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:48.565962 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4wmz" event={"ID":"e1248384-82d5-4dd3-aa6c-f1dfa5c25770","Type":"ContainerStarted","Data":"5f3ce45b963c7dbf6fd7ef77eaebcf4b0bd78096dcb37492530d773d1f61a52a"} Jul 13 14:25:51.581877 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:51.581840 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4wmz" event={"ID":"e1248384-82d5-4dd3-aa6c-f1dfa5c25770","Type":"ContainerStarted","Data":"56cfa0cfdc9b792acf8f66d4dbb4d234b110b6e03c363a3d5b5a51ed22647683"} Jul 13 14:25:51.617527 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:25:51.617474 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z4wmz" podStartSLOduration=2.143740361 podStartE2EDuration="4.617460324s" totalImagesPullingTime="2.473719963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:25:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:25:51.616640005 +0000 UTC m=+303.912642960" watchObservedRunningTime="2026-07-13 14:25:51.617460324 +0000 UTC m=+303.913463279" Jul 13 14:26:11.800876 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:11.800836 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt"] Jul 13 14:26:11.803763 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:11.803740 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt" Jul 13 14:26:11.814312 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:11.814291 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 13 14:26:11.815125 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:11.815108 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 13 14:26:11.819616 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:11.819595 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 13 14:26:11.819721 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:11.819611 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 13 14:26:11.819868 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:11.819852 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-769rd\"" Jul 13 14:26:11.825975 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:11.825950 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt"] Jul 13 14:26:11.935957 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:11.935917 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jbzv\" (UniqueName: \"kubernetes.io/projected/681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4-kube-api-access-9jbzv\") pod \"opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt\" (UID: \"681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4\") " pod="opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt" Jul 13 14:26:11.935957 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:11.935960 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4-manifests\") pod \"opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt\" (UID: \"681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4\") " pod="opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt" Jul 13 14:26:11.936184 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:11.935995 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4-webhook-cert\") pod \"opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt\" (UID: \"681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4\") " pod="opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt" Jul 13 14:26:11.936184 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:11.936059 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4-tmp\") pod \"opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt\" (UID: \"681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4\") " pod="opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt" Jul 13 14:26:11.936184 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:11.936094 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt\" (UID: \"681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4\") " pod="opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt" Jul 13 14:26:12.037026 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:12.036986 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt\" (UID: \"681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4\") " pod="opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt" Jul 13 14:26:12.037227 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:12.037042 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jbzv\" (UniqueName: \"kubernetes.io/projected/681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4-kube-api-access-9jbzv\") pod \"opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt\" (UID: \"681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4\") " pod="opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt" Jul 13 14:26:12.037227 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:12.037073 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4-manifests\") pod \"opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt\" (UID: \"681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4\") " pod="opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt" Jul 13 14:26:12.037227 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:12.037103 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4-webhook-cert\") pod \"opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt\" (UID: \"681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4\") " pod="opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt" Jul 13 14:26:12.037227 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:12.037131 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4-tmp\") pod \"opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt\" (UID: \"681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4\") " pod="opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt" Jul 13 14:26:12.037639 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:12.037573 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4-manifests\") pod \"opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt\" (UID: \"681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4\") " pod="opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt" Jul 13 14:26:12.039511 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:12.039485 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4-tmp\") pod \"opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt\" (UID: \"681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4\") " pod="opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt" Jul 13 14:26:12.039607 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:12.039567 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt\" (UID: \"681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4\") " pod="opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt" Jul 13 14:26:12.039656 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:12.039631 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4-webhook-cert\") pod \"opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt\" (UID: \"681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4\") " pod="opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt" Jul 13 14:26:12.058526 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:12.058457 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jbzv\" (UniqueName: \"kubernetes.io/projected/681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4-kube-api-access-9jbzv\") pod \"opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt\" (UID: \"681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4\") " pod="opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt" Jul 13 14:26:12.116962 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:12.116925 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt" Jul 13 14:26:12.274311 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:12.274274 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt"] Jul 13 14:26:12.278947 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:26:12.278915 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod681c9e4c_d7e1_4c0c_b7d1_fb9f119409d4.slice/crio-e6e776a36b4a0daeedd77a22a79f3b7a05a5154354e9ba29ebe58ef0a52df97b WatchSource:0}: Error finding container e6e776a36b4a0daeedd77a22a79f3b7a05a5154354e9ba29ebe58ef0a52df97b: Status 404 returned error can't find the container with id e6e776a36b4a0daeedd77a22a79f3b7a05a5154354e9ba29ebe58ef0a52df97b Jul 13 14:26:12.280815 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:12.280791 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 14:26:12.676800 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:12.676764 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt" event={"ID":"681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4","Type":"ContainerStarted","Data":"e6e776a36b4a0daeedd77a22a79f3b7a05a5154354e9ba29ebe58ef0a52df97b"} Jul 13 14:26:15.693860 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:15.693806 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt" event={"ID":"681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4","Type":"ContainerStarted","Data":"d4c4be95ee4e9f74a091c557d5a3c536c9b883d82f160a5c6f55c9e54f75dda7"} Jul 13 14:26:16.700232 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:16.700141 2568 generic.go:356] "Generic (PLEG): container finished" podID="681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4" containerID="d4c4be95ee4e9f74a091c557d5a3c536c9b883d82f160a5c6f55c9e54f75dda7" exitCode=0 Jul 13 14:26:16.700673 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:16.700222 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt" event={"ID":"681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4","Type":"ContainerDied","Data":"d4c4be95ee4e9f74a091c557d5a3c536c9b883d82f160a5c6f55c9e54f75dda7"} Jul 13 14:26:17.707993 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:17.707948 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt" event={"ID":"681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4","Type":"ContainerStarted","Data":"c43daf9441cc145dbcddec8dfb03d3184639030d6f9bda6c8c72d632a5096f56"} Jul 13 14:26:17.708465 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:17.708058 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt" Jul 13 14:26:17.783331 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:17.783275 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt" podStartSLOduration=2.370642636 podStartE2EDuration="6.783256472s" totalImagesPullingTime="3.383015949s" totalInitContainerRuntime="1.029597887s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:26:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:26:17.782828496 +0000 UTC m=+330.078831451" watchObservedRunningTime="2026-07-13 14:26:17.783256472 +0000 UTC m=+330.079259427" Jul 13 14:26:28.714494 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:28.714455 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt" Jul 13 14:26:34.053448 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:34.053410 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7fcc85dc7-npfr6"] Jul 13 14:26:34.062383 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:34.062352 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7fcc85dc7-npfr6" Jul 13 14:26:34.070674 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:34.070444 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 13 14:26:34.070674 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:34.070444 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 13 14:26:34.070674 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:34.070529 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-lnhsf\"" Jul 13 14:26:34.089611 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:34.089559 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7fcc85dc7-npfr6"] Jul 13 14:26:34.124483 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:34.124442 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjxj8\" (UniqueName: \"kubernetes.io/projected/574b2301-5677-4bd4-8610-37e7ef519609-kube-api-access-cjxj8\") pod \"kube-auth-proxy-7fcc85dc7-npfr6\" (UID: \"574b2301-5677-4bd4-8610-37e7ef519609\") " pod="openshift-ingress/kube-auth-proxy-7fcc85dc7-npfr6" Jul 13 14:26:34.124693 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:34.124541 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/574b2301-5677-4bd4-8610-37e7ef519609-tmp\") pod \"kube-auth-proxy-7fcc85dc7-npfr6\" (UID: \"574b2301-5677-4bd4-8610-37e7ef519609\") " pod="openshift-ingress/kube-auth-proxy-7fcc85dc7-npfr6" Jul 13 14:26:34.124693 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:34.124569 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/574b2301-5677-4bd4-8610-37e7ef519609-tls-certs\") pod \"kube-auth-proxy-7fcc85dc7-npfr6\" (UID: \"574b2301-5677-4bd4-8610-37e7ef519609\") " pod="openshift-ingress/kube-auth-proxy-7fcc85dc7-npfr6" Jul 13 14:26:34.225399 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:34.225356 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/574b2301-5677-4bd4-8610-37e7ef519609-tmp\") pod \"kube-auth-proxy-7fcc85dc7-npfr6\" (UID: \"574b2301-5677-4bd4-8610-37e7ef519609\") " pod="openshift-ingress/kube-auth-proxy-7fcc85dc7-npfr6" Jul 13 14:26:34.225399 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:34.225392 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/574b2301-5677-4bd4-8610-37e7ef519609-tls-certs\") pod \"kube-auth-proxy-7fcc85dc7-npfr6\" (UID: \"574b2301-5677-4bd4-8610-37e7ef519609\") " pod="openshift-ingress/kube-auth-proxy-7fcc85dc7-npfr6" Jul 13 14:26:34.225728 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:34.225423 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjxj8\" (UniqueName: \"kubernetes.io/projected/574b2301-5677-4bd4-8610-37e7ef519609-kube-api-access-cjxj8\") pod \"kube-auth-proxy-7fcc85dc7-npfr6\" (UID: \"574b2301-5677-4bd4-8610-37e7ef519609\") " pod="openshift-ingress/kube-auth-proxy-7fcc85dc7-npfr6" Jul 13 14:26:34.227960 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:34.227929 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/574b2301-5677-4bd4-8610-37e7ef519609-tmp\") pod \"kube-auth-proxy-7fcc85dc7-npfr6\" (UID: \"574b2301-5677-4bd4-8610-37e7ef519609\") " pod="openshift-ingress/kube-auth-proxy-7fcc85dc7-npfr6" Jul 13 14:26:34.228110 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:34.228074 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/574b2301-5677-4bd4-8610-37e7ef519609-tls-certs\") pod \"kube-auth-proxy-7fcc85dc7-npfr6\" (UID: \"574b2301-5677-4bd4-8610-37e7ef519609\") " pod="openshift-ingress/kube-auth-proxy-7fcc85dc7-npfr6" Jul 13 14:26:34.295962 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:34.295934 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjxj8\" (UniqueName: \"kubernetes.io/projected/574b2301-5677-4bd4-8610-37e7ef519609-kube-api-access-cjxj8\") pod \"kube-auth-proxy-7fcc85dc7-npfr6\" (UID: \"574b2301-5677-4bd4-8610-37e7ef519609\") " pod="openshift-ingress/kube-auth-proxy-7fcc85dc7-npfr6" Jul 13 14:26:34.373939 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:34.373904 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7fcc85dc7-npfr6" Jul 13 14:26:34.533910 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:34.533879 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7fcc85dc7-npfr6"] Jul 13 14:26:34.537833 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:26:34.537801 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod574b2301_5677_4bd4_8610_37e7ef519609.slice/crio-f809153be7038bc2a8f4cba230aa56bc004b8f1494006b57f2e117753d58f0a0 WatchSource:0}: Error finding container f809153be7038bc2a8f4cba230aa56bc004b8f1494006b57f2e117753d58f0a0: Status 404 returned error can't find the container with id f809153be7038bc2a8f4cba230aa56bc004b8f1494006b57f2e117753d58f0a0 Jul 13 14:26:34.792179 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:34.792081 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7fcc85dc7-npfr6" event={"ID":"574b2301-5677-4bd4-8610-37e7ef519609","Type":"ContainerStarted","Data":"f809153be7038bc2a8f4cba230aa56bc004b8f1494006b57f2e117753d58f0a0"} Jul 13 14:26:37.812038 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:37.811991 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7fcc85dc7-npfr6" event={"ID":"574b2301-5677-4bd4-8610-37e7ef519609","Type":"ContainerStarted","Data":"e8b6579c096e70f5a48a2cef5e8f4b13f9b6d1df8ab7beeb778896d3dc45b426"} Jul 13 14:26:37.843423 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:37.843363 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7fcc85dc7-npfr6" podStartSLOduration=1.116415557 podStartE2EDuration="3.843347514s" totalImagesPullingTime="2.726931957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:26:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:26:37.84135629 +0000 UTC m=+350.137359243" watchObservedRunningTime="2026-07-13 14:26:37.843347514 +0000 UTC m=+350.139350467" Jul 13 14:26:40.022998 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:40.022957 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-fff4bf78c-4tdt2"] Jul 13 14:26:40.027574 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:40.027549 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-fff4bf78c-4tdt2" Jul 13 14:26:40.031874 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:40.031846 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9ss6z\"" Jul 13 14:26:40.032040 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:40.031848 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 13 14:26:40.032040 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:40.031845 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 13 14:26:40.032040 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:40.031854 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 13 14:26:40.039489 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:40.039469 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-fff4bf78c-4tdt2"] Jul 13 14:26:40.079308 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:40.079282 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2873f0c1-c363-4cf2-a081-393989177ed0-metrics-cert\") pod \"lws-controller-manager-fff4bf78c-4tdt2\" (UID: \"2873f0c1-c363-4cf2-a081-393989177ed0\") " pod="openshift-lws-operator/lws-controller-manager-fff4bf78c-4tdt2" Jul 13 14:26:40.079448 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:40.079333 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zt7d\" (UniqueName: \"kubernetes.io/projected/2873f0c1-c363-4cf2-a081-393989177ed0-kube-api-access-2zt7d\") pod \"lws-controller-manager-fff4bf78c-4tdt2\" (UID: \"2873f0c1-c363-4cf2-a081-393989177ed0\") " pod="openshift-lws-operator/lws-controller-manager-fff4bf78c-4tdt2" Jul 13 14:26:40.079448 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:40.079407 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2873f0c1-c363-4cf2-a081-393989177ed0-manager-config\") pod \"lws-controller-manager-fff4bf78c-4tdt2\" (UID: \"2873f0c1-c363-4cf2-a081-393989177ed0\") " pod="openshift-lws-operator/lws-controller-manager-fff4bf78c-4tdt2" Jul 13 14:26:40.079526 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:40.079464 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2873f0c1-c363-4cf2-a081-393989177ed0-cert\") pod \"lws-controller-manager-fff4bf78c-4tdt2\" (UID: \"2873f0c1-c363-4cf2-a081-393989177ed0\") " pod="openshift-lws-operator/lws-controller-manager-fff4bf78c-4tdt2" Jul 13 14:26:40.180011 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:40.179973 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2873f0c1-c363-4cf2-a081-393989177ed0-manager-config\") pod \"lws-controller-manager-fff4bf78c-4tdt2\" (UID: \"2873f0c1-c363-4cf2-a081-393989177ed0\") " pod="openshift-lws-operator/lws-controller-manager-fff4bf78c-4tdt2" Jul 13 14:26:40.180210 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:40.180025 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2873f0c1-c363-4cf2-a081-393989177ed0-cert\") pod \"lws-controller-manager-fff4bf78c-4tdt2\" (UID: \"2873f0c1-c363-4cf2-a081-393989177ed0\") " pod="openshift-lws-operator/lws-controller-manager-fff4bf78c-4tdt2" Jul 13 14:26:40.180210 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:40.180054 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2873f0c1-c363-4cf2-a081-393989177ed0-metrics-cert\") pod \"lws-controller-manager-fff4bf78c-4tdt2\" (UID: \"2873f0c1-c363-4cf2-a081-393989177ed0\") " pod="openshift-lws-operator/lws-controller-manager-fff4bf78c-4tdt2" Jul 13 14:26:40.180210 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:40.180092 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zt7d\" (UniqueName: \"kubernetes.io/projected/2873f0c1-c363-4cf2-a081-393989177ed0-kube-api-access-2zt7d\") pod \"lws-controller-manager-fff4bf78c-4tdt2\" (UID: \"2873f0c1-c363-4cf2-a081-393989177ed0\") " pod="openshift-lws-operator/lws-controller-manager-fff4bf78c-4tdt2" Jul 13 14:26:40.180712 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:40.180689 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2873f0c1-c363-4cf2-a081-393989177ed0-manager-config\") pod \"lws-controller-manager-fff4bf78c-4tdt2\" (UID: \"2873f0c1-c363-4cf2-a081-393989177ed0\") " pod="openshift-lws-operator/lws-controller-manager-fff4bf78c-4tdt2" Jul 13 14:26:40.182731 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:40.182702 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2873f0c1-c363-4cf2-a081-393989177ed0-cert\") pod \"lws-controller-manager-fff4bf78c-4tdt2\" (UID: \"2873f0c1-c363-4cf2-a081-393989177ed0\") " pod="openshift-lws-operator/lws-controller-manager-fff4bf78c-4tdt2" Jul 13 14:26:40.182731 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:40.182720 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2873f0c1-c363-4cf2-a081-393989177ed0-metrics-cert\") pod \"lws-controller-manager-fff4bf78c-4tdt2\" (UID: \"2873f0c1-c363-4cf2-a081-393989177ed0\") " pod="openshift-lws-operator/lws-controller-manager-fff4bf78c-4tdt2" Jul 13 14:26:40.191234 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:40.191204 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zt7d\" (UniqueName: \"kubernetes.io/projected/2873f0c1-c363-4cf2-a081-393989177ed0-kube-api-access-2zt7d\") pod \"lws-controller-manager-fff4bf78c-4tdt2\" (UID: \"2873f0c1-c363-4cf2-a081-393989177ed0\") " pod="openshift-lws-operator/lws-controller-manager-fff4bf78c-4tdt2" Jul 13 14:26:40.338087 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:40.338057 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-fff4bf78c-4tdt2" Jul 13 14:26:40.499469 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:40.499443 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-fff4bf78c-4tdt2"] Jul 13 14:26:40.500559 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:26:40.500531 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2873f0c1_c363_4cf2_a081_393989177ed0.slice/crio-a6b0e8ea0e37871ef193e7aa7b24cceebad8cc0ed73ea6c46370ec0dfe5b8c21 WatchSource:0}: Error finding container a6b0e8ea0e37871ef193e7aa7b24cceebad8cc0ed73ea6c46370ec0dfe5b8c21: Status 404 returned error can't find the container with id a6b0e8ea0e37871ef193e7aa7b24cceebad8cc0ed73ea6c46370ec0dfe5b8c21 Jul 13 14:26:40.827294 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:40.827257 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-fff4bf78c-4tdt2" event={"ID":"2873f0c1-c363-4cf2-a081-393989177ed0","Type":"ContainerStarted","Data":"a6b0e8ea0e37871ef193e7aa7b24cceebad8cc0ed73ea6c46370ec0dfe5b8c21"} Jul 13 14:26:42.839117 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:42.839073 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-fff4bf78c-4tdt2" event={"ID":"2873f0c1-c363-4cf2-a081-393989177ed0","Type":"ContainerStarted","Data":"8dee0d7d8f930332f67c5b4009da5e044c28bb27afc2afa1d0c6ff559151e3b8"} Jul 13 14:26:42.839514 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:42.839191 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-fff4bf78c-4tdt2" Jul 13 14:26:42.887834 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:42.887774 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-fff4bf78c-4tdt2" podStartSLOduration=1.209843372 podStartE2EDuration="2.887758257s" totalImagesPullingTime="1.677914885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:26:42.886863482 +0000 UTC m=+355.182866437" watchObservedRunningTime="2026-07-13 14:26:42.887758257 +0000 UTC m=+355.183761288" Jul 13 14:26:53.846069 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:26:53.846035 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-fff4bf78c-4tdt2" Jul 13 14:27:57.585963 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:27:57.585926 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bbb5b9fbf-d9lcf"] Jul 13 14:28:22.609834 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:22.609766 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5bbb5b9fbf-d9lcf" podUID="387b6167-883a-4e74-a30a-0f7c99829e36" containerName="console" containerID="cri-o://e721e74ef9870fcfd45b72d7872192690fc027bda74ca24b591d6b7cbc6edc65" gracePeriod=15 Jul 13 14:28:22.863167 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:22.863104 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:28:22.938246 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:22.938214 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxrg9\" (UniqueName: \"kubernetes.io/projected/387b6167-883a-4e74-a30a-0f7c99829e36-kube-api-access-hxrg9\") pod \"387b6167-883a-4e74-a30a-0f7c99829e36\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " Jul 13 14:28:22.938443 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:22.938258 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/387b6167-883a-4e74-a30a-0f7c99829e36-console-config\") pod \"387b6167-883a-4e74-a30a-0f7c99829e36\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " Jul 13 14:28:22.938443 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:22.938274 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/387b6167-883a-4e74-a30a-0f7c99829e36-service-ca\") pod \"387b6167-883a-4e74-a30a-0f7c99829e36\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " Jul 13 14:28:22.938443 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:22.938349 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/387b6167-883a-4e74-a30a-0f7c99829e36-console-oauth-config\") pod \"387b6167-883a-4e74-a30a-0f7c99829e36\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " Jul 13 14:28:22.938443 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:22.938381 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/387b6167-883a-4e74-a30a-0f7c99829e36-console-serving-cert\") pod \"387b6167-883a-4e74-a30a-0f7c99829e36\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " Jul 13 14:28:22.938443 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:22.938403 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/387b6167-883a-4e74-a30a-0f7c99829e36-oauth-serving-cert\") pod \"387b6167-883a-4e74-a30a-0f7c99829e36\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " Jul 13 14:28:22.938443 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:22.938441 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/387b6167-883a-4e74-a30a-0f7c99829e36-trusted-ca-bundle\") pod \"387b6167-883a-4e74-a30a-0f7c99829e36\" (UID: \"387b6167-883a-4e74-a30a-0f7c99829e36\") " Jul 13 14:28:22.938792 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:22.938767 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/387b6167-883a-4e74-a30a-0f7c99829e36-console-config" (OuterVolumeSpecName: "console-config") pod "387b6167-883a-4e74-a30a-0f7c99829e36" (UID: "387b6167-883a-4e74-a30a-0f7c99829e36"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:28:22.938850 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:22.938802 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/387b6167-883a-4e74-a30a-0f7c99829e36-service-ca" (OuterVolumeSpecName: "service-ca") pod "387b6167-883a-4e74-a30a-0f7c99829e36" (UID: "387b6167-883a-4e74-a30a-0f7c99829e36"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:28:22.938948 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:22.938925 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/387b6167-883a-4e74-a30a-0f7c99829e36-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "387b6167-883a-4e74-a30a-0f7c99829e36" (UID: "387b6167-883a-4e74-a30a-0f7c99829e36"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:28:22.939012 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:22.938991 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/387b6167-883a-4e74-a30a-0f7c99829e36-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "387b6167-883a-4e74-a30a-0f7c99829e36" (UID: "387b6167-883a-4e74-a30a-0f7c99829e36"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 14:28:22.940577 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:22.940554 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/387b6167-883a-4e74-a30a-0f7c99829e36-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "387b6167-883a-4e74-a30a-0f7c99829e36" (UID: "387b6167-883a-4e74-a30a-0f7c99829e36"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:28:22.940693 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:22.940605 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/387b6167-883a-4e74-a30a-0f7c99829e36-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "387b6167-883a-4e74-a30a-0f7c99829e36" (UID: "387b6167-883a-4e74-a30a-0f7c99829e36"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:28:22.940751 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:22.940693 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/387b6167-883a-4e74-a30a-0f7c99829e36-kube-api-access-hxrg9" (OuterVolumeSpecName: "kube-api-access-hxrg9") pod "387b6167-883a-4e74-a30a-0f7c99829e36" (UID: "387b6167-883a-4e74-a30a-0f7c99829e36"). InnerVolumeSpecName "kube-api-access-hxrg9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:28:23.039490 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:23.039456 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/387b6167-883a-4e74-a30a-0f7c99829e36-console-oauth-config\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:28:23.039490 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:23.039485 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/387b6167-883a-4e74-a30a-0f7c99829e36-console-serving-cert\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:28:23.039490 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:23.039495 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/387b6167-883a-4e74-a30a-0f7c99829e36-oauth-serving-cert\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:28:23.039735 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:23.039503 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/387b6167-883a-4e74-a30a-0f7c99829e36-trusted-ca-bundle\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:28:23.039735 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:23.039511 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxrg9\" (UniqueName: \"kubernetes.io/projected/387b6167-883a-4e74-a30a-0f7c99829e36-kube-api-access-hxrg9\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:28:23.039735 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:23.039521 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/387b6167-883a-4e74-a30a-0f7c99829e36-console-config\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:28:23.039735 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:23.039529 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/387b6167-883a-4e74-a30a-0f7c99829e36-service-ca\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:28:23.293022 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:23.292933 2568 generic.go:356] "Generic (PLEG): container finished" podID="387b6167-883a-4e74-a30a-0f7c99829e36" containerID="e721e74ef9870fcfd45b72d7872192690fc027bda74ca24b591d6b7cbc6edc65" exitCode=0 Jul 13 14:28:23.293022 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:23.292976 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bbb5b9fbf-d9lcf" Jul 13 14:28:23.293022 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:23.293008 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bbb5b9fbf-d9lcf" event={"ID":"387b6167-883a-4e74-a30a-0f7c99829e36","Type":"ContainerDied","Data":"e721e74ef9870fcfd45b72d7872192690fc027bda74ca24b591d6b7cbc6edc65"} Jul 13 14:28:23.293221 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:23.293054 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bbb5b9fbf-d9lcf" event={"ID":"387b6167-883a-4e74-a30a-0f7c99829e36","Type":"ContainerDied","Data":"a0c1f8f4654a0203e289f82d63bf9fdff4a5b5d4d89728c0265ae866a16cf6f6"} Jul 13 14:28:23.293221 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:23.293075 2568 scope.go:117] "RemoveContainer" containerID="e721e74ef9870fcfd45b72d7872192690fc027bda74ca24b591d6b7cbc6edc65" Jul 13 14:28:23.305036 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:23.305018 2568 scope.go:117] "RemoveContainer" containerID="e721e74ef9870fcfd45b72d7872192690fc027bda74ca24b591d6b7cbc6edc65" Jul 13 14:28:23.305289 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:28:23.305271 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e721e74ef9870fcfd45b72d7872192690fc027bda74ca24b591d6b7cbc6edc65\": container with ID starting with e721e74ef9870fcfd45b72d7872192690fc027bda74ca24b591d6b7cbc6edc65 not found: ID does not exist" containerID="e721e74ef9870fcfd45b72d7872192690fc027bda74ca24b591d6b7cbc6edc65" Jul 13 14:28:23.305353 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:23.305296 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e721e74ef9870fcfd45b72d7872192690fc027bda74ca24b591d6b7cbc6edc65"} err="failed to get container status \"e721e74ef9870fcfd45b72d7872192690fc027bda74ca24b591d6b7cbc6edc65\": rpc error: code = NotFound desc = could not find container \"e721e74ef9870fcfd45b72d7872192690fc027bda74ca24b591d6b7cbc6edc65\": container with ID starting with e721e74ef9870fcfd45b72d7872192690fc027bda74ca24b591d6b7cbc6edc65 not found: ID does not exist" Jul 13 14:28:23.328709 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:23.328683 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bbb5b9fbf-d9lcf"] Jul 13 14:28:23.331717 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:23.331690 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bbb5b9fbf-d9lcf"] Jul 13 14:28:24.201707 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:28:24.201663 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="387b6167-883a-4e74-a30a-0f7c99829e36" path="/var/lib/kubelet/pods/387b6167-883a-4e74-a30a-0f7c99829e36/volumes" Jul 13 14:29:38.286072 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:38.286011 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:29:38.286507 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:38.286345 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="387b6167-883a-4e74-a30a-0f7c99829e36" containerName="console" Jul 13 14:29:38.286507 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:38.286358 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="387b6167-883a-4e74-a30a-0f7c99829e36" containerName="console" Jul 13 14:29:38.286507 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:38.286446 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="387b6167-883a-4e74-a30a-0f7c99829e36" containerName="console" Jul 13 14:29:38.289603 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:38.289567 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8gx9" Jul 13 14:29:38.292357 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:38.292334 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 14:29:38.293812 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:38.293787 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fn6p6\"" Jul 13 14:29:38.293937 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:38.293804 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 13 14:29:38.293937 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:38.293818 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 14:29:38.302267 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:38.302243 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:29:38.318000 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:38.317971 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:29:38.353964 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:38.353925 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tfxl\" (UniqueName: \"kubernetes.io/projected/b982b99e-2023-4182-a43b-1c475066e7e5-kube-api-access-8tfxl\") pod \"limitador-limitador-54d6d988d5-m8gx9\" (UID: \"b982b99e-2023-4182-a43b-1c475066e7e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m8gx9" Jul 13 14:29:38.354112 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:38.354006 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b982b99e-2023-4182-a43b-1c475066e7e5-config-file\") pod \"limitador-limitador-54d6d988d5-m8gx9\" (UID: \"b982b99e-2023-4182-a43b-1c475066e7e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m8gx9" Jul 13 14:29:38.454793 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:38.454755 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tfxl\" (UniqueName: \"kubernetes.io/projected/b982b99e-2023-4182-a43b-1c475066e7e5-kube-api-access-8tfxl\") pod \"limitador-limitador-54d6d988d5-m8gx9\" (UID: \"b982b99e-2023-4182-a43b-1c475066e7e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m8gx9" Jul 13 14:29:38.454966 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:38.454815 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b982b99e-2023-4182-a43b-1c475066e7e5-config-file\") pod \"limitador-limitador-54d6d988d5-m8gx9\" (UID: \"b982b99e-2023-4182-a43b-1c475066e7e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m8gx9" Jul 13 14:29:38.455383 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:38.455363 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b982b99e-2023-4182-a43b-1c475066e7e5-config-file\") pod \"limitador-limitador-54d6d988d5-m8gx9\" (UID: \"b982b99e-2023-4182-a43b-1c475066e7e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m8gx9" Jul 13 14:29:38.464258 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:38.464236 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tfxl\" (UniqueName: \"kubernetes.io/projected/b982b99e-2023-4182-a43b-1c475066e7e5-kube-api-access-8tfxl\") pod \"limitador-limitador-54d6d988d5-m8gx9\" (UID: \"b982b99e-2023-4182-a43b-1c475066e7e5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-m8gx9" Jul 13 14:29:38.600404 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:38.600371 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8gx9" Jul 13 14:29:38.726276 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:38.726240 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-6r8hf"] Jul 13 14:29:38.729802 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:38.729780 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6r8hf" Jul 13 14:29:38.732806 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:38.732786 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7k45z\"" Jul 13 14:29:38.741386 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:38.741366 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6r8hf"] Jul 13 14:29:38.743895 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:38.743872 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:29:38.747100 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:29:38.747077 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb982b99e_2023_4182_a43b_1c475066e7e5.slice/crio-4654b71ad266b836093d6173a55d48de103553663d1d85d574f2cfbb6b9f77e5 WatchSource:0}: Error finding container 4654b71ad266b836093d6173a55d48de103553663d1d85d574f2cfbb6b9f77e5: Status 404 returned error can't find the container with id 4654b71ad266b836093d6173a55d48de103553663d1d85d574f2cfbb6b9f77e5 Jul 13 14:29:38.757444 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:38.757421 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4kzb\" (UniqueName: \"kubernetes.io/projected/e7b167fa-0f5e-4e84-bf58-0a9a494b4818-kube-api-access-x4kzb\") pod \"authorino-58cd955675-6r8hf\" (UID: \"e7b167fa-0f5e-4e84-bf58-0a9a494b4818\") " pod="kuadrant-system/authorino-58cd955675-6r8hf" Jul 13 14:29:38.857946 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:38.857843 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4kzb\" (UniqueName: \"kubernetes.io/projected/e7b167fa-0f5e-4e84-bf58-0a9a494b4818-kube-api-access-x4kzb\") pod \"authorino-58cd955675-6r8hf\" (UID: \"e7b167fa-0f5e-4e84-bf58-0a9a494b4818\") " pod="kuadrant-system/authorino-58cd955675-6r8hf" Jul 13 14:29:38.867415 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:38.867386 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4kzb\" (UniqueName: \"kubernetes.io/projected/e7b167fa-0f5e-4e84-bf58-0a9a494b4818-kube-api-access-x4kzb\") pod \"authorino-58cd955675-6r8hf\" (UID: \"e7b167fa-0f5e-4e84-bf58-0a9a494b4818\") " pod="kuadrant-system/authorino-58cd955675-6r8hf" Jul 13 14:29:39.039445 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:39.039408 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6r8hf" Jul 13 14:29:39.169408 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:39.169377 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6r8hf"] Jul 13 14:29:39.173193 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:29:39.173165 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7b167fa_0f5e_4e84_bf58_0a9a494b4818.slice/crio-4291c338032d8c0937addcd12e61fc90491175a1023336100fe135558db58c84 WatchSource:0}: Error finding container 4291c338032d8c0937addcd12e61fc90491175a1023336100fe135558db58c84: Status 404 returned error can't find the container with id 4291c338032d8c0937addcd12e61fc90491175a1023336100fe135558db58c84 Jul 13 14:29:39.634074 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:39.634036 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6r8hf" event={"ID":"e7b167fa-0f5e-4e84-bf58-0a9a494b4818","Type":"ContainerStarted","Data":"4291c338032d8c0937addcd12e61fc90491175a1023336100fe135558db58c84"} Jul 13 14:29:39.635128 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:39.635102 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8gx9" event={"ID":"b982b99e-2023-4182-a43b-1c475066e7e5","Type":"ContainerStarted","Data":"4654b71ad266b836093d6173a55d48de103553663d1d85d574f2cfbb6b9f77e5"} Jul 13 14:29:44.187036 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:44.186999 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6r8hf"] Jul 13 14:29:44.661971 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:44.661936 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8gx9" event={"ID":"b982b99e-2023-4182-a43b-1c475066e7e5","Type":"ContainerStarted","Data":"a56af59b0509168d440af28e566277bc74146a7530048d799cbc94ebd4aad8fd"} Jul 13 14:29:44.662159 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:44.662047 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8gx9" Jul 13 14:29:44.663538 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:44.663513 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6r8hf" event={"ID":"e7b167fa-0f5e-4e84-bf58-0a9a494b4818","Type":"ContainerStarted","Data":"ca27c5dbce24901e05474f4823622cb5c33ad9989a08306fd990e368ff8b45a5"} Jul 13 14:29:44.684832 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:44.684755 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8gx9" podStartSLOduration=1.832024254 podStartE2EDuration="6.684737541s" totalImagesPullingTime="4.852713287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:29:44.682650703 +0000 UTC m=+536.978653656" watchObservedRunningTime="2026-07-13 14:29:44.684737541 +0000 UTC m=+536.980740495" Jul 13 14:29:44.699288 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:44.699217 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-6r8hf" podStartSLOduration=2.264360862 podStartE2EDuration="6.699204026s" totalImagesPullingTime="4.434843164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:29:44.698547597 +0000 UTC m=+536.994550552" watchObservedRunningTime="2026-07-13 14:29:44.699204026 +0000 UTC m=+536.995206979" Jul 13 14:29:45.668288 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:45.668227 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-6r8hf" podUID="e7b167fa-0f5e-4e84-bf58-0a9a494b4818" containerName="authorino" containerID="cri-o://ca27c5dbce24901e05474f4823622cb5c33ad9989a08306fd990e368ff8b45a5" gracePeriod=30 Jul 13 14:29:45.914656 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:45.914620 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6r8hf" Jul 13 14:29:46.017945 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:46.017862 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4kzb\" (UniqueName: \"kubernetes.io/projected/e7b167fa-0f5e-4e84-bf58-0a9a494b4818-kube-api-access-x4kzb\") pod \"e7b167fa-0f5e-4e84-bf58-0a9a494b4818\" (UID: \"e7b167fa-0f5e-4e84-bf58-0a9a494b4818\") " Jul 13 14:29:46.020048 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:46.020022 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7b167fa-0f5e-4e84-bf58-0a9a494b4818-kube-api-access-x4kzb" (OuterVolumeSpecName: "kube-api-access-x4kzb") pod "e7b167fa-0f5e-4e84-bf58-0a9a494b4818" (UID: "e7b167fa-0f5e-4e84-bf58-0a9a494b4818"). InnerVolumeSpecName "kube-api-access-x4kzb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:29:46.118895 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:46.118860 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4kzb\" (UniqueName: \"kubernetes.io/projected/e7b167fa-0f5e-4e84-bf58-0a9a494b4818-kube-api-access-x4kzb\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:29:46.673496 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:46.673456 2568 generic.go:356] "Generic (PLEG): container finished" podID="e7b167fa-0f5e-4e84-bf58-0a9a494b4818" containerID="ca27c5dbce24901e05474f4823622cb5c33ad9989a08306fd990e368ff8b45a5" exitCode=0 Jul 13 14:29:46.674030 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:46.673507 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6r8hf" Jul 13 14:29:46.674030 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:46.673544 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6r8hf" event={"ID":"e7b167fa-0f5e-4e84-bf58-0a9a494b4818","Type":"ContainerDied","Data":"ca27c5dbce24901e05474f4823622cb5c33ad9989a08306fd990e368ff8b45a5"} Jul 13 14:29:46.674030 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:46.673612 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6r8hf" event={"ID":"e7b167fa-0f5e-4e84-bf58-0a9a494b4818","Type":"ContainerDied","Data":"4291c338032d8c0937addcd12e61fc90491175a1023336100fe135558db58c84"} Jul 13 14:29:46.674030 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:46.673631 2568 scope.go:117] "RemoveContainer" containerID="ca27c5dbce24901e05474f4823622cb5c33ad9989a08306fd990e368ff8b45a5" Jul 13 14:29:46.682064 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:46.682039 2568 scope.go:117] "RemoveContainer" containerID="ca27c5dbce24901e05474f4823622cb5c33ad9989a08306fd990e368ff8b45a5" Jul 13 14:29:46.682349 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:29:46.682329 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca27c5dbce24901e05474f4823622cb5c33ad9989a08306fd990e368ff8b45a5\": container with ID starting with ca27c5dbce24901e05474f4823622cb5c33ad9989a08306fd990e368ff8b45a5 not found: ID does not exist" containerID="ca27c5dbce24901e05474f4823622cb5c33ad9989a08306fd990e368ff8b45a5" Jul 13 14:29:46.682428 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:46.682364 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca27c5dbce24901e05474f4823622cb5c33ad9989a08306fd990e368ff8b45a5"} err="failed to get container status \"ca27c5dbce24901e05474f4823622cb5c33ad9989a08306fd990e368ff8b45a5\": rpc error: code = NotFound desc = could not find container \"ca27c5dbce24901e05474f4823622cb5c33ad9989a08306fd990e368ff8b45a5\": container with ID starting with ca27c5dbce24901e05474f4823622cb5c33ad9989a08306fd990e368ff8b45a5 not found: ID does not exist" Jul 13 14:29:46.691005 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:46.690981 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6r8hf"] Jul 13 14:29:46.693849 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:46.693827 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-6r8hf"] Jul 13 14:29:48.201367 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:48.201334 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7b167fa-0f5e-4e84-bf58-0a9a494b4818" path="/var/lib/kubelet/pods/e7b167fa-0f5e-4e84-bf58-0a9a494b4818/volumes" Jul 13 14:29:55.669921 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:29:55.669885 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-m8gx9" Jul 13 14:30:16.560263 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:30:16.560225 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59ffd9695-krhjm"] Jul 13 14:30:16.560930 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:30:16.560721 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7b167fa-0f5e-4e84-bf58-0a9a494b4818" containerName="authorino" Jul 13 14:30:16.560930 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:30:16.560742 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7b167fa-0f5e-4e84-bf58-0a9a494b4818" containerName="authorino" Jul 13 14:30:16.560930 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:30:16.560841 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7b167fa-0f5e-4e84-bf58-0a9a494b4818" containerName="authorino" Jul 13 14:30:16.563769 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:30:16.563748 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59ffd9695-krhjm" Jul 13 14:30:16.567904 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:30:16.567870 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7k45z\"" Jul 13 14:30:16.567904 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:30:16.567892 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 13 14:30:16.573160 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:30:16.573137 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59ffd9695-krhjm"] Jul 13 14:30:16.674694 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:30:16.674660 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e3dee4d7-7f75-492b-b41a-506d2923354a-tls-cert\") pod \"authorino-59ffd9695-krhjm\" (UID: \"e3dee4d7-7f75-492b-b41a-506d2923354a\") " pod="kuadrant-system/authorino-59ffd9695-krhjm" Jul 13 14:30:16.674894 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:30:16.674792 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m55b\" (UniqueName: \"kubernetes.io/projected/e3dee4d7-7f75-492b-b41a-506d2923354a-kube-api-access-9m55b\") pod \"authorino-59ffd9695-krhjm\" (UID: \"e3dee4d7-7f75-492b-b41a-506d2923354a\") " pod="kuadrant-system/authorino-59ffd9695-krhjm" Jul 13 14:30:16.775766 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:30:16.775728 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m55b\" (UniqueName: \"kubernetes.io/projected/e3dee4d7-7f75-492b-b41a-506d2923354a-kube-api-access-9m55b\") pod \"authorino-59ffd9695-krhjm\" (UID: \"e3dee4d7-7f75-492b-b41a-506d2923354a\") " pod="kuadrant-system/authorino-59ffd9695-krhjm" Jul 13 14:30:16.775955 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:30:16.775891 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e3dee4d7-7f75-492b-b41a-506d2923354a-tls-cert\") pod \"authorino-59ffd9695-krhjm\" (UID: \"e3dee4d7-7f75-492b-b41a-506d2923354a\") " pod="kuadrant-system/authorino-59ffd9695-krhjm" Jul 13 14:30:16.778416 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:30:16.778392 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e3dee4d7-7f75-492b-b41a-506d2923354a-tls-cert\") pod \"authorino-59ffd9695-krhjm\" (UID: \"e3dee4d7-7f75-492b-b41a-506d2923354a\") " pod="kuadrant-system/authorino-59ffd9695-krhjm" Jul 13 14:30:16.786120 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:30:16.786090 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m55b\" (UniqueName: \"kubernetes.io/projected/e3dee4d7-7f75-492b-b41a-506d2923354a-kube-api-access-9m55b\") pod \"authorino-59ffd9695-krhjm\" (UID: \"e3dee4d7-7f75-492b-b41a-506d2923354a\") " pod="kuadrant-system/authorino-59ffd9695-krhjm" Jul 13 14:30:16.873236 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:30:16.873200 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59ffd9695-krhjm" Jul 13 14:30:17.010240 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:30:17.010202 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59ffd9695-krhjm"] Jul 13 14:30:17.013478 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:30:17.013450 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3dee4d7_7f75_492b_b41a_506d2923354a.slice/crio-9b76cbf24cc224224d2b95a745abdb1d2055992d499f53c4212f0ec9c1821b2e WatchSource:0}: Error finding container 9b76cbf24cc224224d2b95a745abdb1d2055992d499f53c4212f0ec9c1821b2e: Status 404 returned error can't find the container with id 9b76cbf24cc224224d2b95a745abdb1d2055992d499f53c4212f0ec9c1821b2e Jul 13 14:30:17.815687 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:30:17.815652 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59ffd9695-krhjm" event={"ID":"e3dee4d7-7f75-492b-b41a-506d2923354a","Type":"ContainerStarted","Data":"4988c32782e48fa63f91be194bb451b25d5c1066927461378fd913a2a6a9d47a"} Jul 13 14:30:17.816094 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:30:17.815694 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59ffd9695-krhjm" event={"ID":"e3dee4d7-7f75-492b-b41a-506d2923354a","Type":"ContainerStarted","Data":"9b76cbf24cc224224d2b95a745abdb1d2055992d499f53c4212f0ec9c1821b2e"} Jul 13 14:30:17.836297 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:30:17.836242 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59ffd9695-krhjm" podStartSLOduration=1.379992953 podStartE2EDuration="1.836226119s" totalImagesPullingTime="456.233166ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:30:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:30:17.834966114 +0000 UTC m=+570.130969107" watchObservedRunningTime="2026-07-13 14:30:17.836226119 +0000 UTC m=+570.132229073" Jul 13 14:30:48.158475 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:30:48.158445 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mhprm_7c99e821-79c3-439a-b51b-46cd0ad8b03c/cluster-monitoring-operator/0.log" Jul 13 14:30:48.160011 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:30:48.159989 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mhprm_7c99e821-79c3-439a-b51b-46cd0ad8b03c/cluster-monitoring-operator/0.log" Jul 13 14:30:48.162677 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:30:48.162660 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qhxl5_80da8d62-eca0-42fe-b858-813173b67f1a/console-operator/1.log" Jul 13 14:30:48.164391 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:30:48.164371 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qhxl5_80da8d62-eca0-42fe-b858-813173b67f1a/console-operator/1.log" Jul 13 14:30:48.167679 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:30:48.167662 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbgpb_74b3da28-f883-40d3-89a1-10381739a75d/ovn-acl-logging/0.log" Jul 13 14:30:48.169305 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:30:48.169287 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbgpb_74b3da28-f883-40d3-89a1-10381739a75d/ovn-acl-logging/0.log" Jul 13 14:31:00.283207 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:31:00.283168 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:31:23.705431 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:31:23.705391 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:31:38.189092 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:31:38.189049 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:31:58.589001 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:31:58.588964 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:32:05.807652 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:05.807613 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:32:13.695565 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:13.695528 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:32:20.989176 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:20.989140 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c"] Jul 13 14:32:20.992786 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:20.992757 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" Jul 13 14:32:20.996771 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:20.996745 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 13 14:32:20.996967 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:20.996861 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-llrxn\"" Jul 13 14:32:20.996967 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:20.996864 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 13 14:32:20.996967 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:20.996908 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 13 14:32:21.001980 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:21.001956 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c"] Jul 13 14:32:21.027460 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:21.027422 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41c2aebf-74e9-4994-835c-aecc85b6e1a6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c\" (UID: \"41c2aebf-74e9-4994-835c-aecc85b6e1a6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" Jul 13 14:32:21.027460 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:21.027458 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdfjm\" (UniqueName: \"kubernetes.io/projected/41c2aebf-74e9-4994-835c-aecc85b6e1a6-kube-api-access-fdfjm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c\" (UID: \"41c2aebf-74e9-4994-835c-aecc85b6e1a6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" Jul 13 14:32:21.027727 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:21.027481 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41c2aebf-74e9-4994-835c-aecc85b6e1a6-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c\" (UID: \"41c2aebf-74e9-4994-835c-aecc85b6e1a6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" Jul 13 14:32:21.027727 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:21.027546 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41c2aebf-74e9-4994-835c-aecc85b6e1a6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c\" (UID: \"41c2aebf-74e9-4994-835c-aecc85b6e1a6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" Jul 13 14:32:21.027727 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:21.027683 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41c2aebf-74e9-4994-835c-aecc85b6e1a6-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c\" (UID: \"41c2aebf-74e9-4994-835c-aecc85b6e1a6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" Jul 13 14:32:21.027727 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:21.027715 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41c2aebf-74e9-4994-835c-aecc85b6e1a6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c\" (UID: \"41c2aebf-74e9-4994-835c-aecc85b6e1a6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" Jul 13 14:32:21.128714 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:21.128674 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41c2aebf-74e9-4994-835c-aecc85b6e1a6-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c\" (UID: \"41c2aebf-74e9-4994-835c-aecc85b6e1a6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" Jul 13 14:32:21.128877 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:21.128722 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41c2aebf-74e9-4994-835c-aecc85b6e1a6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c\" (UID: \"41c2aebf-74e9-4994-835c-aecc85b6e1a6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" Jul 13 14:32:21.128877 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:21.128787 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41c2aebf-74e9-4994-835c-aecc85b6e1a6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c\" (UID: \"41c2aebf-74e9-4994-835c-aecc85b6e1a6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" Jul 13 14:32:21.128877 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:21.128818 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdfjm\" (UniqueName: \"kubernetes.io/projected/41c2aebf-74e9-4994-835c-aecc85b6e1a6-kube-api-access-fdfjm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c\" (UID: \"41c2aebf-74e9-4994-835c-aecc85b6e1a6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" Jul 13 14:32:21.128877 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:21.128851 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41c2aebf-74e9-4994-835c-aecc85b6e1a6-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c\" (UID: \"41c2aebf-74e9-4994-835c-aecc85b6e1a6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" Jul 13 14:32:21.129027 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:21.128894 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41c2aebf-74e9-4994-835c-aecc85b6e1a6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c\" (UID: \"41c2aebf-74e9-4994-835c-aecc85b6e1a6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" Jul 13 14:32:21.129152 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:21.129131 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41c2aebf-74e9-4994-835c-aecc85b6e1a6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c\" (UID: \"41c2aebf-74e9-4994-835c-aecc85b6e1a6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" Jul 13 14:32:21.129200 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:21.129152 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41c2aebf-74e9-4994-835c-aecc85b6e1a6-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c\" (UID: \"41c2aebf-74e9-4994-835c-aecc85b6e1a6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" Jul 13 14:32:21.129306 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:21.129289 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41c2aebf-74e9-4994-835c-aecc85b6e1a6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c\" (UID: \"41c2aebf-74e9-4994-835c-aecc85b6e1a6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" Jul 13 14:32:21.131138 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:21.131108 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41c2aebf-74e9-4994-835c-aecc85b6e1a6-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c\" (UID: \"41c2aebf-74e9-4994-835c-aecc85b6e1a6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" Jul 13 14:32:21.131262 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:21.131245 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41c2aebf-74e9-4994-835c-aecc85b6e1a6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c\" (UID: \"41c2aebf-74e9-4994-835c-aecc85b6e1a6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" Jul 13 14:32:21.138326 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:21.138302 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdfjm\" (UniqueName: \"kubernetes.io/projected/41c2aebf-74e9-4994-835c-aecc85b6e1a6-kube-api-access-fdfjm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c\" (UID: \"41c2aebf-74e9-4994-835c-aecc85b6e1a6\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" Jul 13 14:32:21.303568 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:21.303487 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" Jul 13 14:32:21.442766 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:21.442744 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c"] Jul 13 14:32:21.447642 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:32:21.447609 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41c2aebf_74e9_4994_835c_aecc85b6e1a6.slice/crio-ec5c40f61425750a84e6fcd7286f35409b4ee068ae156b8389200a8964a96d3a WatchSource:0}: Error finding container ec5c40f61425750a84e6fcd7286f35409b4ee068ae156b8389200a8964a96d3a: Status 404 returned error can't find the container with id ec5c40f61425750a84e6fcd7286f35409b4ee068ae156b8389200a8964a96d3a Jul 13 14:32:21.449439 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:21.449421 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 14:32:22.385362 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:22.385318 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" event={"ID":"41c2aebf-74e9-4994-835c-aecc85b6e1a6","Type":"ContainerStarted","Data":"ec5c40f61425750a84e6fcd7286f35409b4ee068ae156b8389200a8964a96d3a"} Jul 13 14:32:23.392526 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:23.392483 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" event={"ID":"41c2aebf-74e9-4994-835c-aecc85b6e1a6","Type":"ContainerStarted","Data":"2cc563a5a565feafa38e8c915c985b1264d318a7bd728b7f18904ff7142694e9"} Jul 13 14:32:23.421729 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:23.421681 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" podStartSLOduration=2.3525736520000002 podStartE2EDuration="3.421664408s" totalImagesPullingTime="1.069090756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:32:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:32:23.420318655 +0000 UTC m=+695.716321608" watchObservedRunningTime="2026-07-13 14:32:23.421664408 +0000 UTC m=+695.717667362" Jul 13 14:32:23.900412 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:23.900362 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:32:31.304274 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:31.304242 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" Jul 13 14:32:31.304748 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:31.304287 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" Jul 13 14:32:31.317297 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:31.317274 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" Jul 13 14:32:31.440881 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:32:31.440854 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c" Jul 13 14:33:13.530936 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:13.530897 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-85496f78b6-q5vlx"] Jul 13 14:33:13.534131 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:13.534112 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85496f78b6-q5vlx" Jul 13 14:33:13.553165 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:13.553140 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85496f78b6-q5vlx"] Jul 13 14:33:13.666422 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:13.666380 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk457\" (UniqueName: \"kubernetes.io/projected/95128f06-9f1b-474d-b11d-3c9c20669faf-kube-api-access-fk457\") pod \"authorino-85496f78b6-q5vlx\" (UID: \"95128f06-9f1b-474d-b11d-3c9c20669faf\") " pod="kuadrant-system/authorino-85496f78b6-q5vlx" Jul 13 14:33:13.666422 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:13.666421 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/95128f06-9f1b-474d-b11d-3c9c20669faf-tls-cert\") pod \"authorino-85496f78b6-q5vlx\" (UID: \"95128f06-9f1b-474d-b11d-3c9c20669faf\") " pod="kuadrant-system/authorino-85496f78b6-q5vlx" Jul 13 14:33:13.767548 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:13.767503 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk457\" (UniqueName: \"kubernetes.io/projected/95128f06-9f1b-474d-b11d-3c9c20669faf-kube-api-access-fk457\") pod \"authorino-85496f78b6-q5vlx\" (UID: \"95128f06-9f1b-474d-b11d-3c9c20669faf\") " pod="kuadrant-system/authorino-85496f78b6-q5vlx" Jul 13 14:33:13.767548 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:13.767547 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/95128f06-9f1b-474d-b11d-3c9c20669faf-tls-cert\") pod \"authorino-85496f78b6-q5vlx\" (UID: \"95128f06-9f1b-474d-b11d-3c9c20669faf\") " pod="kuadrant-system/authorino-85496f78b6-q5vlx" Jul 13 14:33:13.770128 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:13.770104 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/95128f06-9f1b-474d-b11d-3c9c20669faf-tls-cert\") pod \"authorino-85496f78b6-q5vlx\" (UID: \"95128f06-9f1b-474d-b11d-3c9c20669faf\") " pod="kuadrant-system/authorino-85496f78b6-q5vlx" Jul 13 14:33:13.778996 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:13.778950 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk457\" (UniqueName: \"kubernetes.io/projected/95128f06-9f1b-474d-b11d-3c9c20669faf-kube-api-access-fk457\") pod \"authorino-85496f78b6-q5vlx\" (UID: \"95128f06-9f1b-474d-b11d-3c9c20669faf\") " pod="kuadrant-system/authorino-85496f78b6-q5vlx" Jul 13 14:33:13.843478 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:13.843433 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85496f78b6-q5vlx" Jul 13 14:33:13.976175 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:13.976151 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85496f78b6-q5vlx"] Jul 13 14:33:13.978271 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:33:13.978232 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95128f06_9f1b_474d_b11d_3c9c20669faf.slice/crio-7889ac92ecfe3d1054ada7d05197f6b25cc57fbd4cc855155f3fa1259b1d223c WatchSource:0}: Error finding container 7889ac92ecfe3d1054ada7d05197f6b25cc57fbd4cc855155f3fa1259b1d223c: Status 404 returned error can't find the container with id 7889ac92ecfe3d1054ada7d05197f6b25cc57fbd4cc855155f3fa1259b1d223c Jul 13 14:33:14.627472 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:14.627438 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85496f78b6-q5vlx" event={"ID":"95128f06-9f1b-474d-b11d-3c9c20669faf","Type":"ContainerStarted","Data":"7889ac92ecfe3d1054ada7d05197f6b25cc57fbd4cc855155f3fa1259b1d223c"} Jul 13 14:33:15.636998 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:15.636939 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85496f78b6-q5vlx" event={"ID":"95128f06-9f1b-474d-b11d-3c9c20669faf","Type":"ContainerStarted","Data":"6b2d9ca08112e9da78685ab836febcc9498d83a47985d830c33122f32e37bcfa"} Jul 13 14:33:15.689151 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:15.689062 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-85496f78b6-q5vlx" podStartSLOduration=1.597326568 podStartE2EDuration="2.689037828s" totalImagesPullingTime="1.09171126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:33:15.68694737 +0000 UTC m=+747.982950325" watchObservedRunningTime="2026-07-13 14:33:15.689037828 +0000 UTC m=+747.985040784" Jul 13 14:33:15.734088 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:15.734045 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59ffd9695-krhjm"] Jul 13 14:33:15.734277 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:15.734232 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59ffd9695-krhjm" podUID="e3dee4d7-7f75-492b-b41a-506d2923354a" containerName="authorino" containerID="cri-o://4988c32782e48fa63f91be194bb451b25d5c1066927461378fd913a2a6a9d47a" gracePeriod=30 Jul 13 14:33:15.985781 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:15.985743 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59ffd9695-krhjm" Jul 13 14:33:16.089966 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:16.089925 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9m55b\" (UniqueName: \"kubernetes.io/projected/e3dee4d7-7f75-492b-b41a-506d2923354a-kube-api-access-9m55b\") pod \"e3dee4d7-7f75-492b-b41a-506d2923354a\" (UID: \"e3dee4d7-7f75-492b-b41a-506d2923354a\") " Jul 13 14:33:16.090175 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:16.089995 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e3dee4d7-7f75-492b-b41a-506d2923354a-tls-cert\") pod \"e3dee4d7-7f75-492b-b41a-506d2923354a\" (UID: \"e3dee4d7-7f75-492b-b41a-506d2923354a\") " Jul 13 14:33:16.092158 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:16.092112 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3dee4d7-7f75-492b-b41a-506d2923354a-kube-api-access-9m55b" (OuterVolumeSpecName: "kube-api-access-9m55b") pod "e3dee4d7-7f75-492b-b41a-506d2923354a" (UID: "e3dee4d7-7f75-492b-b41a-506d2923354a"). InnerVolumeSpecName "kube-api-access-9m55b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:33:16.100848 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:16.100816 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3dee4d7-7f75-492b-b41a-506d2923354a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e3dee4d7-7f75-492b-b41a-506d2923354a" (UID: "e3dee4d7-7f75-492b-b41a-506d2923354a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:33:16.190896 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:16.190808 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9m55b\" (UniqueName: \"kubernetes.io/projected/e3dee4d7-7f75-492b-b41a-506d2923354a-kube-api-access-9m55b\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:33:16.190896 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:16.190854 2568 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e3dee4d7-7f75-492b-b41a-506d2923354a-tls-cert\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:33:16.643062 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:16.643025 2568 generic.go:356] "Generic (PLEG): container finished" podID="e3dee4d7-7f75-492b-b41a-506d2923354a" containerID="4988c32782e48fa63f91be194bb451b25d5c1066927461378fd913a2a6a9d47a" exitCode=0 Jul 13 14:33:16.643509 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:16.643093 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59ffd9695-krhjm" Jul 13 14:33:16.643509 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:16.643087 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59ffd9695-krhjm" event={"ID":"e3dee4d7-7f75-492b-b41a-506d2923354a","Type":"ContainerDied","Data":"4988c32782e48fa63f91be194bb451b25d5c1066927461378fd913a2a6a9d47a"} Jul 13 14:33:16.643509 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:16.643211 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59ffd9695-krhjm" event={"ID":"e3dee4d7-7f75-492b-b41a-506d2923354a","Type":"ContainerDied","Data":"9b76cbf24cc224224d2b95a745abdb1d2055992d499f53c4212f0ec9c1821b2e"} Jul 13 14:33:16.643509 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:16.643233 2568 scope.go:117] "RemoveContainer" containerID="4988c32782e48fa63f91be194bb451b25d5c1066927461378fd913a2a6a9d47a" Jul 13 14:33:16.652853 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:16.652831 2568 scope.go:117] "RemoveContainer" containerID="4988c32782e48fa63f91be194bb451b25d5c1066927461378fd913a2a6a9d47a" Jul 13 14:33:16.653169 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:33:16.653142 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4988c32782e48fa63f91be194bb451b25d5c1066927461378fd913a2a6a9d47a\": container with ID starting with 4988c32782e48fa63f91be194bb451b25d5c1066927461378fd913a2a6a9d47a not found: ID does not exist" containerID="4988c32782e48fa63f91be194bb451b25d5c1066927461378fd913a2a6a9d47a" Jul 13 14:33:16.653268 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:16.653175 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4988c32782e48fa63f91be194bb451b25d5c1066927461378fd913a2a6a9d47a"} err="failed to get container status \"4988c32782e48fa63f91be194bb451b25d5c1066927461378fd913a2a6a9d47a\": rpc error: code = NotFound desc = could not find container \"4988c32782e48fa63f91be194bb451b25d5c1066927461378fd913a2a6a9d47a\": container with ID starting with 4988c32782e48fa63f91be194bb451b25d5c1066927461378fd913a2a6a9d47a not found: ID does not exist" Jul 13 14:33:16.662600 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:16.662557 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59ffd9695-krhjm"] Jul 13 14:33:16.665026 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:16.665003 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59ffd9695-krhjm"] Jul 13 14:33:18.202854 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:18.202811 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3dee4d7-7f75-492b-b41a-506d2923354a" path="/var/lib/kubelet/pods/e3dee4d7-7f75-492b-b41a-506d2923354a/volumes" Jul 13 14:33:45.716631 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:45.716574 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:33:55.117737 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:33:55.117698 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:34:06.303546 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:34:06.303504 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:34:15.694238 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:34:15.694199 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:34:26.414842 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:34:26.414804 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:34:53.815515 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:34:53.815476 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:35:05.504523 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:35:05.504485 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:35:41.901880 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:35:41.901801 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:35:48.188240 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:35:48.188211 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mhprm_7c99e821-79c3-439a-b51b-46cd0ad8b03c/cluster-monitoring-operator/0.log" Jul 13 14:35:48.188784 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:35:48.188298 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mhprm_7c99e821-79c3-439a-b51b-46cd0ad8b03c/cluster-monitoring-operator/0.log" Jul 13 14:35:48.192598 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:35:48.192559 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qhxl5_80da8d62-eca0-42fe-b858-813173b67f1a/console-operator/1.log" Jul 13 14:35:48.192731 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:35:48.192571 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qhxl5_80da8d62-eca0-42fe-b858-813173b67f1a/console-operator/1.log" Jul 13 14:35:48.197928 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:35:48.197894 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbgpb_74b3da28-f883-40d3-89a1-10381739a75d/ovn-acl-logging/0.log" Jul 13 14:35:48.198321 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:35:48.198301 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbgpb_74b3da28-f883-40d3-89a1-10381739a75d/ovn-acl-logging/0.log" Jul 13 14:35:51.394698 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:35:51.394667 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:36:00.212889 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:36:00.212855 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:36:11.798122 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:36:11.798087 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:36:22.801633 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:36:22.801577 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:36:31.702803 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:36:31.702767 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:36:43.898139 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:36:43.898096 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:36:53.992743 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:36:53.992707 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:37:16.391868 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:37:16.391822 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:37:28.596289 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:37:28.596255 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:37:53.330852 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:37:53.330814 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:38:03.513213 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:38:03.513171 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:38:20.205373 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:38:20.205338 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:38:29.903523 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:38:29.903487 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:38:39.692672 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:38:39.692639 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:38:49.597523 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:38:49.597435 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:38:58.707027 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:38:58.706974 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:40:47.616518 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:40:47.616479 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:40:48.216043 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:40:48.216012 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mhprm_7c99e821-79c3-439a-b51b-46cd0ad8b03c/cluster-monitoring-operator/0.log" Jul 13 14:40:48.218235 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:40:48.218211 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mhprm_7c99e821-79c3-439a-b51b-46cd0ad8b03c/cluster-monitoring-operator/0.log" Jul 13 14:40:48.220082 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:40:48.220060 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qhxl5_80da8d62-eca0-42fe-b858-813173b67f1a/console-operator/1.log" Jul 13 14:40:48.222062 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:40:48.222039 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qhxl5_80da8d62-eca0-42fe-b858-813173b67f1a/console-operator/1.log" Jul 13 14:40:48.224903 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:40:48.224882 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbgpb_74b3da28-f883-40d3-89a1-10381739a75d/ovn-acl-logging/0.log" Jul 13 14:40:48.226740 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:40:48.226724 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbgpb_74b3da28-f883-40d3-89a1-10381739a75d/ovn-acl-logging/0.log" Jul 13 14:41:00.006966 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:41:00.006930 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:41:09.101007 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:41:09.100965 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:41:20.400712 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:41:20.400675 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:41:30.111653 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:41:30.111610 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:41:40.993669 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:41:40.993565 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:41:51.507461 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:41:51.507423 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:42:01.105386 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:42:01.105349 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:42:11.806387 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:42:11.806341 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:42:22.216323 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:42:22.216289 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:42:34.697136 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:42:34.697099 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:42:56.810223 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:42:56.810185 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:43:06.595505 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:43:06.595469 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:43:16.406284 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:43:16.406238 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:43:27.406476 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:43:27.406429 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:43:37.002259 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:43:37.002218 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:43:49.401976 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:43:49.401928 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:43:59.901549 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:43:59.901511 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:44:09.303426 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:44:09.303391 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:44:19.295523 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:44:19.295484 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:44:28.720573 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:44:28.720534 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:44:38.193439 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:44:38.193401 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:44:52.811860 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:44:52.811762 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:45:02.618203 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:45:02.618166 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:45:12.297968 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:45:12.297929 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:45:21.901823 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:45:21.901784 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:45:31.506726 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:45:31.506689 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:45:43.795907 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:45:43.795871 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:45:48.242353 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:45:48.242323 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mhprm_7c99e821-79c3-439a-b51b-46cd0ad8b03c/cluster-monitoring-operator/0.log" Jul 13 14:45:48.244562 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:45:48.244538 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mhprm_7c99e821-79c3-439a-b51b-46cd0ad8b03c/cluster-monitoring-operator/0.log" Jul 13 14:45:48.247177 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:45:48.247154 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qhxl5_80da8d62-eca0-42fe-b858-813173b67f1a/console-operator/1.log" Jul 13 14:45:48.249216 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:45:48.249195 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qhxl5_80da8d62-eca0-42fe-b858-813173b67f1a/console-operator/1.log" Jul 13 14:45:48.252038 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:45:48.252018 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbgpb_74b3da28-f883-40d3-89a1-10381739a75d/ovn-acl-logging/0.log" Jul 13 14:45:48.254310 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:45:48.254286 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbgpb_74b3da28-f883-40d3-89a1-10381739a75d/ovn-acl-logging/0.log" Jul 13 14:46:00.206672 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:46:00.206630 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:46:12.519669 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:46:12.519628 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:46:22.196084 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:46:22.196047 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:46:36.205304 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:46:36.205271 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:46:45.405545 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:46:45.405507 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:46:55.404425 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:46:55.404391 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:50:48.269853 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:50:48.269820 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mhprm_7c99e821-79c3-439a-b51b-46cd0ad8b03c/cluster-monitoring-operator/0.log" Jul 13 14:50:48.274015 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:50:48.273989 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mhprm_7c99e821-79c3-439a-b51b-46cd0ad8b03c/cluster-monitoring-operator/0.log" Jul 13 14:50:48.274216 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:50:48.274201 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qhxl5_80da8d62-eca0-42fe-b858-813173b67f1a/console-operator/1.log" Jul 13 14:50:48.278185 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:50:48.278163 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qhxl5_80da8d62-eca0-42fe-b858-813173b67f1a/console-operator/1.log" Jul 13 14:50:48.279130 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:50:48.279109 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbgpb_74b3da28-f883-40d3-89a1-10381739a75d/ovn-acl-logging/0.log" Jul 13 14:50:48.283384 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:50:48.283363 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbgpb_74b3da28-f883-40d3-89a1-10381739a75d/ovn-acl-logging/0.log" Jul 13 14:53:36.601217 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:53:36.601183 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:53:46.293793 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:53:46.293710 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:55:13.192762 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:55:13.192711 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:55:22.096610 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:55:22.096542 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:55:33.095926 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:55:33.095889 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:55:45.100268 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:55:45.100232 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:55:48.298644 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:55:48.298607 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mhprm_7c99e821-79c3-439a-b51b-46cd0ad8b03c/cluster-monitoring-operator/0.log" Jul 13 14:55:48.302890 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:55:48.302862 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qhxl5_80da8d62-eca0-42fe-b858-813173b67f1a/console-operator/1.log" Jul 13 14:55:48.304364 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:55:48.304344 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mhprm_7c99e821-79c3-439a-b51b-46cd0ad8b03c/cluster-monitoring-operator/0.log" Jul 13 14:55:48.307794 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:55:48.307776 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbgpb_74b3da28-f883-40d3-89a1-10381739a75d/ovn-acl-logging/0.log" Jul 13 14:55:48.308645 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:55:48.308624 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qhxl5_80da8d62-eca0-42fe-b858-813173b67f1a/console-operator/1.log" Jul 13 14:55:48.312865 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:55:48.312842 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbgpb_74b3da28-f883-40d3-89a1-10381739a75d/ovn-acl-logging/0.log" Jul 13 14:56:18.396499 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:18.396441 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:56:23.297068 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.297030 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs"] Jul 13 14:56:23.297473 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.297406 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3dee4d7-7f75-492b-b41a-506d2923354a" containerName="authorino" Jul 13 14:56:23.297473 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.297419 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3dee4d7-7f75-492b-b41a-506d2923354a" containerName="authorino" Jul 13 14:56:23.297560 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.297531 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3dee4d7-7f75-492b-b41a-506d2923354a" containerName="authorino" Jul 13 14:56:23.300569 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.300547 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" Jul 13 14:56:23.303310 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.303285 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-575864a3\"/\"e2e-lifecycle-model-575864a3-kserve-self-signed-certs\"" Jul 13 14:56:23.303441 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.303332 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-575864a3\"/\"openshift-service-ca.crt\"" Jul 13 14:56:23.304400 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.304382 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-575864a3\"/\"default-dockercfg-kvdf8\"" Jul 13 14:56:23.304461 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.304418 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-575864a3\"/\"kube-root-ca.crt\"" Jul 13 14:56:23.310369 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.310345 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs"] Jul 13 14:56:23.398883 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.398847 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-tls-certs\") pod \"e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs\" (UID: \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\") " pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" Jul 13 14:56:23.399080 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.398899 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-tmp-dir\") pod \"e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs\" (UID: \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\") " pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" Jul 13 14:56:23.399080 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.398957 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-home\") pod \"e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs\" (UID: \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\") " pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" Jul 13 14:56:23.399080 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.398982 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-model-cache\") pod \"e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs\" (UID: \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\") " pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" Jul 13 14:56:23.399080 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.399008 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-dshm\") pod \"e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs\" (UID: \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\") " pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" Jul 13 14:56:23.399080 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.399034 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j46v5\" (UniqueName: \"kubernetes.io/projected/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-kube-api-access-j46v5\") pod \"e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs\" (UID: \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\") " pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" Jul 13 14:56:23.499701 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.499669 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-home\") pod \"e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs\" (UID: \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\") " pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" Jul 13 14:56:23.499895 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.499725 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-model-cache\") pod \"e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs\" (UID: \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\") " pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" Jul 13 14:56:23.499895 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.499766 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-dshm\") pod \"e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs\" (UID: \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\") " pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" Jul 13 14:56:23.499895 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.499812 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j46v5\" (UniqueName: \"kubernetes.io/projected/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-kube-api-access-j46v5\") pod \"e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs\" (UID: \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\") " pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" Jul 13 14:56:23.499895 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.499848 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-tls-certs\") pod \"e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs\" (UID: \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\") " pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" Jul 13 14:56:23.500104 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.499924 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-tmp-dir\") pod \"e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs\" (UID: \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\") " pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" Jul 13 14:56:23.500167 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.500132 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-home\") pod \"e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs\" (UID: \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\") " pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" Jul 13 14:56:23.500221 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.500173 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-model-cache\") pod \"e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs\" (UID: \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\") " pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" Jul 13 14:56:23.500312 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.500286 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-tmp-dir\") pod \"e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs\" (UID: \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\") " pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" Jul 13 14:56:23.502141 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.502120 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-dshm\") pod \"e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs\" (UID: \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\") " pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" Jul 13 14:56:23.502284 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.502266 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-tls-certs\") pod \"e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs\" (UID: \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\") " pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" Jul 13 14:56:23.508984 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.508959 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j46v5\" (UniqueName: \"kubernetes.io/projected/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-kube-api-access-j46v5\") pod \"e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs\" (UID: \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\") " pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" Jul 13 14:56:23.610848 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.610808 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" Jul 13 14:56:23.747387 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.747364 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs"] Jul 13 14:56:23.749537 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:56:23.749507 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63ddab3a_a9f5_4b5f_89d6_963a01bea79d.slice/crio-fb426d0c63e9eca10197cc55694008e1076c83aecb4f8bc8e074433925ae7a89 WatchSource:0}: Error finding container fb426d0c63e9eca10197cc55694008e1076c83aecb4f8bc8e074433925ae7a89: Status 404 returned error can't find the container with id fb426d0c63e9eca10197cc55694008e1076c83aecb4f8bc8e074433925ae7a89 Jul 13 14:56:23.979184 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.979084 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" event={"ID":"63ddab3a-a9f5-4b5f-89d6-963a01bea79d","Type":"ContainerStarted","Data":"15c866c80d9b68194ef8bce7de52f677c9328e19324c17ed023950d49b2a5777"} Jul 13 14:56:23.979184 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:23.979138 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" event={"ID":"63ddab3a-a9f5-4b5f-89d6-963a01bea79d","Type":"ContainerStarted","Data":"fb426d0c63e9eca10197cc55694008e1076c83aecb4f8bc8e074433925ae7a89"} Jul 13 14:56:29.698142 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:29.698089 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" podStartSLOduration=6.698071631 podStartE2EDuration="6.698071631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:56:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:56:24.008484389 +0000 UTC m=+2136.304487343" watchObservedRunningTime="2026-07-13 14:56:29.698071631 +0000 UTC m=+2141.994074585" Jul 13 14:56:29.698553 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:29.698398 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:56:33.611656 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:33.611613 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" Jul 13 14:56:33.612084 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:33.611683 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" Jul 13 14:56:33.624402 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:33.624377 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" Jul 13 14:56:34.040643 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:34.040544 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" Jul 13 14:56:46.298308 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:46.298220 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:56:54.541946 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:56:54.541904 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs"] Jul 13 14:57:00.193968 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:00.193930 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:57:09.562358 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:09.562307 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" podUID="63ddab3a-a9f5-4b5f-89d6-963a01bea79d" containerName="main" containerID="cri-o://15c866c80d9b68194ef8bce7de52f677c9328e19324c17ed023950d49b2a5777" gracePeriod=45 Jul 13 14:57:09.820538 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:09.820505 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" Jul 13 14:57:10.000270 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.000233 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-model-cache\") pod \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\" (UID: \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\") " Jul 13 14:57:10.000476 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.000311 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j46v5\" (UniqueName: \"kubernetes.io/projected/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-kube-api-access-j46v5\") pod \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\" (UID: \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\") " Jul 13 14:57:10.000476 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.000377 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-tls-certs\") pod \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\" (UID: \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\") " Jul 13 14:57:10.000476 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.000401 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-dshm\") pod \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\" (UID: \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\") " Jul 13 14:57:10.000476 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.000425 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-home\") pod \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\" (UID: \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\") " Jul 13 14:57:10.000727 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.000488 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-tmp-dir\") pod \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\" (UID: \"63ddab3a-a9f5-4b5f-89d6-963a01bea79d\") " Jul 13 14:57:10.000727 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.000564 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-model-cache" (OuterVolumeSpecName: "model-cache") pod "63ddab3a-a9f5-4b5f-89d6-963a01bea79d" (UID: "63ddab3a-a9f5-4b5f-89d6-963a01bea79d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 14:57:10.000825 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.000765 2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-model-cache\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:57:10.000825 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.000786 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "63ddab3a-a9f5-4b5f-89d6-963a01bea79d" (UID: "63ddab3a-a9f5-4b5f-89d6-963a01bea79d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 14:57:10.000921 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.000816 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-home" (OuterVolumeSpecName: "home") pod "63ddab3a-a9f5-4b5f-89d6-963a01bea79d" (UID: "63ddab3a-a9f5-4b5f-89d6-963a01bea79d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 14:57:10.002763 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.002720 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-dshm" (OuterVolumeSpecName: "dshm") pod "63ddab3a-a9f5-4b5f-89d6-963a01bea79d" (UID: "63ddab3a-a9f5-4b5f-89d6-963a01bea79d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 14:57:10.002860 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.002768 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "63ddab3a-a9f5-4b5f-89d6-963a01bea79d" (UID: "63ddab3a-a9f5-4b5f-89d6-963a01bea79d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 14:57:10.002860 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.002810 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-kube-api-access-j46v5" (OuterVolumeSpecName: "kube-api-access-j46v5") pod "63ddab3a-a9f5-4b5f-89d6-963a01bea79d" (UID: "63ddab3a-a9f5-4b5f-89d6-963a01bea79d"). InnerVolumeSpecName "kube-api-access-j46v5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 14:57:10.101230 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.101126 2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-tmp-dir\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:57:10.101230 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.101169 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j46v5\" (UniqueName: \"kubernetes.io/projected/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-kube-api-access-j46v5\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:57:10.101230 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.101181 2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-tls-certs\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:57:10.101230 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.101190 2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-dshm\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:57:10.101230 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.101197 2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63ddab3a-a9f5-4b5f-89d6-963a01bea79d-home\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 14:57:10.196260 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.196226 2568 generic.go:356] "Generic (PLEG): container finished" podID="63ddab3a-a9f5-4b5f-89d6-963a01bea79d" containerID="15c866c80d9b68194ef8bce7de52f677c9328e19324c17ed023950d49b2a5777" exitCode=0 Jul 13 14:57:10.196434 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.196342 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" Jul 13 14:57:10.201637 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.201607 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" event={"ID":"63ddab3a-a9f5-4b5f-89d6-963a01bea79d","Type":"ContainerDied","Data":"15c866c80d9b68194ef8bce7de52f677c9328e19324c17ed023950d49b2a5777"} Jul 13 14:57:10.201802 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.201647 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs" event={"ID":"63ddab3a-a9f5-4b5f-89d6-963a01bea79d","Type":"ContainerDied","Data":"fb426d0c63e9eca10197cc55694008e1076c83aecb4f8bc8e074433925ae7a89"} Jul 13 14:57:10.201802 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.201667 2568 scope.go:117] "RemoveContainer" containerID="15c866c80d9b68194ef8bce7de52f677c9328e19324c17ed023950d49b2a5777" Jul 13 14:57:10.210902 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.210875 2568 scope.go:117] "RemoveContainer" containerID="15c866c80d9b68194ef8bce7de52f677c9328e19324c17ed023950d49b2a5777" Jul 13 14:57:10.211221 ip-10-0-138-70 kubenswrapper[2568]: E0713 14:57:10.211195 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15c866c80d9b68194ef8bce7de52f677c9328e19324c17ed023950d49b2a5777\": container with ID starting with 15c866c80d9b68194ef8bce7de52f677c9328e19324c17ed023950d49b2a5777 not found: ID does not exist" containerID="15c866c80d9b68194ef8bce7de52f677c9328e19324c17ed023950d49b2a5777" Jul 13 14:57:10.211284 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.211233 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15c866c80d9b68194ef8bce7de52f677c9328e19324c17ed023950d49b2a5777"} err="failed to get container status \"15c866c80d9b68194ef8bce7de52f677c9328e19324c17ed023950d49b2a5777\": rpc error: code = NotFound desc = could not find container \"15c866c80d9b68194ef8bce7de52f677c9328e19324c17ed023950d49b2a5777\": container with ID starting with 15c866c80d9b68194ef8bce7de52f677c9328e19324c17ed023950d49b2a5777 not found: ID does not exist" Jul 13 14:57:10.221616 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.221575 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs"] Jul 13 14:57:10.225881 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:10.225857 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-575864a3/e2e-lifecycle-model-575864a3-kserve-5dcc8cdb87-btzqs"] Jul 13 14:57:12.202245 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:12.202209 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63ddab3a-a9f5-4b5f-89d6-963a01bea79d" path="/var/lib/kubelet/pods/63ddab3a-a9f5-4b5f-89d6-963a01bea79d/volumes" Jul 13 14:57:41.489726 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:41.489689 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:57:50.910299 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:57:50.910257 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:58:04.236152 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:58:04.236114 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:58:51.890967 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:58:51.890933 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:59:00.686374 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.686339 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d"] Jul 13 14:59:00.686895 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.686677 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63ddab3a-a9f5-4b5f-89d6-963a01bea79d" containerName="main" Jul 13 14:59:00.686895 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.686690 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="63ddab3a-a9f5-4b5f-89d6-963a01bea79d" containerName="main" Jul 13 14:59:00.686895 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.686758 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="63ddab3a-a9f5-4b5f-89d6-963a01bea79d" containerName="main" Jul 13 14:59:00.689655 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.689633 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" Jul 13 14:59:00.693956 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.693931 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d6591f\"/\"default-dockercfg-vmjlk\"" Jul 13 14:59:00.693956 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.693949 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d6591f\"/\"test-model-d6591f-kserve-self-signed-certs\"" Jul 13 14:59:00.694137 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.693932 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d6591f\"/\"openshift-service-ca.crt\"" Jul 13 14:59:00.694137 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.693986 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d6591f\"/\"kube-root-ca.crt\"" Jul 13 14:59:00.700516 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.700492 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d"] Jul 13 14:59:00.831937 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.831893 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6903786-685b-4c51-89af-acb3661b6169-tls-certs\") pod \"test-model-d6591f-kserve-74bb655f7f-scl9d\" (UID: \"b6903786-685b-4c51-89af-acb3661b6169\") " pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" Jul 13 14:59:00.832113 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.831959 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6903786-685b-4c51-89af-acb3661b6169-home\") pod \"test-model-d6591f-kserve-74bb655f7f-scl9d\" (UID: \"b6903786-685b-4c51-89af-acb3661b6169\") " pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" Jul 13 14:59:00.832113 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.831983 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6903786-685b-4c51-89af-acb3661b6169-dshm\") pod \"test-model-d6591f-kserve-74bb655f7f-scl9d\" (UID: \"b6903786-685b-4c51-89af-acb3661b6169\") " pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" Jul 13 14:59:00.832113 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.832002 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6903786-685b-4c51-89af-acb3661b6169-tmp-dir\") pod \"test-model-d6591f-kserve-74bb655f7f-scl9d\" (UID: \"b6903786-685b-4c51-89af-acb3661b6169\") " pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" Jul 13 14:59:00.832113 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.832020 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dpbn\" (UniqueName: \"kubernetes.io/projected/b6903786-685b-4c51-89af-acb3661b6169-kube-api-access-5dpbn\") pod \"test-model-d6591f-kserve-74bb655f7f-scl9d\" (UID: \"b6903786-685b-4c51-89af-acb3661b6169\") " pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" Jul 13 14:59:00.832113 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.832077 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6903786-685b-4c51-89af-acb3661b6169-model-cache\") pod \"test-model-d6591f-kserve-74bb655f7f-scl9d\" (UID: \"b6903786-685b-4c51-89af-acb3661b6169\") " pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" Jul 13 14:59:00.932612 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.932542 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6903786-685b-4c51-89af-acb3661b6169-model-cache\") pod \"test-model-d6591f-kserve-74bb655f7f-scl9d\" (UID: \"b6903786-685b-4c51-89af-acb3661b6169\") " pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" Jul 13 14:59:00.932805 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.932658 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6903786-685b-4c51-89af-acb3661b6169-tls-certs\") pod \"test-model-d6591f-kserve-74bb655f7f-scl9d\" (UID: \"b6903786-685b-4c51-89af-acb3661b6169\") " pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" Jul 13 14:59:00.932805 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.932699 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6903786-685b-4c51-89af-acb3661b6169-home\") pod \"test-model-d6591f-kserve-74bb655f7f-scl9d\" (UID: \"b6903786-685b-4c51-89af-acb3661b6169\") " pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" Jul 13 14:59:00.932805 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.932717 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6903786-685b-4c51-89af-acb3661b6169-dshm\") pod \"test-model-d6591f-kserve-74bb655f7f-scl9d\" (UID: \"b6903786-685b-4c51-89af-acb3661b6169\") " pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" Jul 13 14:59:00.932805 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.932733 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6903786-685b-4c51-89af-acb3661b6169-tmp-dir\") pod \"test-model-d6591f-kserve-74bb655f7f-scl9d\" (UID: \"b6903786-685b-4c51-89af-acb3661b6169\") " pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" Jul 13 14:59:00.932805 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.932751 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dpbn\" (UniqueName: \"kubernetes.io/projected/b6903786-685b-4c51-89af-acb3661b6169-kube-api-access-5dpbn\") pod \"test-model-d6591f-kserve-74bb655f7f-scl9d\" (UID: \"b6903786-685b-4c51-89af-acb3661b6169\") " pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" Jul 13 14:59:00.933100 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.933074 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6903786-685b-4c51-89af-acb3661b6169-model-cache\") pod \"test-model-d6591f-kserve-74bb655f7f-scl9d\" (UID: \"b6903786-685b-4c51-89af-acb3661b6169\") " pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" Jul 13 14:59:00.933174 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.933102 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6903786-685b-4c51-89af-acb3661b6169-home\") pod \"test-model-d6591f-kserve-74bb655f7f-scl9d\" (UID: \"b6903786-685b-4c51-89af-acb3661b6169\") " pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" Jul 13 14:59:00.933224 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.933166 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6903786-685b-4c51-89af-acb3661b6169-tmp-dir\") pod \"test-model-d6591f-kserve-74bb655f7f-scl9d\" (UID: \"b6903786-685b-4c51-89af-acb3661b6169\") " pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" Jul 13 14:59:00.935050 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.935025 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6903786-685b-4c51-89af-acb3661b6169-dshm\") pod \"test-model-d6591f-kserve-74bb655f7f-scl9d\" (UID: \"b6903786-685b-4c51-89af-acb3661b6169\") " pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" Jul 13 14:59:00.935245 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.935231 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6903786-685b-4c51-89af-acb3661b6169-tls-certs\") pod \"test-model-d6591f-kserve-74bb655f7f-scl9d\" (UID: \"b6903786-685b-4c51-89af-acb3661b6169\") " pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" Jul 13 14:59:00.942913 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.942850 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dpbn\" (UniqueName: \"kubernetes.io/projected/b6903786-685b-4c51-89af-acb3661b6169-kube-api-access-5dpbn\") pod \"test-model-d6591f-kserve-74bb655f7f-scl9d\" (UID: \"b6903786-685b-4c51-89af-acb3661b6169\") " pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" Jul 13 14:59:00.999331 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:00.999292 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" Jul 13 14:59:01.137910 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:01.137876 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d"] Jul 13 14:59:01.141700 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:59:01.141669 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6903786_685b_4c51_89af_acb3661b6169.slice/crio-63a846011bfeafa1563ff9532027484a8639750a0c8053cd2588ca651e2987c2 WatchSource:0}: Error finding container 63a846011bfeafa1563ff9532027484a8639750a0c8053cd2588ca651e2987c2: Status 404 returned error can't find the container with id 63a846011bfeafa1563ff9532027484a8639750a0c8053cd2588ca651e2987c2 Jul 13 14:59:01.694339 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:01.694291 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" event={"ID":"b6903786-685b-4c51-89af-acb3661b6169","Type":"ContainerStarted","Data":"e35df0ed9f2ab9f5b7d183858cf11dfdc31f02237615a8aca91584f64d5290a0"} Jul 13 14:59:01.694339 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:01.694341 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" event={"ID":"b6903786-685b-4c51-89af-acb3661b6169","Type":"ContainerStarted","Data":"63a846011bfeafa1563ff9532027484a8639750a0c8053cd2588ca651e2987c2"} Jul 13 14:59:01.714066 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:01.714017 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" podStartSLOduration=1.714003084 podStartE2EDuration="1.714003084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:59:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:59:01.712965307 +0000 UTC m=+2294.008968274" watchObservedRunningTime="2026-07-13 14:59:01.714003084 +0000 UTC m=+2294.010006037" Jul 13 14:59:07.002255 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:07.002219 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:59:10.999539 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:10.999497 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" Jul 13 14:59:11.000002 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:10.999554 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" Jul 13 14:59:11.012261 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:11.012231 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" Jul 13 14:59:11.754464 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:11.754429 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" Jul 13 14:59:36.702042 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:36.702009 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5"] Jul 13 14:59:36.705428 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:36.705410 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" Jul 13 14:59:36.709516 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:36.709490 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-b132ed\"/\"test-model-b132ed-kserve-self-signed-certs\"" Jul 13 14:59:36.709516 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:36.709503 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-b132ed\"/\"default-dockercfg-8rmmk\"" Jul 13 14:59:36.709713 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:36.709566 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-b132ed\"/\"kube-root-ca.crt\"" Jul 13 14:59:36.709713 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:36.709566 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-b132ed\"/\"openshift-service-ca.crt\"" Jul 13 14:59:36.717113 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:36.717091 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5"] Jul 13 14:59:36.835734 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:36.835699 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1158554d-c2ab-4d47-a983-3e2123148574-model-cache\") pod \"test-model-b132ed-kserve-6d774b76c-vz2w5\" (UID: \"1158554d-c2ab-4d47-a983-3e2123148574\") " pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" Jul 13 14:59:36.835734 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:36.835737 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1158554d-c2ab-4d47-a983-3e2123148574-tls-certs\") pod \"test-model-b132ed-kserve-6d774b76c-vz2w5\" (UID: \"1158554d-c2ab-4d47-a983-3e2123148574\") " pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" Jul 13 14:59:36.835980 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:36.835823 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1158554d-c2ab-4d47-a983-3e2123148574-tmp-dir\") pod \"test-model-b132ed-kserve-6d774b76c-vz2w5\" (UID: \"1158554d-c2ab-4d47-a983-3e2123148574\") " pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" Jul 13 14:59:36.835980 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:36.835858 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1158554d-c2ab-4d47-a983-3e2123148574-dshm\") pod \"test-model-b132ed-kserve-6d774b76c-vz2w5\" (UID: \"1158554d-c2ab-4d47-a983-3e2123148574\") " pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" Jul 13 14:59:36.835980 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:36.835887 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw482\" (UniqueName: \"kubernetes.io/projected/1158554d-c2ab-4d47-a983-3e2123148574-kube-api-access-hw482\") pod \"test-model-b132ed-kserve-6d774b76c-vz2w5\" (UID: \"1158554d-c2ab-4d47-a983-3e2123148574\") " pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" Jul 13 14:59:36.835980 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:36.835964 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1158554d-c2ab-4d47-a983-3e2123148574-home\") pod \"test-model-b132ed-kserve-6d774b76c-vz2w5\" (UID: \"1158554d-c2ab-4d47-a983-3e2123148574\") " pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" Jul 13 14:59:36.936379 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:36.936343 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw482\" (UniqueName: \"kubernetes.io/projected/1158554d-c2ab-4d47-a983-3e2123148574-kube-api-access-hw482\") pod \"test-model-b132ed-kserve-6d774b76c-vz2w5\" (UID: \"1158554d-c2ab-4d47-a983-3e2123148574\") " pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" Jul 13 14:59:36.936573 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:36.936405 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1158554d-c2ab-4d47-a983-3e2123148574-home\") pod \"test-model-b132ed-kserve-6d774b76c-vz2w5\" (UID: \"1158554d-c2ab-4d47-a983-3e2123148574\") " pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" Jul 13 14:59:36.936573 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:36.936453 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1158554d-c2ab-4d47-a983-3e2123148574-model-cache\") pod \"test-model-b132ed-kserve-6d774b76c-vz2w5\" (UID: \"1158554d-c2ab-4d47-a983-3e2123148574\") " pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" Jul 13 14:59:36.936573 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:36.936473 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1158554d-c2ab-4d47-a983-3e2123148574-tls-certs\") pod \"test-model-b132ed-kserve-6d774b76c-vz2w5\" (UID: \"1158554d-c2ab-4d47-a983-3e2123148574\") " pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" Jul 13 14:59:36.936573 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:36.936513 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1158554d-c2ab-4d47-a983-3e2123148574-tmp-dir\") pod \"test-model-b132ed-kserve-6d774b76c-vz2w5\" (UID: \"1158554d-c2ab-4d47-a983-3e2123148574\") " pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" Jul 13 14:59:36.936573 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:36.936537 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1158554d-c2ab-4d47-a983-3e2123148574-dshm\") pod \"test-model-b132ed-kserve-6d774b76c-vz2w5\" (UID: \"1158554d-c2ab-4d47-a983-3e2123148574\") " pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" Jul 13 14:59:36.936906 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:36.936882 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1158554d-c2ab-4d47-a983-3e2123148574-home\") pod \"test-model-b132ed-kserve-6d774b76c-vz2w5\" (UID: \"1158554d-c2ab-4d47-a983-3e2123148574\") " pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" Jul 13 14:59:36.936954 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:36.936904 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1158554d-c2ab-4d47-a983-3e2123148574-model-cache\") pod \"test-model-b132ed-kserve-6d774b76c-vz2w5\" (UID: \"1158554d-c2ab-4d47-a983-3e2123148574\") " pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" Jul 13 14:59:36.936990 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:36.936960 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1158554d-c2ab-4d47-a983-3e2123148574-tmp-dir\") pod \"test-model-b132ed-kserve-6d774b76c-vz2w5\" (UID: \"1158554d-c2ab-4d47-a983-3e2123148574\") " pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" Jul 13 14:59:36.938766 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:36.938747 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1158554d-c2ab-4d47-a983-3e2123148574-dshm\") pod \"test-model-b132ed-kserve-6d774b76c-vz2w5\" (UID: \"1158554d-c2ab-4d47-a983-3e2123148574\") " pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" Jul 13 14:59:36.939047 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:36.939028 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1158554d-c2ab-4d47-a983-3e2123148574-tls-certs\") pod \"test-model-b132ed-kserve-6d774b76c-vz2w5\" (UID: \"1158554d-c2ab-4d47-a983-3e2123148574\") " pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" Jul 13 14:59:36.945793 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:36.945768 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw482\" (UniqueName: \"kubernetes.io/projected/1158554d-c2ab-4d47-a983-3e2123148574-kube-api-access-hw482\") pod \"test-model-b132ed-kserve-6d774b76c-vz2w5\" (UID: \"1158554d-c2ab-4d47-a983-3e2123148574\") " pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" Jul 13 14:59:37.015475 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:37.015398 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" Jul 13 14:59:37.152877 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:37.152848 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5"] Jul 13 14:59:37.155450 ip-10-0-138-70 kubenswrapper[2568]: W0713 14:59:37.155423 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1158554d_c2ab_4d47_a983_3e2123148574.slice/crio-a8846df8d9343c7d087a631e4e9d91a05160a0d2fb081e3f2d9047446e0b581f WatchSource:0}: Error finding container a8846df8d9343c7d087a631e4e9d91a05160a0d2fb081e3f2d9047446e0b581f: Status 404 returned error can't find the container with id a8846df8d9343c7d087a631e4e9d91a05160a0d2fb081e3f2d9047446e0b581f Jul 13 14:59:37.859775 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:37.859733 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" event={"ID":"1158554d-c2ab-4d47-a983-3e2123148574","Type":"ContainerStarted","Data":"1a1f45ead2e0f74b95d4c9c7f90636dac53650e4041caf934ad45ad3bcaacd56"} Jul 13 14:59:37.860176 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:37.859783 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" event={"ID":"1158554d-c2ab-4d47-a983-3e2123148574","Type":"ContainerStarted","Data":"a8846df8d9343c7d087a631e4e9d91a05160a0d2fb081e3f2d9047446e0b581f"} Jul 13 14:59:37.879998 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:37.879950 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" podStartSLOduration=1.879935401 podStartE2EDuration="1.879935401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 14:59:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 14:59:37.878783056 +0000 UTC m=+2330.174786029" watchObservedRunningTime="2026-07-13 14:59:37.879935401 +0000 UTC m=+2330.175938354" Jul 13 14:59:41.199820 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:41.199741 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 14:59:47.016451 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:47.016408 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" Jul 13 14:59:47.016931 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:47.016461 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" Jul 13 14:59:47.029385 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:47.029361 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" Jul 13 14:59:47.917962 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:47.917931 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" Jul 13 14:59:55.104960 ip-10-0-138-70 kubenswrapper[2568]: I0713 14:59:55.104911 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 15:00:05.910045 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:05.910003 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d"] Jul 13 15:00:06.909994 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:06.909960 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5"] Jul 13 15:00:12.995980 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:12.995942 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 15:00:20.930271 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:20.930225 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" podUID="b6903786-685b-4c51-89af-acb3661b6169" containerName="main" containerID="cri-o://e35df0ed9f2ab9f5b7d183858cf11dfdc31f02237615a8aca91584f64d5290a0" gracePeriod=45 Jul 13 15:00:21.058722 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:21.058683 2568 generic.go:356] "Generic (PLEG): container finished" podID="b6903786-685b-4c51-89af-acb3661b6169" containerID="e35df0ed9f2ab9f5b7d183858cf11dfdc31f02237615a8aca91584f64d5290a0" exitCode=0 Jul 13 15:00:21.058873 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:21.058723 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" event={"ID":"b6903786-685b-4c51-89af-acb3661b6169","Type":"ContainerDied","Data":"e35df0ed9f2ab9f5b7d183858cf11dfdc31f02237615a8aca91584f64d5290a0"} Jul 13 15:00:21.186801 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:21.186737 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" Jul 13 15:00:21.210941 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:21.210910 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dpbn\" (UniqueName: \"kubernetes.io/projected/b6903786-685b-4c51-89af-acb3661b6169-kube-api-access-5dpbn\") pod \"b6903786-685b-4c51-89af-acb3661b6169\" (UID: \"b6903786-685b-4c51-89af-acb3661b6169\") " Jul 13 15:00:21.211102 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:21.210997 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6903786-685b-4c51-89af-acb3661b6169-tls-certs\") pod \"b6903786-685b-4c51-89af-acb3661b6169\" (UID: \"b6903786-685b-4c51-89af-acb3661b6169\") " Jul 13 15:00:21.211102 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:21.211022 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6903786-685b-4c51-89af-acb3661b6169-dshm\") pod \"b6903786-685b-4c51-89af-acb3661b6169\" (UID: \"b6903786-685b-4c51-89af-acb3661b6169\") " Jul 13 15:00:21.211102 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:21.211041 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6903786-685b-4c51-89af-acb3661b6169-home\") pod \"b6903786-685b-4c51-89af-acb3661b6169\" (UID: \"b6903786-685b-4c51-89af-acb3661b6169\") " Jul 13 15:00:21.211102 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:21.211077 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6903786-685b-4c51-89af-acb3661b6169-tmp-dir\") pod \"b6903786-685b-4c51-89af-acb3661b6169\" (UID: \"b6903786-685b-4c51-89af-acb3661b6169\") " Jul 13 15:00:21.211316 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:21.211114 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6903786-685b-4c51-89af-acb3661b6169-model-cache\") pod \"b6903786-685b-4c51-89af-acb3661b6169\" (UID: \"b6903786-685b-4c51-89af-acb3661b6169\") " Jul 13 15:00:21.211411 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:21.211360 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6903786-685b-4c51-89af-acb3661b6169-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b6903786-685b-4c51-89af-acb3661b6169" (UID: "b6903786-685b-4c51-89af-acb3661b6169"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:00:21.211411 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:21.211390 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6903786-685b-4c51-89af-acb3661b6169-model-cache" (OuterVolumeSpecName: "model-cache") pod "b6903786-685b-4c51-89af-acb3661b6169" (UID: "b6903786-685b-4c51-89af-acb3661b6169"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:00:21.211411 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:21.211374 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6903786-685b-4c51-89af-acb3661b6169-home" (OuterVolumeSpecName: "home") pod "b6903786-685b-4c51-89af-acb3661b6169" (UID: "b6903786-685b-4c51-89af-acb3661b6169"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:00:21.213569 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:21.213542 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6903786-685b-4c51-89af-acb3661b6169-dshm" (OuterVolumeSpecName: "dshm") pod "b6903786-685b-4c51-89af-acb3661b6169" (UID: "b6903786-685b-4c51-89af-acb3661b6169"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:00:21.213712 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:21.213627 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6903786-685b-4c51-89af-acb3661b6169-kube-api-access-5dpbn" (OuterVolumeSpecName: "kube-api-access-5dpbn") pod "b6903786-685b-4c51-89af-acb3661b6169" (UID: "b6903786-685b-4c51-89af-acb3661b6169"). InnerVolumeSpecName "kube-api-access-5dpbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:00:21.213857 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:21.213835 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6903786-685b-4c51-89af-acb3661b6169-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b6903786-685b-4c51-89af-acb3661b6169" (UID: "b6903786-685b-4c51-89af-acb3661b6169"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 15:00:21.312527 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:21.312488 2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6903786-685b-4c51-89af-acb3661b6169-tls-certs\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 15:00:21.312527 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:21.312518 2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6903786-685b-4c51-89af-acb3661b6169-dshm\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 15:00:21.312527 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:21.312527 2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6903786-685b-4c51-89af-acb3661b6169-home\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 15:00:21.312527 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:21.312535 2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6903786-685b-4c51-89af-acb3661b6169-tmp-dir\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 15:00:21.312849 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:21.312543 2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6903786-685b-4c51-89af-acb3661b6169-model-cache\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 15:00:21.312849 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:21.312551 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dpbn\" (UniqueName: \"kubernetes.io/projected/b6903786-685b-4c51-89af-acb3661b6169-kube-api-access-5dpbn\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 15:00:21.930082 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:21.930036 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" podUID="1158554d-c2ab-4d47-a983-3e2123148574" containerName="main" containerID="cri-o://1a1f45ead2e0f74b95d4c9c7f90636dac53650e4041caf934ad45ad3bcaacd56" gracePeriod=45 Jul 13 15:00:22.064967 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.064938 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" Jul 13 15:00:22.065438 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.064937 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d" event={"ID":"b6903786-685b-4c51-89af-acb3661b6169","Type":"ContainerDied","Data":"63a846011bfeafa1563ff9532027484a8639750a0c8053cd2588ca651e2987c2"} Jul 13 15:00:22.065438 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.065101 2568 scope.go:117] "RemoveContainer" containerID="e35df0ed9f2ab9f5b7d183858cf11dfdc31f02237615a8aca91584f64d5290a0" Jul 13 15:00:22.066655 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.066629 2568 generic.go:356] "Generic (PLEG): container finished" podID="1158554d-c2ab-4d47-a983-3e2123148574" containerID="1a1f45ead2e0f74b95d4c9c7f90636dac53650e4041caf934ad45ad3bcaacd56" exitCode=0 Jul 13 15:00:22.066793 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.066680 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" event={"ID":"1158554d-c2ab-4d47-a983-3e2123148574","Type":"ContainerDied","Data":"1a1f45ead2e0f74b95d4c9c7f90636dac53650e4041caf934ad45ad3bcaacd56"} Jul 13 15:00:22.090667 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.090636 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d"] Jul 13 15:00:22.100391 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.100364 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-d6591f/test-model-d6591f-kserve-74bb655f7f-scl9d"] Jul 13 15:00:22.186606 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.186517 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" Jul 13 15:00:22.202802 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.202776 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6903786-685b-4c51-89af-acb3661b6169" path="/var/lib/kubelet/pods/b6903786-685b-4c51-89af-acb3661b6169/volumes" Jul 13 15:00:22.219933 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.219904 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1158554d-c2ab-4d47-a983-3e2123148574-tmp-dir\") pod \"1158554d-c2ab-4d47-a983-3e2123148574\" (UID: \"1158554d-c2ab-4d47-a983-3e2123148574\") " Jul 13 15:00:22.220112 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.219946 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1158554d-c2ab-4d47-a983-3e2123148574-tls-certs\") pod \"1158554d-c2ab-4d47-a983-3e2123148574\" (UID: \"1158554d-c2ab-4d47-a983-3e2123148574\") " Jul 13 15:00:22.220112 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.219965 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hw482\" (UniqueName: \"kubernetes.io/projected/1158554d-c2ab-4d47-a983-3e2123148574-kube-api-access-hw482\") pod \"1158554d-c2ab-4d47-a983-3e2123148574\" (UID: \"1158554d-c2ab-4d47-a983-3e2123148574\") " Jul 13 15:00:22.220112 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.219985 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1158554d-c2ab-4d47-a983-3e2123148574-dshm\") pod \"1158554d-c2ab-4d47-a983-3e2123148574\" (UID: \"1158554d-c2ab-4d47-a983-3e2123148574\") " Jul 13 15:00:22.220112 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.220019 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1158554d-c2ab-4d47-a983-3e2123148574-model-cache\") pod \"1158554d-c2ab-4d47-a983-3e2123148574\" (UID: \"1158554d-c2ab-4d47-a983-3e2123148574\") " Jul 13 15:00:22.220112 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.220036 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1158554d-c2ab-4d47-a983-3e2123148574-home\") pod \"1158554d-c2ab-4d47-a983-3e2123148574\" (UID: \"1158554d-c2ab-4d47-a983-3e2123148574\") " Jul 13 15:00:22.220389 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.220232 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1158554d-c2ab-4d47-a983-3e2123148574-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1158554d-c2ab-4d47-a983-3e2123148574" (UID: "1158554d-c2ab-4d47-a983-3e2123148574"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:00:22.220389 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.220356 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1158554d-c2ab-4d47-a983-3e2123148574-model-cache" (OuterVolumeSpecName: "model-cache") pod "1158554d-c2ab-4d47-a983-3e2123148574" (UID: "1158554d-c2ab-4d47-a983-3e2123148574"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:00:22.220504 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.220437 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1158554d-c2ab-4d47-a983-3e2123148574-home" (OuterVolumeSpecName: "home") pod "1158554d-c2ab-4d47-a983-3e2123148574" (UID: "1158554d-c2ab-4d47-a983-3e2123148574"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:00:22.222317 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.222287 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1158554d-c2ab-4d47-a983-3e2123148574-kube-api-access-hw482" (OuterVolumeSpecName: "kube-api-access-hw482") pod "1158554d-c2ab-4d47-a983-3e2123148574" (UID: "1158554d-c2ab-4d47-a983-3e2123148574"). InnerVolumeSpecName "kube-api-access-hw482". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 15:00:22.222420 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.222318 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1158554d-c2ab-4d47-a983-3e2123148574-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1158554d-c2ab-4d47-a983-3e2123148574" (UID: "1158554d-c2ab-4d47-a983-3e2123148574"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 15:00:22.222625 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.222607 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1158554d-c2ab-4d47-a983-3e2123148574-dshm" (OuterVolumeSpecName: "dshm") pod "1158554d-c2ab-4d47-a983-3e2123148574" (UID: "1158554d-c2ab-4d47-a983-3e2123148574"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 15:00:22.321285 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.321243 2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1158554d-c2ab-4d47-a983-3e2123148574-tls-certs\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 15:00:22.321285 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.321279 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hw482\" (UniqueName: \"kubernetes.io/projected/1158554d-c2ab-4d47-a983-3e2123148574-kube-api-access-hw482\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 15:00:22.321285 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.321290 2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1158554d-c2ab-4d47-a983-3e2123148574-dshm\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 15:00:22.321522 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.321299 2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1158554d-c2ab-4d47-a983-3e2123148574-model-cache\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 15:00:22.321522 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.321307 2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1158554d-c2ab-4d47-a983-3e2123148574-home\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 15:00:22.321522 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:22.321315 2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1158554d-c2ab-4d47-a983-3e2123148574-tmp-dir\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jul 13 15:00:23.073877 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:23.073844 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" Jul 13 15:00:23.074387 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:23.073847 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5" event={"ID":"1158554d-c2ab-4d47-a983-3e2123148574","Type":"ContainerDied","Data":"a8846df8d9343c7d087a631e4e9d91a05160a0d2fb081e3f2d9047446e0b581f"} Jul 13 15:00:23.074387 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:23.073970 2568 scope.go:117] "RemoveContainer" containerID="1a1f45ead2e0f74b95d4c9c7f90636dac53650e4041caf934ad45ad3bcaacd56" Jul 13 15:00:23.096700 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:23.096669 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5"] Jul 13 15:00:23.100696 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:23.100668 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-b132ed/test-model-b132ed-kserve-6d774b76c-vz2w5"] Jul 13 15:00:24.202800 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:24.202760 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1158554d-c2ab-4d47-a983-3e2123148574" path="/var/lib/kubelet/pods/1158554d-c2ab-4d47-a983-3e2123148574/volumes" Jul 13 15:00:48.324730 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:48.324696 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mhprm_7c99e821-79c3-439a-b51b-46cd0ad8b03c/cluster-monitoring-operator/0.log" Jul 13 15:00:48.329320 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:48.329294 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qhxl5_80da8d62-eca0-42fe-b858-813173b67f1a/console-operator/1.log" Jul 13 15:00:48.332858 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:48.332834 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mhprm_7c99e821-79c3-439a-b51b-46cd0ad8b03c/cluster-monitoring-operator/0.log" Jul 13 15:00:48.334956 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:48.334934 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbgpb_74b3da28-f883-40d3-89a1-10381739a75d/ovn-acl-logging/0.log" Jul 13 15:00:48.337268 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:48.337251 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qhxl5_80da8d62-eca0-42fe-b858-813173b67f1a/console-operator/1.log" Jul 13 15:00:48.342427 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:48.342404 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tbgpb_74b3da28-f883-40d3-89a1-10381739a75d/ovn-acl-logging/0.log" Jul 13 15:00:53.698798 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:00:53.698760 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-m8gx9"] Jul 13 15:04:20.665599 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:20.665557 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85496f78b6-q5vlx_95128f06-9f1b-474d-b11d-3c9c20669faf/authorino/0.log" Jul 13 15:04:26.700918 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:26.700886 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt_681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4/copy-manifests/0.log" Jul 13 15:04:26.715463 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:26.715425 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt_681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4/manager/0.log" Jul 13 15:04:28.878869 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:28.878837 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85496f78b6-q5vlx_95128f06-9f1b-474d-b11d-3c9c20669faf/authorino/0.log" Jul 13 15:04:29.657360 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:29.657332 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-m8gx9_b982b99e-2023-4182-a43b-1c475066e7e5/limitador/0.log" Jul 13 15:04:30.553967 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:30.553933 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7fcc85dc7-npfr6_574b2301-5677-4bd4-8610-37e7ef519609/kube-auth-proxy/0.log" Jul 13 15:04:31.100057 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:31.100027 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dbcbf69c6-pxjzx_7e7fe954-9a11-4bc8-a29f-c8d9a04b833f/router/0.log" Jul 13 15:04:32.143134 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:32.143099 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-wpk5c_41c2aebf-74e9-4994-835c-aecc85b6e1a6/main/0.log" Jul 13 15:04:36.341812 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:36.341770 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bbh27/must-gather-vkrg7"] Jul 13 15:04:36.342202 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:36.342132 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6903786-685b-4c51-89af-acb3661b6169" containerName="main" Jul 13 15:04:36.342202 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:36.342146 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6903786-685b-4c51-89af-acb3661b6169" containerName="main" Jul 13 15:04:36.342202 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:36.342159 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1158554d-c2ab-4d47-a983-3e2123148574" containerName="main" Jul 13 15:04:36.342202 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:36.342169 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1158554d-c2ab-4d47-a983-3e2123148574" containerName="main" Jul 13 15:04:36.342335 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:36.342238 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6903786-685b-4c51-89af-acb3661b6169" containerName="main" Jul 13 15:04:36.342335 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:36.342249 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1158554d-c2ab-4d47-a983-3e2123148574" containerName="main" Jul 13 15:04:36.345391 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:36.345372 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bbh27/must-gather-vkrg7" Jul 13 15:04:36.348627 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:36.348601 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bbh27\"/\"kube-root-ca.crt\"" Jul 13 15:04:36.348942 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:36.348928 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bbh27\"/\"openshift-service-ca.crt\"" Jul 13 15:04:36.349964 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:36.349940 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bbh27\"/\"default-dockercfg-x5lm4\"" Jul 13 15:04:36.359265 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:36.359238 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bbh27/must-gather-vkrg7"] Jul 13 15:04:36.492548 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:36.492490 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stk6x\" (UniqueName: \"kubernetes.io/projected/9e845b84-12e1-424f-844c-de17ef88c762-kube-api-access-stk6x\") pod \"must-gather-vkrg7\" (UID: \"9e845b84-12e1-424f-844c-de17ef88c762\") " pod="openshift-must-gather-bbh27/must-gather-vkrg7" Jul 13 15:04:36.492742 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:36.492599 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9e845b84-12e1-424f-844c-de17ef88c762-must-gather-output\") pod \"must-gather-vkrg7\" (UID: \"9e845b84-12e1-424f-844c-de17ef88c762\") " pod="openshift-must-gather-bbh27/must-gather-vkrg7" Jul 13 15:04:36.593938 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:36.593836 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9e845b84-12e1-424f-844c-de17ef88c762-must-gather-output\") pod \"must-gather-vkrg7\" (UID: \"9e845b84-12e1-424f-844c-de17ef88c762\") " pod="openshift-must-gather-bbh27/must-gather-vkrg7" Jul 13 15:04:36.593938 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:36.593940 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stk6x\" (UniqueName: \"kubernetes.io/projected/9e845b84-12e1-424f-844c-de17ef88c762-kube-api-access-stk6x\") pod \"must-gather-vkrg7\" (UID: \"9e845b84-12e1-424f-844c-de17ef88c762\") " pod="openshift-must-gather-bbh27/must-gather-vkrg7" Jul 13 15:04:36.594185 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:36.594164 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9e845b84-12e1-424f-844c-de17ef88c762-must-gather-output\") pod \"must-gather-vkrg7\" (UID: \"9e845b84-12e1-424f-844c-de17ef88c762\") " pod="openshift-must-gather-bbh27/must-gather-vkrg7" Jul 13 15:04:36.605217 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:36.605182 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stk6x\" (UniqueName: \"kubernetes.io/projected/9e845b84-12e1-424f-844c-de17ef88c762-kube-api-access-stk6x\") pod \"must-gather-vkrg7\" (UID: \"9e845b84-12e1-424f-844c-de17ef88c762\") " pod="openshift-must-gather-bbh27/must-gather-vkrg7" Jul 13 15:04:36.654955 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:36.654922 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bbh27/must-gather-vkrg7" Jul 13 15:04:36.799408 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:36.799166 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bbh27/must-gather-vkrg7"] Jul 13 15:04:36.802221 ip-10-0-138-70 kubenswrapper[2568]: W0713 15:04:36.802188 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e845b84_12e1_424f_844c_de17ef88c762.slice/crio-cbdbcda5cf754fd14a2b74f25a49403c080f170098595e2a2f12b11538f13844 WatchSource:0}: Error finding container cbdbcda5cf754fd14a2b74f25a49403c080f170098595e2a2f12b11538f13844: Status 404 returned error can't find the container with id cbdbcda5cf754fd14a2b74f25a49403c080f170098595e2a2f12b11538f13844 Jul 13 15:04:36.804133 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:36.804111 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 15:04:37.209317 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:37.209277 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bbh27/must-gather-vkrg7" event={"ID":"9e845b84-12e1-424f-844c-de17ef88c762","Type":"ContainerStarted","Data":"cbdbcda5cf754fd14a2b74f25a49403c080f170098595e2a2f12b11538f13844"} Jul 13 15:04:38.219265 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:38.218417 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bbh27/must-gather-vkrg7" event={"ID":"9e845b84-12e1-424f-844c-de17ef88c762","Type":"ContainerStarted","Data":"b91605d9e0bcbddb20155000200794ed66dc47d93fc8f3ef86c623f536059a73"} Jul 13 15:04:38.219265 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:38.218473 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bbh27/must-gather-vkrg7" event={"ID":"9e845b84-12e1-424f-844c-de17ef88c762","Type":"ContainerStarted","Data":"9377245243b16c8548f0b1d167418c4288a476219f52c64be3ee2351c0c233ff"} Jul 13 15:04:38.246527 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:38.246442 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bbh27/must-gather-vkrg7" podStartSLOduration=1.585115958 podStartE2EDuration="2.246420357s" totalImagesPullingTime="661.304399ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 15:04:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:04:38.242916828 +0000 UTC m=+2630.538919783" watchObservedRunningTime="2026-07-13 15:04:38.246420357 +0000 UTC m=+2630.542423364" Jul 13 15:04:39.112336 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:39.112294 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4vn2v_1612be17-dbf1-4d08-a9d8-fa7ec57fee55/global-pull-secret-syncer/0.log" Jul 13 15:04:39.329383 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:39.329343 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xng5s_53f28e70-42bd-44fd-9d7c-86a8627d7bfe/konnectivity-agent/0.log" Jul 13 15:04:39.381530 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:39.381459 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-70.ec2.internal_b04179ee16bc51140974d528cab249f3/haproxy/0.log" Jul 13 15:04:44.555751 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:44.555709 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85496f78b6-q5vlx_95128f06-9f1b-474d-b11d-3c9c20669faf/authorino/0.log" Jul 13 15:04:44.839910 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:44.839873 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-m8gx9_b982b99e-2023-4182-a43b-1c475066e7e5/limitador/0.log" Jul 13 15:04:46.820262 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:46.820217 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mhprm_7c99e821-79c3-439a-b51b-46cd0ad8b03c/cluster-monitoring-operator/1.log" Jul 13 15:04:46.930061 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:46.930026 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-mhprm_7c99e821-79c3-439a-b51b-46cd0ad8b03c/cluster-monitoring-operator/0.log" Jul 13 15:04:47.280013 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:47.279925 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bjhgf_9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a/node-exporter/0.log" Jul 13 15:04:47.304741 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:47.304685 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bjhgf_9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a/kube-rbac-proxy/0.log" Jul 13 15:04:47.326553 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:47.326499 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bjhgf_9d2b0ebe-002c-4dbe-9626-18a6a2b18c5a/init-textfile/0.log" Jul 13 15:04:49.057968 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:49.057930 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bbh27/perf-node-gather-daemonset-jdmqt"] Jul 13 15:04:49.064246 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:49.064220 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bbh27/perf-node-gather-daemonset-jdmqt" Jul 13 15:04:49.076514 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:49.076481 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bbh27/perf-node-gather-daemonset-jdmqt"] Jul 13 15:04:49.144651 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:49.144576 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fcdf8146-9632-467c-8011-2617aafb0d5a-proc\") pod \"perf-node-gather-daemonset-jdmqt\" (UID: \"fcdf8146-9632-467c-8011-2617aafb0d5a\") " pod="openshift-must-gather-bbh27/perf-node-gather-daemonset-jdmqt" Jul 13 15:04:49.144846 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:49.144692 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fcdf8146-9632-467c-8011-2617aafb0d5a-lib-modules\") pod \"perf-node-gather-daemonset-jdmqt\" (UID: \"fcdf8146-9632-467c-8011-2617aafb0d5a\") " pod="openshift-must-gather-bbh27/perf-node-gather-daemonset-jdmqt" Jul 13 15:04:49.144846 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:49.144730 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fcdf8146-9632-467c-8011-2617aafb0d5a-podres\") pod \"perf-node-gather-daemonset-jdmqt\" (UID: \"fcdf8146-9632-467c-8011-2617aafb0d5a\") " pod="openshift-must-gather-bbh27/perf-node-gather-daemonset-jdmqt" Jul 13 15:04:49.144846 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:49.144796 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcdf8146-9632-467c-8011-2617aafb0d5a-sys\") pod \"perf-node-gather-daemonset-jdmqt\" (UID: \"fcdf8146-9632-467c-8011-2617aafb0d5a\") " pod="openshift-must-gather-bbh27/perf-node-gather-daemonset-jdmqt" Jul 13 15:04:49.144846 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:49.144828 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xwbc\" (UniqueName: \"kubernetes.io/projected/fcdf8146-9632-467c-8011-2617aafb0d5a-kube-api-access-5xwbc\") pod \"perf-node-gather-daemonset-jdmqt\" (UID: \"fcdf8146-9632-467c-8011-2617aafb0d5a\") " pod="openshift-must-gather-bbh27/perf-node-gather-daemonset-jdmqt" Jul 13 15:04:49.152961 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:49.152932 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-66xjj_763621c1-55cf-4798-a6a2-f75362fc8d46/networking-console-plugin/0.log" Jul 13 15:04:49.246147 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:49.246107 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fcdf8146-9632-467c-8011-2617aafb0d5a-proc\") pod \"perf-node-gather-daemonset-jdmqt\" (UID: \"fcdf8146-9632-467c-8011-2617aafb0d5a\") " pod="openshift-must-gather-bbh27/perf-node-gather-daemonset-jdmqt" Jul 13 15:04:49.246502 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:49.246482 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fcdf8146-9632-467c-8011-2617aafb0d5a-lib-modules\") pod \"perf-node-gather-daemonset-jdmqt\" (UID: \"fcdf8146-9632-467c-8011-2617aafb0d5a\") " pod="openshift-must-gather-bbh27/perf-node-gather-daemonset-jdmqt" Jul 13 15:04:49.246680 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:49.246654 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fcdf8146-9632-467c-8011-2617aafb0d5a-podres\") pod \"perf-node-gather-daemonset-jdmqt\" (UID: \"fcdf8146-9632-467c-8011-2617aafb0d5a\") " pod="openshift-must-gather-bbh27/perf-node-gather-daemonset-jdmqt" Jul 13 15:04:49.246850 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:49.246801 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fcdf8146-9632-467c-8011-2617aafb0d5a-podres\") pod \"perf-node-gather-daemonset-jdmqt\" (UID: \"fcdf8146-9632-467c-8011-2617aafb0d5a\") " pod="openshift-must-gather-bbh27/perf-node-gather-daemonset-jdmqt" Jul 13 15:04:49.246922 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:49.246710 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fcdf8146-9632-467c-8011-2617aafb0d5a-lib-modules\") pod \"perf-node-gather-daemonset-jdmqt\" (UID: \"fcdf8146-9632-467c-8011-2617aafb0d5a\") " pod="openshift-must-gather-bbh27/perf-node-gather-daemonset-jdmqt" Jul 13 15:04:49.246922 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:49.246436 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fcdf8146-9632-467c-8011-2617aafb0d5a-proc\") pod \"perf-node-gather-daemonset-jdmqt\" (UID: \"fcdf8146-9632-467c-8011-2617aafb0d5a\") " pod="openshift-must-gather-bbh27/perf-node-gather-daemonset-jdmqt" Jul 13 15:04:49.247392 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:49.247366 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcdf8146-9632-467c-8011-2617aafb0d5a-sys\") pod \"perf-node-gather-daemonset-jdmqt\" (UID: \"fcdf8146-9632-467c-8011-2617aafb0d5a\") " pod="openshift-must-gather-bbh27/perf-node-gather-daemonset-jdmqt" Jul 13 15:04:49.247485 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:49.247428 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xwbc\" (UniqueName: \"kubernetes.io/projected/fcdf8146-9632-467c-8011-2617aafb0d5a-kube-api-access-5xwbc\") pod \"perf-node-gather-daemonset-jdmqt\" (UID: \"fcdf8146-9632-467c-8011-2617aafb0d5a\") " pod="openshift-must-gather-bbh27/perf-node-gather-daemonset-jdmqt" Jul 13 15:04:49.247686 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:49.247665 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcdf8146-9632-467c-8011-2617aafb0d5a-sys\") pod \"perf-node-gather-daemonset-jdmqt\" (UID: \"fcdf8146-9632-467c-8011-2617aafb0d5a\") " pod="openshift-must-gather-bbh27/perf-node-gather-daemonset-jdmqt" Jul 13 15:04:49.257885 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:49.257851 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xwbc\" (UniqueName: \"kubernetes.io/projected/fcdf8146-9632-467c-8011-2617aafb0d5a-kube-api-access-5xwbc\") pod \"perf-node-gather-daemonset-jdmqt\" (UID: \"fcdf8146-9632-467c-8011-2617aafb0d5a\") " pod="openshift-must-gather-bbh27/perf-node-gather-daemonset-jdmqt" Jul 13 15:04:49.383810 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:49.383765 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bbh27/perf-node-gather-daemonset-jdmqt" Jul 13 15:04:49.571975 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:49.571941 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bbh27/perf-node-gather-daemonset-jdmqt"] Jul 13 15:04:49.802878 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:49.802845 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qhxl5_80da8d62-eca0-42fe-b858-813173b67f1a/console-operator/1.log" Jul 13 15:04:49.809311 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:49.809275 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-qhxl5_80da8d62-eca0-42fe-b858-813173b67f1a/console-operator/2.log" Jul 13 15:04:50.298522 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:50.298474 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bbh27/perf-node-gather-daemonset-jdmqt" event={"ID":"fcdf8146-9632-467c-8011-2617aafb0d5a","Type":"ContainerStarted","Data":"7fb2cfd767f6bda426d342063f0d4d5e863847cc468a19fa4a1bf6954ea77ac3"} Jul 13 15:04:50.298957 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:50.298540 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bbh27/perf-node-gather-daemonset-jdmqt" event={"ID":"fcdf8146-9632-467c-8011-2617aafb0d5a","Type":"ContainerStarted","Data":"2bed2f655ff28fc5e380f1415a45ea53583bba5f2d07998fc9bf1158a834f91a"} Jul 13 15:04:50.298957 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:50.298614 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bbh27/perf-node-gather-daemonset-jdmqt" Jul 13 15:04:50.326474 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:50.326417 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bbh27/perf-node-gather-daemonset-jdmqt" podStartSLOduration=1.326396319 podStartE2EDuration="1.326396319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 15:04:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 15:04:50.325955659 +0000 UTC m=+2642.621958626" watchObservedRunningTime="2026-07-13 15:04:50.326396319 +0000 UTC m=+2642.622399273" Jul 13 15:04:50.351970 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:50.351942 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-hcctc_de30738d-0b8e-4291-a423-7402c02d805c/download-server/0.log" Jul 13 15:04:50.981474 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:50.981443 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-kdz7l_aff8e8d8-6f56-4c8e-8cec-310e90c4fd5a/volume-data-source-validator/0.log" Jul 13 15:04:52.102311 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:52.102274 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9wm7s_c42d2b9c-d394-4e63-b1f2-b38552d30bef/dns/0.log" Jul 13 15:04:52.125841 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:52.125801 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9wm7s_c42d2b9c-d394-4e63-b1f2-b38552d30bef/kube-rbac-proxy/0.log" Jul 13 15:04:52.202070 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:52.202041 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s6dr2_0c2dbfef-a3bc-424d-8010-f28cfea8fb4e/dns-node-resolver/0.log" Jul 13 15:04:52.887020 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:52.886988 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mn8c6_297ea06e-b94d-4b46-82a4-d3134f30ded1/node-ca/0.log" Jul 13 15:04:54.016973 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:54.016944 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7fcc85dc7-npfr6_574b2301-5677-4bd4-8610-37e7ef519609/kube-auth-proxy/0.log" Jul 13 15:04:54.206085 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:54.206060 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dbcbf69c6-pxjzx_7e7fe954-9a11-4bc8-a29f-c8d9a04b833f/router/0.log" Jul 13 15:04:54.933545 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:54.933509 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8chnn_036cc3ac-9400-462a-99f7-1e31413ddd0c/serve-healthcheck-canary/0.log" Jul 13 15:04:55.411148 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:55.411117 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-nm6zq_e855d2f8-93c3-44a2-990e-173213d93499/insights-operator/0.log" Jul 13 15:04:55.413480 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:55.413457 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-nm6zq_e855d2f8-93c3-44a2-990e-173213d93499/insights-operator/1.log" Jul 13 15:04:55.438597 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:55.438560 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ctwq6_60f5db48-d091-4d0f-b896-0eab77775965/kube-rbac-proxy/0.log" Jul 13 15:04:55.466531 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:55.466502 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ctwq6_60f5db48-d091-4d0f-b896-0eab77775965/exporter/0.log" Jul 13 15:04:55.495741 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:55.495708 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ctwq6_60f5db48-d091-4d0f-b896-0eab77775965/extractor/0.log" Jul 13 15:04:56.315792 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:56.315759 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bbh27/perf-node-gather-daemonset-jdmqt" Jul 13 15:04:58.465662 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:58.465627 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt_681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4/manager/0.log" Jul 13 15:04:58.486448 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:58.486418 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67bcd5d8ff-4gtqt_681c9e4c-d7e1-4c0c-b7d1-fb9f119409d4/copy-manifests/0.log" Jul 13 15:04:59.879891 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:59.879855 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7fcc85dc7-npfr6_574b2301-5677-4bd4-8610-37e7ef519609/kube-auth-proxy/0.log" Jul 13 15:04:59.889389 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:59.889357 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-fff4bf78c-4tdt2_2873f0c1-c363-4cf2-a081-393989177ed0/manager/0.log" Jul 13 15:04:59.959447 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:04:59.959386 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-z4wmz_e1248384-82d5-4dd3-aa6c-f1dfa5c25770/openshift-lws-operator/0.log" Jul 13 15:05:00.042394 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:05:00.042357 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dbcbf69c6-pxjzx_7e7fe954-9a11-4bc8-a29f-c8d9a04b833f/router/0.log" Jul 13 15:05:01.400499 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:05:01.400472 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7fcc85dc7-npfr6_574b2301-5677-4bd4-8610-37e7ef519609/kube-auth-proxy/0.log" Jul 13 15:05:01.579952 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:05:01.579915 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dbcbf69c6-pxjzx_7e7fe954-9a11-4bc8-a29f-c8d9a04b833f/router/0.log" Jul 13 15:05:05.453771 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:05:05.453736 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-j7xs5_438d0107-45d7-482f-8ee7-da3e9dafb3e7/kube-storage-version-migrator-operator/1.log" Jul 13 15:05:05.454674 ip-10-0-138-70 kubenswrapper[2568]: I0713 15:05:05.454648 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-j7xs5_438d0107-45d7-482f-8ee7-da3e9dafb3e7/kube-storage-version-migrator-operator/0.log"