Jul 02 15:25:54.825310 ip-10-0-138-41 systemd[1]: Starting Kubernetes Kubelet... Jul 02 15:25:55.262672 ip-10-0-138-41 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 15:25:55.262672 ip-10-0-138-41 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 15:25:55.262672 ip-10-0-138-41 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 15:25:55.262672 ip-10-0-138-41 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 15:25:55.262672 ip-10-0-138-41 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 15:25:55.262672 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.238087 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 15:25:55.262672 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248144 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:25:55.262672 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248161 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:25:55.262672 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248165 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:25:55.262672 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248168 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:25:55.262672 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248171 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:25:55.262672 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248174 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:25:55.262672 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248178 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:25:55.262672 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248180 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:25:55.475902 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248183 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:25:55.475902 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248186 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:25:55.475902 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248189 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:25:55.475902 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248192 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:25:55.475902 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248195 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:25:55.475902 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248197 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:25:55.475902 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248200 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:25:55.475902 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248203 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:25:55.475902 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248205 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:25:55.475902 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248208 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:25:55.475902 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248211 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:25:55.475902 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248213 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:25:55.475902 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248216 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:25:55.475902 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248218 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:25:55.475902 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248221 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:25:55.475902 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248223 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:25:55.475902 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248227 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:25:55.475902 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248229 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:25:55.475902 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248232 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:25:55.475902 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248234 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:25:55.321579 ip-10-0-138-41 systemd[1]: Started Kubernetes Kubelet. Jul 02 15:25:55.488706 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248237 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:25:55.488706 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248240 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:25:55.488706 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248243 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:25:55.488706 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248245 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:25:55.488706 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248248 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:25:55.488706 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248250 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:25:55.488706 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248253 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:25:55.488706 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248256 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:25:55.488706 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248259 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:25:55.488706 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248261 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:25:55.488706 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248264 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:25:55.488706 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248267 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:25:55.488706 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248269 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:25:55.488706 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248271 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:25:55.488706 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248274 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:25:55.488706 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248277 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:25:55.488706 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248279 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:25:55.488706 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248283 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:25:55.488706 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248286 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:25:55.488706 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248289 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:25:55.492659 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248291 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:25:55.492659 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248294 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:25:55.492659 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248298 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:25:55.492659 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248300 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:25:55.492659 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248303 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:25:55.492659 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248305 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:25:55.492659 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248308 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:25:55.492659 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248310 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:25:55.492659 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248313 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:25:55.492659 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248315 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:25:55.492659 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248318 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:25:55.492659 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248320 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:25:55.492659 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248323 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:25:55.492659 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248325 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:25:55.492659 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248328 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:25:55.492659 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248331 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:25:55.492659 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248334 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:25:55.492659 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248336 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:25:55.492659 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248339 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:25:55.492659 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248341 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:25:55.493419 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248344 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:25:55.493419 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248346 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:25:55.493419 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248349 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:25:55.493419 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248352 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:25:55.493419 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248354 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:25:55.493419 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248357 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:25:55.493419 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248359 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:25:55.493419 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248362 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:25:55.493419 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248364 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:25:55.493419 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248367 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:25:55.493419 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248369 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:25:55.493419 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248374 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:25:55.493419 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248377 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:25:55.493419 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248380 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:25:55.493419 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248382 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:25:55.493419 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248386 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:25:55.493419 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248390 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:25:55.493419 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248393 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:25:55.493419 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248395 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:25:55.493419 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248398 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:25:55.494179 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248400 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:25:55.494179 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248404 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:25:55.494179 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248408 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:25:55.494179 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248411 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:25:55.494179 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248414 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:25:55.494179 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248418 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:25:55.494179 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248422 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:25:55.494179 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248425 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:25:55.494179 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248427 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:25:55.494179 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248430 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:25:55.494179 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.248434 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:25:55.494179 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249162 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:25:55.494179 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249170 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:25:55.494179 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249173 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:25:55.494179 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249176 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:25:55.494179 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249178 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:25:55.494179 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249181 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:25:55.494179 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249184 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:25:55.494179 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249186 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:25:55.495129 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249189 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:25:55.495129 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249192 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:25:55.495129 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249195 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:25:55.495129 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249198 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:25:55.495129 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249202 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:25:55.495129 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249205 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:25:55.495129 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249207 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:25:55.495129 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249210 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:25:55.495129 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249214 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:25:55.495129 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249219 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:25:55.495129 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249224 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:25:55.495129 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249227 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:25:55.495129 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249230 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:25:55.495129 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249232 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:25:55.495129 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249235 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:25:55.495129 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249237 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:25:55.495129 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249240 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:25:55.495129 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249242 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:25:55.495129 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249245 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:25:55.495926 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249247 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:25:55.495926 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249250 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:25:55.495926 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249252 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:25:55.495926 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249255 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:25:55.495926 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249258 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:25:55.495926 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249260 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:25:55.495926 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249263 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:25:55.495926 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249266 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:25:55.495926 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249268 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:25:55.495926 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249271 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:25:55.495926 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249273 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:25:55.495926 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249276 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:25:55.495926 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249278 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:25:55.495926 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249281 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:25:55.495926 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249283 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:25:55.495926 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249286 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:25:55.495926 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249289 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:25:55.495926 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249293 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:25:55.495926 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249296 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:25:55.495926 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249298 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:25:55.495926 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249301 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:25:55.496733 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249304 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:25:55.496733 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249306 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:25:55.496733 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249311 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:25:55.496733 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249314 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:25:55.496733 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249317 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:25:55.496733 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249319 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:25:55.496733 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249322 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:25:55.496733 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249324 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:25:55.496733 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249327 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:25:55.496733 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249329 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:25:55.496733 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249332 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:25:55.496733 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249334 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:25:55.496733 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249337 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:25:55.496733 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249340 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:25:55.496733 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249342 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:25:55.496733 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249345 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:25:55.496733 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249347 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:25:55.496733 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249350 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:25:55.496733 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249353 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:25:55.497373 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249356 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:25:55.497373 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249358 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:25:55.497373 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249361 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:25:55.497373 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249363 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:25:55.497373 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249366 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:25:55.497373 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249371 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:25:55.497373 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249374 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:25:55.497373 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249377 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:25:55.497373 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249380 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:25:55.497373 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249384 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:25:55.497373 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249386 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:25:55.497373 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249389 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:25:55.497373 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249392 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:25:55.497373 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249395 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:25:55.497373 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249397 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:25:55.497373 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249401 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:25:55.497373 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249404 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:25:55.497373 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249407 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:25:55.497373 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249409 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:25:55.498057 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249412 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:25:55.498057 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249416 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:25:55.498057 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249419 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:25:55.498057 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249422 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:25:55.498057 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249425 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:25:55.498057 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249428 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:25:55.498057 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249430 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:25:55.498057 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249433 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:25:55.498057 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249435 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:25:55.498057 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249437 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:25:55.498057 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249440 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:25:55.498057 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249442 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:25:55.498057 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249444 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:25:55.498057 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249822 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:25:55.498057 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249827 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:25:55.498057 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249829 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:25:55.498057 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249832 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:25:55.498057 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249834 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:25:55.498057 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249837 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:25:55.498627 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249840 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:25:55.498627 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249843 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:25:55.498627 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249845 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:25:55.498627 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249849 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:25:55.498627 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249852 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:25:55.498627 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249855 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:25:55.498627 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249857 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:25:55.498627 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249860 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:25:55.498627 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249863 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:25:55.498627 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249867 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:25:55.498627 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249870 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:25:55.498627 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249873 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:25:55.498627 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249875 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:25:55.498627 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249878 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:25:55.498627 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249881 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:25:55.498627 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249883 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:25:55.498627 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249887 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:25:55.498627 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249890 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:25:55.498627 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249893 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:25:55.499254 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249896 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:25:55.499254 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249898 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:25:55.499254 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249901 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:25:55.499254 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249904 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:25:55.499254 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249906 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:25:55.499254 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249909 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:25:55.499254 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249911 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:25:55.499254 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249913 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:25:55.499254 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249916 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:25:55.499254 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249919 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:25:55.499254 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249921 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:25:55.499254 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249923 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:25:55.499254 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249926 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:25:55.499254 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249928 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:25:55.499254 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249931 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:25:55.499254 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249933 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:25:55.499254 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249937 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:25:55.499254 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249940 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:25:55.499254 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249942 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:25:55.499254 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249945 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:25:55.499818 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249947 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:25:55.499818 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249950 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:25:55.499818 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249954 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:25:55.499818 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249956 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:25:55.499818 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249960 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:25:55.499818 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249962 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:25:55.499818 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249965 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:25:55.499818 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249967 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:25:55.499818 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249970 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:25:55.499818 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249972 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:25:55.499818 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249975 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:25:55.499818 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249977 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:25:55.499818 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249980 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:25:55.499818 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249982 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:25:55.499818 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249985 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:25:55.499818 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.249987 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:25:55.499818 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250005 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:25:55.499818 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250009 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:25:55.499818 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250012 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:25:55.499818 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250015 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:25:55.500457 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250017 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:25:55.500457 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250020 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:25:55.500457 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250022 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:25:55.500457 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250025 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:25:55.500457 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250027 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:25:55.500457 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250030 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:25:55.500457 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250032 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:25:55.500457 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250035 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:25:55.500457 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250039 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:25:55.500457 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250041 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:25:55.500457 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250044 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:25:55.500457 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250046 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:25:55.500457 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250049 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:25:55.500457 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250052 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:25:55.500457 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250055 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:25:55.500457 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250060 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:25:55.500457 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250064 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:25:55.500457 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250068 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:25:55.500457 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250071 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:25:55.501077 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250075 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:25:55.501077 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250078 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:25:55.501077 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250081 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:25:55.501077 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250084 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:25:55.501077 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250086 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:25:55.501077 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250089 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:25:55.501077 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250091 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:25:55.501077 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250094 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:25:55.501077 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250096 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:25:55.501077 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250099 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:25:55.501077 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250102 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:25:55.501077 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250104 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:25:55.501077 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250107 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:25:55.501077 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250109 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:25:55.501077 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250112 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:25:55.501077 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250184 2573 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 15:25:55.501077 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250195 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 15:25:55.501077 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250201 2573 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 15:25:55.501077 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250205 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 15:25:55.501077 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250209 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 15:25:55.501077 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250213 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 15:25:55.501077 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250219 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 15:25:55.501688 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250223 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 15:25:55.501688 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250226 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 15:25:55.501688 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250229 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 15:25:55.501688 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250232 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 15:25:55.501688 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250236 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 15:25:55.501688 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250240 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 15:25:55.501688 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250243 2573 flags.go:64] FLAG: --cgroup-root="" Jul 02 15:25:55.501688 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250246 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 15:25:55.501688 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250249 2573 flags.go:64] FLAG: --client-ca-file="" Jul 02 15:25:55.501688 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250252 2573 flags.go:64] FLAG: --cloud-provider="external" Jul 02 15:25:55.501688 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250256 2573 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 15:25:55.501688 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250260 2573 flags.go:64] FLAG: --cluster-domain="" Jul 02 15:25:55.501688 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250263 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 15:25:55.501688 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250266 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 15:25:55.501688 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250269 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 15:25:55.501688 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250273 2573 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 15:25:55.501688 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250276 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 15:25:55.501688 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250279 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 15:25:55.501688 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250282 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 15:25:55.501688 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250285 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 15:25:55.501688 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250288 2573 flags.go:64] FLAG: --contention-profiling="false" Jul 02 15:25:55.501688 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250291 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 15:25:55.501688 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250294 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 15:25:55.501688 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250297 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 15:25:55.716332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250300 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 15:25:55.716332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250304 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 15:25:55.716332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250307 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 15:25:55.716332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250309 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 15:25:55.716332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250312 2573 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 15:25:55.716332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250315 2573 flags.go:64] FLAG: --enable-server="true" Jul 02 15:25:55.716332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250318 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 15:25:55.716332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250323 2573 flags.go:64] FLAG: --event-burst="100" Jul 02 15:25:55.716332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250326 2573 flags.go:64] FLAG: --event-qps="50" Jul 02 15:25:55.716332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250329 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 15:25:55.716332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250332 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 15:25:55.716332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250335 2573 flags.go:64] FLAG: --eviction-hard="" Jul 02 15:25:55.716332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250339 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 15:25:55.716332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250343 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 15:25:55.716332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250346 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 15:25:55.716332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250349 2573 flags.go:64] FLAG: --eviction-soft="" Jul 02 15:25:55.716332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250351 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 15:25:55.716332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250354 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 15:25:55.716332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250358 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 15:25:55.716332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250361 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 15:25:55.716332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250364 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 15:25:55.716332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250367 2573 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 15:25:55.716332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250370 2573 flags.go:64] FLAG: --feature-gates="" Jul 02 15:25:55.716332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250373 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 15:25:55.716332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250376 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 15:25:55.717298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250379 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 15:25:55.717298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250382 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 15:25:55.717298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250385 2573 flags.go:64] FLAG: --healthz-port="10248" Jul 02 15:25:55.717298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250388 2573 flags.go:64] FLAG: --help="false" Jul 02 15:25:55.717298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250391 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-138-41.ec2.internal" Jul 02 15:25:55.717298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250394 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 15:25:55.717298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250397 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 15:25:55.717298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250400 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 15:25:55.717298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250403 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 15:25:55.717298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250406 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 15:25:55.717298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250409 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 15:25:55.717298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250412 2573 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 15:25:55.717298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250415 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 15:25:55.717298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250418 2573 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 15:25:55.717298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250423 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 15:25:55.717298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250426 2573 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 15:25:55.717298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250429 2573 flags.go:64] FLAG: --kube-reserved="" Jul 02 15:25:55.717298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250432 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 15:25:55.717298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250435 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 15:25:55.717298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250438 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 15:25:55.717298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250442 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 15:25:55.717298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250445 2573 flags.go:64] FLAG: --lock-file="" Jul 02 15:25:55.717298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250448 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 15:25:55.717298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250451 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 15:25:55.717985 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250455 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 15:25:55.717985 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250460 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 15:25:55.717985 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250464 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 15:25:55.717985 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250467 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 15:25:55.717985 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250470 2573 flags.go:64] FLAG: --logging-format="text" Jul 02 15:25:55.717985 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250472 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 15:25:55.717985 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250475 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 15:25:55.717985 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250478 2573 flags.go:64] FLAG: --manifest-url="" Jul 02 15:25:55.717985 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250481 2573 flags.go:64] FLAG: --manifest-url-header="" Jul 02 15:25:55.717985 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250485 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 15:25:55.717985 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250488 2573 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 15:25:55.717985 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250492 2573 flags.go:64] FLAG: --max-pods="110" Jul 02 15:25:55.717985 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250495 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 15:25:55.717985 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250498 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 15:25:55.717985 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250500 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 15:25:55.717985 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250503 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 15:25:55.717985 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250506 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 15:25:55.717985 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250509 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 15:25:55.717985 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250512 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 15:25:55.717985 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250519 2573 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 15:25:55.717985 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250522 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 15:25:55.717985 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250525 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 15:25:55.717985 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250530 2573 flags.go:64] FLAG: --pod-cidr="" Jul 02 15:25:55.718651 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250533 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 02 15:25:55.718651 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250538 2573 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 15:25:55.718651 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250541 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 15:25:55.718651 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250544 2573 flags.go:64] FLAG: --pods-per-core="0" Jul 02 15:25:55.718651 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250547 2573 flags.go:64] FLAG: --port="10250" Jul 02 15:25:55.718651 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250552 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 15:25:55.718651 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250554 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0eed0a1760d7e050f" Jul 02 15:25:55.718651 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250558 2573 flags.go:64] FLAG: --qos-reserved="" Jul 02 15:25:55.718651 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250561 2573 flags.go:64] FLAG: --read-only-port="10255" Jul 02 15:25:55.718651 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250564 2573 flags.go:64] FLAG: --register-node="true" Jul 02 15:25:55.718651 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250567 2573 flags.go:64] FLAG: --register-with-taints="" Jul 02 15:25:55.718651 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250571 2573 flags.go:64] FLAG: --registry-burst="10" Jul 02 15:25:55.718651 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250575 2573 flags.go:64] FLAG: --registry-qps="5" Jul 02 15:25:55.718651 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250577 2573 flags.go:64] FLAG: --reserved-cpus="" Jul 02 15:25:55.718651 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250580 2573 flags.go:64] FLAG: --reserved-memory="" Jul 02 15:25:55.718651 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250584 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 15:25:55.718651 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250587 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 15:25:55.718651 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250590 2573 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 15:25:55.718651 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250592 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 15:25:55.718651 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250595 2573 flags.go:64] FLAG: --runonce="false" Jul 02 15:25:55.718651 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250598 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 15:25:55.718651 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250601 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 15:25:55.718651 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250604 2573 flags.go:64] FLAG: --seccomp-default="false" Jul 02 15:25:55.718651 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250607 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 15:25:55.718651 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250609 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 15:25:55.719316 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250613 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 15:25:55.719316 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250615 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 15:25:55.719316 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250618 2573 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 15:25:55.719316 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250621 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 15:25:55.719316 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250624 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 15:25:55.719316 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250627 2573 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 15:25:55.719316 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250629 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 15:25:55.719316 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250634 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 15:25:55.719316 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250637 2573 flags.go:64] FLAG: --system-cgroups="" Jul 02 15:25:55.719316 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250639 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 15:25:55.719316 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250645 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 15:25:55.719316 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250647 2573 flags.go:64] FLAG: --tls-cert-file="" Jul 02 15:25:55.719316 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250653 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 15:25:55.719316 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250657 2573 flags.go:64] FLAG: --tls-min-version="" Jul 02 15:25:55.719316 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250660 2573 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 15:25:55.719316 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250663 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 15:25:55.719316 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250666 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 15:25:55.719316 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250668 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 15:25:55.719316 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250671 2573 flags.go:64] FLAG: --v="2" Jul 02 15:25:55.719316 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250675 2573 flags.go:64] FLAG: --version="false" Jul 02 15:25:55.719316 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250680 2573 flags.go:64] FLAG: --vmodule="" Jul 02 15:25:55.719316 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250684 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 15:25:55.719316 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.250687 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 15:25:55.719316 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250806 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:25:55.719316 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250810 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:25:55.720063 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250812 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:25:55.720063 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250816 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:25:55.720063 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250818 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:25:55.720063 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250821 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:25:55.720063 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250824 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:25:55.720063 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250826 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:25:55.720063 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250829 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:25:55.720063 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250832 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:25:55.720063 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250834 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:25:55.720063 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250837 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:25:55.720063 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250840 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:25:55.720063 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250842 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:25:55.720063 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250845 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:25:55.720063 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250848 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:25:55.720063 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250852 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:25:55.720063 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250854 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:25:55.720063 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250857 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:25:55.720063 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250859 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:25:55.720063 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250862 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:25:55.720063 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250866 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:25:55.720912 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250869 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:25:55.720912 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250871 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:25:55.720912 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250874 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:25:55.720912 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250877 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:25:55.720912 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250879 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:25:55.720912 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250882 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:25:55.720912 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250885 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:25:55.720912 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250887 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:25:55.720912 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250891 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:25:55.720912 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250894 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:25:55.720912 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250897 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:25:55.720912 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250900 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:25:55.720912 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250902 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:25:55.720912 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250905 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:25:55.720912 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250908 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:25:55.720912 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250910 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:25:55.720912 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250913 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:25:55.720912 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250915 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:25:55.720912 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250917 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:25:55.721476 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250920 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:25:55.721476 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250922 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:25:55.721476 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250925 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:25:55.721476 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250928 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:25:55.721476 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250930 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:25:55.721476 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250932 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:25:55.721476 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250935 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:25:55.721476 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250939 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:25:55.721476 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250941 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:25:55.721476 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250944 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:25:55.721476 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250946 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:25:55.721476 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250949 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:25:55.721476 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250952 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:25:55.721476 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250955 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:25:55.721476 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250957 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:25:55.721476 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250960 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:25:55.721476 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250962 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:25:55.721476 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250965 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:25:55.721476 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250968 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:25:55.721476 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250970 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:25:55.926817 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250972 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:25:55.926817 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250975 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:25:55.926817 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250978 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:25:55.926817 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250980 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:25:55.926817 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250983 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:25:55.926817 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250985 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:25:55.926817 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.250988 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:25:55.926817 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251009 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:25:55.926817 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251013 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:25:55.926817 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251015 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:25:55.926817 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251017 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:25:55.926817 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251020 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:25:55.926817 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251022 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:25:55.926817 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251025 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:25:55.926817 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251028 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:25:55.926817 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251030 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:25:55.926817 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251032 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:25:55.926817 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251035 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:25:55.926817 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251037 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:25:55.926817 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251043 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:25:55.928510 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251046 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:25:55.928510 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251049 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:25:55.928510 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251051 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:25:55.928510 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251054 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:25:55.928510 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251058 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:25:55.928510 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251061 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:25:55.928510 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251063 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:25:55.928510 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251066 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:25:55.928510 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251068 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:25:55.928510 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251072 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:25:55.928510 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251076 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:25:55.928510 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251080 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:25:55.928510 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251083 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:25:55.928510 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251086 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:25:55.928510 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251088 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:25:55.928510 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251092 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:25:55.928510 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251094 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:25:55.928510 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.251097 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:25:55.929118 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.251790 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 15:25:55.929118 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.258649 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 15:25:55.929118 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.258668 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 15:25:55.929118 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.258683 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 15:25:55.929118 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.258689 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 15:25:55.929118 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258746 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:25:55.929118 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258753 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:25:55.929118 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258757 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:25:55.929118 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258760 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:25:55.929118 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258764 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:25:55.929118 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258767 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:25:55.929118 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258770 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:25:55.929118 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258772 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:25:55.929118 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258775 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:25:55.929596 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258778 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:25:55.929596 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258780 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:25:55.929596 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258783 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:25:55.929596 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258785 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:25:55.929596 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258788 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:25:55.929596 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258790 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:25:55.929596 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258793 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:25:55.929596 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258796 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:25:55.929596 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258798 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:25:55.929596 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258801 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:25:55.929596 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258804 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:25:55.929596 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258806 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:25:55.929596 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258810 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:25:55.929596 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258813 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:25:55.929596 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258817 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:25:55.929596 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258819 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:25:55.929596 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258822 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:25:55.929596 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258825 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:25:55.929596 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258828 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:25:55.930145 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258830 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:25:55.930145 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258834 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:25:55.930145 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258836 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:25:55.930145 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258839 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:25:55.930145 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258842 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:25:55.930145 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258844 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:25:55.930145 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258847 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:25:55.930145 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258850 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:25:55.930145 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258853 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:25:55.930145 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258855 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:25:55.930145 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258858 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:25:55.930145 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258861 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:25:55.930145 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258863 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:25:55.930145 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258866 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:25:55.930145 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258871 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:25:55.930145 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258875 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:25:55.930145 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258878 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:25:55.930145 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258881 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:25:55.930145 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258885 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:25:55.930145 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258888 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:25:55.930757 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258890 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:25:55.930757 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258893 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:25:55.930757 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258896 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:25:55.930757 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258898 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:25:55.930757 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258901 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:25:55.930757 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258903 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:25:55.930757 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258906 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:25:55.930757 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258908 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:25:55.930757 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258911 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:25:55.930757 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258914 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:25:55.930757 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258916 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:25:55.930757 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258919 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:25:55.930757 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258922 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:25:55.930757 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258925 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:25:55.930757 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258928 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:25:55.930757 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258931 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:25:55.930757 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258934 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:25:55.930757 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258936 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:25:55.930757 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258939 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:25:55.930757 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258942 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:25:55.931382 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258944 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:25:55.931382 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258947 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:25:55.931382 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258949 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:25:55.931382 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258952 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:25:55.931382 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258955 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:25:55.931382 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258957 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:25:55.931382 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258960 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:25:55.931382 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258962 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:25:55.931382 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258965 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:25:55.931382 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258968 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:25:55.931382 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258971 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:25:55.931382 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258973 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:25:55.931382 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258976 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:25:55.931382 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258978 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:25:55.931382 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258981 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:25:55.931382 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258983 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:25:55.931382 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258986 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:25:55.931382 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.258988 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:25:55.931382 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259006 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:25:55.931382 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259009 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:25:55.931976 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259011 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:25:55.931976 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259017 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:25:55.931976 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259019 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:25:55.931976 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259022 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:25:55.931976 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259025 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:25:55.931976 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259027 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:25:55.931976 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259031 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:25:55.931976 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259035 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:25:55.931976 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259037 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:25:55.931976 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259040 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:25:55.931976 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259042 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:25:55.931976 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.259048 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 15:25:55.931976 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259165 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 15:25:55.931976 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259169 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 15:25:55.931976 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259172 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 15:25:55.932444 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259175 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 15:25:55.932444 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259178 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 15:25:55.932444 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259180 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 15:25:55.932444 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259183 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 15:25:55.932444 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259186 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 15:25:55.932444 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259188 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 15:25:55.932444 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259191 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 15:25:55.932444 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259194 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 15:25:55.932444 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259197 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 15:25:55.932444 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259199 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 15:25:55.932444 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259202 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 15:25:55.932444 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259205 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 15:25:55.932444 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259207 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 15:25:55.932444 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259210 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 15:25:55.932444 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259212 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 15:25:55.932444 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259215 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 15:25:55.932444 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259217 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 15:25:55.932444 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259220 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 15:25:55.932444 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259222 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 15:25:55.932444 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259226 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 15:25:55.933041 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259228 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 15:25:55.933041 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259231 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 15:25:55.933041 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259234 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 15:25:55.933041 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259237 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 15:25:55.933041 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259240 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 15:25:55.933041 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259243 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 15:25:55.933041 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259245 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 15:25:55.933041 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259248 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 15:25:55.933041 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259250 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 15:25:55.933041 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259253 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 15:25:55.933041 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259255 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 15:25:55.933041 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259258 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 15:25:55.933041 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259262 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 15:25:55.933041 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259266 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 15:25:55.933041 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259269 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 15:25:55.933041 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259271 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 15:25:55.933041 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259274 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 15:25:55.933041 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259277 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 15:25:55.933041 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259280 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 15:25:55.933635 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259283 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 15:25:55.933635 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259287 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 15:25:55.933635 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259289 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 15:25:55.933635 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259292 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 15:25:55.933635 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259295 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 15:25:55.933635 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259297 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 15:25:55.933635 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259300 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 15:25:55.933635 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259303 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 15:25:55.933635 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259305 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 15:25:55.933635 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259308 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 15:25:55.933635 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259310 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 15:25:55.933635 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259313 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 15:25:55.933635 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259319 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 15:25:55.933635 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259321 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 15:25:55.933635 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259324 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 15:25:55.933635 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259326 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 15:25:55.933635 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259330 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 15:25:55.933635 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259333 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 15:25:55.933635 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259335 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 15:25:55.934238 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259338 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 15:25:55.934238 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259341 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 15:25:55.934238 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259344 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 15:25:55.934238 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259346 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 15:25:55.934238 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259348 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 15:25:55.934238 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259351 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 15:25:55.934238 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259353 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 15:25:55.934238 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259356 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 15:25:55.934238 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259359 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 15:25:55.934238 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259361 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 15:25:55.934238 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259364 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 15:25:55.934238 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259366 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 15:25:55.934238 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259369 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 02 15:25:55.934238 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259372 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 15:25:55.934238 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259374 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 15:25:55.934238 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259377 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 15:25:55.934238 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259379 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 15:25:55.934238 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259382 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 15:25:55.934238 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259384 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 15:25:55.934238 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259386 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 15:25:55.934801 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259389 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 15:25:55.934801 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259392 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 15:25:55.934801 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259394 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 15:25:55.934801 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259397 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 15:25:55.934801 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259399 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 15:25:55.934801 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259404 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 15:25:55.934801 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259406 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 15:25:55.934801 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259409 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 15:25:55.934801 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259411 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 15:25:55.934801 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259415 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 15:25:55.934801 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259418 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 15:25:55.934801 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259421 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 15:25:55.934801 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259423 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 15:25:55.934801 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259426 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 15:25:55.934801 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259428 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 15:25:55.934801 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259431 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 15:25:55.934801 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259434 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 15:25:55.934801 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.259438 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 15:25:55.935453 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.259443 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 15:25:55.935453 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.259556 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 15:25:55.935453 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.261957 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 15:25:55.935453 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.263641 2573 server.go:1019] "Starting client certificate rotation" Jul 02 15:25:55.935453 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.263753 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 15:25:55.935453 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.263797 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 15:25:55.935453 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.266548 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 15:25:55.935453 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.271726 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 15:25:55.935453 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.283167 2573 log.go:25] "Validated CRI v1 runtime API" Jul 02 15:25:55.935453 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.285785 2573 log.go:25] "Validated CRI v1 image API" Jul 02 15:25:55.935453 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.286593 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 15:25:55.935453 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.289276 2573 fs.go:135] Filesystem UUIDs: map[058c9b04-5708-4c89-b9f6-3d1571c99aca:/dev/nvme0n1p3 09baaf7f-71b6-471b-a3b4-1e70d97605a5:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 02 15:25:55.935833 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.289299 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 15:25:55.935833 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.290646 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 15:25:55.936025 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.294870 2573 manager.go:216] Machine: {Timestamp:2026-07-02 15:25:55.293172639 +0000 UTC m=+0.365486348 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101979 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2456a10e263708c5681cfad8287a67 SystemUUID:ec2456a1-0e26-3708-c568-1cfad8287a67 BootID:0f6cf83a-b3bb-4d08-8b7c-f3677b05fc4c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1b:70:79:1d:01 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1b:70:79:1d:01 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:49:23:7e:93:e2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 15:25:55.936025 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.295019 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 15:25:55.936025 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.295133 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 15:25:55.936025 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.298811 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 15:25:55.936025 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.298858 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-41.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 15:25:55.936025 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.300536 2573 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 15:25:55.936025 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.300548 2573 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 15:25:55.936025 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.300556 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 15:25:55.936025 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.300572 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 15:25:55.936025 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.301890 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 15:25:55.936025 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.306819 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 02 15:25:55.936025 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.306956 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 15:25:55.936025 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.306988 2573 kubelet.go:486] "Attempting to sync node with API server" Jul 02 15:25:55.936025 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.307011 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 15:25:55.936025 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.307028 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 15:25:55.936025 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.307039 2573 kubelet.go:398] "Adding apiserver pod source" Jul 02 15:25:55.936025 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.307049 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 15:25:55.936025 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.307406 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.307426 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.310628 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.312568 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.312597 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.314232 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.314246 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.314252 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.314258 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.314267 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.314273 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.314281 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.314286 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.314292 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.314298 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.314307 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.314312 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.315249 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.315258 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.318530 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-41.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:55.318672 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:55.318769 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-41.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.319678 2573 server.go:1268] "Started kubelet" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.319934 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.320984 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.321066 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.322423 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.322671 2573 server.go:310] "Adding debug handlers to kubelet server" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:55.324713 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-41.ec2.internal.18be827837383761 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-41.ec2.internal,UID:ip-10-0-138-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-41.ec2.internal,},FirstTimestamp:2026-07-02 15:25:55.319412577 +0000 UTC m=+0.391726310,LastTimestamp:2026-07-02 15:25:55.319412577 +0000 UTC m=+0.391726310,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-41.ec2.internal,}" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:55.325904 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.329869 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.329872 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:55.330359 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-41.ec2.internal\" not found" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.330619 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.330619 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.330656 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.330798 2573 reconstruct.go:97] "Volume reconstruction finished" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.330807 2573 reconciler.go:29] "Reconciler: start to sync state" Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.330971 2573 factory.go:55] Registering systemd factory Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.330986 2573 factory.go:223] Registration of the systemd container factory successfully Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.331211 2573 factory.go:153] Registering CRI-O factory Jul 02 15:25:55.936681 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.331224 2573 factory.go:223] Registration of the crio container factory successfully Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.331278 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.331301 2573 factory.go:103] Registering Raw factory Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.331318 2573 manager.go:1196] Started watching for new ooms in manager Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.331688 2573 manager.go:349] Starting recovery of all containers Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:55.341779 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-41.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:55.341882 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.344059 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t2mpq" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.344359 2573 manager.go:354] Recovery completed Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:55.347292 2573 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.349059 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t2mpq" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.350397 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.354467 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-41.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.354494 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-41.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.354507 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-41.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.355668 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.355680 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.355695 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.355707 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.356812 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-41.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.356837 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-41.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.356850 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-41.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.357780 2573 policy_none.go:49] "None policy: Start" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.357796 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.357809 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.359879 2573 policy_none.go:47] "Start" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.408988 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.410123 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.410172 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.410201 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:55.410244 2573 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.412255 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:55.431020 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-41.ec2.internal\" not found" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.493714 2573 manager.go:337] "Starting Device Plugin manager" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:55.493815 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.493830 2573 server.go:87] "Starting device plugin registration server" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.494134 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.494145 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.494238 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.494332 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.494339 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:55.494900 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:55.494945 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-41.ec2.internal\" not found" Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.510839 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-41.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-41.ec2.internal"] Jul 02 15:25:55.937834 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.510937 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.513094 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-41.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.513119 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-41.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.513129 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-41.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.515450 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.515555 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-41.ec2.internal" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.515585 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.516267 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-41.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.516287 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-41.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.516297 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-41.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.516303 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-41.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.516325 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-41.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.516338 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-41.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.518542 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-41.ec2.internal" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.518563 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.519350 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-41.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.519374 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-41.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.519384 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-41.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:55.523426 2573 helpers.go:245] readString: Failed to read "/sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51c81bcd0cbade972c4abc4428920b02.slice/cpu.weight": read /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51c81bcd0cbade972c4abc4428920b02.slice/cpu.weight: no such device Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.531885 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/51c81bcd0cbade972c4abc4428920b02-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-41.ec2.internal\" (UID: \"51c81bcd0cbade972c4abc4428920b02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-41.ec2.internal" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.531910 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51c81bcd0cbade972c4abc4428920b02-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-41.ec2.internal\" (UID: \"51c81bcd0cbade972c4abc4428920b02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-41.ec2.internal" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.531928 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a69f5b6d35760bc20e58af7c0e937070-config\") pod \"kube-apiserver-proxy-ip-10-0-138-41.ec2.internal\" (UID: \"a69f5b6d35760bc20e58af7c0e937070\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-41.ec2.internal" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:55.544851 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-41.ec2.internal\" not found" node="ip-10-0-138-41.ec2.internal" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:55.549545 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-41.ec2.internal\" not found" node="ip-10-0-138-41.ec2.internal" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:55.550301 2573 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-41.ec2.internal\" not found" node="ip-10-0-138-41.ec2.internal" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.594565 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.595507 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-41.ec2.internal" event="NodeHasSufficientMemory" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.595537 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-41.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.595546 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-41.ec2.internal" event="NodeHasSufficientPID" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.595579 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-41.ec2.internal" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.604512 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-41.ec2.internal" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:55.604538 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-41.ec2.internal\": node \"ip-10-0-138-41.ec2.internal\" not found" Jul 02 15:25:55.939121 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:55.627652 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-41.ec2.internal\" not found" Jul 02 15:25:55.942821 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.632434 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/51c81bcd0cbade972c4abc4428920b02-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-41.ec2.internal\" (UID: \"51c81bcd0cbade972c4abc4428920b02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-41.ec2.internal" Jul 02 15:25:55.942821 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.632470 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51c81bcd0cbade972c4abc4428920b02-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-41.ec2.internal\" (UID: \"51c81bcd0cbade972c4abc4428920b02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-41.ec2.internal" Jul 02 15:25:55.942821 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.632489 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a69f5b6d35760bc20e58af7c0e937070-config\") pod \"kube-apiserver-proxy-ip-10-0-138-41.ec2.internal\" (UID: \"a69f5b6d35760bc20e58af7c0e937070\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-41.ec2.internal" Jul 02 15:25:55.942821 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.632525 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/51c81bcd0cbade972c4abc4428920b02-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-41.ec2.internal\" (UID: \"51c81bcd0cbade972c4abc4428920b02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-41.ec2.internal" Jul 02 15:25:55.942821 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.632533 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a69f5b6d35760bc20e58af7c0e937070-config\") pod \"kube-apiserver-proxy-ip-10-0-138-41.ec2.internal\" (UID: \"a69f5b6d35760bc20e58af7c0e937070\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-41.ec2.internal" Jul 02 15:25:55.942821 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.632525 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51c81bcd0cbade972c4abc4428920b02-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-41.ec2.internal\" (UID: \"51c81bcd0cbade972c4abc4428920b02\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-41.ec2.internal" Jul 02 15:25:55.942821 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:55.728601 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-41.ec2.internal\" not found" Jul 02 15:25:55.942821 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:55.830201 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-41.ec2.internal\" not found" Jul 02 15:25:55.942821 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.849540 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-41.ec2.internal" Jul 02 15:25:55.942821 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:55.857653 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-41.ec2.internal" Jul 02 15:25:55.942821 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:55.931218 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-41.ec2.internal\" not found" Jul 02 15:25:56.201940 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:56.037705 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-41.ec2.internal\" not found" Jul 02 15:25:56.201940 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:56.138765 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-41.ec2.internal\" not found" Jul 02 15:25:56.427562 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:56.239378 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-41.ec2.internal\" not found" Jul 02 15:25:56.427562 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:56.240268 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:25:56.427562 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:56.262425 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 15:25:56.427562 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:56.262563 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 15:25:56.427562 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:56.262603 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 15:25:56.427562 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:56.339539 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-41.ec2.internal\" not found" Jul 02 15:25:56.427562 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:56.355765 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 15:20:55 +0000 UTC" deadline="2028-02-13 13:20:36.252687225 +0000 UTC" Jul 02 15:25:56.427562 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:56.355802 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14181h54m39.896888439s" Jul 02 15:25:56.570370 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:56.440605 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-41.ec2.internal\" not found" Jul 02 15:25:56.570370 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:56.541653 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-41.ec2.internal\" not found" Jul 02 15:25:56.570370 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:56.565284 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda69f5b6d35760bc20e58af7c0e937070.slice/crio-a36f29bc1c1b71d07a3ec124a0e9383955d878958103be08280b176ea93ce156 WatchSource:0}: Error finding container a36f29bc1c1b71d07a3ec124a0e9383955d878958103be08280b176ea93ce156: Status 404 returned error can't find the container with id a36f29bc1c1b71d07a3ec124a0e9383955d878958103be08280b176ea93ce156 Jul 02 15:25:56.570370 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:56.565779 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51c81bcd0cbade972c4abc4428920b02.slice/crio-0c832ca620cded03b9f30914aff282078ea2fdd6656990834160bddcee836e17 WatchSource:0}: Error finding container 0c832ca620cded03b9f30914aff282078ea2fdd6656990834160bddcee836e17: Status 404 returned error can't find the container with id 0c832ca620cded03b9f30914aff282078ea2fdd6656990834160bddcee836e17 Jul 02 15:25:56.571530 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:56.571235 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 15:25:56.855331 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:56.642678 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-41.ec2.internal\" not found" Jul 02 15:25:56.855331 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:56.743687 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-41.ec2.internal\" not found" Jul 02 15:25:56.855331 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:56.844655 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-41.ec2.internal\" not found" Jul 02 15:25:57.096185 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:56.881585 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:25:57.096185 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:56.905775 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:25:57.096185 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:56.930702 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-41.ec2.internal" Jul 02 15:25:57.096185 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:56.943831 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 15:25:57.096185 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:56.945062 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-41.ec2.internal" Jul 02 15:25:57.096185 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:56.970354 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.308165 2573 apiserver.go:52] "Watching apiserver" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.315293 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.318622 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-qrttf","openshift-multus/multus-additional-cni-plugins-wqdxl","openshift-network-diagnostics/network-check-target-nb2v6","openshift-ovn-kubernetes/ovnkube-node-rg8r5","kube-system/global-pull-secret-syncer-qs9xw","kube-system/konnectivity-agent-cpn2h","kube-system/kube-apiserver-proxy-ip-10-0-138-41.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-41.ec2.internal","openshift-multus/multus-mhpx9","openshift-multus/network-metrics-daemon-fdm7r","openshift-network-operator/iptables-alerter-knvp4","openshift-cluster-node-tuning-operator/tuned-6tk7t","openshift-dns/node-resolver-dvrtk"] Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.321360 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-knvp4" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.323587 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.324307 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.324307 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.324358 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.324383 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6kpgz\"" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.325887 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.325938 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m8rmg\"" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.326344 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.327050 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:57.327127 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb2v6" podUID="14b9879f-f279-48b7-8198-ea88bcd46396" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.329405 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.330097 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.331929 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.331977 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.332217 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.332221 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.332374 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.332465 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vgt8q\"" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.332740 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.332813 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.334215 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.334495 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.334720 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cpn2h" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.334747 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.334809 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6mz5w\"" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.334848 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.336822 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.337159 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.337205 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xd6rj\"" Jul 02 15:25:57.404921 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.337221 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 15:25:57.407084 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.339412 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 15:25:57.407084 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.339424 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 15:25:57.407084 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.339460 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 15:25:57.407084 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.339651 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qrttf" Jul 02 15:25:57.407084 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.340015 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-thpds\"" Jul 02 15:25:57.407084 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.341878 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sgthj\"" Jul 02 15:25:57.407084 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.342117 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 15:25:57.407084 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.342131 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 15:25:57.407084 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.342204 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 15:25:57.407084 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.342765 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:25:57.407084 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:57.342828 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdm7r" podUID="e7056290-1f84-464b-9b53-afd3bc43bec1" Jul 02 15:25:57.407084 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.345389 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 15:25:57.407084 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.346342 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:25:57.407084 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:57.346762 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs9xw" podUID="43c7deaa-395b-4e22-81b8-b52ce0f359b9" Jul 02 15:25:57.407084 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.347588 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-etc-kubernetes\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.407084 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.347630 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-etc-openvswitch\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.407084 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.347663 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d12ba42-4046-41ad-880c-9e75e1c29a5a-ovn-node-metrics-cert\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.407084 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.347696 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-etc-systemd\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.407084 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.347731 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-lib-modules\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.407084 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.347765 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-run-openvswitch\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.407084 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.347797 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-multus-socket-dir-parent\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.407084 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.347830 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-host-var-lib-cni-bin\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.407084 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.347867 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-systemd-units\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.407998 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.347897 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1d12ba42-4046-41ad-880c-9e75e1c29a5a-ovnkube-script-lib\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.407998 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.347994 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-host-run-netns\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.407998 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.348047 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-multus-conf-dir\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.407998 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.348178 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-multus-daemon-config\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.407998 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.348237 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c9eb5914-4b29-474b-87b9-f703e64c1702-iptables-alerter-script\") pod \"iptables-alerter-knvp4\" (UID: \"c9eb5914-4b29-474b-87b9-f703e64c1702\") " pod="openshift-network-operator/iptables-alerter-knvp4" Jul 02 15:25:57.407998 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.348278 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1d12ba42-4046-41ad-880c-9e75e1c29a5a-ovnkube-config\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.407998 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.348309 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-hostroot\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.407998 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.348514 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9eb5914-4b29-474b-87b9-f703e64c1702-host-slash\") pod \"iptables-alerter-knvp4\" (UID: \"c9eb5914-4b29-474b-87b9-f703e64c1702\") " pod="openshift-network-operator/iptables-alerter-knvp4" Jul 02 15:25:57.407998 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.348550 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-etc-modprobe-d\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.407998 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.348577 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45fd292f-66ba-4637-8166-4e82342b5d14-tmp\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.407998 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.348598 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-var-lib-openvswitch\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.407998 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.348633 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbst7\" (UniqueName: \"kubernetes.io/projected/14b9879f-f279-48b7-8198-ea88bcd46396-kube-api-access-tbst7\") pod \"network-check-target-nb2v6\" (UID: \"14b9879f-f279-48b7-8198-ea88bcd46396\") " pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:25:57.407998 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.348661 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-host-slash\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.407998 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.348691 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-node-log\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.407998 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.348721 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-host-cni-bin\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.407998 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.348746 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-host-var-lib-kubelet\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.407998 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.348784 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-run\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.409139 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.348808 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-os-release\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.409139 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.349192 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-etc-sysctl-d\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.409139 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.349231 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-var-lib-kubelet\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.409139 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.349255 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx65j\" (UniqueName: \"kubernetes.io/projected/45fd292f-66ba-4637-8166-4e82342b5d14-kube-api-access-kx65j\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.409139 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.349288 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-run-systemd\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.409139 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.349320 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1d12ba42-4046-41ad-880c-9e75e1c29a5a-env-overrides\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.409139 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.349386 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvbzv\" (UniqueName: \"kubernetes.io/projected/1d12ba42-4046-41ad-880c-9e75e1c29a5a-kube-api-access-vvbzv\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.409139 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.349445 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-multus-cni-dir\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.409139 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.349479 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-etc-sysctl-conf\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.409139 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.349848 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/45fd292f-66ba-4637-8166-4e82342b5d14-etc-tuned\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.409139 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.349877 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-host-run-netns\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.409139 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.349900 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-log-socket\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.409139 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.349926 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-host-run-k8s-cni-cncf-io\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.409139 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.349955 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6xmf\" (UniqueName: \"kubernetes.io/projected/c9eb5914-4b29-474b-87b9-f703e64c1702-kube-api-access-j6xmf\") pod \"iptables-alerter-knvp4\" (UID: \"c9eb5914-4b29-474b-87b9-f703e64c1702\") " pod="openshift-network-operator/iptables-alerter-knvp4" Jul 02 15:25:57.409139 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.349984 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-etc-sysconfig\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.409139 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.350044 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-host-kubelet\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.409139 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.350078 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-sys\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.414901 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.350104 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wqdxl" Jul 02 15:25:57.414901 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.350107 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.414901 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.350135 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-host-run-multus-certs\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.414901 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.350159 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-run-ovn\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.414901 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.350183 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk4qc\" (UniqueName: \"kubernetes.io/projected/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-kube-api-access-mk4qc\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.414901 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.350216 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-system-cni-dir\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.414901 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.350244 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-cnibin\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.414901 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.350268 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-host-run-ovn-kubernetes\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.414901 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.350299 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-host-cni-netd\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.414901 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.350321 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-cni-binary-copy\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.414901 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.350345 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-etc-kubernetes\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.414901 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.350371 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-host-var-lib-cni-multus\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.414901 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.350397 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-host\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.414901 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.352479 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dvrtk" Jul 02 15:25:57.414901 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.352520 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 15:25:57.414901 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.352481 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 15:25:57.414901 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.353082 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nm5jb\"" Jul 02 15:25:57.414901 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.354869 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 15:25:57.414901 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.354874 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ns8xc\"" Jul 02 15:25:57.414901 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.354936 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 15:25:57.414901 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.369170 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8s9qc" Jul 02 15:25:57.414901 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.376839 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8s9qc" Jul 02 15:25:57.414901 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.414729 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-41.ec2.internal" event={"ID":"51c81bcd0cbade972c4abc4428920b02","Type":"ContainerStarted","Data":"0c832ca620cded03b9f30914aff282078ea2fdd6656990834160bddcee836e17"} Jul 02 15:25:57.416470 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.415666 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-41.ec2.internal" event={"ID":"a69f5b6d35760bc20e58af7c0e937070","Type":"ContainerStarted","Data":"a36f29bc1c1b71d07a3ec124a0e9383955d878958103be08280b176ea93ce156"} Jul 02 15:25:57.583919 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.432059 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 15:25:57.583919 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.451587 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-multus-conf-dir\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.583919 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.451630 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-multus-daemon-config\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.583919 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.451665 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967-cni-binary-copy\") pod \"multus-additional-cni-plugins-wqdxl\" (UID: \"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967\") " pod="openshift-multus/multus-additional-cni-plugins-wqdxl" Jul 02 15:25:57.583919 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.451708 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpbst\" (UniqueName: \"kubernetes.io/projected/1ba1a511-b4bb-4e2d-b876-9d3d9a54dae7-kube-api-access-bpbst\") pod \"node-ca-qrttf\" (UID: \"1ba1a511-b4bb-4e2d-b876-9d3d9a54dae7\") " pod="openshift-image-registry/node-ca-qrttf" Jul 02 15:25:57.583919 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.451717 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-multus-conf-dir\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.583919 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.451736 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c9eb5914-4b29-474b-87b9-f703e64c1702-iptables-alerter-script\") pod \"iptables-alerter-knvp4\" (UID: \"c9eb5914-4b29-474b-87b9-f703e64c1702\") " pod="openshift-network-operator/iptables-alerter-knvp4" Jul 02 15:25:57.583919 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.451763 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1d12ba42-4046-41ad-880c-9e75e1c29a5a-ovnkube-config\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.583919 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.451792 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-hostroot\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.583919 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.451854 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-hostroot\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.583919 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.451874 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43c7deaa-395b-4e22-81b8-b52ce0f359b9-kubelet-config\") pod \"global-pull-secret-syncer-qs9xw\" (UID: \"43c7deaa-395b-4e22-81b8-b52ce0f359b9\") " pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:25:57.583919 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.451923 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967-cnibin\") pod \"multus-additional-cni-plugins-wqdxl\" (UID: \"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967\") " pod="openshift-multus/multus-additional-cni-plugins-wqdxl" Jul 02 15:25:57.583919 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.451956 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlh4x\" (UniqueName: \"kubernetes.io/projected/61c2c69b-7481-4ef5-a874-aa280ce47dee-kube-api-access-qlh4x\") pod \"node-resolver-dvrtk\" (UID: \"61c2c69b-7481-4ef5-a874-aa280ce47dee\") " pod="openshift-dns/node-resolver-dvrtk" Jul 02 15:25:57.583919 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.451988 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9eb5914-4b29-474b-87b9-f703e64c1702-host-slash\") pod \"iptables-alerter-knvp4\" (UID: \"c9eb5914-4b29-474b-87b9-f703e64c1702\") " pod="openshift-network-operator/iptables-alerter-knvp4" Jul 02 15:25:57.583919 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452030 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-etc-modprobe-d\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.583919 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452049 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9eb5914-4b29-474b-87b9-f703e64c1702-host-slash\") pod \"iptables-alerter-knvp4\" (UID: \"c9eb5914-4b29-474b-87b9-f703e64c1702\") " pod="openshift-network-operator/iptables-alerter-knvp4" Jul 02 15:25:57.583919 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452055 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45fd292f-66ba-4637-8166-4e82342b5d14-tmp\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.583919 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452080 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-var-lib-openvswitch\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.585461 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452104 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43c7deaa-395b-4e22-81b8-b52ce0f359b9-dbus\") pod \"global-pull-secret-syncer-qs9xw\" (UID: \"43c7deaa-395b-4e22-81b8-b52ce0f359b9\") " pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:25:57.585461 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452130 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wqdxl\" (UID: \"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967\") " pod="openshift-multus/multus-additional-cni-plugins-wqdxl" Jul 02 15:25:57.585461 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452137 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-etc-modprobe-d\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.585461 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452159 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v29p5\" (UniqueName: \"kubernetes.io/projected/9317314e-af53-4088-83c7-1398b91836f6-kube-api-access-v29p5\") pod \"aws-ebs-csi-driver-node-kmwkq\" (UID: \"9317314e-af53-4088-83c7-1398b91836f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" Jul 02 15:25:57.585461 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452166 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-var-lib-openvswitch\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.585461 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452187 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbst7\" (UniqueName: \"kubernetes.io/projected/14b9879f-f279-48b7-8198-ea88bcd46396-kube-api-access-tbst7\") pod \"network-check-target-nb2v6\" (UID: \"14b9879f-f279-48b7-8198-ea88bcd46396\") " pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:25:57.585461 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452214 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-host-slash\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.585461 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452240 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-node-log\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.585461 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452264 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-host-cni-bin\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.585461 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452272 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-host-slash\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.585461 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452289 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-host-var-lib-kubelet\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.585461 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452318 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-node-log\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.585461 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452329 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-host-cni-bin\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.585461 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452341 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-multus-daemon-config\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.585461 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452356 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/61c2c69b-7481-4ef5-a874-aa280ce47dee-hosts-file\") pod \"node-resolver-dvrtk\" (UID: \"61c2c69b-7481-4ef5-a874-aa280ce47dee\") " pod="openshift-dns/node-resolver-dvrtk" Jul 02 15:25:57.585461 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452382 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-run\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.585461 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452344 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-host-var-lib-kubelet\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.586365 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452405 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-os-release\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.586365 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452413 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c9eb5914-4b29-474b-87b9-f703e64c1702-iptables-alerter-script\") pod \"iptables-alerter-knvp4\" (UID: \"c9eb5914-4b29-474b-87b9-f703e64c1702\") " pod="openshift-network-operator/iptables-alerter-knvp4" Jul 02 15:25:57.586365 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452464 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-etc-sysctl-d\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.586365 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452472 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 15:25:57.586365 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452518 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-var-lib-kubelet\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.586365 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452532 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-run\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.586365 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452554 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx65j\" (UniqueName: \"kubernetes.io/projected/45fd292f-66ba-4637-8166-4e82342b5d14-kube-api-access-kx65j\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.586365 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452560 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-os-release\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.586365 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452567 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1d12ba42-4046-41ad-880c-9e75e1c29a5a-ovnkube-config\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.586365 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452578 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-etc-sysctl-d\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.586365 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452582 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-run-systemd\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.586365 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452622 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-run-systemd\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.586365 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452614 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1d12ba42-4046-41ad-880c-9e75e1c29a5a-env-overrides\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.586365 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452589 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-var-lib-kubelet\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.586365 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452653 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvbzv\" (UniqueName: \"kubernetes.io/projected/1d12ba42-4046-41ad-880c-9e75e1c29a5a-kube-api-access-vvbzv\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.586365 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452687 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-multus-cni-dir\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.586365 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452706 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967-os-release\") pod \"multus-additional-cni-plugins-wqdxl\" (UID: \"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967\") " pod="openshift-multus/multus-additional-cni-plugins-wqdxl" Jul 02 15:25:57.586365 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452727 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-etc-sysctl-conf\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.587260 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452750 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/45fd292f-66ba-4637-8166-4e82342b5d14-etc-tuned\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.587260 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452800 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-host-run-netns\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.587260 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452823 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-log-socket\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.587260 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452849 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-host-run-k8s-cni-cncf-io\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.587260 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452860 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-multus-cni-dir\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.587260 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452874 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967-system-cni-dir\") pod \"multus-additional-cni-plugins-wqdxl\" (UID: \"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967\") " pod="openshift-multus/multus-additional-cni-plugins-wqdxl" Jul 02 15:25:57.587260 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452901 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61c2c69b-7481-4ef5-a874-aa280ce47dee-tmp-dir\") pod \"node-resolver-dvrtk\" (UID: \"61c2c69b-7481-4ef5-a874-aa280ce47dee\") " pod="openshift-dns/node-resolver-dvrtk" Jul 02 15:25:57.587260 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452917 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-etc-sysctl-conf\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.587260 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452922 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-host-run-netns\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.587260 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452950 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9317314e-af53-4088-83c7-1398b91836f6-sys-fs\") pod \"aws-ebs-csi-driver-node-kmwkq\" (UID: \"9317314e-af53-4088-83c7-1398b91836f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" Jul 02 15:25:57.587260 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452979 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-host-run-k8s-cni-cncf-io\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.587260 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452986 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-log-socket\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.587260 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.452989 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1d12ba42-4046-41ad-880c-9e75e1c29a5a-env-overrides\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.587260 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453106 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6xmf\" (UniqueName: \"kubernetes.io/projected/c9eb5914-4b29-474b-87b9-f703e64c1702-kube-api-access-j6xmf\") pod \"iptables-alerter-knvp4\" (UID: \"c9eb5914-4b29-474b-87b9-f703e64c1702\") " pod="openshift-network-operator/iptables-alerter-knvp4" Jul 02 15:25:57.587260 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453135 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-etc-sysconfig\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.587260 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453175 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-host-kubelet\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.587260 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453200 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ba1a511-b4bb-4e2d-b876-9d3d9a54dae7-host\") pod \"node-ca-qrttf\" (UID: \"1ba1a511-b4bb-4e2d-b876-9d3d9a54dae7\") " pod="openshift-image-registry/node-ca-qrttf" Jul 02 15:25:57.587990 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453224 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8fad264-8fc9-4e9e-b870-a5fc8fac6f67-konnectivity-ca\") pod \"konnectivity-agent-cpn2h\" (UID: \"f8fad264-8fc9-4e9e-b870-a5fc8fac6f67\") " pod="kube-system/konnectivity-agent-cpn2h" Jul 02 15:25:57.587990 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453219 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-etc-sysconfig\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.587990 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453285 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7056290-1f84-464b-9b53-afd3bc43bec1-metrics-certs\") pod \"network-metrics-daemon-fdm7r\" (UID: \"e7056290-1f84-464b-9b53-afd3bc43bec1\") " pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:25:57.587990 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453311 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-sys\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.587990 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453336 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.587990 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453363 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-host-run-multus-certs\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.587990 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453382 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9317314e-af53-4088-83c7-1398b91836f6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kmwkq\" (UID: \"9317314e-af53-4088-83c7-1398b91836f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" Jul 02 15:25:57.587990 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453390 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.587990 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453403 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9317314e-af53-4088-83c7-1398b91836f6-etc-selinux\") pod \"aws-ebs-csi-driver-node-kmwkq\" (UID: \"9317314e-af53-4088-83c7-1398b91836f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" Jul 02 15:25:57.587990 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453363 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-host-kubelet\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.587990 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453429 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8fad264-8fc9-4e9e-b870-a5fc8fac6f67-agent-certs\") pod \"konnectivity-agent-cpn2h\" (UID: \"f8fad264-8fc9-4e9e-b870-a5fc8fac6f67\") " pod="kube-system/konnectivity-agent-cpn2h" Jul 02 15:25:57.587990 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453460 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-host-run-multus-certs\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.587990 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453483 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-sys\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.587990 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453492 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-run-ovn\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.587990 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453527 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-run-ovn\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.587990 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453554 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk4qc\" (UniqueName: \"kubernetes.io/projected/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-kube-api-access-mk4qc\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.587990 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453575 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-system-cni-dir\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.588657 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453591 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-cnibin\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.588657 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453614 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9317314e-af53-4088-83c7-1398b91836f6-registration-dir\") pod \"aws-ebs-csi-driver-node-kmwkq\" (UID: \"9317314e-af53-4088-83c7-1398b91836f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" Jul 02 15:25:57.588657 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453655 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-system-cni-dir\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.588657 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453675 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-cnibin\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.588657 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453710 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-host-run-ovn-kubernetes\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.588657 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453741 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-host-cni-netd\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.588657 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453768 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-host-run-ovn-kubernetes\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.588657 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453770 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wqdxl\" (UID: \"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967\") " pod="openshift-multus/multus-additional-cni-plugins-wqdxl" Jul 02 15:25:57.588657 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453802 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9317314e-af53-4088-83c7-1398b91836f6-device-dir\") pod \"aws-ebs-csi-driver-node-kmwkq\" (UID: \"9317314e-af53-4088-83c7-1398b91836f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" Jul 02 15:25:57.588657 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453803 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-host-cni-netd\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.588657 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453829 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-cni-binary-copy\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.588657 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453852 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-etc-kubernetes\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.588657 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453892 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43c7deaa-395b-4e22-81b8-b52ce0f359b9-original-pull-secret\") pod \"global-pull-secret-syncer-qs9xw\" (UID: \"43c7deaa-395b-4e22-81b8-b52ce0f359b9\") " pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:25:57.588657 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453936 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7nkl\" (UniqueName: \"kubernetes.io/projected/e7056290-1f84-464b-9b53-afd3bc43bec1-kube-api-access-w7nkl\") pod \"network-metrics-daemon-fdm7r\" (UID: \"e7056290-1f84-464b-9b53-afd3bc43bec1\") " pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:25:57.588657 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453941 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-etc-kubernetes\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.588657 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453966 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-host-var-lib-cni-multus\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.588657 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.453994 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-host\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.589301 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454012 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-host-var-lib-cni-multus\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.589301 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454055 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1ba1a511-b4bb-4e2d-b876-9d3d9a54dae7-serviceca\") pod \"node-ca-qrttf\" (UID: \"1ba1a511-b4bb-4e2d-b876-9d3d9a54dae7\") " pod="openshift-image-registry/node-ca-qrttf" Jul 02 15:25:57.589301 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454092 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-etc-kubernetes\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.589301 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454126 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-etc-openvswitch\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.589301 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454146 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-host\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.589301 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454153 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d12ba42-4046-41ad-880c-9e75e1c29a5a-ovn-node-metrics-cert\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.589301 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454186 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxtcn\" (UniqueName: \"kubernetes.io/projected/016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967-kube-api-access-jxtcn\") pod \"multus-additional-cni-plugins-wqdxl\" (UID: \"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967\") " pod="openshift-multus/multus-additional-cni-plugins-wqdxl" Jul 02 15:25:57.589301 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454196 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-etc-kubernetes\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.589301 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454213 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9317314e-af53-4088-83c7-1398b91836f6-socket-dir\") pod \"aws-ebs-csi-driver-node-kmwkq\" (UID: \"9317314e-af53-4088-83c7-1398b91836f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" Jul 02 15:25:57.589301 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454240 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-etc-systemd\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.589301 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454272 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-lib-modules\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.589301 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454300 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-run-openvswitch\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.589301 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454324 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-multus-socket-dir-parent\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.589301 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454350 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-host-var-lib-cni-bin\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.589301 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454367 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-cni-binary-copy\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.589301 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454377 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wqdxl\" (UID: \"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967\") " pod="openshift-multus/multus-additional-cni-plugins-wqdxl" Jul 02 15:25:57.589301 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454406 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-systemd-units\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.590051 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454427 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-etc-openvswitch\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.590051 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454432 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1d12ba42-4046-41ad-880c-9e75e1c29a5a-ovnkube-script-lib\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.590051 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454475 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-run-openvswitch\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.590051 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454506 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-host-run-netns\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.590051 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454592 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-host-run-netns\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.590051 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454656 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-host-var-lib-cni-bin\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.590051 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454698 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-lib-modules\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.590051 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454719 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-multus-socket-dir-parent\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.590051 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454747 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/45fd292f-66ba-4637-8166-4e82342b5d14-etc-systemd\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.590051 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454777 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1d12ba42-4046-41ad-880c-9e75e1c29a5a-systemd-units\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.590051 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.454962 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1d12ba42-4046-41ad-880c-9e75e1c29a5a-ovnkube-script-lib\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.590051 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.456307 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45fd292f-66ba-4637-8166-4e82342b5d14-tmp\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.590051 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.456351 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/45fd292f-66ba-4637-8166-4e82342b5d14-etc-tuned\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.590051 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.456930 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d12ba42-4046-41ad-880c-9e75e1c29a5a-ovn-node-metrics-cert\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.590051 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:57.462101 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:25:57.590051 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:57.462122 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:25:57.590051 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:57.462134 2573 projected.go:196] Error preparing data for projected volume kube-api-access-tbst7 for pod openshift-network-diagnostics/network-check-target-nb2v6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:25:57.591109 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:57.462198 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14b9879f-f279-48b7-8198-ea88bcd46396-kube-api-access-tbst7 podName:14b9879f-f279-48b7-8198-ea88bcd46396 nodeName:}" failed. No retries permitted until 2026-07-02 15:25:57.962179098 +0000 UTC m=+3.034492810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tbst7" (UniqueName: "kubernetes.io/projected/14b9879f-f279-48b7-8198-ea88bcd46396-kube-api-access-tbst7") pod "network-check-target-nb2v6" (UID: "14b9879f-f279-48b7-8198-ea88bcd46396") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:25:57.591109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.464981 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx65j\" (UniqueName: \"kubernetes.io/projected/45fd292f-66ba-4637-8166-4e82342b5d14-kube-api-access-kx65j\") pod \"tuned-6tk7t\" (UID: \"45fd292f-66ba-4637-8166-4e82342b5d14\") " pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.591109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.466438 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6xmf\" (UniqueName: \"kubernetes.io/projected/c9eb5914-4b29-474b-87b9-f703e64c1702-kube-api-access-j6xmf\") pod \"iptables-alerter-knvp4\" (UID: \"c9eb5914-4b29-474b-87b9-f703e64c1702\") " pod="openshift-network-operator/iptables-alerter-knvp4" Jul 02 15:25:57.591109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.467486 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk4qc\" (UniqueName: \"kubernetes.io/projected/81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67-kube-api-access-mk4qc\") pod \"multus-mhpx9\" (UID: \"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67\") " pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.591109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.467873 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvbzv\" (UniqueName: \"kubernetes.io/projected/1d12ba42-4046-41ad-880c-9e75e1c29a5a-kube-api-access-vvbzv\") pod \"ovnkube-node-rg8r5\" (UID: \"1d12ba42-4046-41ad-880c-9e75e1c29a5a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.591109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.560429 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9317314e-af53-4088-83c7-1398b91836f6-registration-dir\") pod \"aws-ebs-csi-driver-node-kmwkq\" (UID: \"9317314e-af53-4088-83c7-1398b91836f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" Jul 02 15:25:57.591109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.560463 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wqdxl\" (UID: \"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967\") " pod="openshift-multus/multus-additional-cni-plugins-wqdxl" Jul 02 15:25:57.591109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.560484 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9317314e-af53-4088-83c7-1398b91836f6-device-dir\") pod \"aws-ebs-csi-driver-node-kmwkq\" (UID: \"9317314e-af53-4088-83c7-1398b91836f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" Jul 02 15:25:57.591109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.560577 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9317314e-af53-4088-83c7-1398b91836f6-device-dir\") pod \"aws-ebs-csi-driver-node-kmwkq\" (UID: \"9317314e-af53-4088-83c7-1398b91836f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" Jul 02 15:25:57.591109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.560575 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9317314e-af53-4088-83c7-1398b91836f6-registration-dir\") pod \"aws-ebs-csi-driver-node-kmwkq\" (UID: \"9317314e-af53-4088-83c7-1398b91836f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" Jul 02 15:25:57.591109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.560609 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43c7deaa-395b-4e22-81b8-b52ce0f359b9-original-pull-secret\") pod \"global-pull-secret-syncer-qs9xw\" (UID: \"43c7deaa-395b-4e22-81b8-b52ce0f359b9\") " pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:25:57.591109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.560642 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7nkl\" (UniqueName: \"kubernetes.io/projected/e7056290-1f84-464b-9b53-afd3bc43bec1-kube-api-access-w7nkl\") pod \"network-metrics-daemon-fdm7r\" (UID: \"e7056290-1f84-464b-9b53-afd3bc43bec1\") " pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:25:57.591109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.560667 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1ba1a511-b4bb-4e2d-b876-9d3d9a54dae7-serviceca\") pod \"node-ca-qrttf\" (UID: \"1ba1a511-b4bb-4e2d-b876-9d3d9a54dae7\") " pod="openshift-image-registry/node-ca-qrttf" Jul 02 15:25:57.591109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.560692 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxtcn\" (UniqueName: \"kubernetes.io/projected/016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967-kube-api-access-jxtcn\") pod \"multus-additional-cni-plugins-wqdxl\" (UID: \"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967\") " pod="openshift-multus/multus-additional-cni-plugins-wqdxl" Jul 02 15:25:57.591109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.560716 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9317314e-af53-4088-83c7-1398b91836f6-socket-dir\") pod \"aws-ebs-csi-driver-node-kmwkq\" (UID: \"9317314e-af53-4088-83c7-1398b91836f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" Jul 02 15:25:57.591109 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:57.560727 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:25:57.592043 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.560748 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wqdxl\" (UID: \"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967\") " pod="openshift-multus/multus-additional-cni-plugins-wqdxl" Jul 02 15:25:57.592043 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.560777 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967-cni-binary-copy\") pod \"multus-additional-cni-plugins-wqdxl\" (UID: \"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967\") " pod="openshift-multus/multus-additional-cni-plugins-wqdxl" Jul 02 15:25:57.592043 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:57.560806 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c7deaa-395b-4e22-81b8-b52ce0f359b9-original-pull-secret podName:43c7deaa-395b-4e22-81b8-b52ce0f359b9 nodeName:}" failed. No retries permitted until 2026-07-02 15:25:58.060783792 +0000 UTC m=+3.133097491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43c7deaa-395b-4e22-81b8-b52ce0f359b9-original-pull-secret") pod "global-pull-secret-syncer-qs9xw" (UID: "43c7deaa-395b-4e22-81b8-b52ce0f359b9") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:25:57.592043 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.560869 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpbst\" (UniqueName: \"kubernetes.io/projected/1ba1a511-b4bb-4e2d-b876-9d3d9a54dae7-kube-api-access-bpbst\") pod \"node-ca-qrttf\" (UID: \"1ba1a511-b4bb-4e2d-b876-9d3d9a54dae7\") " pod="openshift-image-registry/node-ca-qrttf" Jul 02 15:25:57.592043 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.560926 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43c7deaa-395b-4e22-81b8-b52ce0f359b9-kubelet-config\") pod \"global-pull-secret-syncer-qs9xw\" (UID: \"43c7deaa-395b-4e22-81b8-b52ce0f359b9\") " pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:25:57.592043 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.560953 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967-cnibin\") pod \"multus-additional-cni-plugins-wqdxl\" (UID: \"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967\") " pod="openshift-multus/multus-additional-cni-plugins-wqdxl" Jul 02 15:25:57.592043 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.560999 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlh4x\" (UniqueName: \"kubernetes.io/projected/61c2c69b-7481-4ef5-a874-aa280ce47dee-kube-api-access-qlh4x\") pod \"node-resolver-dvrtk\" (UID: \"61c2c69b-7481-4ef5-a874-aa280ce47dee\") " pod="openshift-dns/node-resolver-dvrtk" Jul 02 15:25:57.592043 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561049 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43c7deaa-395b-4e22-81b8-b52ce0f359b9-dbus\") pod \"global-pull-secret-syncer-qs9xw\" (UID: \"43c7deaa-395b-4e22-81b8-b52ce0f359b9\") " pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:25:57.592043 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561077 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wqdxl\" (UID: \"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967\") " pod="openshift-multus/multus-additional-cni-plugins-wqdxl" Jul 02 15:25:57.592043 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561104 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v29p5\" (UniqueName: \"kubernetes.io/projected/9317314e-af53-4088-83c7-1398b91836f6-kube-api-access-v29p5\") pod \"aws-ebs-csi-driver-node-kmwkq\" (UID: \"9317314e-af53-4088-83c7-1398b91836f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" Jul 02 15:25:57.592043 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561149 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/61c2c69b-7481-4ef5-a874-aa280ce47dee-hosts-file\") pod \"node-resolver-dvrtk\" (UID: \"61c2c69b-7481-4ef5-a874-aa280ce47dee\") " pod="openshift-dns/node-resolver-dvrtk" Jul 02 15:25:57.592043 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561186 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967-os-release\") pod \"multus-additional-cni-plugins-wqdxl\" (UID: \"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967\") " pod="openshift-multus/multus-additional-cni-plugins-wqdxl" Jul 02 15:25:57.592043 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561218 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967-system-cni-dir\") pod \"multus-additional-cni-plugins-wqdxl\" (UID: \"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967\") " pod="openshift-multus/multus-additional-cni-plugins-wqdxl" Jul 02 15:25:57.592043 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561219 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9317314e-af53-4088-83c7-1398b91836f6-socket-dir\") pod \"aws-ebs-csi-driver-node-kmwkq\" (UID: \"9317314e-af53-4088-83c7-1398b91836f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" Jul 02 15:25:57.592043 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561256 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1ba1a511-b4bb-4e2d-b876-9d3d9a54dae7-serviceca\") pod \"node-ca-qrttf\" (UID: \"1ba1a511-b4bb-4e2d-b876-9d3d9a54dae7\") " pod="openshift-image-registry/node-ca-qrttf" Jul 02 15:25:57.592043 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561264 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61c2c69b-7481-4ef5-a874-aa280ce47dee-tmp-dir\") pod \"node-resolver-dvrtk\" (UID: \"61c2c69b-7481-4ef5-a874-aa280ce47dee\") " pod="openshift-dns/node-resolver-dvrtk" Jul 02 15:25:57.593202 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561292 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43c7deaa-395b-4e22-81b8-b52ce0f359b9-kubelet-config\") pod \"global-pull-secret-syncer-qs9xw\" (UID: \"43c7deaa-395b-4e22-81b8-b52ce0f359b9\") " pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:25:57.593202 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561298 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9317314e-af53-4088-83c7-1398b91836f6-sys-fs\") pod \"aws-ebs-csi-driver-node-kmwkq\" (UID: \"9317314e-af53-4088-83c7-1398b91836f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" Jul 02 15:25:57.593202 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561337 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ba1a511-b4bb-4e2d-b876-9d3d9a54dae7-host\") pod \"node-ca-qrttf\" (UID: \"1ba1a511-b4bb-4e2d-b876-9d3d9a54dae7\") " pod="openshift-image-registry/node-ca-qrttf" Jul 02 15:25:57.593202 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561346 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9317314e-af53-4088-83c7-1398b91836f6-sys-fs\") pod \"aws-ebs-csi-driver-node-kmwkq\" (UID: \"9317314e-af53-4088-83c7-1398b91836f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" Jul 02 15:25:57.593202 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561350 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967-cni-binary-copy\") pod \"multus-additional-cni-plugins-wqdxl\" (UID: \"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967\") " pod="openshift-multus/multus-additional-cni-plugins-wqdxl" Jul 02 15:25:57.593202 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561364 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8fad264-8fc9-4e9e-b870-a5fc8fac6f67-konnectivity-ca\") pod \"konnectivity-agent-cpn2h\" (UID: \"f8fad264-8fc9-4e9e-b870-a5fc8fac6f67\") " pod="kube-system/konnectivity-agent-cpn2h" Jul 02 15:25:57.593202 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561392 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wqdxl\" (UID: \"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967\") " pod="openshift-multus/multus-additional-cni-plugins-wqdxl" Jul 02 15:25:57.593202 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561411 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967-system-cni-dir\") pod \"multus-additional-cni-plugins-wqdxl\" (UID: \"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967\") " pod="openshift-multus/multus-additional-cni-plugins-wqdxl" Jul 02 15:25:57.593202 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561428 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7056290-1f84-464b-9b53-afd3bc43bec1-metrics-certs\") pod \"network-metrics-daemon-fdm7r\" (UID: \"e7056290-1f84-464b-9b53-afd3bc43bec1\") " pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:25:57.593202 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561458 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9317314e-af53-4088-83c7-1398b91836f6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kmwkq\" (UID: \"9317314e-af53-4088-83c7-1398b91836f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" Jul 02 15:25:57.593202 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561486 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9317314e-af53-4088-83c7-1398b91836f6-etc-selinux\") pod \"aws-ebs-csi-driver-node-kmwkq\" (UID: \"9317314e-af53-4088-83c7-1398b91836f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" Jul 02 15:25:57.593202 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561511 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8fad264-8fc9-4e9e-b870-a5fc8fac6f67-agent-certs\") pod \"konnectivity-agent-cpn2h\" (UID: \"f8fad264-8fc9-4e9e-b870-a5fc8fac6f67\") " pod="kube-system/konnectivity-agent-cpn2h" Jul 02 15:25:57.593202 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561535 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967-cnibin\") pod \"multus-additional-cni-plugins-wqdxl\" (UID: \"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967\") " pod="openshift-multus/multus-additional-cni-plugins-wqdxl" Jul 02 15:25:57.593202 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561605 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43c7deaa-395b-4e22-81b8-b52ce0f359b9-dbus\") pod \"global-pull-secret-syncer-qs9xw\" (UID: \"43c7deaa-395b-4e22-81b8-b52ce0f359b9\") " pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:25:57.593202 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561624 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ba1a511-b4bb-4e2d-b876-9d3d9a54dae7-host\") pod \"node-ca-qrttf\" (UID: \"1ba1a511-b4bb-4e2d-b876-9d3d9a54dae7\") " pod="openshift-image-registry/node-ca-qrttf" Jul 02 15:25:57.593202 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561654 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/61c2c69b-7481-4ef5-a874-aa280ce47dee-hosts-file\") pod \"node-resolver-dvrtk\" (UID: \"61c2c69b-7481-4ef5-a874-aa280ce47dee\") " pod="openshift-dns/node-resolver-dvrtk" Jul 02 15:25:57.593202 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561679 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61c2c69b-7481-4ef5-a874-aa280ce47dee-tmp-dir\") pod \"node-resolver-dvrtk\" (UID: \"61c2c69b-7481-4ef5-a874-aa280ce47dee\") " pod="openshift-dns/node-resolver-dvrtk" Jul 02 15:25:57.594109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561685 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967-os-release\") pod \"multus-additional-cni-plugins-wqdxl\" (UID: \"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967\") " pod="openshift-multus/multus-additional-cni-plugins-wqdxl" Jul 02 15:25:57.594109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561714 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wqdxl\" (UID: \"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967\") " pod="openshift-multus/multus-additional-cni-plugins-wqdxl" Jul 02 15:25:57.594109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561749 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9317314e-af53-4088-83c7-1398b91836f6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kmwkq\" (UID: \"9317314e-af53-4088-83c7-1398b91836f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" Jul 02 15:25:57.594109 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:57.561766 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:25:57.594109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.561788 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9317314e-af53-4088-83c7-1398b91836f6-etc-selinux\") pod \"aws-ebs-csi-driver-node-kmwkq\" (UID: \"9317314e-af53-4088-83c7-1398b91836f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" Jul 02 15:25:57.594109 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:57.561810 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7056290-1f84-464b-9b53-afd3bc43bec1-metrics-certs podName:e7056290-1f84-464b-9b53-afd3bc43bec1 nodeName:}" failed. No retries permitted until 2026-07-02 15:25:58.061795699 +0000 UTC m=+3.134109406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7056290-1f84-464b-9b53-afd3bc43bec1-metrics-certs") pod "network-metrics-daemon-fdm7r" (UID: "e7056290-1f84-464b-9b53-afd3bc43bec1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:25:57.594109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.562301 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8fad264-8fc9-4e9e-b870-a5fc8fac6f67-konnectivity-ca\") pod \"konnectivity-agent-cpn2h\" (UID: \"f8fad264-8fc9-4e9e-b870-a5fc8fac6f67\") " pod="kube-system/konnectivity-agent-cpn2h" Jul 02 15:25:57.594109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.562306 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wqdxl\" (UID: \"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967\") " pod="openshift-multus/multus-additional-cni-plugins-wqdxl" Jul 02 15:25:57.594109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.564536 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8fad264-8fc9-4e9e-b870-a5fc8fac6f67-agent-certs\") pod \"konnectivity-agent-cpn2h\" (UID: \"f8fad264-8fc9-4e9e-b870-a5fc8fac6f67\") " pod="kube-system/konnectivity-agent-cpn2h" Jul 02 15:25:57.594109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.570266 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxtcn\" (UniqueName: \"kubernetes.io/projected/016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967-kube-api-access-jxtcn\") pod \"multus-additional-cni-plugins-wqdxl\" (UID: \"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967\") " pod="openshift-multus/multus-additional-cni-plugins-wqdxl" Jul 02 15:25:57.594109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.570317 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlh4x\" (UniqueName: \"kubernetes.io/projected/61c2c69b-7481-4ef5-a874-aa280ce47dee-kube-api-access-qlh4x\") pod \"node-resolver-dvrtk\" (UID: \"61c2c69b-7481-4ef5-a874-aa280ce47dee\") " pod="openshift-dns/node-resolver-dvrtk" Jul 02 15:25:57.594109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.570665 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v29p5\" (UniqueName: \"kubernetes.io/projected/9317314e-af53-4088-83c7-1398b91836f6-kube-api-access-v29p5\") pod \"aws-ebs-csi-driver-node-kmwkq\" (UID: \"9317314e-af53-4088-83c7-1398b91836f6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" Jul 02 15:25:57.594109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.570894 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpbst\" (UniqueName: \"kubernetes.io/projected/1ba1a511-b4bb-4e2d-b876-9d3d9a54dae7-kube-api-access-bpbst\") pod \"node-ca-qrttf\" (UID: \"1ba1a511-b4bb-4e2d-b876-9d3d9a54dae7\") " pod="openshift-image-registry/node-ca-qrttf" Jul 02 15:25:57.594109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.571009 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7nkl\" (UniqueName: \"kubernetes.io/projected/e7056290-1f84-464b-9b53-afd3bc43bec1-kube-api-access-w7nkl\") pod \"network-metrics-daemon-fdm7r\" (UID: \"e7056290-1f84-464b-9b53-afd3bc43bec1\") " pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:25:57.723566 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.634468 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-knvp4" Jul 02 15:25:57.723566 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.642551 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" Jul 02 15:25:57.723566 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:57.647141 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9eb5914_4b29_474b_87b9_f703e64c1702.slice/crio-8a97716344f1595a01d91ebf450c084f092dc380d50378031a57bc63b8d4dd7c WatchSource:0}: Error finding container 8a97716344f1595a01d91ebf450c084f092dc380d50378031a57bc63b8d4dd7c: Status 404 returned error can't find the container with id 8a97716344f1595a01d91ebf450c084f092dc380d50378031a57bc63b8d4dd7c Jul 02 15:25:57.723566 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.653376 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:25:57.723566 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.656663 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mhpx9" Jul 02 15:25:57.723566 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:57.657822 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45fd292f_66ba_4637_8166_4e82342b5d14.slice/crio-cf468cea7855eddeeec221052231d843feb736879e621a46dffdeb384c159052 WatchSource:0}: Error finding container cf468cea7855eddeeec221052231d843feb736879e621a46dffdeb384c159052: Status 404 returned error can't find the container with id cf468cea7855eddeeec221052231d843feb736879e621a46dffdeb384c159052 Jul 02 15:25:57.723566 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:57.663820 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d12ba42_4046_41ad_880c_9e75e1c29a5a.slice/crio-2fa997069a6c12096280de002567e97f804ae3e70c3118bdab92b88d3b3666ab WatchSource:0}: Error finding container 2fa997069a6c12096280de002567e97f804ae3e70c3118bdab92b88d3b3666ab: Status 404 returned error can't find the container with id 2fa997069a6c12096280de002567e97f804ae3e70c3118bdab92b88d3b3666ab Jul 02 15:25:57.723566 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.664499 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cpn2h" Jul 02 15:25:57.723566 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:57.667362 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d05a2e_6cf1_40bb_a41d_f7f1cacd9c67.slice/crio-f749a4f31fbcbbfd7765b0792f0c7439012d7586aecab964a212a604feea2024 WatchSource:0}: Error finding container f749a4f31fbcbbfd7765b0792f0c7439012d7586aecab964a212a604feea2024: Status 404 returned error can't find the container with id f749a4f31fbcbbfd7765b0792f0c7439012d7586aecab964a212a604feea2024 Jul 02 15:25:57.723566 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.672728 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" Jul 02 15:25:57.723566 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:57.677320 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8fad264_8fc9_4e9e_b870_a5fc8fac6f67.slice/crio-084a4cf14ac495c1fda6875a1db699d6f9dc4b38e2df4c3e1650fca0a6a0c6b3 WatchSource:0}: Error finding container 084a4cf14ac495c1fda6875a1db699d6f9dc4b38e2df4c3e1650fca0a6a0c6b3: Status 404 returned error can't find the container with id 084a4cf14ac495c1fda6875a1db699d6f9dc4b38e2df4c3e1650fca0a6a0c6b3 Jul 02 15:25:57.723566 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.682457 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qrttf" Jul 02 15:25:57.723566 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:57.688127 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9317314e_af53_4088_83c7_1398b91836f6.slice/crio-5fbb944383790538dfe8f4f80a7eae61e3de2819972310401f05a8e1ad4a975e WatchSource:0}: Error finding container 5fbb944383790538dfe8f4f80a7eae61e3de2819972310401f05a8e1ad4a975e: Status 404 returned error can't find the container with id 5fbb944383790538dfe8f4f80a7eae61e3de2819972310401f05a8e1ad4a975e Jul 02 15:25:57.723566 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.690404 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wqdxl" Jul 02 15:25:57.723566 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.696628 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dvrtk" Jul 02 15:25:57.723566 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:57.696947 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ba1a511_b4bb_4e2d_b876_9d3d9a54dae7.slice/crio-56f9965f691f1ff186cd9186ea3483445e989af9d2831a6b38e0a99300eb8794 WatchSource:0}: Error finding container 56f9965f691f1ff186cd9186ea3483445e989af9d2831a6b38e0a99300eb8794: Status 404 returned error can't find the container with id 56f9965f691f1ff186cd9186ea3483445e989af9d2831a6b38e0a99300eb8794 Jul 02 15:25:57.924371 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.798975 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:25:58.108002 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:57.964843 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbst7\" (UniqueName: \"kubernetes.io/projected/14b9879f-f279-48b7-8198-ea88bcd46396-kube-api-access-tbst7\") pod \"network-check-target-nb2v6\" (UID: \"14b9879f-f279-48b7-8198-ea88bcd46396\") " pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:25:58.108002 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:57.965023 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:25:58.108002 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:57.965047 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:25:58.108002 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:57.965058 2573 projected.go:196] Error preparing data for projected volume kube-api-access-tbst7 for pod openshift-network-diagnostics/network-check-target-nb2v6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:25:58.108002 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:57.965116 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14b9879f-f279-48b7-8198-ea88bcd46396-kube-api-access-tbst7 podName:14b9879f-f279-48b7-8198-ea88bcd46396 nodeName:}" failed. No retries permitted until 2026-07-02 15:25:58.965097135 +0000 UTC m=+4.037410843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tbst7" (UniqueName: "kubernetes.io/projected/14b9879f-f279-48b7-8198-ea88bcd46396-kube-api-access-tbst7") pod "network-check-target-nb2v6" (UID: "14b9879f-f279-48b7-8198-ea88bcd46396") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:25:58.108002 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:58.066000 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7056290-1f84-464b-9b53-afd3bc43bec1-metrics-certs\") pod \"network-metrics-daemon-fdm7r\" (UID: \"e7056290-1f84-464b-9b53-afd3bc43bec1\") " pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:25:58.108002 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:58.066078 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43c7deaa-395b-4e22-81b8-b52ce0f359b9-original-pull-secret\") pod \"global-pull-secret-syncer-qs9xw\" (UID: \"43c7deaa-395b-4e22-81b8-b52ce0f359b9\") " pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:25:58.108002 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:58.066182 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:25:58.108002 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:58.066205 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:25:58.108002 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:58.066264 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7056290-1f84-464b-9b53-afd3bc43bec1-metrics-certs podName:e7056290-1f84-464b-9b53-afd3bc43bec1 nodeName:}" failed. No retries permitted until 2026-07-02 15:25:59.066244356 +0000 UTC m=+4.138558049 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7056290-1f84-464b-9b53-afd3bc43bec1-metrics-certs") pod "network-metrics-daemon-fdm7r" (UID: "e7056290-1f84-464b-9b53-afd3bc43bec1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:25:58.108002 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:58.066285 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c7deaa-395b-4e22-81b8-b52ce0f359b9-original-pull-secret podName:43c7deaa-395b-4e22-81b8-b52ce0f359b9 nodeName:}" failed. No retries permitted until 2026-07-02 15:25:59.066275877 +0000 UTC m=+4.138589574 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43c7deaa-395b-4e22-81b8-b52ce0f359b9-original-pull-secret") pod "global-pull-secret-syncer-qs9xw" (UID: "43c7deaa-395b-4e22-81b8-b52ce0f359b9") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:25:58.108002 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:58.092532 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod016a5a3b_c15d_4a9e_a8d4_5cb01d4bd967.slice/crio-efc8184fed04c8ddcd8c1fbd02383dfc9b1ef1826695f221aaebec3b9f770585 WatchSource:0}: Error finding container efc8184fed04c8ddcd8c1fbd02383dfc9b1ef1826695f221aaebec3b9f770585: Status 404 returned error can't find the container with id efc8184fed04c8ddcd8c1fbd02383dfc9b1ef1826695f221aaebec3b9f770585 Jul 02 15:25:58.108002 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:25:58.095926 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61c2c69b_7481_4ef5_a874_aa280ce47dee.slice/crio-b089fb9371e6b17f2975435a00bf1e1840d1af619182032309e8c07c17fcc4c0 WatchSource:0}: Error finding container b089fb9371e6b17f2975435a00bf1e1840d1af619182032309e8c07c17fcc4c0: Status 404 returned error can't find the container with id b089fb9371e6b17f2975435a00bf1e1840d1af619182032309e8c07c17fcc4c0 Jul 02 15:25:58.343762 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:58.298252 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 15:25:58.383467 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:58.380257 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 15:20:57 +0000 UTC" deadline="2027-12-17 12:59:06.768037988 +0000 UTC" Jul 02 15:25:58.383467 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:58.380293 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12789h33m8.387750106s" Jul 02 15:25:58.446967 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:58.423407 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" event={"ID":"9317314e-af53-4088-83c7-1398b91836f6","Type":"ContainerStarted","Data":"5fbb944383790538dfe8f4f80a7eae61e3de2819972310401f05a8e1ad4a975e"} Jul 02 15:25:58.446967 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:58.427467 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mhpx9" event={"ID":"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67","Type":"ContainerStarted","Data":"f749a4f31fbcbbfd7765b0792f0c7439012d7586aecab964a212a604feea2024"} Jul 02 15:25:58.446967 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:58.432619 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" event={"ID":"45fd292f-66ba-4637-8166-4e82342b5d14","Type":"ContainerStarted","Data":"cf468cea7855eddeeec221052231d843feb736879e621a46dffdeb384c159052"} Jul 02 15:25:58.446967 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:58.434237 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dvrtk" event={"ID":"61c2c69b-7481-4ef5-a874-aa280ce47dee","Type":"ContainerStarted","Data":"b089fb9371e6b17f2975435a00bf1e1840d1af619182032309e8c07c17fcc4c0"} Jul 02 15:25:58.446967 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:58.442566 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqdxl" event={"ID":"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967","Type":"ContainerStarted","Data":"efc8184fed04c8ddcd8c1fbd02383dfc9b1ef1826695f221aaebec3b9f770585"} Jul 02 15:25:58.449632 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:58.447853 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qrttf" event={"ID":"1ba1a511-b4bb-4e2d-b876-9d3d9a54dae7","Type":"ContainerStarted","Data":"56f9965f691f1ff186cd9186ea3483445e989af9d2831a6b38e0a99300eb8794"} Jul 02 15:25:58.515542 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:58.463832 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cpn2h" event={"ID":"f8fad264-8fc9-4e9e-b870-a5fc8fac6f67","Type":"ContainerStarted","Data":"084a4cf14ac495c1fda6875a1db699d6f9dc4b38e2df4c3e1650fca0a6a0c6b3"} Jul 02 15:25:58.515542 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:58.465983 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" event={"ID":"1d12ba42-4046-41ad-880c-9e75e1c29a5a","Type":"ContainerStarted","Data":"2fa997069a6c12096280de002567e97f804ae3e70c3118bdab92b88d3b3666ab"} Jul 02 15:25:58.515542 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:58.469970 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-knvp4" event={"ID":"c9eb5914-4b29-474b-87b9-f703e64c1702","Type":"ContainerStarted","Data":"8a97716344f1595a01d91ebf450c084f092dc380d50378031a57bc63b8d4dd7c"} Jul 02 15:25:59.001154 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:59.001113 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbst7\" (UniqueName: \"kubernetes.io/projected/14b9879f-f279-48b7-8198-ea88bcd46396-kube-api-access-tbst7\") pod \"network-check-target-nb2v6\" (UID: \"14b9879f-f279-48b7-8198-ea88bcd46396\") " pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:25:59.001777 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:59.001346 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:25:59.001777 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:59.001369 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:25:59.001777 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:59.001383 2573 projected.go:196] Error preparing data for projected volume kube-api-access-tbst7 for pod openshift-network-diagnostics/network-check-target-nb2v6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:25:59.001777 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:59.001447 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14b9879f-f279-48b7-8198-ea88bcd46396-kube-api-access-tbst7 podName:14b9879f-f279-48b7-8198-ea88bcd46396 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:01.001428978 +0000 UTC m=+6.073742670 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tbst7" (UniqueName: "kubernetes.io/projected/14b9879f-f279-48b7-8198-ea88bcd46396-kube-api-access-tbst7") pod "network-check-target-nb2v6" (UID: "14b9879f-f279-48b7-8198-ea88bcd46396") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:25:59.102407 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:59.101511 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7056290-1f84-464b-9b53-afd3bc43bec1-metrics-certs\") pod \"network-metrics-daemon-fdm7r\" (UID: \"e7056290-1f84-464b-9b53-afd3bc43bec1\") " pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:25:59.102407 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:59.101602 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43c7deaa-395b-4e22-81b8-b52ce0f359b9-original-pull-secret\") pod \"global-pull-secret-syncer-qs9xw\" (UID: \"43c7deaa-395b-4e22-81b8-b52ce0f359b9\") " pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:25:59.102407 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:59.101766 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:25:59.102407 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:59.101828 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c7deaa-395b-4e22-81b8-b52ce0f359b9-original-pull-secret podName:43c7deaa-395b-4e22-81b8-b52ce0f359b9 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:01.101809918 +0000 UTC m=+6.174123614 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43c7deaa-395b-4e22-81b8-b52ce0f359b9-original-pull-secret") pod "global-pull-secret-syncer-qs9xw" (UID: "43c7deaa-395b-4e22-81b8-b52ce0f359b9") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:25:59.102407 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:59.102244 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:25:59.102407 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:59.102304 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7056290-1f84-464b-9b53-afd3bc43bec1-metrics-certs podName:e7056290-1f84-464b-9b53-afd3bc43bec1 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:01.1022887 +0000 UTC m=+6.174602390 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7056290-1f84-464b-9b53-afd3bc43bec1-metrics-certs") pod "network-metrics-daemon-fdm7r" (UID: "e7056290-1f84-464b-9b53-afd3bc43bec1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:25:59.380693 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:59.380553 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 15:20:57 +0000 UTC" deadline="2028-02-07 07:51:23.529263473 +0000 UTC" Jul 02 15:25:59.380693 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:59.380613 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14032h25m24.148654522s" Jul 02 15:25:59.416145 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:59.416114 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:25:59.416297 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:59.416244 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb2v6" podUID="14b9879f-f279-48b7-8198-ea88bcd46396" Jul 02 15:25:59.416653 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:59.416631 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:25:59.416783 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:59.416762 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdm7r" podUID="e7056290-1f84-464b-9b53-afd3bc43bec1" Jul 02 15:25:59.416863 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:59.416833 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:25:59.416916 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:25:59.416899 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs9xw" podUID="43c7deaa-395b-4e22-81b8-b52ce0f359b9" Jul 02 15:25:59.494545 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:59.494480 2573 generic.go:356] "Generic (PLEG): container finished" podID="51c81bcd0cbade972c4abc4428920b02" containerID="957e199b381cec653663164a97b53c15287f7bf8f5be92c1505062d3907e4601" exitCode=0 Jul 02 15:25:59.494545 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:25:59.494537 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-41.ec2.internal" event={"ID":"51c81bcd0cbade972c4abc4428920b02","Type":"ContainerDied","Data":"957e199b381cec653663164a97b53c15287f7bf8f5be92c1505062d3907e4601"} Jul 02 15:26:01.017089 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:01.017022 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbst7\" (UniqueName: \"kubernetes.io/projected/14b9879f-f279-48b7-8198-ea88bcd46396-kube-api-access-tbst7\") pod \"network-check-target-nb2v6\" (UID: \"14b9879f-f279-48b7-8198-ea88bcd46396\") " pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:26:01.017547 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:01.017210 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:26:01.017547 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:01.017240 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:26:01.017547 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:01.017255 2573 projected.go:196] Error preparing data for projected volume kube-api-access-tbst7 for pod openshift-network-diagnostics/network-check-target-nb2v6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:26:01.017547 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:01.017328 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14b9879f-f279-48b7-8198-ea88bcd46396-kube-api-access-tbst7 podName:14b9879f-f279-48b7-8198-ea88bcd46396 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:05.017309077 +0000 UTC m=+10.089622782 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tbst7" (UniqueName: "kubernetes.io/projected/14b9879f-f279-48b7-8198-ea88bcd46396-kube-api-access-tbst7") pod "network-check-target-nb2v6" (UID: "14b9879f-f279-48b7-8198-ea88bcd46396") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:26:01.117440 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:01.117400 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7056290-1f84-464b-9b53-afd3bc43bec1-metrics-certs\") pod \"network-metrics-daemon-fdm7r\" (UID: \"e7056290-1f84-464b-9b53-afd3bc43bec1\") " pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:26:01.117614 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:01.117461 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43c7deaa-395b-4e22-81b8-b52ce0f359b9-original-pull-secret\") pod \"global-pull-secret-syncer-qs9xw\" (UID: \"43c7deaa-395b-4e22-81b8-b52ce0f359b9\") " pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:26:01.117614 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:01.117587 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:26:01.117724 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:01.117647 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c7deaa-395b-4e22-81b8-b52ce0f359b9-original-pull-secret podName:43c7deaa-395b-4e22-81b8-b52ce0f359b9 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:05.11762908 +0000 UTC m=+10.189942773 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43c7deaa-395b-4e22-81b8-b52ce0f359b9-original-pull-secret") pod "global-pull-secret-syncer-qs9xw" (UID: "43c7deaa-395b-4e22-81b8-b52ce0f359b9") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:26:01.118075 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:01.118057 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:26:01.118168 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:01.118111 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7056290-1f84-464b-9b53-afd3bc43bec1-metrics-certs podName:e7056290-1f84-464b-9b53-afd3bc43bec1 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:05.118095026 +0000 UTC m=+10.190408722 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7056290-1f84-464b-9b53-afd3bc43bec1-metrics-certs") pod "network-metrics-daemon-fdm7r" (UID: "e7056290-1f84-464b-9b53-afd3bc43bec1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:26:01.412711 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:01.412104 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:26:01.412711 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:01.412249 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdm7r" podUID="e7056290-1f84-464b-9b53-afd3bc43bec1" Jul 02 15:26:01.412711 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:01.412116 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:26:01.412711 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:01.412399 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs9xw" podUID="43c7deaa-395b-4e22-81b8-b52ce0f359b9" Jul 02 15:26:01.412711 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:01.412447 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:26:01.412711 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:01.412517 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb2v6" podUID="14b9879f-f279-48b7-8198-ea88bcd46396" Jul 02 15:26:03.410854 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:03.410809 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:26:03.411374 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:03.410956 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdm7r" podUID="e7056290-1f84-464b-9b53-afd3bc43bec1" Jul 02 15:26:03.411452 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:03.411441 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:26:03.411558 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:03.411533 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs9xw" podUID="43c7deaa-395b-4e22-81b8-b52ce0f359b9" Jul 02 15:26:03.411647 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:03.411633 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:26:03.411738 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:03.411712 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb2v6" podUID="14b9879f-f279-48b7-8198-ea88bcd46396" Jul 02 15:26:04.510582 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:04.510347 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-41.ec2.internal" event={"ID":"51c81bcd0cbade972c4abc4428920b02","Type":"ContainerStarted","Data":"cd821e736bbad29c9b2b9022e8385092e806d09e41760ffbdd4693ba6fe44328"} Jul 02 15:26:04.526475 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:04.526412 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-41.ec2.internal" podStartSLOduration=7.526394602 podStartE2EDuration="7.526394602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:25:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:04.52592088 +0000 UTC m=+9.598234589" watchObservedRunningTime="2026-07-02 15:26:04.526394602 +0000 UTC m=+9.598708314" Jul 02 15:26:05.049040 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:05.048961 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbst7\" (UniqueName: \"kubernetes.io/projected/14b9879f-f279-48b7-8198-ea88bcd46396-kube-api-access-tbst7\") pod \"network-check-target-nb2v6\" (UID: \"14b9879f-f279-48b7-8198-ea88bcd46396\") " pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:26:05.049300 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:05.049116 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:26:05.049300 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:05.049141 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:26:05.049300 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:05.049155 2573 projected.go:196] Error preparing data for projected volume kube-api-access-tbst7 for pod openshift-network-diagnostics/network-check-target-nb2v6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:26:05.049300 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:05.049219 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14b9879f-f279-48b7-8198-ea88bcd46396-kube-api-access-tbst7 podName:14b9879f-f279-48b7-8198-ea88bcd46396 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:13.049201741 +0000 UTC m=+18.121515451 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tbst7" (UniqueName: "kubernetes.io/projected/14b9879f-f279-48b7-8198-ea88bcd46396-kube-api-access-tbst7") pod "network-check-target-nb2v6" (UID: "14b9879f-f279-48b7-8198-ea88bcd46396") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:26:05.149512 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:05.149454 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43c7deaa-395b-4e22-81b8-b52ce0f359b9-original-pull-secret\") pod \"global-pull-secret-syncer-qs9xw\" (UID: \"43c7deaa-395b-4e22-81b8-b52ce0f359b9\") " pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:26:05.149664 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:05.149554 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7056290-1f84-464b-9b53-afd3bc43bec1-metrics-certs\") pod \"network-metrics-daemon-fdm7r\" (UID: \"e7056290-1f84-464b-9b53-afd3bc43bec1\") " pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:26:05.149718 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:05.149685 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:26:05.149797 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:05.149745 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7056290-1f84-464b-9b53-afd3bc43bec1-metrics-certs podName:e7056290-1f84-464b-9b53-afd3bc43bec1 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:13.149726607 +0000 UTC m=+18.222040301 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7056290-1f84-464b-9b53-afd3bc43bec1-metrics-certs") pod "network-metrics-daemon-fdm7r" (UID: "e7056290-1f84-464b-9b53-afd3bc43bec1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:26:05.149863 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:05.149829 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:26:05.149918 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:05.149881 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c7deaa-395b-4e22-81b8-b52ce0f359b9-original-pull-secret podName:43c7deaa-395b-4e22-81b8-b52ce0f359b9 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:13.149869454 +0000 UTC m=+18.222183162 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43c7deaa-395b-4e22-81b8-b52ce0f359b9-original-pull-secret") pod "global-pull-secret-syncer-qs9xw" (UID: "43c7deaa-395b-4e22-81b8-b52ce0f359b9") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:26:05.412407 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:05.412319 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:26:05.412560 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:05.412432 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb2v6" podUID="14b9879f-f279-48b7-8198-ea88bcd46396" Jul 02 15:26:05.413155 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:05.412876 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:26:05.413155 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:05.413007 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdm7r" podUID="e7056290-1f84-464b-9b53-afd3bc43bec1" Jul 02 15:26:05.413155 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:05.413055 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:26:05.413155 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:05.413125 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs9xw" podUID="43c7deaa-395b-4e22-81b8-b52ce0f359b9" Jul 02 15:26:07.410853 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:07.410816 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:26:07.410853 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:07.410816 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:26:07.411417 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:07.410838 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:26:07.411417 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:07.410955 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb2v6" podUID="14b9879f-f279-48b7-8198-ea88bcd46396" Jul 02 15:26:07.411417 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:07.411070 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs9xw" podUID="43c7deaa-395b-4e22-81b8-b52ce0f359b9" Jul 02 15:26:07.411417 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:07.411196 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdm7r" podUID="e7056290-1f84-464b-9b53-afd3bc43bec1" Jul 02 15:26:09.411259 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:09.411225 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:26:09.411729 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:09.411373 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:26:09.411729 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:09.411382 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdm7r" podUID="e7056290-1f84-464b-9b53-afd3bc43bec1" Jul 02 15:26:09.411729 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:09.411401 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:26:09.411729 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:09.411485 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb2v6" podUID="14b9879f-f279-48b7-8198-ea88bcd46396" Jul 02 15:26:09.411729 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:09.411539 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs9xw" podUID="43c7deaa-395b-4e22-81b8-b52ce0f359b9" Jul 02 15:26:11.411443 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:11.411400 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:26:11.411443 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:11.411438 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:26:11.411443 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:11.411455 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:26:11.412057 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:11.411553 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdm7r" podUID="e7056290-1f84-464b-9b53-afd3bc43bec1" Jul 02 15:26:11.412057 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:11.411631 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs9xw" podUID="43c7deaa-395b-4e22-81b8-b52ce0f359b9" Jul 02 15:26:11.412057 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:11.411715 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb2v6" podUID="14b9879f-f279-48b7-8198-ea88bcd46396" Jul 02 15:26:13.113003 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:13.112967 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbst7\" (UniqueName: \"kubernetes.io/projected/14b9879f-f279-48b7-8198-ea88bcd46396-kube-api-access-tbst7\") pod \"network-check-target-nb2v6\" (UID: \"14b9879f-f279-48b7-8198-ea88bcd46396\") " pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:26:13.113481 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:13.113182 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:26:13.113481 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:13.113207 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:26:13.113481 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:13.113222 2573 projected.go:196] Error preparing data for projected volume kube-api-access-tbst7 for pod openshift-network-diagnostics/network-check-target-nb2v6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:26:13.113481 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:13.113285 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14b9879f-f279-48b7-8198-ea88bcd46396-kube-api-access-tbst7 podName:14b9879f-f279-48b7-8198-ea88bcd46396 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:29.113263986 +0000 UTC m=+34.185577735 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tbst7" (UniqueName: "kubernetes.io/projected/14b9879f-f279-48b7-8198-ea88bcd46396-kube-api-access-tbst7") pod "network-check-target-nb2v6" (UID: "14b9879f-f279-48b7-8198-ea88bcd46396") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:26:13.214301 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:13.214266 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43c7deaa-395b-4e22-81b8-b52ce0f359b9-original-pull-secret\") pod \"global-pull-secret-syncer-qs9xw\" (UID: \"43c7deaa-395b-4e22-81b8-b52ce0f359b9\") " pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:26:13.214441 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:13.214414 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:26:13.214441 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:13.214425 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7056290-1f84-464b-9b53-afd3bc43bec1-metrics-certs\") pod \"network-metrics-daemon-fdm7r\" (UID: \"e7056290-1f84-464b-9b53-afd3bc43bec1\") " pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:26:13.214515 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:13.214475 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c7deaa-395b-4e22-81b8-b52ce0f359b9-original-pull-secret podName:43c7deaa-395b-4e22-81b8-b52ce0f359b9 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:29.214456515 +0000 UTC m=+34.286770205 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43c7deaa-395b-4e22-81b8-b52ce0f359b9-original-pull-secret") pod "global-pull-secret-syncer-qs9xw" (UID: "43c7deaa-395b-4e22-81b8-b52ce0f359b9") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:26:13.214559 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:13.214517 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:26:13.214559 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:13.214553 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7056290-1f84-464b-9b53-afd3bc43bec1-metrics-certs podName:e7056290-1f84-464b-9b53-afd3bc43bec1 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:29.214542064 +0000 UTC m=+34.286855753 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7056290-1f84-464b-9b53-afd3bc43bec1-metrics-certs") pod "network-metrics-daemon-fdm7r" (UID: "e7056290-1f84-464b-9b53-afd3bc43bec1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:26:13.410919 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:13.410827 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:26:13.411105 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:13.410823 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:26:13.411105 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:13.410962 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs9xw" podUID="43c7deaa-395b-4e22-81b8-b52ce0f359b9" Jul 02 15:26:13.411105 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:13.410835 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:26:13.411105 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:13.411022 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb2v6" podUID="14b9879f-f279-48b7-8198-ea88bcd46396" Jul 02 15:26:13.411306 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:13.411137 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdm7r" podUID="e7056290-1f84-464b-9b53-afd3bc43bec1" Jul 02 15:26:15.412302 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:15.412262 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:26:15.412741 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:15.412363 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:26:15.412741 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:15.412374 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb2v6" podUID="14b9879f-f279-48b7-8198-ea88bcd46396" Jul 02 15:26:15.412741 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:15.412508 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:26:15.412741 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:15.412522 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdm7r" podUID="e7056290-1f84-464b-9b53-afd3bc43bec1" Jul 02 15:26:15.412741 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:15.412559 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs9xw" podUID="43c7deaa-395b-4e22-81b8-b52ce0f359b9" Jul 02 15:26:17.410769 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:17.410728 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:26:17.411247 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:17.410728 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:26:17.411247 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:17.410857 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs9xw" podUID="43c7deaa-395b-4e22-81b8-b52ce0f359b9" Jul 02 15:26:17.411247 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:17.410943 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb2v6" podUID="14b9879f-f279-48b7-8198-ea88bcd46396" Jul 02 15:26:17.411247 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:17.410728 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:26:17.411247 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:17.411068 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdm7r" podUID="e7056290-1f84-464b-9b53-afd3bc43bec1" Jul 02 15:26:18.538401 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:18.538182 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dvrtk" event={"ID":"61c2c69b-7481-4ef5-a874-aa280ce47dee","Type":"ContainerStarted","Data":"472fbde87d1512dc1002ad77c657a349e3c1f10e1c323f679b6296504a2b38ef"} Jul 02 15:26:18.541386 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:18.541357 2573 generic.go:356] "Generic (PLEG): container finished" podID="016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967" containerID="eb1752adba028e6401d4148e1856bebf601cb3084b7824aee8fd22a5f541aa4e" exitCode=0 Jul 02 15:26:18.541498 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:18.541460 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqdxl" event={"ID":"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967","Type":"ContainerDied","Data":"eb1752adba028e6401d4148e1856bebf601cb3084b7824aee8fd22a5f541aa4e"} Jul 02 15:26:18.542961 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:18.542933 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qrttf" event={"ID":"1ba1a511-b4bb-4e2d-b876-9d3d9a54dae7","Type":"ContainerStarted","Data":"4fc0f9a9052bd90c370dab4e1098d919f227e0c574496626b509c133e28e7956"} Jul 02 15:26:18.544491 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:18.544458 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cpn2h" event={"ID":"f8fad264-8fc9-4e9e-b870-a5fc8fac6f67","Type":"ContainerStarted","Data":"53da384702a021be4aa104496f3b56c49010e48c54e1468ed1bcaf047d6c07e0"} Jul 02 15:26:18.546793 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:18.546762 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" event={"ID":"1d12ba42-4046-41ad-880c-9e75e1c29a5a","Type":"ContainerStarted","Data":"73f1f599ef5972cd6564828deed1b359544791277a7b91701686ae92d5513994"} Jul 02 15:26:18.546886 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:18.546849 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" event={"ID":"1d12ba42-4046-41ad-880c-9e75e1c29a5a","Type":"ContainerStarted","Data":"3a4642e1926c09b00a52d254062f684a8cc5d20afd91bf3d94deb95971862dd6"} Jul 02 15:26:18.548248 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:18.548223 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-41.ec2.internal" event={"ID":"a69f5b6d35760bc20e58af7c0e937070","Type":"ContainerStarted","Data":"ac3803346bf00b968286b4aef995401e0b17cc3ded502df9eb514000c12089a8"} Jul 02 15:26:18.549476 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:18.549455 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" event={"ID":"9317314e-af53-4088-83c7-1398b91836f6","Type":"ContainerStarted","Data":"f7ee6fb4c61d31d2fc400c5cca190c79d4aaeec5fe938d4f2589a00df086272c"} Jul 02 15:26:18.550752 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:18.550721 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mhpx9" event={"ID":"81d05a2e-6cf1-40bb-a41d-f7f1cacd9c67","Type":"ContainerStarted","Data":"b267d5b229c4a1c7608d669c429d808741c236502f6740eeb067e800da2d3a8a"} Jul 02 15:26:18.552265 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:18.552245 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" event={"ID":"45fd292f-66ba-4637-8166-4e82342b5d14","Type":"ContainerStarted","Data":"546bb58af6b739380f6114b59b81bd2dca1e0a2d4d717e2e63838244a854981a"} Jul 02 15:26:18.575906 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:18.575861 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dvrtk" podStartSLOduration=2.5707365380000002 podStartE2EDuration="22.575846294s" totalImagesPullingTime="20.005109756s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:18.575678161 +0000 UTC m=+23.647991875" watchObservedRunningTime="2026-07-02 15:26:18.575846294 +0000 UTC m=+23.648160007" Jul 02 15:26:18.591250 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:18.591203 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6tk7t" podStartSLOduration=3.15797034 podStartE2EDuration="23.591190493s" totalImagesPullingTime="20.433220153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:18.590915406 +0000 UTC m=+23.663229119" watchObservedRunningTime="2026-07-02 15:26:18.591190493 +0000 UTC m=+23.663504205" Jul 02 15:26:18.610052 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:18.609971 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mhpx9" podStartSLOduration=2.02377984 podStartE2EDuration="22.609950107s" totalImagesPullingTime="20.586170267s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:18.608629509 +0000 UTC m=+23.680943223" watchObservedRunningTime="2026-07-02 15:26:18.609950107 +0000 UTC m=+23.682263823" Jul 02 15:26:18.653008 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:18.652940 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qrttf" podStartSLOduration=2.279294986 podStartE2EDuration="22.652918726s" totalImagesPullingTime="20.37362374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:18.652400104 +0000 UTC m=+23.724713841" watchObservedRunningTime="2026-07-02 15:26:18.652918726 +0000 UTC m=+23.725232440" Jul 02 15:26:18.653480 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:18.653443 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cpn2h" podStartSLOduration=2.261754563 podStartE2EDuration="22.653429783s" totalImagesPullingTime="20.39167522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:18.630358045 +0000 UTC m=+23.702671758" watchObservedRunningTime="2026-07-02 15:26:18.653429783 +0000 UTC m=+23.725743497" Jul 02 15:26:18.667772 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:18.667735 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-41.ec2.internal" podStartSLOduration=21.667720368 podStartE2EDuration="21.667720368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:25:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:18.667241279 +0000 UTC m=+23.739554996" watchObservedRunningTime="2026-07-02 15:26:18.667720368 +0000 UTC m=+23.740034080" Jul 02 15:26:19.411056 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:19.410954 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:26:19.411056 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:19.410975 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:26:19.411305 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:19.411104 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs9xw" podUID="43c7deaa-395b-4e22-81b8-b52ce0f359b9" Jul 02 15:26:19.411305 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:19.411166 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:26:19.411305 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:19.411269 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdm7r" podUID="e7056290-1f84-464b-9b53-afd3bc43bec1" Jul 02 15:26:19.411482 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:19.411347 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb2v6" podUID="14b9879f-f279-48b7-8198-ea88bcd46396" Jul 02 15:26:19.558563 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:19.558528 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" event={"ID":"1d12ba42-4046-41ad-880c-9e75e1c29a5a","Type":"ContainerStarted","Data":"a78b50d51f0ba191b723d43bb7ef046d0b713329e0a0163f9093c8950d62e5fc"} Jul 02 15:26:19.558989 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:19.558622 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" event={"ID":"1d12ba42-4046-41ad-880c-9e75e1c29a5a","Type":"ContainerStarted","Data":"83db9e18177c7a57dfbee1193b356bad1f043b089427e702175bb602734a7178"} Jul 02 15:26:19.558989 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:19.558675 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" event={"ID":"1d12ba42-4046-41ad-880c-9e75e1c29a5a","Type":"ContainerStarted","Data":"b80355d2e90f7bb6d02a3e5a14d904c41f1f4119dcc34d15c54654e5490ff5f0"} Jul 02 15:26:19.558989 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:19.558721 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" event={"ID":"1d12ba42-4046-41ad-880c-9e75e1c29a5a","Type":"ContainerStarted","Data":"68e43a3a79e655d0e7c5ea6d20ec2aff88f6a31d128f5fc4992a046d564519a8"} Jul 02 15:26:19.560097 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:19.560027 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-knvp4" event={"ID":"c9eb5914-4b29-474b-87b9-f703e64c1702","Type":"ContainerStarted","Data":"884c6b5fc754cd0dc58632bd8205c21c5807dc15d8ed078719075ed4b1cc048e"} Jul 02 15:26:19.575418 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:19.575368 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-knvp4" podStartSLOduration=4.152650115 podStartE2EDuration="24.575348782s" totalImagesPullingTime="20.422698667s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:19.574675631 +0000 UTC m=+24.646989340" watchObservedRunningTime="2026-07-02 15:26:19.575348782 +0000 UTC m=+24.647662496" Jul 02 15:26:19.836695 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:19.836648 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 15:26:20.508505 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:20.508387 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T15:26:19.83667288Z","UUID":"e6e651bc-8644-4e86-af84-5fabf7244eb4","Handler":null,"Name":"","Endpoint":""} Jul 02 15:26:20.510752 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:20.510729 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 15:26:20.510906 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:20.510773 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 15:26:20.564825 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:20.564789 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" event={"ID":"9317314e-af53-4088-83c7-1398b91836f6","Type":"ContainerStarted","Data":"c6c3b5d9ab5faa283d8b5824c44d1b745f3138e95d6db341e2128b1e463dccd1"} Jul 02 15:26:21.410671 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:21.410437 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:26:21.410671 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:21.410465 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:26:21.410671 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:21.410473 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:26:21.410671 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:21.410570 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb2v6" podUID="14b9879f-f279-48b7-8198-ea88bcd46396" Jul 02 15:26:21.410897 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:21.410788 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdm7r" podUID="e7056290-1f84-464b-9b53-afd3bc43bec1" Jul 02 15:26:21.410897 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:21.410872 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs9xw" podUID="43c7deaa-395b-4e22-81b8-b52ce0f359b9" Jul 02 15:26:21.571380 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:21.571286 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" event={"ID":"1d12ba42-4046-41ad-880c-9e75e1c29a5a","Type":"ContainerStarted","Data":"80fc9cb4476b812d763a97740c96b8a6e5ee2ab3889af9e1328b7b43d6c8944f"} Jul 02 15:26:21.573543 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:21.573512 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" event={"ID":"9317314e-af53-4088-83c7-1398b91836f6","Type":"ContainerStarted","Data":"172d6f3e3deef5c34ad1117e8469087789d8e1c1b0321af3f1f62be81acadd82"} Jul 02 15:26:21.591457 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:21.591406 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kmwkq" podStartSLOduration=2.495088803 podStartE2EDuration="25.591392626s" totalImagesPullingTime="23.096303823s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:25:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:21.591257881 +0000 UTC m=+26.663571593" watchObservedRunningTime="2026-07-02 15:26:21.591392626 +0000 UTC m=+26.663706371" Jul 02 15:26:22.764124 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:22.763882 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cpn2h" Jul 02 15:26:23.322686 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:23.322654 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cpn2h" Jul 02 15:26:23.323247 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:23.323232 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cpn2h" Jul 02 15:26:23.411409 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:23.411323 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:26:23.411540 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:23.411423 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs9xw" podUID="43c7deaa-395b-4e22-81b8-b52ce0f359b9" Jul 02 15:26:23.411540 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:23.411324 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:26:23.411540 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:23.411472 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:26:23.411647 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:23.411558 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdm7r" podUID="e7056290-1f84-464b-9b53-afd3bc43bec1" Jul 02 15:26:23.411686 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:23.411644 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb2v6" podUID="14b9879f-f279-48b7-8198-ea88bcd46396" Jul 02 15:26:23.579491 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:23.579459 2573 generic.go:356] "Generic (PLEG): container finished" podID="016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967" containerID="72197dd3aaf01646ff6b0f24184884f79dd415ef46ab97000051b8f3744d19f8" exitCode=0 Jul 02 15:26:23.579659 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:23.579518 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqdxl" event={"ID":"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967","Type":"ContainerDied","Data":"72197dd3aaf01646ff6b0f24184884f79dd415ef46ab97000051b8f3744d19f8"} Jul 02 15:26:23.583416 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:23.583390 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" event={"ID":"1d12ba42-4046-41ad-880c-9e75e1c29a5a","Type":"ContainerStarted","Data":"771ad71784a278d569fa9bdaafbdb50c251651010fe220510c9ab49e44f59bcf"} Jul 02 15:26:23.583738 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:23.583705 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:26:23.584030 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:23.583770 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:26:23.584030 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:23.583815 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:26:23.584321 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:23.584301 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cpn2h" Jul 02 15:26:23.599099 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:23.599074 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:26:23.599228 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:23.599190 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:26:23.650053 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:23.650007 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" podStartSLOduration=8.082939636 podStartE2EDuration="28.649976923s" totalImagesPullingTime="20.567037287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:23.649812617 +0000 UTC m=+28.722126320" watchObservedRunningTime="2026-07-02 15:26:23.649976923 +0000 UTC m=+28.722290634" Jul 02 15:26:25.172253 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:25.172219 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nb2v6"] Jul 02 15:26:25.173035 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:25.172359 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:26:25.173035 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:25.172460 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb2v6" podUID="14b9879f-f279-48b7-8198-ea88bcd46396" Jul 02 15:26:25.175989 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:25.175959 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qs9xw"] Jul 02 15:26:25.176170 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:25.176094 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:26:25.176239 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:25.176179 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs9xw" podUID="43c7deaa-395b-4e22-81b8-b52ce0f359b9" Jul 02 15:26:25.176651 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:25.176625 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fdm7r"] Jul 02 15:26:25.176781 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:25.176721 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:26:25.176836 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:25.176814 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdm7r" podUID="e7056290-1f84-464b-9b53-afd3bc43bec1" Jul 02 15:26:26.411232 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:26.411202 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:26:26.411617 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:26.411303 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb2v6" podUID="14b9879f-f279-48b7-8198-ea88bcd46396" Jul 02 15:26:26.592214 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:26.592178 2573 generic.go:356] "Generic (PLEG): container finished" podID="016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967" containerID="05ed347ca52bf604829c82b73c40382ee610b60b74b6a9e9db2d1d639975bb2d" exitCode=0 Jul 02 15:26:26.592371 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:26.592248 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqdxl" event={"ID":"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967","Type":"ContainerDied","Data":"05ed347ca52bf604829c82b73c40382ee610b60b74b6a9e9db2d1d639975bb2d"} Jul 02 15:26:27.411446 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:27.411411 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:26:27.411446 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:27.411446 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:26:27.411922 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:27.411537 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs9xw" podUID="43c7deaa-395b-4e22-81b8-b52ce0f359b9" Jul 02 15:26:27.411922 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:27.411780 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdm7r" podUID="e7056290-1f84-464b-9b53-afd3bc43bec1" Jul 02 15:26:28.411132 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:28.410949 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:26:28.411298 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:28.411210 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb2v6" podUID="14b9879f-f279-48b7-8198-ea88bcd46396" Jul 02 15:26:28.599175 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:28.599143 2573 generic.go:356] "Generic (PLEG): container finished" podID="016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967" containerID="5f6288d4d07d555aa716fd1b6a3ac9310c916afc8baf178b742ab33e4a0fbd0f" exitCode=0 Jul 02 15:26:28.599649 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:28.599226 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqdxl" event={"ID":"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967","Type":"ContainerDied","Data":"5f6288d4d07d555aa716fd1b6a3ac9310c916afc8baf178b742ab33e4a0fbd0f"} Jul 02 15:26:29.138662 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:29.138628 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbst7\" (UniqueName: \"kubernetes.io/projected/14b9879f-f279-48b7-8198-ea88bcd46396-kube-api-access-tbst7\") pod \"network-check-target-nb2v6\" (UID: \"14b9879f-f279-48b7-8198-ea88bcd46396\") " pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:26:29.138841 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:29.138757 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 15:26:29.138841 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:29.138774 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 15:26:29.138841 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:29.138783 2573 projected.go:196] Error preparing data for projected volume kube-api-access-tbst7 for pod openshift-network-diagnostics/network-check-target-nb2v6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:26:29.138841 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:29.138836 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/14b9879f-f279-48b7-8198-ea88bcd46396-kube-api-access-tbst7 podName:14b9879f-f279-48b7-8198-ea88bcd46396 nodeName:}" failed. No retries permitted until 2026-07-02 15:27:01.138820438 +0000 UTC m=+66.211134148 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tbst7" (UniqueName: "kubernetes.io/projected/14b9879f-f279-48b7-8198-ea88bcd46396-kube-api-access-tbst7") pod "network-check-target-nb2v6" (UID: "14b9879f-f279-48b7-8198-ea88bcd46396") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 15:26:29.239619 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:29.239584 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7056290-1f84-464b-9b53-afd3bc43bec1-metrics-certs\") pod \"network-metrics-daemon-fdm7r\" (UID: \"e7056290-1f84-464b-9b53-afd3bc43bec1\") " pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:26:29.239619 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:29.239625 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43c7deaa-395b-4e22-81b8-b52ce0f359b9-original-pull-secret\") pod \"global-pull-secret-syncer-qs9xw\" (UID: \"43c7deaa-395b-4e22-81b8-b52ce0f359b9\") " pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:26:29.239809 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:29.239729 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 15:26:29.239809 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:29.239734 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:26:29.239809 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:29.239781 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43c7deaa-395b-4e22-81b8-b52ce0f359b9-original-pull-secret podName:43c7deaa-395b-4e22-81b8-b52ce0f359b9 nodeName:}" failed. No retries permitted until 2026-07-02 15:27:01.239767689 +0000 UTC m=+66.312081378 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43c7deaa-395b-4e22-81b8-b52ce0f359b9-original-pull-secret") pod "global-pull-secret-syncer-qs9xw" (UID: "43c7deaa-395b-4e22-81b8-b52ce0f359b9") : object "kube-system"/"original-pull-secret" not registered Jul 02 15:26:29.239809 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:29.239794 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7056290-1f84-464b-9b53-afd3bc43bec1-metrics-certs podName:e7056290-1f84-464b-9b53-afd3bc43bec1 nodeName:}" failed. No retries permitted until 2026-07-02 15:27:01.239787928 +0000 UTC m=+66.312101617 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7056290-1f84-464b-9b53-afd3bc43bec1-metrics-certs") pod "network-metrics-daemon-fdm7r" (UID: "e7056290-1f84-464b-9b53-afd3bc43bec1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 15:26:29.411369 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:29.410804 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:26:29.411369 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:29.410853 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:26:29.411369 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:29.410955 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdm7r" podUID="e7056290-1f84-464b-9b53-afd3bc43bec1" Jul 02 15:26:29.411369 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:29.411089 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs9xw" podUID="43c7deaa-395b-4e22-81b8-b52ce0f359b9" Jul 02 15:26:30.411213 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:30.411177 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:26:30.411752 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:30.411298 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nb2v6" podUID="14b9879f-f279-48b7-8198-ea88bcd46396" Jul 02 15:26:31.283498 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.283467 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-41.ec2.internal" event="NodeReady" Jul 02 15:26:31.283677 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.283613 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 15:26:31.322642 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.322610 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66f696bff6-4w865"] Jul 02 15:26:31.326150 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.326130 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:31.328806 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.328783 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 15:26:31.329205 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.329184 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 15:26:31.329205 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.329198 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vqr2l\"" Jul 02 15:26:31.329377 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.329210 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 15:26:31.334152 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.333890 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cvjvk"] Jul 02 15:26:31.334823 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.334800 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 15:26:31.337196 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.337180 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cvjvk" Jul 02 15:26:31.339536 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.339516 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 15:26:31.339903 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.339611 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kt6gc\"" Jul 02 15:26:31.339973 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.339917 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 15:26:31.340297 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.340272 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66f696bff6-4w865"] Jul 02 15:26:31.346312 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.346226 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2snr8"] Jul 02 15:26:31.349402 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.349384 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2snr8" Jul 02 15:26:31.350983 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.350964 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cvjvk"] Jul 02 15:26:31.352043 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.351856 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 15:26:31.352043 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.351981 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 15:26:31.352043 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.351983 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 15:26:31.352360 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.352342 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-248dl\"" Jul 02 15:26:31.360114 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.360091 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2snr8"] Jul 02 15:26:31.410480 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.410453 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:26:31.410622 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.410463 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:26:31.414272 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.413246 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 15:26:31.414272 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.413497 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 15:26:31.421251 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.421205 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ffxgv\"" Jul 02 15:26:31.454625 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.454586 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-ca-trust-extracted\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:31.454625 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.454628 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-metrics-tls\") pod \"dns-default-cvjvk\" (UID: \"fabe6b91-ef60-4c9c-83b9-9d522cd51fcd\") " pod="openshift-dns/dns-default-cvjvk" Jul 02 15:26:31.454863 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.454731 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-tls\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:31.454863 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.454771 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-trusted-ca\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:31.454863 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.454805 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-bound-sa-token\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:31.454863 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.454834 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-installation-pull-secrets\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:31.454863 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.454858 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/429e5081-104e-4014-a5d9-825d1da547ce-cert\") pod \"ingress-canary-2snr8\" (UID: \"429e5081-104e-4014-a5d9-825d1da547ce\") " pod="openshift-ingress-canary/ingress-canary-2snr8" Jul 02 15:26:31.455139 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.454885 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s9st\" (UniqueName: \"kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-kube-api-access-4s9st\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:31.455139 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.454921 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-tmp-dir\") pod \"dns-default-cvjvk\" (UID: \"fabe6b91-ef60-4c9c-83b9-9d522cd51fcd\") " pod="openshift-dns/dns-default-cvjvk" Jul 02 15:26:31.455139 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.454963 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6plns\" (UniqueName: \"kubernetes.io/projected/429e5081-104e-4014-a5d9-825d1da547ce-kube-api-access-6plns\") pod \"ingress-canary-2snr8\" (UID: \"429e5081-104e-4014-a5d9-825d1da547ce\") " pod="openshift-ingress-canary/ingress-canary-2snr8" Jul 02 15:26:31.455139 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.455023 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-image-registry-private-configuration\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:31.455139 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.455055 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-config-volume\") pod \"dns-default-cvjvk\" (UID: \"fabe6b91-ef60-4c9c-83b9-9d522cd51fcd\") " pod="openshift-dns/dns-default-cvjvk" Jul 02 15:26:31.455139 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.455084 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnttb\" (UniqueName: \"kubernetes.io/projected/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-kube-api-access-qnttb\") pod \"dns-default-cvjvk\" (UID: \"fabe6b91-ef60-4c9c-83b9-9d522cd51fcd\") " pod="openshift-dns/dns-default-cvjvk" Jul 02 15:26:31.455426 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.455158 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-certificates\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:31.556089 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.555986 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-installation-pull-secrets\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:31.556089 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.556039 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/429e5081-104e-4014-a5d9-825d1da547ce-cert\") pod \"ingress-canary-2snr8\" (UID: \"429e5081-104e-4014-a5d9-825d1da547ce\") " pod="openshift-ingress-canary/ingress-canary-2snr8" Jul 02 15:26:31.556089 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.556067 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s9st\" (UniqueName: \"kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-kube-api-access-4s9st\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:31.556089 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.556089 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-tmp-dir\") pod \"dns-default-cvjvk\" (UID: \"fabe6b91-ef60-4c9c-83b9-9d522cd51fcd\") " pod="openshift-dns/dns-default-cvjvk" Jul 02 15:26:31.556417 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.556117 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6plns\" (UniqueName: \"kubernetes.io/projected/429e5081-104e-4014-a5d9-825d1da547ce-kube-api-access-6plns\") pod \"ingress-canary-2snr8\" (UID: \"429e5081-104e-4014-a5d9-825d1da547ce\") " pod="openshift-ingress-canary/ingress-canary-2snr8" Jul 02 15:26:31.556417 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.556172 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-image-registry-private-configuration\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:31.556417 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.556200 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-config-volume\") pod \"dns-default-cvjvk\" (UID: \"fabe6b91-ef60-4c9c-83b9-9d522cd51fcd\") " pod="openshift-dns/dns-default-cvjvk" Jul 02 15:26:31.556417 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.556224 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnttb\" (UniqueName: \"kubernetes.io/projected/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-kube-api-access-qnttb\") pod \"dns-default-cvjvk\" (UID: \"fabe6b91-ef60-4c9c-83b9-9d522cd51fcd\") " pod="openshift-dns/dns-default-cvjvk" Jul 02 15:26:31.556417 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.556263 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-certificates\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:31.556417 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.556309 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-ca-trust-extracted\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:31.556417 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.556334 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-metrics-tls\") pod \"dns-default-cvjvk\" (UID: \"fabe6b91-ef60-4c9c-83b9-9d522cd51fcd\") " pod="openshift-dns/dns-default-cvjvk" Jul 02 15:26:31.556417 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.556381 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-tls\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:31.556417 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.556401 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-trusted-ca\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:31.556800 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.556425 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-bound-sa-token\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:31.556800 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.556452 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-tmp-dir\") pod \"dns-default-cvjvk\" (UID: \"fabe6b91-ef60-4c9c-83b9-9d522cd51fcd\") " pod="openshift-dns/dns-default-cvjvk" Jul 02 15:26:31.556800 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:31.556550 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 15:26:31.556800 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:31.556663 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-metrics-tls podName:fabe6b91-ef60-4c9c-83b9-9d522cd51fcd nodeName:}" failed. No retries permitted until 2026-07-02 15:26:32.056641163 +0000 UTC m=+37.128954856 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-metrics-tls") pod "dns-default-cvjvk" (UID: "fabe6b91-ef60-4c9c-83b9-9d522cd51fcd") : secret "dns-default-metrics-tls" not found Jul 02 15:26:31.556800 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:31.556743 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 15:26:31.556800 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:31.556758 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66f696bff6-4w865: secret "image-registry-tls" not found Jul 02 15:26:31.557143 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:31.556812 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-tls podName:e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:32.056797255 +0000 UTC m=+37.129110945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-tls") pod "image-registry-66f696bff6-4w865" (UID: "e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1") : secret "image-registry-tls" not found Jul 02 15:26:31.557143 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.556923 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-config-volume\") pod \"dns-default-cvjvk\" (UID: \"fabe6b91-ef60-4c9c-83b9-9d522cd51fcd\") " pod="openshift-dns/dns-default-cvjvk" Jul 02 15:26:31.557143 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.557141 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-ca-trust-extracted\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:31.557784 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.557763 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-certificates\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:31.558184 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.558157 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-trusted-ca\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:31.561147 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.561126 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-image-registry-private-configuration\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:31.561266 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.561151 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-installation-pull-secrets\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:31.561266 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.561236 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/429e5081-104e-4014-a5d9-825d1da547ce-cert\") pod \"ingress-canary-2snr8\" (UID: \"429e5081-104e-4014-a5d9-825d1da547ce\") " pod="openshift-ingress-canary/ingress-canary-2snr8" Jul 02 15:26:31.565747 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.565723 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-bound-sa-token\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:31.565931 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.565910 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s9st\" (UniqueName: \"kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-kube-api-access-4s9st\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:31.566896 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.566875 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6plns\" (UniqueName: \"kubernetes.io/projected/429e5081-104e-4014-a5d9-825d1da547ce-kube-api-access-6plns\") pod \"ingress-canary-2snr8\" (UID: \"429e5081-104e-4014-a5d9-825d1da547ce\") " pod="openshift-ingress-canary/ingress-canary-2snr8" Jul 02 15:26:31.567024 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.566925 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnttb\" (UniqueName: \"kubernetes.io/projected/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-kube-api-access-qnttb\") pod \"dns-default-cvjvk\" (UID: \"fabe6b91-ef60-4c9c-83b9-9d522cd51fcd\") " pod="openshift-dns/dns-default-cvjvk" Jul 02 15:26:31.660020 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:31.659970 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2snr8" Jul 02 15:26:32.060190 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:32.060155 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-tls\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:32.060393 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:32.060335 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 15:26:32.060393 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:32.060343 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-metrics-tls\") pod \"dns-default-cvjvk\" (UID: \"fabe6b91-ef60-4c9c-83b9-9d522cd51fcd\") " pod="openshift-dns/dns-default-cvjvk" Jul 02 15:26:32.060393 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:32.060356 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66f696bff6-4w865: secret "image-registry-tls" not found Jul 02 15:26:32.060551 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:32.060469 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-tls podName:e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:33.060447701 +0000 UTC m=+38.132761390 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-tls") pod "image-registry-66f696bff6-4w865" (UID: "e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1") : secret "image-registry-tls" not found Jul 02 15:26:32.060551 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:32.060482 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 15:26:32.060551 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:32.060526 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-metrics-tls podName:fabe6b91-ef60-4c9c-83b9-9d522cd51fcd nodeName:}" failed. No retries permitted until 2026-07-02 15:26:33.060510799 +0000 UTC m=+38.132824493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-metrics-tls") pod "dns-default-cvjvk" (UID: "fabe6b91-ef60-4c9c-83b9-9d522cd51fcd") : secret "dns-default-metrics-tls" not found Jul 02 15:26:32.304494 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:32.304450 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:32.406464 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:32.406380 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:32.411159 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:32.411138 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:26:32.413713 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:32.413689 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 15:26:32.413848 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:32.413747 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 15:26:32.414637 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:32.414606 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pj7tx\"" Jul 02 15:26:32.507742 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:32.507709 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:32.607984 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:32.607944 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:32.806419 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:32.806386 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:32.910781 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:32.910603 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:32.917499 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:32.917464 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2snr8"] Jul 02 15:26:32.921198 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:26:32.921167 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod429e5081_104e_4014_a5d9_825d1da547ce.slice/crio-c0d51c7020c4c0ab0e17ee4d7e244c3dab20aaeb5c47f9bbfe69f1e7c062f29f WatchSource:0}: Error finding container c0d51c7020c4c0ab0e17ee4d7e244c3dab20aaeb5c47f9bbfe69f1e7c062f29f: Status 404 returned error can't find the container with id c0d51c7020c4c0ab0e17ee4d7e244c3dab20aaeb5c47f9bbfe69f1e7c062f29f Jul 02 15:26:33.068847 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:33.068816 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-metrics-tls\") pod \"dns-default-cvjvk\" (UID: \"fabe6b91-ef60-4c9c-83b9-9d522cd51fcd\") " pod="openshift-dns/dns-default-cvjvk" Jul 02 15:26:33.068969 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:33.068870 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-tls\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:33.069028 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:33.068974 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 15:26:33.069060 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:33.069052 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-metrics-tls podName:fabe6b91-ef60-4c9c-83b9-9d522cd51fcd nodeName:}" failed. No retries permitted until 2026-07-02 15:26:35.069036754 +0000 UTC m=+40.141350443 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-metrics-tls") pod "dns-default-cvjvk" (UID: "fabe6b91-ef60-4c9c-83b9-9d522cd51fcd") : secret "dns-default-metrics-tls" not found Jul 02 15:26:33.069103 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:33.068983 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 15:26:33.069103 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:33.069087 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66f696bff6-4w865: secret "image-registry-tls" not found Jul 02 15:26:33.069165 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:33.069132 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-tls podName:e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:35.069121321 +0000 UTC m=+40.141435011 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-tls") pod "image-registry-66f696bff6-4w865" (UID: "e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1") : secret "image-registry-tls" not found Jul 02 15:26:33.613740 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:33.613709 2573 generic.go:356] "Generic (PLEG): container finished" podID="016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967" containerID="2e55fd531af03cade64aa323bb51676b05a6a061cf1de1e081d3322c0b18f79f" exitCode=0 Jul 02 15:26:33.614250 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:33.613783 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqdxl" event={"ID":"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967","Type":"ContainerDied","Data":"2e55fd531af03cade64aa323bb51676b05a6a061cf1de1e081d3322c0b18f79f"} Jul 02 15:26:33.614848 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:33.614825 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2snr8" event={"ID":"429e5081-104e-4014-a5d9-825d1da547ce","Type":"ContainerStarted","Data":"c0d51c7020c4c0ab0e17ee4d7e244c3dab20aaeb5c47f9bbfe69f1e7c062f29f"} Jul 02 15:26:34.619644 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:34.619616 2573 generic.go:356] "Generic (PLEG): container finished" podID="016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967" containerID="d20b56684d937a83170de62de7f1ed63aac54502102a8b6c79e2c5a4638c225c" exitCode=0 Jul 02 15:26:34.620056 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:34.619667 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqdxl" event={"ID":"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967","Type":"ContainerDied","Data":"d20b56684d937a83170de62de7f1ed63aac54502102a8b6c79e2c5a4638c225c"} Jul 02 15:26:35.085307 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:35.085108 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-tls\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:35.085307 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:35.085301 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 15:26:35.085545 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:35.085326 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66f696bff6-4w865: secret "image-registry-tls" not found Jul 02 15:26:35.085545 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:35.085403 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-tls podName:e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:39.085376956 +0000 UTC m=+44.157690665 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-tls") pod "image-registry-66f696bff6-4w865" (UID: "e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1") : secret "image-registry-tls" not found Jul 02 15:26:35.085545 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:35.085431 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-metrics-tls\") pod \"dns-default-cvjvk\" (UID: \"fabe6b91-ef60-4c9c-83b9-9d522cd51fcd\") " pod="openshift-dns/dns-default-cvjvk" Jul 02 15:26:35.085545 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:35.085539 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 15:26:35.085735 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:35.085580 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-metrics-tls podName:fabe6b91-ef60-4c9c-83b9-9d522cd51fcd nodeName:}" failed. No retries permitted until 2026-07-02 15:26:39.085565191 +0000 UTC m=+44.157878887 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-metrics-tls") pod "dns-default-cvjvk" (UID: "fabe6b91-ef60-4c9c-83b9-9d522cd51fcd") : secret "dns-default-metrics-tls" not found Jul 02 15:26:35.337531 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:35.337454 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:35.437400 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:35.437370 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:35.625033 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:35.624941 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqdxl" event={"ID":"016a5a3b-c15d-4a9e-a8d4-5cb01d4bd967","Type":"ContainerStarted","Data":"86098071d566cd866ec2f5289b7b5a86cd138b003a0dca82af7c47f4b1bb9a40"} Jul 02 15:26:35.648464 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:35.648424 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wqdxl" podStartSLOduration=7.671734649 podStartE2EDuration="39.648409455s" totalImagesPullingTime="31.976674806s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:25:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:35.647352025 +0000 UTC m=+40.719665738" watchObservedRunningTime="2026-07-02 15:26:35.648409455 +0000 UTC m=+40.720723167" Jul 02 15:26:35.769426 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:35.769387 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:35.868910 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:35.868872 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:36.071826 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.071796 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-k2jm9"] Jul 02 15:26:36.091660 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.091635 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-k2jm9"] Jul 02 15:26:36.091798 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.091733 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-k2jm9" Jul 02 15:26:36.094239 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.094213 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 02 15:26:36.094406 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.094275 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 02 15:26:36.094406 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.094217 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-w598b\"" Jul 02 15:26:36.173369 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.173339 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-5hn5p"] Jul 02 15:26:36.193440 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.193255 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-pjjbc"] Jul 02 15:26:36.193694 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.193505 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-5hn5p" Jul 02 15:26:36.194027 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.193631 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g597r\" (UniqueName: \"kubernetes.io/projected/a97a5d82-e5f7-4a9d-ba2b-00efec3db99a-kube-api-access-g597r\") pod \"volume-data-source-validator-69d9f679db-k2jm9\" (UID: \"a97a5d82-e5f7-4a9d-ba2b-00efec3db99a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-k2jm9" Jul 02 15:26:36.200034 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.199984 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-4jxld\"" Jul 02 15:26:36.200160 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.200029 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 02 15:26:36.200160 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.200098 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 02 15:26:36.200160 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.200088 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 02 15:26:36.200719 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.200699 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 02 15:26:36.211239 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.211219 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-z9zgk"] Jul 02 15:26:36.211337 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.211323 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-pjjbc" Jul 02 15:26:36.213987 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.213963 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 15:26:36.215083 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.215055 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 02 15:26:36.215167 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.215062 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 15:26:36.215251 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.215231 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 02 15:26:36.215356 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.215342 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-k7b2s\"" Jul 02 15:26:36.229384 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.229365 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-qcglg"] Jul 02 15:26:36.229481 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.229464 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-z9zgk" Jul 02 15:26:36.232099 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.232053 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 02 15:26:36.232200 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.232100 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 02 15:26:36.232200 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.232102 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 02 15:26:36.232200 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.232144 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-cwnqt\"" Jul 02 15:26:36.255498 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.255479 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-qcglg" Jul 02 15:26:36.255498 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.255492 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-g5scp"] Jul 02 15:26:36.257750 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.257733 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-9q9lk\"" Jul 02 15:26:36.257814 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.257741 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 15:26:36.258065 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.258021 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 02 15:26:36.258246 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.258228 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 02 15:26:36.258323 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.258310 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 15:26:36.269505 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.269485 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-5hn5p"] Jul 02 15:26:36.269574 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.269512 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-z9zgk"] Jul 02 15:26:36.269574 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.269531 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-qcglg"] Jul 02 15:26:36.269645 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.269597 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-g5scp" Jul 02 15:26:36.269645 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.269617 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-pjjbc"] Jul 02 15:26:36.269645 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.269632 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-g5scp"] Jul 02 15:26:36.269730 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.269674 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-x8l44"] Jul 02 15:26:36.271838 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.271822 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 02 15:26:36.272051 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.272038 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 02 15:26:36.272124 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.272074 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 02 15:26:36.272188 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.272157 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 02 15:26:36.272294 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.272277 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-gbqrr\"" Jul 02 15:26:36.272722 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.272709 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 02 15:26:36.277825 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.277802 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 02 15:26:36.293680 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.293652 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-x8l44"] Jul 02 15:26:36.293807 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.293689 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7d7c49774c-69ntk"] Jul 02 15:26:36.293807 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.293769 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-x8l44" Jul 02 15:26:36.294797 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.294774 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpfgg\" (UniqueName: \"kubernetes.io/projected/8fded7d4-f80c-4108-b1bd-438c5607386d-kube-api-access-bpfgg\") pod \"kube-storage-version-migrator-operator-79964ff6f9-5hn5p\" (UID: \"8fded7d4-f80c-4108-b1bd-438c5607386d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-5hn5p" Jul 02 15:26:36.294916 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.294829 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kljb8\" (UniqueName: \"kubernetes.io/projected/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-kube-api-access-kljb8\") pod \"cluster-monitoring-operator-54cb84584-pjjbc\" (UID: \"76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-pjjbc" Jul 02 15:26:36.294916 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.294859 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-pjjbc\" (UID: \"76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-pjjbc" Jul 02 15:26:36.294916 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.294881 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g597r\" (UniqueName: \"kubernetes.io/projected/a97a5d82-e5f7-4a9d-ba2b-00efec3db99a-kube-api-access-g597r\") pod \"volume-data-source-validator-69d9f679db-k2jm9\" (UID: \"a97a5d82-e5f7-4a9d-ba2b-00efec3db99a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-k2jm9" Jul 02 15:26:36.294916 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.294902 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8fded7d4-f80c-4108-b1bd-438c5607386d-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-5hn5p\" (UID: \"8fded7d4-f80c-4108-b1bd-438c5607386d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-5hn5p" Jul 02 15:26:36.295135 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.295042 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-pjjbc\" (UID: \"76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-pjjbc" Jul 02 15:26:36.295135 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.295073 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ffbh\" (UniqueName: \"kubernetes.io/projected/efcf0d95-9599-4a86-9094-a4bf89434e71-kube-api-access-5ffbh\") pod \"cluster-samples-operator-9ddc5ff76-z9zgk\" (UID: \"efcf0d95-9599-4a86-9094-a4bf89434e71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-z9zgk" Jul 02 15:26:36.295224 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.295164 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8fded7d4-f80c-4108-b1bd-438c5607386d-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-5hn5p\" (UID: \"8fded7d4-f80c-4108-b1bd-438c5607386d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-5hn5p" Jul 02 15:26:36.295224 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.295187 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/efcf0d95-9599-4a86-9094-a4bf89434e71-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-z9zgk\" (UID: \"efcf0d95-9599-4a86-9094-a4bf89434e71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-z9zgk" Jul 02 15:26:36.296976 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.296958 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-52fcf\"" Jul 02 15:26:36.313500 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.313475 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g597r\" (UniqueName: \"kubernetes.io/projected/a97a5d82-e5f7-4a9d-ba2b-00efec3db99a-kube-api-access-g597r\") pod \"volume-data-source-validator-69d9f679db-k2jm9\" (UID: \"a97a5d82-e5f7-4a9d-ba2b-00efec3db99a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-k2jm9" Jul 02 15:26:36.313784 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.313770 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-8lcv4"] Jul 02 15:26:36.313906 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.313889 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:26:36.316701 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.316471 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 02 15:26:36.316701 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.316489 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2gqwl\"" Jul 02 15:26:36.316701 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.316524 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 15:26:36.316701 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.316523 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 02 15:26:36.316701 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.316591 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 02 15:26:36.316701 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.316665 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 02 15:26:36.316701 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.316671 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 15:26:36.333902 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.333882 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-8lcv4"] Jul 02 15:26:36.334021 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.333910 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7d7c49774c-69ntk"] Jul 02 15:26:36.334021 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.334008 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-8lcv4" Jul 02 15:26:36.336276 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.336255 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 02 15:26:36.336418 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.336293 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 02 15:26:36.336418 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.336294 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 02 15:26:36.336418 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.336294 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 02 15:26:36.336418 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.336407 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-jbbt9\"" Jul 02 15:26:36.395949 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.395917 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7475\" (UniqueName: \"kubernetes.io/projected/cd214bd3-835e-4a77-ad2c-f4a61e793bba-kube-api-access-p7475\") pod \"insights-operator-5f67b55555-qcglg\" (UID: \"cd214bd3-835e-4a77-ad2c-f4a61e793bba\") " pod="openshift-insights/insights-operator-5f67b55555-qcglg" Jul 02 15:26:36.395949 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.395954 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-pjjbc\" (UID: \"76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-pjjbc" Jul 02 15:26:36.396198 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.395975 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-stats-auth\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:26:36.396198 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.396019 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8fded7d4-f80c-4108-b1bd-438c5607386d-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-5hn5p\" (UID: \"8fded7d4-f80c-4108-b1bd-438c5607386d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-5hn5p" Jul 02 15:26:36.396198 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.396042 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ffbh\" (UniqueName: \"kubernetes.io/projected/efcf0d95-9599-4a86-9094-a4bf89434e71-kube-api-access-5ffbh\") pod \"cluster-samples-operator-9ddc5ff76-z9zgk\" (UID: \"efcf0d95-9599-4a86-9094-a4bf89434e71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-z9zgk" Jul 02 15:26:36.396198 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.396062 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-pjjbc\" (UID: \"76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-pjjbc" Jul 02 15:26:36.396198 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.396089 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8fded7d4-f80c-4108-b1bd-438c5607386d-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-5hn5p\" (UID: \"8fded7d4-f80c-4108-b1bd-438c5607386d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-5hn5p" Jul 02 15:26:36.396198 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:36.396096 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 15:26:36.396198 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:36.396191 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-cluster-monitoring-operator-tls podName:76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:36.896168823 +0000 UTC m=+41.968482515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-pjjbc" (UID: "76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8") : secret "cluster-monitoring-operator-tls" not found Jul 02 15:26:36.396542 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.396218 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpfgg\" (UniqueName: \"kubernetes.io/projected/8fded7d4-f80c-4108-b1bd-438c5607386d-kube-api-access-bpfgg\") pod \"kube-storage-version-migrator-operator-79964ff6f9-5hn5p\" (UID: \"8fded7d4-f80c-4108-b1bd-438c5607386d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-5hn5p" Jul 02 15:26:36.396542 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.396261 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hdkp\" (UniqueName: \"kubernetes.io/projected/16f301e2-dc19-4056-b4e0-777db733c4bf-kube-api-access-2hdkp\") pod \"network-check-source-56499946bc-x8l44\" (UID: \"16f301e2-dc19-4056-b4e0-777db733c4bf\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-x8l44" Jul 02 15:26:36.396542 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.396285 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2a799b2e-a2de-4260-8fe4-0cb5242c0952-serving-cert\") pod \"console-operator-7fdbdf9c99-g5scp\" (UID: \"2a799b2e-a2de-4260-8fe4-0cb5242c0952\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-g5scp" Jul 02 15:26:36.396542 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.396312 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd214bd3-835e-4a77-ad2c-f4a61e793bba-tmp\") pod \"insights-operator-5f67b55555-qcglg\" (UID: \"cd214bd3-835e-4a77-ad2c-f4a61e793bba\") " pod="openshift-insights/insights-operator-5f67b55555-qcglg" Jul 02 15:26:36.396542 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.396337 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtxg9\" (UniqueName: \"kubernetes.io/projected/2ba6b11a-b88f-405b-a92c-99768fca5c8f-kube-api-access-rtxg9\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:26:36.396542 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.396365 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml46b\" (UniqueName: \"kubernetes.io/projected/2a799b2e-a2de-4260-8fe4-0cb5242c0952-kube-api-access-ml46b\") pod \"console-operator-7fdbdf9c99-g5scp\" (UID: \"2a799b2e-a2de-4260-8fe4-0cb5242c0952\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-g5scp" Jul 02 15:26:36.396542 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.396408 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2a799b2e-a2de-4260-8fe4-0cb5242c0952-trusted-ca\") pod \"console-operator-7fdbdf9c99-g5scp\" (UID: \"2a799b2e-a2de-4260-8fe4-0cb5242c0952\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-g5scp" Jul 02 15:26:36.396542 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.396459 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kljb8\" (UniqueName: \"kubernetes.io/projected/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-kube-api-access-kljb8\") pod \"cluster-monitoring-operator-54cb84584-pjjbc\" (UID: \"76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-pjjbc" Jul 02 15:26:36.396542 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.396492 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2a799b2e-a2de-4260-8fe4-0cb5242c0952-config\") pod \"console-operator-7fdbdf9c99-g5scp\" (UID: \"2a799b2e-a2de-4260-8fe4-0cb5242c0952\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-g5scp" Jul 02 15:26:36.396891 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.396555 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cd214bd3-835e-4a77-ad2c-f4a61e793bba-snapshots\") pod \"insights-operator-5f67b55555-qcglg\" (UID: \"cd214bd3-835e-4a77-ad2c-f4a61e793bba\") " pod="openshift-insights/insights-operator-5f67b55555-qcglg" Jul 02 15:26:36.396891 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.396604 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd214bd3-835e-4a77-ad2c-f4a61e793bba-service-ca-bundle\") pod \"insights-operator-5f67b55555-qcglg\" (UID: \"cd214bd3-835e-4a77-ad2c-f4a61e793bba\") " pod="openshift-insights/insights-operator-5f67b55555-qcglg" Jul 02 15:26:36.396891 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.396629 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-default-certificate\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:26:36.396891 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.396656 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ba6b11a-b88f-405b-a92c-99768fca5c8f-service-ca-bundle\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:26:36.396891 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.396706 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8fded7d4-f80c-4108-b1bd-438c5607386d-config\") pod \"kube-storage-version-migrator-operator-79964ff6f9-5hn5p\" (UID: \"8fded7d4-f80c-4108-b1bd-438c5607386d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-5hn5p" Jul 02 15:26:36.396891 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.396733 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd214bd3-835e-4a77-ad2c-f4a61e793bba-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-qcglg\" (UID: \"cd214bd3-835e-4a77-ad2c-f4a61e793bba\") " pod="openshift-insights/insights-operator-5f67b55555-qcglg" Jul 02 15:26:36.396891 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.396766 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd214bd3-835e-4a77-ad2c-f4a61e793bba-serving-cert\") pod \"insights-operator-5f67b55555-qcglg\" (UID: \"cd214bd3-835e-4a77-ad2c-f4a61e793bba\") " pod="openshift-insights/insights-operator-5f67b55555-qcglg" Jul 02 15:26:36.396891 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.396806 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/efcf0d95-9599-4a86-9094-a4bf89434e71-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-z9zgk\" (UID: \"efcf0d95-9599-4a86-9094-a4bf89434e71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-z9zgk" Jul 02 15:26:36.396891 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.396845 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-metrics-certs\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:26:36.397204 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.396902 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-pjjbc\" (UID: \"76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-pjjbc" Jul 02 15:26:36.397204 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:36.396910 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 15:26:36.397204 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:36.396980 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efcf0d95-9599-4a86-9094-a4bf89434e71-samples-operator-tls podName:efcf0d95-9599-4a86-9094-a4bf89434e71 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:36.896963041 +0000 UTC m=+41.969276735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/efcf0d95-9599-4a86-9094-a4bf89434e71-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-z9zgk" (UID: "efcf0d95-9599-4a86-9094-a4bf89434e71") : secret "samples-operator-tls" not found Jul 02 15:26:36.398474 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.398454 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8fded7d4-f80c-4108-b1bd-438c5607386d-serving-cert\") pod \"kube-storage-version-migrator-operator-79964ff6f9-5hn5p\" (UID: \"8fded7d4-f80c-4108-b1bd-438c5607386d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-5hn5p" Jul 02 15:26:36.400459 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.400442 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-k2jm9" Jul 02 15:26:36.404708 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.404686 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpfgg\" (UniqueName: \"kubernetes.io/projected/8fded7d4-f80c-4108-b1bd-438c5607386d-kube-api-access-bpfgg\") pod \"kube-storage-version-migrator-operator-79964ff6f9-5hn5p\" (UID: \"8fded7d4-f80c-4108-b1bd-438c5607386d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-5hn5p" Jul 02 15:26:36.405377 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.405356 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ffbh\" (UniqueName: \"kubernetes.io/projected/efcf0d95-9599-4a86-9094-a4bf89434e71-kube-api-access-5ffbh\") pod \"cluster-samples-operator-9ddc5ff76-z9zgk\" (UID: \"efcf0d95-9599-4a86-9094-a4bf89434e71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-z9zgk" Jul 02 15:26:36.405465 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.405451 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kljb8\" (UniqueName: \"kubernetes.io/projected/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-kube-api-access-kljb8\") pod \"cluster-monitoring-operator-54cb84584-pjjbc\" (UID: \"76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-pjjbc" Jul 02 15:26:36.497472 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.497444 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f09efd02-cadc-487d-a7d3-c6f46620278b-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-8lcv4\" (UID: \"f09efd02-cadc-487d-a7d3-c6f46620278b\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-8lcv4" Jul 02 15:26:36.497595 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.497507 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hdkp\" (UniqueName: \"kubernetes.io/projected/16f301e2-dc19-4056-b4e0-777db733c4bf-kube-api-access-2hdkp\") pod \"network-check-source-56499946bc-x8l44\" (UID: \"16f301e2-dc19-4056-b4e0-777db733c4bf\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-x8l44" Jul 02 15:26:36.497595 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.497531 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2a799b2e-a2de-4260-8fe4-0cb5242c0952-serving-cert\") pod \"console-operator-7fdbdf9c99-g5scp\" (UID: \"2a799b2e-a2de-4260-8fe4-0cb5242c0952\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-g5scp" Jul 02 15:26:36.497595 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.497556 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f09efd02-cadc-487d-a7d3-c6f46620278b-config\") pod \"service-ca-operator-5d7b7dc95c-8lcv4\" (UID: \"f09efd02-cadc-487d-a7d3-c6f46620278b\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-8lcv4" Jul 02 15:26:36.497595 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.497582 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd214bd3-835e-4a77-ad2c-f4a61e793bba-tmp\") pod \"insights-operator-5f67b55555-qcglg\" (UID: \"cd214bd3-835e-4a77-ad2c-f4a61e793bba\") " pod="openshift-insights/insights-operator-5f67b55555-qcglg" Jul 02 15:26:36.497784 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.497607 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtxg9\" (UniqueName: \"kubernetes.io/projected/2ba6b11a-b88f-405b-a92c-99768fca5c8f-kube-api-access-rtxg9\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:26:36.497784 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.497640 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml46b\" (UniqueName: \"kubernetes.io/projected/2a799b2e-a2de-4260-8fe4-0cb5242c0952-kube-api-access-ml46b\") pod \"console-operator-7fdbdf9c99-g5scp\" (UID: \"2a799b2e-a2de-4260-8fe4-0cb5242c0952\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-g5scp" Jul 02 15:26:36.497784 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.497667 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2a799b2e-a2de-4260-8fe4-0cb5242c0952-trusted-ca\") pod \"console-operator-7fdbdf9c99-g5scp\" (UID: \"2a799b2e-a2de-4260-8fe4-0cb5242c0952\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-g5scp" Jul 02 15:26:36.497784 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.497691 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2a799b2e-a2de-4260-8fe4-0cb5242c0952-config\") pod \"console-operator-7fdbdf9c99-g5scp\" (UID: \"2a799b2e-a2de-4260-8fe4-0cb5242c0952\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-g5scp" Jul 02 15:26:36.497784 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.497723 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vmsr\" (UniqueName: \"kubernetes.io/projected/f09efd02-cadc-487d-a7d3-c6f46620278b-kube-api-access-4vmsr\") pod \"service-ca-operator-5d7b7dc95c-8lcv4\" (UID: \"f09efd02-cadc-487d-a7d3-c6f46620278b\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-8lcv4" Jul 02 15:26:36.497784 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.497773 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cd214bd3-835e-4a77-ad2c-f4a61e793bba-snapshots\") pod \"insights-operator-5f67b55555-qcglg\" (UID: \"cd214bd3-835e-4a77-ad2c-f4a61e793bba\") " pod="openshift-insights/insights-operator-5f67b55555-qcglg" Jul 02 15:26:36.498094 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.497804 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd214bd3-835e-4a77-ad2c-f4a61e793bba-service-ca-bundle\") pod \"insights-operator-5f67b55555-qcglg\" (UID: \"cd214bd3-835e-4a77-ad2c-f4a61e793bba\") " pod="openshift-insights/insights-operator-5f67b55555-qcglg" Jul 02 15:26:36.498094 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.497838 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-default-certificate\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:26:36.498094 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.497863 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ba6b11a-b88f-405b-a92c-99768fca5c8f-service-ca-bundle\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:26:36.498094 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.497912 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd214bd3-835e-4a77-ad2c-f4a61e793bba-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-qcglg\" (UID: \"cd214bd3-835e-4a77-ad2c-f4a61e793bba\") " pod="openshift-insights/insights-operator-5f67b55555-qcglg" Jul 02 15:26:36.498094 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.497936 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd214bd3-835e-4a77-ad2c-f4a61e793bba-serving-cert\") pod \"insights-operator-5f67b55555-qcglg\" (UID: \"cd214bd3-835e-4a77-ad2c-f4a61e793bba\") " pod="openshift-insights/insights-operator-5f67b55555-qcglg" Jul 02 15:26:36.498094 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.498079 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd214bd3-835e-4a77-ad2c-f4a61e793bba-tmp\") pod \"insights-operator-5f67b55555-qcglg\" (UID: \"cd214bd3-835e-4a77-ad2c-f4a61e793bba\") " pod="openshift-insights/insights-operator-5f67b55555-qcglg" Jul 02 15:26:36.498365 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:36.498119 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ba6b11a-b88f-405b-a92c-99768fca5c8f-service-ca-bundle podName:2ba6b11a-b88f-405b-a92c-99768fca5c8f nodeName:}" failed. No retries permitted until 2026-07-02 15:26:36.998099908 +0000 UTC m=+42.070413603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ba6b11a-b88f-405b-a92c-99768fca5c8f-service-ca-bundle") pod "router-default-7d7c49774c-69ntk" (UID: "2ba6b11a-b88f-405b-a92c-99768fca5c8f") : configmap references non-existent config key: service-ca.crt Jul 02 15:26:36.498912 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.498450 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-metrics-certs\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:26:36.498912 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.498497 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7475\" (UniqueName: \"kubernetes.io/projected/cd214bd3-835e-4a77-ad2c-f4a61e793bba-kube-api-access-p7475\") pod \"insights-operator-5f67b55555-qcglg\" (UID: \"cd214bd3-835e-4a77-ad2c-f4a61e793bba\") " pod="openshift-insights/insights-operator-5f67b55555-qcglg" Jul 02 15:26:36.498912 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.498553 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-stats-auth\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:26:36.498912 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.498581 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2a799b2e-a2de-4260-8fe4-0cb5242c0952-config\") pod \"console-operator-7fdbdf9c99-g5scp\" (UID: \"2a799b2e-a2de-4260-8fe4-0cb5242c0952\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-g5scp" Jul 02 15:26:36.499197 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.498912 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2a799b2e-a2de-4260-8fe4-0cb5242c0952-trusted-ca\") pod \"console-operator-7fdbdf9c99-g5scp\" (UID: \"2a799b2e-a2de-4260-8fe4-0cb5242c0952\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-g5scp" Jul 02 15:26:36.499197 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:36.499037 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 15:26:36.499197 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:36.499097 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-metrics-certs podName:2ba6b11a-b88f-405b-a92c-99768fca5c8f nodeName:}" failed. No retries permitted until 2026-07-02 15:26:36.99907999 +0000 UTC m=+42.071393692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-metrics-certs") pod "router-default-7d7c49774c-69ntk" (UID: "2ba6b11a-b88f-405b-a92c-99768fca5c8f") : secret "router-metrics-certs-default" not found Jul 02 15:26:36.499197 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.499121 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd214bd3-835e-4a77-ad2c-f4a61e793bba-service-ca-bundle\") pod \"insights-operator-5f67b55555-qcglg\" (UID: \"cd214bd3-835e-4a77-ad2c-f4a61e793bba\") " pod="openshift-insights/insights-operator-5f67b55555-qcglg" Jul 02 15:26:36.499197 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.499165 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/cd214bd3-835e-4a77-ad2c-f4a61e793bba-snapshots\") pod \"insights-operator-5f67b55555-qcglg\" (UID: \"cd214bd3-835e-4a77-ad2c-f4a61e793bba\") " pod="openshift-insights/insights-operator-5f67b55555-qcglg" Jul 02 15:26:36.499197 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.499193 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd214bd3-835e-4a77-ad2c-f4a61e793bba-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-qcglg\" (UID: \"cd214bd3-835e-4a77-ad2c-f4a61e793bba\") " pod="openshift-insights/insights-operator-5f67b55555-qcglg" Jul 02 15:26:36.501979 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.501746 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-default-certificate\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:26:36.501979 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.501901 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2a799b2e-a2de-4260-8fe4-0cb5242c0952-serving-cert\") pod \"console-operator-7fdbdf9c99-g5scp\" (UID: \"2a799b2e-a2de-4260-8fe4-0cb5242c0952\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-g5scp" Jul 02 15:26:36.501979 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.501925 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-stats-auth\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:26:36.502222 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.502086 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd214bd3-835e-4a77-ad2c-f4a61e793bba-serving-cert\") pod \"insights-operator-5f67b55555-qcglg\" (UID: \"cd214bd3-835e-4a77-ad2c-f4a61e793bba\") " pod="openshift-insights/insights-operator-5f67b55555-qcglg" Jul 02 15:26:36.506505 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.506484 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtxg9\" (UniqueName: \"kubernetes.io/projected/2ba6b11a-b88f-405b-a92c-99768fca5c8f-kube-api-access-rtxg9\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:26:36.506862 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.506840 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hdkp\" (UniqueName: \"kubernetes.io/projected/16f301e2-dc19-4056-b4e0-777db733c4bf-kube-api-access-2hdkp\") pod \"network-check-source-56499946bc-x8l44\" (UID: \"16f301e2-dc19-4056-b4e0-777db733c4bf\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-x8l44" Jul 02 15:26:36.506933 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.506916 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml46b\" (UniqueName: \"kubernetes.io/projected/2a799b2e-a2de-4260-8fe4-0cb5242c0952-kube-api-access-ml46b\") pod \"console-operator-7fdbdf9c99-g5scp\" (UID: \"2a799b2e-a2de-4260-8fe4-0cb5242c0952\") " pod="openshift-console-operator/console-operator-7fdbdf9c99-g5scp" Jul 02 15:26:36.507065 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.506935 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-5hn5p" Jul 02 15:26:36.507161 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.507144 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7475\" (UniqueName: \"kubernetes.io/projected/cd214bd3-835e-4a77-ad2c-f4a61e793bba-kube-api-access-p7475\") pod \"insights-operator-5f67b55555-qcglg\" (UID: \"cd214bd3-835e-4a77-ad2c-f4a61e793bba\") " pod="openshift-insights/insights-operator-5f67b55555-qcglg" Jul 02 15:26:36.543034 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.543006 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-k2jm9"] Jul 02 15:26:36.547027 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:26:36.546988 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda97a5d82_e5f7_4a9d_ba2b_00efec3db99a.slice/crio-1315bd64d897cecb1f5692c907ca38c53e01ad40b222bfc43c5441d987334396 WatchSource:0}: Error finding container 1315bd64d897cecb1f5692c907ca38c53e01ad40b222bfc43c5441d987334396: Status 404 returned error can't find the container with id 1315bd64d897cecb1f5692c907ca38c53e01ad40b222bfc43c5441d987334396 Jul 02 15:26:36.564620 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.564589 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-qcglg" Jul 02 15:26:36.578838 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.578759 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7fdbdf9c99-g5scp" Jul 02 15:26:36.603217 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.600056 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f09efd02-cadc-487d-a7d3-c6f46620278b-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-8lcv4\" (UID: \"f09efd02-cadc-487d-a7d3-c6f46620278b\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-8lcv4" Jul 02 15:26:36.603217 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.600120 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f09efd02-cadc-487d-a7d3-c6f46620278b-config\") pod \"service-ca-operator-5d7b7dc95c-8lcv4\" (UID: \"f09efd02-cadc-487d-a7d3-c6f46620278b\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-8lcv4" Jul 02 15:26:36.603217 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.600171 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vmsr\" (UniqueName: \"kubernetes.io/projected/f09efd02-cadc-487d-a7d3-c6f46620278b-kube-api-access-4vmsr\") pod \"service-ca-operator-5d7b7dc95c-8lcv4\" (UID: \"f09efd02-cadc-487d-a7d3-c6f46620278b\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-8lcv4" Jul 02 15:26:36.603217 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.601155 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f09efd02-cadc-487d-a7d3-c6f46620278b-config\") pod \"service-ca-operator-5d7b7dc95c-8lcv4\" (UID: \"f09efd02-cadc-487d-a7d3-c6f46620278b\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-8lcv4" Jul 02 15:26:36.603217 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.602426 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-x8l44" Jul 02 15:26:36.611302 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.611237 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f09efd02-cadc-487d-a7d3-c6f46620278b-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-8lcv4\" (UID: \"f09efd02-cadc-487d-a7d3-c6f46620278b\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-8lcv4" Jul 02 15:26:36.615463 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.615349 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vmsr\" (UniqueName: \"kubernetes.io/projected/f09efd02-cadc-487d-a7d3-c6f46620278b-kube-api-access-4vmsr\") pod \"service-ca-operator-5d7b7dc95c-8lcv4\" (UID: \"f09efd02-cadc-487d-a7d3-c6f46620278b\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-8lcv4" Jul 02 15:26:36.629883 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.629842 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2snr8" event={"ID":"429e5081-104e-4014-a5d9-825d1da547ce","Type":"ContainerStarted","Data":"5ad3c784ff95d2f420ea201a60176f89fbfa27fb122bb1889920a293965e9c06"} Jul 02 15:26:36.631332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.631302 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-k2jm9" event={"ID":"a97a5d82-e5f7-4a9d-ba2b-00efec3db99a","Type":"ContainerStarted","Data":"1315bd64d897cecb1f5692c907ca38c53e01ad40b222bfc43c5441d987334396"} Jul 02 15:26:36.642722 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.642672 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-8lcv4" Jul 02 15:26:36.652172 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.652085 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2snr8" podStartSLOduration=2.947021501 podStartE2EDuration="5.652065887s" totalImagesPullingTime="2.705044386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:36.650661555 +0000 UTC m=+41.722975268" watchObservedRunningTime="2026-07-02 15:26:36.652065887 +0000 UTC m=+41.724379598" Jul 02 15:26:36.711667 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.711426 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-5hn5p"] Jul 02 15:26:36.726611 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.726492 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:36.806304 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.806267 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-qcglg"] Jul 02 15:26:36.811624 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:26:36.811593 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd214bd3_835e_4a77_ad2c_f4a61e793bba.slice/crio-89d9a962d66cd06a45e8977931a0d5478a51f617888d7f1784c779b78a565df1 WatchSource:0}: Error finding container 89d9a962d66cd06a45e8977931a0d5478a51f617888d7f1784c779b78a565df1: Status 404 returned error can't find the container with id 89d9a962d66cd06a45e8977931a0d5478a51f617888d7f1784c779b78a565df1 Jul 02 15:26:36.820906 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.820805 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:36.821167 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.821140 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7fdbdf9c99-g5scp"] Jul 02 15:26:36.827739 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:26:36.827712 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a799b2e_a2de_4260_8fe4_0cb5242c0952.slice/crio-d0f44bbe23eff4550597dab3e03355e03145f41789337dd4901e4addb503b97a WatchSource:0}: Error finding container d0f44bbe23eff4550597dab3e03355e03145f41789337dd4901e4addb503b97a: Status 404 returned error can't find the container with id d0f44bbe23eff4550597dab3e03355e03145f41789337dd4901e4addb503b97a Jul 02 15:26:36.845826 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.845781 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-x8l44"] Jul 02 15:26:36.848764 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:26:36.848741 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16f301e2_dc19_4056_b4e0_777db733c4bf.slice/crio-9192f308e5d8b64cb2fef0e562a21d574f8684cb4eac4582f673b97f4498d7c1 WatchSource:0}: Error finding container 9192f308e5d8b64cb2fef0e562a21d574f8684cb4eac4582f673b97f4498d7c1: Status 404 returned error can't find the container with id 9192f308e5d8b64cb2fef0e562a21d574f8684cb4eac4582f673b97f4498d7c1 Jul 02 15:26:36.858970 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.858950 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-8lcv4"] Jul 02 15:26:36.861063 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:26:36.861040 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf09efd02_cadc_487d_a7d3_c6f46620278b.slice/crio-4a17c4df3bf50a5f30a3ebead45373878ce67220a8e58c3ecda0b22cc22985b9 WatchSource:0}: Error finding container 4a17c4df3bf50a5f30a3ebead45373878ce67220a8e58c3ecda0b22cc22985b9: Status 404 returned error can't find the container with id 4a17c4df3bf50a5f30a3ebead45373878ce67220a8e58c3ecda0b22cc22985b9 Jul 02 15:26:36.903755 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.903714 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-pjjbc\" (UID: \"76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-pjjbc" Jul 02 15:26:36.903892 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:36.903860 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 15:26:36.903947 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:36.903939 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-cluster-monitoring-operator-tls podName:76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:37.903923673 +0000 UTC m=+42.976237364 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-pjjbc" (UID: "76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8") : secret "cluster-monitoring-operator-tls" not found Jul 02 15:26:36.904033 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:36.904017 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/efcf0d95-9599-4a86-9094-a4bf89434e71-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-z9zgk\" (UID: \"efcf0d95-9599-4a86-9094-a4bf89434e71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-z9zgk" Jul 02 15:26:36.904136 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:36.904123 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 15:26:36.904188 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:36.904170 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efcf0d95-9599-4a86-9094-a4bf89434e71-samples-operator-tls podName:efcf0d95-9599-4a86-9094-a4bf89434e71 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:37.904159085 +0000 UTC m=+42.976472775 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/efcf0d95-9599-4a86-9094-a4bf89434e71-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-z9zgk" (UID: "efcf0d95-9599-4a86-9094-a4bf89434e71") : secret "samples-operator-tls" not found Jul 02 15:26:37.004676 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:37.004640 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ba6b11a-b88f-405b-a92c-99768fca5c8f-service-ca-bundle\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:26:37.004852 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:37.004715 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-metrics-certs\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:26:37.004852 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:37.004823 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 15:26:37.004852 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:37.004838 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ba6b11a-b88f-405b-a92c-99768fca5c8f-service-ca-bundle podName:2ba6b11a-b88f-405b-a92c-99768fca5c8f nodeName:}" failed. No retries permitted until 2026-07-02 15:26:38.004816595 +0000 UTC m=+43.077130304 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ba6b11a-b88f-405b-a92c-99768fca5c8f-service-ca-bundle") pod "router-default-7d7c49774c-69ntk" (UID: "2ba6b11a-b88f-405b-a92c-99768fca5c8f") : configmap references non-existent config key: service-ca.crt Jul 02 15:26:37.005054 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:37.004867 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-metrics-certs podName:2ba6b11a-b88f-405b-a92c-99768fca5c8f nodeName:}" failed. No retries permitted until 2026-07-02 15:26:38.004855944 +0000 UTC m=+43.077169633 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-metrics-certs") pod "router-default-7d7c49774c-69ntk" (UID: "2ba6b11a-b88f-405b-a92c-99768fca5c8f") : secret "router-metrics-certs-default" not found Jul 02 15:26:37.635970 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:37.635928 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-8lcv4" event={"ID":"f09efd02-cadc-487d-a7d3-c6f46620278b","Type":"ContainerStarted","Data":"4a17c4df3bf50a5f30a3ebead45373878ce67220a8e58c3ecda0b22cc22985b9"} Jul 02 15:26:37.638145 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:37.638074 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-x8l44" event={"ID":"16f301e2-dc19-4056-b4e0-777db733c4bf","Type":"ContainerStarted","Data":"9192f308e5d8b64cb2fef0e562a21d574f8684cb4eac4582f673b97f4498d7c1"} Jul 02 15:26:37.639771 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:37.639741 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-qcglg" event={"ID":"cd214bd3-835e-4a77-ad2c-f4a61e793bba","Type":"ContainerStarted","Data":"89d9a962d66cd06a45e8977931a0d5478a51f617888d7f1784c779b78a565df1"} Jul 02 15:26:37.641216 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:37.641163 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-g5scp" event={"ID":"2a799b2e-a2de-4260-8fe4-0cb5242c0952","Type":"ContainerStarted","Data":"d0f44bbe23eff4550597dab3e03355e03145f41789337dd4901e4addb503b97a"} Jul 02 15:26:37.642675 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:37.642651 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-5hn5p" event={"ID":"8fded7d4-f80c-4108-b1bd-438c5607386d","Type":"ContainerStarted","Data":"da7ece4b97a1648861bb3c7c02d0a8ace49aa85c3ad1faf53b67341825c3af41"} Jul 02 15:26:37.913769 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:37.913669 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/efcf0d95-9599-4a86-9094-a4bf89434e71-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-z9zgk\" (UID: \"efcf0d95-9599-4a86-9094-a4bf89434e71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-z9zgk" Jul 02 15:26:37.913769 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:37.913750 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-pjjbc\" (UID: \"76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-pjjbc" Jul 02 15:26:37.914014 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:37.913943 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 15:26:37.914082 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:37.914026 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-cluster-monitoring-operator-tls podName:76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:39.913988603 +0000 UTC m=+44.986302317 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-pjjbc" (UID: "76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8") : secret "cluster-monitoring-operator-tls" not found Jul 02 15:26:37.914446 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:37.914422 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 15:26:37.914561 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:37.914500 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efcf0d95-9599-4a86-9094-a4bf89434e71-samples-operator-tls podName:efcf0d95-9599-4a86-9094-a4bf89434e71 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:39.914481988 +0000 UTC m=+44.986795684 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/efcf0d95-9599-4a86-9094-a4bf89434e71-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-z9zgk" (UID: "efcf0d95-9599-4a86-9094-a4bf89434e71") : secret "samples-operator-tls" not found Jul 02 15:26:38.015285 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:38.015239 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ba6b11a-b88f-405b-a92c-99768fca5c8f-service-ca-bundle\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:26:38.015450 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:38.015336 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-metrics-certs\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:26:38.015450 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:38.015417 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ba6b11a-b88f-405b-a92c-99768fca5c8f-service-ca-bundle podName:2ba6b11a-b88f-405b-a92c-99768fca5c8f nodeName:}" failed. No retries permitted until 2026-07-02 15:26:40.01539556 +0000 UTC m=+45.087709255 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ba6b11a-b88f-405b-a92c-99768fca5c8f-service-ca-bundle") pod "router-default-7d7c49774c-69ntk" (UID: "2ba6b11a-b88f-405b-a92c-99768fca5c8f") : configmap references non-existent config key: service-ca.crt Jul 02 15:26:38.015590 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:38.015501 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 15:26:38.015590 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:38.015551 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-metrics-certs podName:2ba6b11a-b88f-405b-a92c-99768fca5c8f nodeName:}" failed. No retries permitted until 2026-07-02 15:26:40.015536098 +0000 UTC m=+45.087849804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-metrics-certs") pod "router-default-7d7c49774c-69ntk" (UID: "2ba6b11a-b88f-405b-a92c-99768fca5c8f") : secret "router-metrics-certs-default" not found Jul 02 15:26:38.158555 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:38.158518 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:38.259268 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:38.259134 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:38.648814 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:38.648189 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-k2jm9" event={"ID":"a97a5d82-e5f7-4a9d-ba2b-00efec3db99a","Type":"ContainerStarted","Data":"8e97883ea2e2066e61d5581d3a836a18535498d98fe2af204e637366f52fd818"} Jul 02 15:26:38.664593 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:38.663962 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-k2jm9" podStartSLOduration=0.837446152 podStartE2EDuration="2.663938991s" totalImagesPullingTime="1.826492839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:26:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:38.662779721 +0000 UTC m=+43.735093433" watchObservedRunningTime="2026-07-02 15:26:38.663938991 +0000 UTC m=+43.736252703" Jul 02 15:26:38.752747 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:38.752682 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:38.806440 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:38.806344 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:39.128452 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:39.128415 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-tls\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:39.128628 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:39.128531 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-metrics-tls\") pod \"dns-default-cvjvk\" (UID: \"fabe6b91-ef60-4c9c-83b9-9d522cd51fcd\") " pod="openshift-dns/dns-default-cvjvk" Jul 02 15:26:39.128705 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:39.128678 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 15:26:39.128705 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:39.128685 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 15:26:39.128804 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:39.128708 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66f696bff6-4w865: secret "image-registry-tls" not found Jul 02 15:26:39.128804 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:39.128748 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-metrics-tls podName:fabe6b91-ef60-4c9c-83b9-9d522cd51fcd nodeName:}" failed. No retries permitted until 2026-07-02 15:26:47.128728644 +0000 UTC m=+52.201042341 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-metrics-tls") pod "dns-default-cvjvk" (UID: "fabe6b91-ef60-4c9c-83b9-9d522cd51fcd") : secret "dns-default-metrics-tls" not found Jul 02 15:26:39.128804 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:39.128767 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-tls podName:e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:47.128757889 +0000 UTC m=+52.201071585 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-tls") pod "image-registry-66f696bff6-4w865" (UID: "e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1") : secret "image-registry-tls" not found Jul 02 15:26:39.935184 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:39.935146 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/efcf0d95-9599-4a86-9094-a4bf89434e71-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-z9zgk\" (UID: \"efcf0d95-9599-4a86-9094-a4bf89434e71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-z9zgk" Jul 02 15:26:39.935644 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:39.935217 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-pjjbc\" (UID: \"76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-pjjbc" Jul 02 15:26:39.935644 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:39.935308 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 15:26:39.935644 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:39.935383 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 15:26:39.935644 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:39.935390 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efcf0d95-9599-4a86-9094-a4bf89434e71-samples-operator-tls podName:efcf0d95-9599-4a86-9094-a4bf89434e71 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:43.935357392 +0000 UTC m=+49.007671092 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/efcf0d95-9599-4a86-9094-a4bf89434e71-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-z9zgk" (UID: "efcf0d95-9599-4a86-9094-a4bf89434e71") : secret "samples-operator-tls" not found Jul 02 15:26:39.935644 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:39.935454 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-cluster-monitoring-operator-tls podName:76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:43.935440402 +0000 UTC m=+49.007754092 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-pjjbc" (UID: "76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8") : secret "cluster-monitoring-operator-tls" not found Jul 02 15:26:40.036655 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:40.036616 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ba6b11a-b88f-405b-a92c-99768fca5c8f-service-ca-bundle\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:26:40.036858 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:40.036711 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-metrics-certs\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:26:40.036858 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:40.036791 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ba6b11a-b88f-405b-a92c-99768fca5c8f-service-ca-bundle podName:2ba6b11a-b88f-405b-a92c-99768fca5c8f nodeName:}" failed. No retries permitted until 2026-07-02 15:26:44.036772071 +0000 UTC m=+49.109085764 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ba6b11a-b88f-405b-a92c-99768fca5c8f-service-ca-bundle") pod "router-default-7d7c49774c-69ntk" (UID: "2ba6b11a-b88f-405b-a92c-99768fca5c8f") : configmap references non-existent config key: service-ca.crt Jul 02 15:26:40.036858 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:40.036841 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 15:26:40.037071 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:40.036880 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-metrics-certs podName:2ba6b11a-b88f-405b-a92c-99768fca5c8f nodeName:}" failed. No retries permitted until 2026-07-02 15:26:44.03687097 +0000 UTC m=+49.109184677 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-metrics-certs") pod "router-default-7d7c49774c-69ntk" (UID: "2ba6b11a-b88f-405b-a92c-99768fca5c8f") : secret "router-metrics-certs-default" not found Jul 02 15:26:43.663936 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:43.663900 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-x8l44" event={"ID":"16f301e2-dc19-4056-b4e0-777db733c4bf","Type":"ContainerStarted","Data":"3996dcd0d5098068560369d262c8b3a6a81e979b0ebe4415e8273b7a7e5031fd"} Jul 02 15:26:43.665525 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:43.665493 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-qcglg" event={"ID":"cd214bd3-835e-4a77-ad2c-f4a61e793bba","Type":"ContainerStarted","Data":"2f3e72d45d738cfe58395a80623803a67d84063eff84be258e7c929715fd81d1"} Jul 02 15:26:43.667068 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:43.667044 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-5hn5p" event={"ID":"8fded7d4-f80c-4108-b1bd-438c5607386d","Type":"ContainerStarted","Data":"c27855f3578184bb69a334b61535887498c6a3853a67a6f09676d15acc82a01b"} Jul 02 15:26:43.679674 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:43.679542 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56499946bc-x8l44" podStartSLOduration=1.071055381 podStartE2EDuration="7.679523012s" totalImagesPullingTime="6.608467631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:26:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:43.678503553 +0000 UTC m=+48.750817266" watchObservedRunningTime="2026-07-02 15:26:43.679523012 +0000 UTC m=+48.751836725" Jul 02 15:26:43.692569 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:43.692517 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-5hn5p" podStartSLOduration=0.957498415 podStartE2EDuration="7.692497044s" totalImagesPullingTime="6.734998629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:26:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:43.69226763 +0000 UTC m=+48.764581342" watchObservedRunningTime="2026-07-02 15:26:43.692497044 +0000 UTC m=+48.764810751" Jul 02 15:26:43.710782 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:43.710333 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-qcglg" podStartSLOduration=1.065188375 podStartE2EDuration="7.710302547s" totalImagesPullingTime="6.645114172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:26:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:43.708233962 +0000 UTC m=+48.780547687" watchObservedRunningTime="2026-07-02 15:26:43.710302547 +0000 UTC m=+48.782616260" Jul 02 15:26:43.972108 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:43.971982 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/efcf0d95-9599-4a86-9094-a4bf89434e71-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-z9zgk\" (UID: \"efcf0d95-9599-4a86-9094-a4bf89434e71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-z9zgk" Jul 02 15:26:43.972108 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:43.972086 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-pjjbc\" (UID: \"76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-pjjbc" Jul 02 15:26:43.972348 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:43.972147 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 15:26:43.972348 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:43.972200 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 15:26:43.972348 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:43.972225 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efcf0d95-9599-4a86-9094-a4bf89434e71-samples-operator-tls podName:efcf0d95-9599-4a86-9094-a4bf89434e71 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:51.972205971 +0000 UTC m=+57.044519669 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/efcf0d95-9599-4a86-9094-a4bf89434e71-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-z9zgk" (UID: "efcf0d95-9599-4a86-9094-a4bf89434e71") : secret "samples-operator-tls" not found Jul 02 15:26:43.972348 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:43.972262 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-cluster-monitoring-operator-tls podName:76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:51.972244829 +0000 UTC m=+57.044558523 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-pjjbc" (UID: "76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8") : secret "cluster-monitoring-operator-tls" not found Jul 02 15:26:44.079934 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:44.079891 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ba6b11a-b88f-405b-a92c-99768fca5c8f-service-ca-bundle\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:26:44.080131 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:44.080011 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-metrics-certs\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:26:44.080131 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:44.080127 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 15:26:44.080240 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:44.080163 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ba6b11a-b88f-405b-a92c-99768fca5c8f-service-ca-bundle podName:2ba6b11a-b88f-405b-a92c-99768fca5c8f nodeName:}" failed. No retries permitted until 2026-07-02 15:26:52.080139881 +0000 UTC m=+57.152453576 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ba6b11a-b88f-405b-a92c-99768fca5c8f-service-ca-bundle") pod "router-default-7d7c49774c-69ntk" (UID: "2ba6b11a-b88f-405b-a92c-99768fca5c8f") : configmap references non-existent config key: service-ca.crt Jul 02 15:26:44.080301 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:44.080281 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-metrics-certs podName:2ba6b11a-b88f-405b-a92c-99768fca5c8f nodeName:}" failed. No retries permitted until 2026-07-02 15:26:52.080266015 +0000 UTC m=+57.152579710 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-metrics-certs") pod "router-default-7d7c49774c-69ntk" (UID: "2ba6b11a-b88f-405b-a92c-99768fca5c8f") : secret "router-metrics-certs-default" not found Jul 02 15:26:44.673491 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:44.673455 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-8lcv4" event={"ID":"f09efd02-cadc-487d-a7d3-c6f46620278b","Type":"ContainerStarted","Data":"c2e0d2b2894e530609e3c04265d41ff5d5ba4a016703426dfed81197b30fe697"} Jul 02 15:26:44.675272 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:44.675246 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-g5scp_2a799b2e-a2de-4260-8fe4-0cb5242c0952/console-operator/0.log" Jul 02 15:26:44.675415 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:44.675291 2573 generic.go:356] "Generic (PLEG): container finished" podID="2a799b2e-a2de-4260-8fe4-0cb5242c0952" containerID="0271c72e586850cda419358e8b333cb8ebbfb25f59c176f528c86b7f3da8687a" exitCode=255 Jul 02 15:26:44.675415 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:44.675393 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-g5scp" event={"ID":"2a799b2e-a2de-4260-8fe4-0cb5242c0952","Type":"ContainerDied","Data":"0271c72e586850cda419358e8b333cb8ebbfb25f59c176f528c86b7f3da8687a"} Jul 02 15:26:44.675622 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:44.675606 2573 scope.go:117] "RemoveContainer" containerID="0271c72e586850cda419358e8b333cb8ebbfb25f59c176f528c86b7f3da8687a" Jul 02 15:26:44.691849 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:44.691782 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-8lcv4" podStartSLOduration=2.090215829 podStartE2EDuration="8.691764968s" totalImagesPullingTime="6.601549139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:26:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:44.691195863 +0000 UTC m=+49.763509576" watchObservedRunningTime="2026-07-02 15:26:44.691764968 +0000 UTC m=+49.764078682" Jul 02 15:26:44.894757 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:44.894723 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:44.910203 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:44.910171 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-t4tfs"] Jul 02 15:26:44.927601 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:44.927533 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-t4tfs"] Jul 02 15:26:44.927767 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:44.927662 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-t4tfs" Jul 02 15:26:44.930403 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:44.930380 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 02 15:26:44.930534 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:44.930381 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 02 15:26:44.930598 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:44.930383 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-pgqjz\"" Jul 02 15:26:44.988347 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:44.988306 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:45.092004 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.091964 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j65sw\" (UniqueName: \"kubernetes.io/projected/da7ee8a7-e3cf-4210-91fb-86e3a689464c-kube-api-access-j65sw\") pod \"migrator-786f9fbc5-t4tfs\" (UID: \"da7ee8a7-e3cf-4210-91fb-86e3a689464c\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-t4tfs" Jul 02 15:26:45.186928 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.186889 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:45.193003 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.192965 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j65sw\" (UniqueName: \"kubernetes.io/projected/da7ee8a7-e3cf-4210-91fb-86e3a689464c-kube-api-access-j65sw\") pod \"migrator-786f9fbc5-t4tfs\" (UID: \"da7ee8a7-e3cf-4210-91fb-86e3a689464c\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-t4tfs" Jul 02 15:26:45.200454 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.200424 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j65sw\" (UniqueName: \"kubernetes.io/projected/da7ee8a7-e3cf-4210-91fb-86e3a689464c-kube-api-access-j65sw\") pod \"migrator-786f9fbc5-t4tfs\" (UID: \"da7ee8a7-e3cf-4210-91fb-86e3a689464c\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-t4tfs" Jul 02 15:26:45.238624 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.238588 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-t4tfs" Jul 02 15:26:45.347844 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.347479 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-khjtk"] Jul 02 15:26:45.381087 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.381057 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-khjtk"] Jul 02 15:26:45.381257 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.381196 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-khjtk" Jul 02 15:26:45.383622 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.383597 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 15:26:45.383742 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.383632 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kxmrv\"" Jul 02 15:26:45.383742 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.383656 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 15:26:45.386149 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.386120 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:45.405558 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.405532 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-t4tfs"] Jul 02 15:26:45.408352 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:26:45.408329 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda7ee8a7_e3cf_4210_91fb_86e3a689464c.slice/crio-63dae129cb280a69f80501e8c62a7f812352781952cad3851a21ccb1edb2e339 WatchSource:0}: Error finding container 63dae129cb280a69f80501e8c62a7f812352781952cad3851a21ccb1edb2e339: Status 404 returned error can't find the container with id 63dae129cb280a69f80501e8c62a7f812352781952cad3851a21ccb1edb2e339 Jul 02 15:26:45.445377 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.445344 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-kc7bx"] Jul 02 15:26:45.457094 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.457062 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:45.465048 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.465026 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-kc7bx"] Jul 02 15:26:45.465157 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.465074 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kc7bx" Jul 02 15:26:45.467588 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.467563 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 02 15:26:45.467675 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.467630 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 02 15:26:45.467725 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.467691 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wfzq6\"" Jul 02 15:26:45.495788 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.495767 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af82554e-e11c-4678-80d1-1872fa59260a-crio-socket\") pod \"insights-runtime-extractor-khjtk\" (UID: \"af82554e-e11c-4678-80d1-1872fa59260a\") " pod="openshift-insights/insights-runtime-extractor-khjtk" Jul 02 15:26:45.495897 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.495799 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vg8c\" (UniqueName: \"kubernetes.io/projected/af82554e-e11c-4678-80d1-1872fa59260a-kube-api-access-6vg8c\") pod \"insights-runtime-extractor-khjtk\" (UID: \"af82554e-e11c-4678-80d1-1872fa59260a\") " pod="openshift-insights/insights-runtime-extractor-khjtk" Jul 02 15:26:45.495897 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.495832 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af82554e-e11c-4678-80d1-1872fa59260a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-khjtk\" (UID: \"af82554e-e11c-4678-80d1-1872fa59260a\") " pod="openshift-insights/insights-runtime-extractor-khjtk" Jul 02 15:26:45.495897 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.495852 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af82554e-e11c-4678-80d1-1872fa59260a-data-volume\") pod \"insights-runtime-extractor-khjtk\" (UID: \"af82554e-e11c-4678-80d1-1872fa59260a\") " pod="openshift-insights/insights-runtime-extractor-khjtk" Jul 02 15:26:45.496017 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.495923 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af82554e-e11c-4678-80d1-1872fa59260a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-khjtk\" (UID: \"af82554e-e11c-4678-80d1-1872fa59260a\") " pod="openshift-insights/insights-runtime-extractor-khjtk" Jul 02 15:26:45.551131 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.551097 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:45.596572 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.596535 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af82554e-e11c-4678-80d1-1872fa59260a-data-volume\") pod \"insights-runtime-extractor-khjtk\" (UID: \"af82554e-e11c-4678-80d1-1872fa59260a\") " pod="openshift-insights/insights-runtime-extractor-khjtk" Jul 02 15:26:45.596725 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.596638 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af82554e-e11c-4678-80d1-1872fa59260a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-khjtk\" (UID: \"af82554e-e11c-4678-80d1-1872fa59260a\") " pod="openshift-insights/insights-runtime-extractor-khjtk" Jul 02 15:26:45.596725 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.596713 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19761344-4840-4e55-8c33-f01bb0bbb8c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-kc7bx\" (UID: \"19761344-4840-4e55-8c33-f01bb0bbb8c3\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kc7bx" Jul 02 15:26:45.596807 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:45.596787 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 15:26:45.596862 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:45.596849 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af82554e-e11c-4678-80d1-1872fa59260a-insights-runtime-extractor-tls podName:af82554e-e11c-4678-80d1-1872fa59260a nodeName:}" failed. No retries permitted until 2026-07-02 15:26:46.09683334 +0000 UTC m=+51.169147030 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af82554e-e11c-4678-80d1-1872fa59260a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-khjtk" (UID: "af82554e-e11c-4678-80d1-1872fa59260a") : secret "insights-runtime-extractor-tls" not found Jul 02 15:26:45.596862 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.596796 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/19761344-4840-4e55-8c33-f01bb0bbb8c3-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-kc7bx\" (UID: \"19761344-4840-4e55-8c33-f01bb0bbb8c3\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kc7bx" Jul 02 15:26:45.596942 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.596895 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af82554e-e11c-4678-80d1-1872fa59260a-data-volume\") pod \"insights-runtime-extractor-khjtk\" (UID: \"af82554e-e11c-4678-80d1-1872fa59260a\") " pod="openshift-insights/insights-runtime-extractor-khjtk" Jul 02 15:26:45.596942 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.596896 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af82554e-e11c-4678-80d1-1872fa59260a-crio-socket\") pod \"insights-runtime-extractor-khjtk\" (UID: \"af82554e-e11c-4678-80d1-1872fa59260a\") " pod="openshift-insights/insights-runtime-extractor-khjtk" Jul 02 15:26:45.597024 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.596944 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vg8c\" (UniqueName: \"kubernetes.io/projected/af82554e-e11c-4678-80d1-1872fa59260a-kube-api-access-6vg8c\") pod \"insights-runtime-extractor-khjtk\" (UID: \"af82554e-e11c-4678-80d1-1872fa59260a\") " pod="openshift-insights/insights-runtime-extractor-khjtk" Jul 02 15:26:45.597024 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.596979 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af82554e-e11c-4678-80d1-1872fa59260a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-khjtk\" (UID: \"af82554e-e11c-4678-80d1-1872fa59260a\") " pod="openshift-insights/insights-runtime-extractor-khjtk" Jul 02 15:26:45.597096 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.597075 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af82554e-e11c-4678-80d1-1872fa59260a-crio-socket\") pod \"insights-runtime-extractor-khjtk\" (UID: \"af82554e-e11c-4678-80d1-1872fa59260a\") " pod="openshift-insights/insights-runtime-extractor-khjtk" Jul 02 15:26:45.597096 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:45.597084 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 15:26:45.597155 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:45.597131 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af82554e-e11c-4678-80d1-1872fa59260a-kube-rbac-proxy-cm podName:af82554e-e11c-4678-80d1-1872fa59260a nodeName:}" failed. No retries permitted until 2026-07-02 15:26:46.097119472 +0000 UTC m=+51.169433161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/af82554e-e11c-4678-80d1-1872fa59260a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-khjtk" (UID: "af82554e-e11c-4678-80d1-1872fa59260a") : configmap "kube-rbac-proxy" not found Jul 02 15:26:45.605581 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.605517 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vg8c\" (UniqueName: \"kubernetes.io/projected/af82554e-e11c-4678-80d1-1872fa59260a-kube-api-access-6vg8c\") pod \"insights-runtime-extractor-khjtk\" (UID: \"af82554e-e11c-4678-80d1-1872fa59260a\") " pod="openshift-insights/insights-runtime-extractor-khjtk" Jul 02 15:26:45.651702 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.651668 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:45.679415 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.679374 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-t4tfs" event={"ID":"da7ee8a7-e3cf-4210-91fb-86e3a689464c","Type":"ContainerStarted","Data":"63dae129cb280a69f80501e8c62a7f812352781952cad3851a21ccb1edb2e339"} Jul 02 15:26:45.680864 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.680843 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-g5scp_2a799b2e-a2de-4260-8fe4-0cb5242c0952/console-operator/1.log" Jul 02 15:26:45.681208 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.681195 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-g5scp_2a799b2e-a2de-4260-8fe4-0cb5242c0952/console-operator/0.log" Jul 02 15:26:45.681264 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.681224 2573 generic.go:356] "Generic (PLEG): container finished" podID="2a799b2e-a2de-4260-8fe4-0cb5242c0952" containerID="e2a945fac911a2e272b0ae02374502b8eade58daffb0d5c1ffb2c3082e63c51a" exitCode=255 Jul 02 15:26:45.681331 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.681313 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-g5scp" event={"ID":"2a799b2e-a2de-4260-8fe4-0cb5242c0952","Type":"ContainerDied","Data":"e2a945fac911a2e272b0ae02374502b8eade58daffb0d5c1ffb2c3082e63c51a"} Jul 02 15:26:45.681383 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.681358 2573 scope.go:117] "RemoveContainer" containerID="0271c72e586850cda419358e8b333cb8ebbfb25f59c176f528c86b7f3da8687a" Jul 02 15:26:45.681568 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.681546 2573 scope.go:117] "RemoveContainer" containerID="e2a945fac911a2e272b0ae02374502b8eade58daffb0d5c1ffb2c3082e63c51a" Jul 02 15:26:45.681748 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:45.681730 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-g5scp_openshift-console-operator(2a799b2e-a2de-4260-8fe4-0cb5242c0952)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-g5scp" podUID="2a799b2e-a2de-4260-8fe4-0cb5242c0952" Jul 02 15:26:45.697937 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.697913 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19761344-4840-4e55-8c33-f01bb0bbb8c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-kc7bx\" (UID: \"19761344-4840-4e55-8c33-f01bb0bbb8c3\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kc7bx" Jul 02 15:26:45.698058 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.697965 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/19761344-4840-4e55-8c33-f01bb0bbb8c3-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-kc7bx\" (UID: \"19761344-4840-4e55-8c33-f01bb0bbb8c3\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kc7bx" Jul 02 15:26:45.698121 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:45.698091 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 15:26:45.698211 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:45.698198 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19761344-4840-4e55-8c33-f01bb0bbb8c3-networking-console-plugin-cert podName:19761344-4840-4e55-8c33-f01bb0bbb8c3 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:46.198142584 +0000 UTC m=+51.270456290 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19761344-4840-4e55-8c33-f01bb0bbb8c3-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-kc7bx" (UID: "19761344-4840-4e55-8c33-f01bb0bbb8c3") : secret "networking-console-plugin-cert" not found Jul 02 15:26:45.698759 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.698657 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/19761344-4840-4e55-8c33-f01bb0bbb8c3-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-kc7bx\" (UID: \"19761344-4840-4e55-8c33-f01bb0bbb8c3\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kc7bx" Jul 02 15:26:45.753137 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:45.753095 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:46.101731 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:46.101695 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af82554e-e11c-4678-80d1-1872fa59260a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-khjtk\" (UID: \"af82554e-e11c-4678-80d1-1872fa59260a\") " pod="openshift-insights/insights-runtime-extractor-khjtk" Jul 02 15:26:46.101943 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:46.101803 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af82554e-e11c-4678-80d1-1872fa59260a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-khjtk\" (UID: \"af82554e-e11c-4678-80d1-1872fa59260a\") " pod="openshift-insights/insights-runtime-extractor-khjtk" Jul 02 15:26:46.101943 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:46.101848 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 15:26:46.101943 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:46.101934 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af82554e-e11c-4678-80d1-1872fa59260a-kube-rbac-proxy-cm podName:af82554e-e11c-4678-80d1-1872fa59260a nodeName:}" failed. No retries permitted until 2026-07-02 15:26:47.101910732 +0000 UTC m=+52.174224427 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/af82554e-e11c-4678-80d1-1872fa59260a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-khjtk" (UID: "af82554e-e11c-4678-80d1-1872fa59260a") : configmap "kube-rbac-proxy" not found Jul 02 15:26:46.102148 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:46.101973 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 15:26:46.102148 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:46.102045 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af82554e-e11c-4678-80d1-1872fa59260a-insights-runtime-extractor-tls podName:af82554e-e11c-4678-80d1-1872fa59260a nodeName:}" failed. No retries permitted until 2026-07-02 15:26:47.102033415 +0000 UTC m=+52.174347121 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af82554e-e11c-4678-80d1-1872fa59260a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-khjtk" (UID: "af82554e-e11c-4678-80d1-1872fa59260a") : secret "insights-runtime-extractor-tls" not found Jul 02 15:26:46.203359 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:46.203323 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19761344-4840-4e55-8c33-f01bb0bbb8c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-kc7bx\" (UID: \"19761344-4840-4e55-8c33-f01bb0bbb8c3\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kc7bx" Jul 02 15:26:46.203520 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:46.203490 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 15:26:46.203578 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:46.203557 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19761344-4840-4e55-8c33-f01bb0bbb8c3-networking-console-plugin-cert podName:19761344-4840-4e55-8c33-f01bb0bbb8c3 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:47.20354136 +0000 UTC m=+52.275855051 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19761344-4840-4e55-8c33-f01bb0bbb8c3-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-kc7bx" (UID: "19761344-4840-4e55-8c33-f01bb0bbb8c3") : secret "networking-console-plugin-cert" not found Jul 02 15:26:46.406926 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:46.406843 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:46.467449 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:46.467409 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:46.579787 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:46.579751 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-g5scp" Jul 02 15:26:46.579972 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:46.579810 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7fdbdf9c99-g5scp" Jul 02 15:26:46.686958 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:46.686884 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-g5scp_2a799b2e-a2de-4260-8fe4-0cb5242c0952/console-operator/1.log" Jul 02 15:26:46.687414 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:46.687332 2573 scope.go:117] "RemoveContainer" containerID="e2a945fac911a2e272b0ae02374502b8eade58daffb0d5c1ffb2c3082e63c51a" Jul 02 15:26:46.687601 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:46.687566 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-g5scp_openshift-console-operator(2a799b2e-a2de-4260-8fe4-0cb5242c0952)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-g5scp" podUID="2a799b2e-a2de-4260-8fe4-0cb5242c0952" Jul 02 15:26:47.098420 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.098388 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:47.115971 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.115946 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af82554e-e11c-4678-80d1-1872fa59260a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-khjtk\" (UID: \"af82554e-e11c-4678-80d1-1872fa59260a\") " pod="openshift-insights/insights-runtime-extractor-khjtk" Jul 02 15:26:47.116102 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.116042 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af82554e-e11c-4678-80d1-1872fa59260a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-khjtk\" (UID: \"af82554e-e11c-4678-80d1-1872fa59260a\") " pod="openshift-insights/insights-runtime-extractor-khjtk" Jul 02 15:26:47.116247 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:47.116229 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 15:26:47.116311 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:47.116301 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af82554e-e11c-4678-80d1-1872fa59260a-insights-runtime-extractor-tls podName:af82554e-e11c-4678-80d1-1872fa59260a nodeName:}" failed. No retries permitted until 2026-07-02 15:26:49.116281 +0000 UTC m=+54.188594692 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af82554e-e11c-4678-80d1-1872fa59260a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-khjtk" (UID: "af82554e-e11c-4678-80d1-1872fa59260a") : secret "insights-runtime-extractor-tls" not found Jul 02 15:26:47.116601 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.116576 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af82554e-e11c-4678-80d1-1872fa59260a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-khjtk\" (UID: \"af82554e-e11c-4678-80d1-1872fa59260a\") " pod="openshift-insights/insights-runtime-extractor-khjtk" Jul 02 15:26:47.217057 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.216971 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-metrics-tls\") pod \"dns-default-cvjvk\" (UID: \"fabe6b91-ef60-4c9c-83b9-9d522cd51fcd\") " pod="openshift-dns/dns-default-cvjvk" Jul 02 15:26:47.217230 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.217096 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-tls\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:26:47.217230 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:47.217142 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 15:26:47.217230 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.217159 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19761344-4840-4e55-8c33-f01bb0bbb8c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-kc7bx\" (UID: \"19761344-4840-4e55-8c33-f01bb0bbb8c3\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kc7bx" Jul 02 15:26:47.217230 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:47.217214 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-metrics-tls podName:fabe6b91-ef60-4c9c-83b9-9d522cd51fcd nodeName:}" failed. No retries permitted until 2026-07-02 15:27:03.217192909 +0000 UTC m=+68.289506618 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-metrics-tls") pod "dns-default-cvjvk" (UID: "fabe6b91-ef60-4c9c-83b9-9d522cd51fcd") : secret "dns-default-metrics-tls" not found Jul 02 15:26:47.217490 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:47.217239 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 15:26:47.217490 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:47.217250 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 15:26:47.217490 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:47.217255 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66f696bff6-4w865: secret "image-registry-tls" not found Jul 02 15:26:47.217490 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:47.217300 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19761344-4840-4e55-8c33-f01bb0bbb8c3-networking-console-plugin-cert podName:19761344-4840-4e55-8c33-f01bb0bbb8c3 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:49.217285947 +0000 UTC m=+54.289599643 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19761344-4840-4e55-8c33-f01bb0bbb8c3-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-kc7bx" (UID: "19761344-4840-4e55-8c33-f01bb0bbb8c3") : secret "networking-console-plugin-cert" not found Jul 02 15:26:47.217490 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:47.217314 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-tls podName:e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1 nodeName:}" failed. No retries permitted until 2026-07-02 15:27:03.217308621 +0000 UTC m=+68.289622343 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-tls") pod "image-registry-66f696bff6-4w865" (UID: "e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1") : secret "image-registry-tls" not found Jul 02 15:26:47.349013 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.348970 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dvrtk_61c2c69b-7481-4ef5-a874-aa280ce47dee/dns-node-resolver/0.log" Jul 02 15:26:47.691366 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.691333 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-t4tfs" event={"ID":"da7ee8a7-e3cf-4210-91fb-86e3a689464c","Type":"ContainerStarted","Data":"7b17590fe34e15598dc3ea5ebe2f259e1da49a055e1bf39c316213baa5ce0374"} Jul 02 15:26:47.691831 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.691387 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-t4tfs" event={"ID":"da7ee8a7-e3cf-4210-91fb-86e3a689464c","Type":"ContainerStarted","Data":"a6d8ecd9e6cc8b720b7f676a6ce64a9f7169ef44df5d9fcb126127493da38df3"} Jul 02 15:26:47.691831 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.691733 2573 scope.go:117] "RemoveContainer" containerID="e2a945fac911a2e272b0ae02374502b8eade58daffb0d5c1ffb2c3082e63c51a" Jul 02 15:26:47.691929 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:47.691865 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7fdbdf9c99-g5scp_openshift-console-operator(2a799b2e-a2de-4260-8fe4-0cb5242c0952)\"" pod="openshift-console-operator/console-operator-7fdbdf9c99-g5scp" podUID="2a799b2e-a2de-4260-8fe4-0cb5242c0952" Jul 02 15:26:47.706091 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.706046 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-t4tfs" podStartSLOduration=2.166960056 podStartE2EDuration="3.706032408s" totalImagesPullingTime="1.539072352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:47.705473871 +0000 UTC m=+52.777787585" watchObservedRunningTime="2026-07-02 15:26:47.706032408 +0000 UTC m=+52.778346120" Jul 02 15:26:47.774173 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.774138 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-rqsr6"] Jul 02 15:26:47.791847 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.791808 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:47.794416 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.794398 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-rqsr6"] Jul 02 15:26:47.794498 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.794487 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-rqsr6" Jul 02 15:26:47.796917 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.796897 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 02 15:26:47.797233 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.797213 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 02 15:26:47.797334 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.797320 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-p67bb\"" Jul 02 15:26:47.797405 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.797392 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 02 15:26:47.797491 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.797474 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 02 15:26:47.824673 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.824642 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d1c2c9ce-460d-4f7b-bf78-70d63d348505-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-rqsr6\" (UID: \"d1c2c9ce-460d-4f7b-bf78-70d63d348505\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-rqsr6" Jul 02 15:26:47.824811 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.824715 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jlq7\" (UniqueName: \"kubernetes.io/projected/d1c2c9ce-460d-4f7b-bf78-70d63d348505-kube-api-access-4jlq7\") pod \"service-ca-7bb4f4bcc7-rqsr6\" (UID: \"d1c2c9ce-460d-4f7b-bf78-70d63d348505\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-rqsr6" Jul 02 15:26:47.824855 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.824816 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d1c2c9ce-460d-4f7b-bf78-70d63d348505-signing-key\") pod \"service-ca-7bb4f4bcc7-rqsr6\" (UID: \"d1c2c9ce-460d-4f7b-bf78-70d63d348505\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-rqsr6" Jul 02 15:26:47.855168 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.855129 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:47.924191 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.924145 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:47.925131 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.925110 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d1c2c9ce-460d-4f7b-bf78-70d63d348505-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-rqsr6\" (UID: \"d1c2c9ce-460d-4f7b-bf78-70d63d348505\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-rqsr6" Jul 02 15:26:47.925227 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.925190 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jlq7\" (UniqueName: \"kubernetes.io/projected/d1c2c9ce-460d-4f7b-bf78-70d63d348505-kube-api-access-4jlq7\") pod \"service-ca-7bb4f4bcc7-rqsr6\" (UID: \"d1c2c9ce-460d-4f7b-bf78-70d63d348505\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-rqsr6" Jul 02 15:26:47.925350 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.925335 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d1c2c9ce-460d-4f7b-bf78-70d63d348505-signing-key\") pod \"service-ca-7bb4f4bcc7-rqsr6\" (UID: \"d1c2c9ce-460d-4f7b-bf78-70d63d348505\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-rqsr6" Jul 02 15:26:47.925838 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.925816 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d1c2c9ce-460d-4f7b-bf78-70d63d348505-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-rqsr6\" (UID: \"d1c2c9ce-460d-4f7b-bf78-70d63d348505\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-rqsr6" Jul 02 15:26:47.927638 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.927622 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d1c2c9ce-460d-4f7b-bf78-70d63d348505-signing-key\") pod \"service-ca-7bb4f4bcc7-rqsr6\" (UID: \"d1c2c9ce-460d-4f7b-bf78-70d63d348505\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-rqsr6" Jul 02 15:26:47.934333 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:47.934302 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jlq7\" (UniqueName: \"kubernetes.io/projected/d1c2c9ce-460d-4f7b-bf78-70d63d348505-kube-api-access-4jlq7\") pod \"service-ca-7bb4f4bcc7-rqsr6\" (UID: \"d1c2c9ce-460d-4f7b-bf78-70d63d348505\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-rqsr6" Jul 02 15:26:48.103518 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:48.103487 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-rqsr6" Jul 02 15:26:48.240957 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:48.240925 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-rqsr6"] Jul 02 15:26:48.243796 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:26:48.243769 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1c2c9ce_460d_4f7b_bf78_70d63d348505.slice/crio-00991f18c9917b8bd06fa38d120ee2d8aaee8c381b994b123f57fe5f178a2d51 WatchSource:0}: Error finding container 00991f18c9917b8bd06fa38d120ee2d8aaee8c381b994b123f57fe5f178a2d51: Status 404 returned error can't find the container with id 00991f18c9917b8bd06fa38d120ee2d8aaee8c381b994b123f57fe5f178a2d51 Jul 02 15:26:48.548931 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:48.548899 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qrttf_1ba1a511-b4bb-4e2d-b876-9d3d9a54dae7/node-ca/0.log" Jul 02 15:26:48.696408 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:48.696320 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-rqsr6" event={"ID":"d1c2c9ce-460d-4f7b-bf78-70d63d348505","Type":"ContainerStarted","Data":"59a787ef63b8f9af3e4afa421239124a898d4f898bfb25df3ae79b77e42d2b9e"} Jul 02 15:26:48.696408 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:48.696377 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-rqsr6" event={"ID":"d1c2c9ce-460d-4f7b-bf78-70d63d348505","Type":"ContainerStarted","Data":"00991f18c9917b8bd06fa38d120ee2d8aaee8c381b994b123f57fe5f178a2d51"} Jul 02 15:26:48.714304 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:48.714245 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7bb4f4bcc7-rqsr6" podStartSLOduration=1.7142258639999999 podStartE2EDuration="1.714225864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:26:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:48.713878425 +0000 UTC m=+53.786192138" watchObservedRunningTime="2026-07-02 15:26:48.714225864 +0000 UTC m=+53.786539577" Jul 02 15:26:48.806740 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:48.806699 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:48.949692 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:48.949599 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2snr8_429e5081-104e-4014-a5d9-825d1da547ce/serve-healthcheck-canary/0.log" Jul 02 15:26:49.136551 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:49.136508 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af82554e-e11c-4678-80d1-1872fa59260a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-khjtk\" (UID: \"af82554e-e11c-4678-80d1-1872fa59260a\") " pod="openshift-insights/insights-runtime-extractor-khjtk" Jul 02 15:26:49.136768 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:49.136691 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 15:26:49.136827 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:49.136773 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af82554e-e11c-4678-80d1-1872fa59260a-insights-runtime-extractor-tls podName:af82554e-e11c-4678-80d1-1872fa59260a nodeName:}" failed. No retries permitted until 2026-07-02 15:26:53.136753246 +0000 UTC m=+58.209066957 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af82554e-e11c-4678-80d1-1872fa59260a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-khjtk" (UID: "af82554e-e11c-4678-80d1-1872fa59260a") : secret "insights-runtime-extractor-tls" not found Jul 02 15:26:49.150652 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:49.150618 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:49.151040 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:49.151016 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-t4tfs_da7ee8a7-e3cf-4210-91fb-86e3a689464c/migrator/0.log" Jul 02 15:26:49.238277 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:49.238167 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19761344-4840-4e55-8c33-f01bb0bbb8c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-kc7bx\" (UID: \"19761344-4840-4e55-8c33-f01bb0bbb8c3\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kc7bx" Jul 02 15:26:49.238462 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:49.238358 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 15:26:49.238523 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:49.238467 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19761344-4840-4e55-8c33-f01bb0bbb8c3-networking-console-plugin-cert podName:19761344-4840-4e55-8c33-f01bb0bbb8c3 nodeName:}" failed. No retries permitted until 2026-07-02 15:26:53.238431537 +0000 UTC m=+58.310745230 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19761344-4840-4e55-8c33-f01bb0bbb8c3-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-kc7bx" (UID: "19761344-4840-4e55-8c33-f01bb0bbb8c3") : secret "networking-console-plugin-cert" not found Jul 02 15:26:49.306226 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:49.306190 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:49.349776 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:49.349747 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-t4tfs_da7ee8a7-e3cf-4210-91fb-86e3a689464c/graceful-termination/0.log" Jul 02 15:26:49.406280 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:49.406246 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:49.505806 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:49.505713 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:49.551747 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:49.551700 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-5hn5p_8fded7d4-f80c-4108-b1bd-438c5607386d/kube-storage-version-migrator-operator/0.log" Jul 02 15:26:50.237702 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:50.237669 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:50.831787 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:50.831754 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:51.055417 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:51.055384 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" limit=1024 Jul 02 15:26:52.067048 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:52.066987 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/efcf0d95-9599-4a86-9094-a4bf89434e71-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-z9zgk\" (UID: \"efcf0d95-9599-4a86-9094-a4bf89434e71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-z9zgk" Jul 02 15:26:52.067492 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:52.067095 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-pjjbc\" (UID: \"76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-pjjbc" Jul 02 15:26:52.067492 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:52.067252 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 15:26:52.067492 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:52.067351 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-cluster-monitoring-operator-tls podName:76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8 nodeName:}" failed. No retries permitted until 2026-07-02 15:27:08.067328602 +0000 UTC m=+73.139642299 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-pjjbc" (UID: "76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8") : secret "cluster-monitoring-operator-tls" not found Jul 02 15:26:52.069340 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:52.069316 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/efcf0d95-9599-4a86-9094-a4bf89434e71-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-z9zgk\" (UID: \"efcf0d95-9599-4a86-9094-a4bf89434e71\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-z9zgk" Jul 02 15:26:52.137322 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:52.137284 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-z9zgk" Jul 02 15:26:52.168087 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:52.168063 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ba6b11a-b88f-405b-a92c-99768fca5c8f-service-ca-bundle\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:26:52.168206 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:52.168142 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-metrics-certs\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:26:52.168305 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:52.168283 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ba6b11a-b88f-405b-a92c-99768fca5c8f-service-ca-bundle podName:2ba6b11a-b88f-405b-a92c-99768fca5c8f nodeName:}" failed. No retries permitted until 2026-07-02 15:27:08.168260501 +0000 UTC m=+73.240574206 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ba6b11a-b88f-405b-a92c-99768fca5c8f-service-ca-bundle") pod "router-default-7d7c49774c-69ntk" (UID: "2ba6b11a-b88f-405b-a92c-99768fca5c8f") : configmap references non-existent config key: service-ca.crt Jul 02 15:26:52.168363 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:52.168291 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 15:26:52.168363 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:52.168340 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-metrics-certs podName:2ba6b11a-b88f-405b-a92c-99768fca5c8f nodeName:}" failed. No retries permitted until 2026-07-02 15:27:08.168331261 +0000 UTC m=+73.240644956 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-metrics-certs") pod "router-default-7d7c49774c-69ntk" (UID: "2ba6b11a-b88f-405b-a92c-99768fca5c8f") : secret "router-metrics-certs-default" not found Jul 02 15:26:52.304409 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:52.304379 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-z9zgk"] Jul 02 15:26:52.710866 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:52.710776 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-z9zgk" event={"ID":"efcf0d95-9599-4a86-9094-a4bf89434e71","Type":"ContainerStarted","Data":"df9996dc48806af26a0be6b87810751a88eaea05203008e1074ea999ff57a1f7"} Jul 02 15:26:53.176741 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:53.176701 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af82554e-e11c-4678-80d1-1872fa59260a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-khjtk\" (UID: \"af82554e-e11c-4678-80d1-1872fa59260a\") " pod="openshift-insights/insights-runtime-extractor-khjtk" Jul 02 15:26:53.177123 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:53.176851 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 15:26:53.177123 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:53.176925 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af82554e-e11c-4678-80d1-1872fa59260a-insights-runtime-extractor-tls podName:af82554e-e11c-4678-80d1-1872fa59260a nodeName:}" failed. No retries permitted until 2026-07-02 15:27:01.176911024 +0000 UTC m=+66.249224717 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af82554e-e11c-4678-80d1-1872fa59260a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-khjtk" (UID: "af82554e-e11c-4678-80d1-1872fa59260a") : secret "insights-runtime-extractor-tls" not found Jul 02 15:26:53.277421 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:53.277383 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19761344-4840-4e55-8c33-f01bb0bbb8c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-kc7bx\" (UID: \"19761344-4840-4e55-8c33-f01bb0bbb8c3\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kc7bx" Jul 02 15:26:53.277616 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:53.277563 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 15:26:53.277685 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:26:53.277643 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19761344-4840-4e55-8c33-f01bb0bbb8c3-networking-console-plugin-cert podName:19761344-4840-4e55-8c33-f01bb0bbb8c3 nodeName:}" failed. No retries permitted until 2026-07-02 15:27:01.27762295 +0000 UTC m=+66.349936657 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19761344-4840-4e55-8c33-f01bb0bbb8c3-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-kc7bx" (UID: "19761344-4840-4e55-8c33-f01bb0bbb8c3") : secret "networking-console-plugin-cert" not found Jul 02 15:26:54.720099 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:54.720063 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-z9zgk" event={"ID":"efcf0d95-9599-4a86-9094-a4bf89434e71","Type":"ContainerStarted","Data":"0183492242a9dc56be61eca486fb42a0d1ae516da52574a840f11bf25254632a"} Jul 02 15:26:54.720482 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:54.720120 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-z9zgk" event={"ID":"efcf0d95-9599-4a86-9094-a4bf89434e71","Type":"ContainerStarted","Data":"79fdcd886c13ce099e781da8ed384f47eb0c299f3e8cbf6daaa1be967cec86ac"} Jul 02 15:26:54.740542 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:54.740472 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-z9zgk" podStartSLOduration=16.558192698 podStartE2EDuration="18.740447819s" totalImagesPullingTime="2.182255121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:26:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:26:54.739176047 +0000 UTC m=+59.811489754" watchObservedRunningTime="2026-07-02 15:26:54.740447819 +0000 UTC m=+59.812761533" Jul 02 15:26:55.597911 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:26:55.597880 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rg8r5" Jul 02 15:27:01.152701 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.152656 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbst7\" (UniqueName: \"kubernetes.io/projected/14b9879f-f279-48b7-8198-ea88bcd46396-kube-api-access-tbst7\") pod \"network-check-target-nb2v6\" (UID: \"14b9879f-f279-48b7-8198-ea88bcd46396\") " pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:27:01.155382 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.155355 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbst7\" (UniqueName: \"kubernetes.io/projected/14b9879f-f279-48b7-8198-ea88bcd46396-kube-api-access-tbst7\") pod \"network-check-target-nb2v6\" (UID: \"14b9879f-f279-48b7-8198-ea88bcd46396\") " pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:27:01.224402 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.224365 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pj7tx\"" Jul 02 15:27:01.232417 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.232381 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:27:01.253512 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.253473 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7056290-1f84-464b-9b53-afd3bc43bec1-metrics-certs\") pod \"network-metrics-daemon-fdm7r\" (UID: \"e7056290-1f84-464b-9b53-afd3bc43bec1\") " pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:27:01.253663 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.253555 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af82554e-e11c-4678-80d1-1872fa59260a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-khjtk\" (UID: \"af82554e-e11c-4678-80d1-1872fa59260a\") " pod="openshift-insights/insights-runtime-extractor-khjtk" Jul 02 15:27:01.253663 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.253589 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43c7deaa-395b-4e22-81b8-b52ce0f359b9-original-pull-secret\") pod \"global-pull-secret-syncer-qs9xw\" (UID: \"43c7deaa-395b-4e22-81b8-b52ce0f359b9\") " pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:27:01.255866 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.255841 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af82554e-e11c-4678-80d1-1872fa59260a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-khjtk\" (UID: \"af82554e-e11c-4678-80d1-1872fa59260a\") " pod="openshift-insights/insights-runtime-extractor-khjtk" Jul 02 15:27:01.256042 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.256024 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 15:27:01.256126 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.256042 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 15:27:01.266347 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.266315 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43c7deaa-395b-4e22-81b8-b52ce0f359b9-original-pull-secret\") pod \"global-pull-secret-syncer-qs9xw\" (UID: \"43c7deaa-395b-4e22-81b8-b52ce0f359b9\") " pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:27:01.266347 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.266325 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7056290-1f84-464b-9b53-afd3bc43bec1-metrics-certs\") pod \"network-metrics-daemon-fdm7r\" (UID: \"e7056290-1f84-464b-9b53-afd3bc43bec1\") " pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:27:01.294867 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.294834 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kxmrv\"" Jul 02 15:27:01.302934 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.302904 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-khjtk" Jul 02 15:27:01.355021 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.354836 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19761344-4840-4e55-8c33-f01bb0bbb8c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-kc7bx\" (UID: \"19761344-4840-4e55-8c33-f01bb0bbb8c3\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kc7bx" Jul 02 15:27:01.357852 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.357816 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19761344-4840-4e55-8c33-f01bb0bbb8c3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-kc7bx\" (UID: \"19761344-4840-4e55-8c33-f01bb0bbb8c3\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kc7bx" Jul 02 15:27:01.368668 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.368549 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nb2v6"] Jul 02 15:27:01.370917 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:27:01.370881 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14b9879f_f279_48b7_8198_ea88bcd46396.slice/crio-e5aa8a56de782727915cb681cf0a41969ca0180cebbc193626d5e6d89d5663ec WatchSource:0}: Error finding container e5aa8a56de782727915cb681cf0a41969ca0180cebbc193626d5e6d89d5663ec: Status 404 returned error can't find the container with id e5aa8a56de782727915cb681cf0a41969ca0180cebbc193626d5e6d89d5663ec Jul 02 15:27:01.375332 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.375315 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wfzq6\"" Jul 02 15:27:01.385648 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.385621 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kc7bx" Jul 02 15:27:01.424319 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.424291 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs9xw" Jul 02 15:27:01.432453 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.432412 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ffxgv\"" Jul 02 15:27:01.440773 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.440735 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdm7r" Jul 02 15:27:01.447707 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.447358 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-khjtk"] Jul 02 15:27:01.458534 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:27:01.458508 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf82554e_e11c_4678_80d1_1872fa59260a.slice/crio-fe380185fa51fbd0ae2621e5d9b3088998ad41dc4170b09c967323c497707486 WatchSource:0}: Error finding container fe380185fa51fbd0ae2621e5d9b3088998ad41dc4170b09c967323c497707486: Status 404 returned error can't find the container with id fe380185fa51fbd0ae2621e5d9b3088998ad41dc4170b09c967323c497707486 Jul 02 15:27:01.560464 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.560436 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-kc7bx"] Jul 02 15:27:01.563501 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:27:01.563472 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19761344_4840_4e55_8c33_f01bb0bbb8c3.slice/crio-799c0e0a492262c490ce54ea8b718ea7cbdc1758013db598613a22cfbb604855 WatchSource:0}: Error finding container 799c0e0a492262c490ce54ea8b718ea7cbdc1758013db598613a22cfbb604855: Status 404 returned error can't find the container with id 799c0e0a492262c490ce54ea8b718ea7cbdc1758013db598613a22cfbb604855 Jul 02 15:27:01.606586 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.606557 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qs9xw"] Jul 02 15:27:01.609503 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:27:01.609472 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c7deaa_395b_4e22_81b8_b52ce0f359b9.slice/crio-e55eb44c804eb26eb32197d9180db7e483664055c03536163ab6e92970960aec WatchSource:0}: Error finding container e55eb44c804eb26eb32197d9180db7e483664055c03536163ab6e92970960aec: Status 404 returned error can't find the container with id e55eb44c804eb26eb32197d9180db7e483664055c03536163ab6e92970960aec Jul 02 15:27:01.624498 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.624466 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fdm7r"] Jul 02 15:27:01.627132 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:27:01.627104 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7056290_1f84_464b_9b53_afd3bc43bec1.slice/crio-6b017738e967a5f2e8897df0e6933920a8b517f591ab3a9ff1b9e9a813de23c6 WatchSource:0}: Error finding container 6b017738e967a5f2e8897df0e6933920a8b517f591ab3a9ff1b9e9a813de23c6: Status 404 returned error can't find the container with id 6b017738e967a5f2e8897df0e6933920a8b517f591ab3a9ff1b9e9a813de23c6 Jul 02 15:27:01.744152 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.744065 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fdm7r" event={"ID":"e7056290-1f84-464b-9b53-afd3bc43bec1","Type":"ContainerStarted","Data":"6b017738e967a5f2e8897df0e6933920a8b517f591ab3a9ff1b9e9a813de23c6"} Jul 02 15:27:01.745123 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.745100 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qs9xw" event={"ID":"43c7deaa-395b-4e22-81b8-b52ce0f359b9","Type":"ContainerStarted","Data":"e55eb44c804eb26eb32197d9180db7e483664055c03536163ab6e92970960aec"} Jul 02 15:27:01.746156 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.746128 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kc7bx" event={"ID":"19761344-4840-4e55-8c33-f01bb0bbb8c3","Type":"ContainerStarted","Data":"799c0e0a492262c490ce54ea8b718ea7cbdc1758013db598613a22cfbb604855"} Jul 02 15:27:01.747226 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.747199 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-khjtk" event={"ID":"af82554e-e11c-4678-80d1-1872fa59260a","Type":"ContainerStarted","Data":"fe380185fa51fbd0ae2621e5d9b3088998ad41dc4170b09c967323c497707486"} Jul 02 15:27:01.748566 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.748546 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nb2v6" event={"ID":"14b9879f-f279-48b7-8198-ea88bcd46396","Type":"ContainerStarted","Data":"3d9ed241c048fceb7223bb16a156baa7f42193ba26b63bd14f9ebab1c5019f69"} Jul 02 15:27:01.748655 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.748576 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nb2v6" event={"ID":"14b9879f-f279-48b7-8198-ea88bcd46396","Type":"ContainerStarted","Data":"e5aa8a56de782727915cb681cf0a41969ca0180cebbc193626d5e6d89d5663ec"} Jul 02 15:27:01.748694 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.748685 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:27:01.763841 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:01.763792 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nb2v6" podStartSLOduration=66.763775817 podStartE2EDuration="1m6.763775817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:25:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:01.76324885 +0000 UTC m=+66.835562562" watchObservedRunningTime="2026-07-02 15:27:01.763775817 +0000 UTC m=+66.836089529" Jul 02 15:27:02.411782 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:02.411744 2573 scope.go:117] "RemoveContainer" containerID="e2a945fac911a2e272b0ae02374502b8eade58daffb0d5c1ffb2c3082e63c51a" Jul 02 15:27:02.755975 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:02.755897 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-g5scp_2a799b2e-a2de-4260-8fe4-0cb5242c0952/console-operator/1.log" Jul 02 15:27:02.756161 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:02.756045 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7fdbdf9c99-g5scp" event={"ID":"2a799b2e-a2de-4260-8fe4-0cb5242c0952","Type":"ContainerStarted","Data":"a83402d2d895d16ddd90edecfe53243d4a13680992fc6f2a76bf4311f39209ff"} Jul 02 15:27:02.774463 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:02.774081 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7fdbdf9c99-g5scp" podStartSLOduration=20.144375869 podStartE2EDuration="26.774057485s" totalImagesPullingTime="6.629681616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:26:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:02.772841822 +0000 UTC m=+67.845155534" watchObservedRunningTime="2026-07-02 15:27:02.774057485 +0000 UTC m=+67.846371200" Jul 02 15:27:03.282750 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:03.282702 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-tls\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:27:03.282948 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:03.282816 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-metrics-tls\") pod \"dns-default-cvjvk\" (UID: \"fabe6b91-ef60-4c9c-83b9-9d522cd51fcd\") " pod="openshift-dns/dns-default-cvjvk" Jul 02 15:27:03.285535 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:03.285498 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fabe6b91-ef60-4c9c-83b9-9d522cd51fcd-metrics-tls\") pod \"dns-default-cvjvk\" (UID: \"fabe6b91-ef60-4c9c-83b9-9d522cd51fcd\") " pod="openshift-dns/dns-default-cvjvk" Jul 02 15:27:03.285659 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:03.285550 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-tls\") pod \"image-registry-66f696bff6-4w865\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:27:03.440753 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:03.440719 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vqr2l\"" Jul 02 15:27:03.448776 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:03.448750 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:27:03.450090 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:03.450063 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kt6gc\"" Jul 02 15:27:03.458538 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:03.458515 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cvjvk" Jul 02 15:27:06.789366 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:06.789338 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cvjvk"] Jul 02 15:27:06.794680 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:27:06.794653 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfabe6b91_ef60_4c9c_83b9_9d522cd51fcd.slice/crio-02fedb74097c1a5909cfba09be115a171868bc1b5657433b60f22f720527b769 WatchSource:0}: Error finding container 02fedb74097c1a5909cfba09be115a171868bc1b5657433b60f22f720527b769: Status 404 returned error can't find the container with id 02fedb74097c1a5909cfba09be115a171868bc1b5657433b60f22f720527b769 Jul 02 15:27:06.806856 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:06.806829 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66f696bff6-4w865"] Jul 02 15:27:06.810635 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:27:06.810611 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8c4b8ae_77e7_4e4a_b15f_aa6753fb5ea1.slice/crio-e7b965d568005d5d5fe48ef5cce16d3e315ae363f1db109e1e09f2d4b2dd2cf4 WatchSource:0}: Error finding container e7b965d568005d5d5fe48ef5cce16d3e315ae363f1db109e1e09f2d4b2dd2cf4: Status 404 returned error can't find the container with id e7b965d568005d5d5fe48ef5cce16d3e315ae363f1db109e1e09f2d4b2dd2cf4 Jul 02 15:27:07.780079 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:07.780022 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cvjvk" event={"ID":"fabe6b91-ef60-4c9c-83b9-9d522cd51fcd","Type":"ContainerStarted","Data":"02fedb74097c1a5909cfba09be115a171868bc1b5657433b60f22f720527b769"} Jul 02 15:27:07.781506 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:07.781471 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66f696bff6-4w865" event={"ID":"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1","Type":"ContainerStarted","Data":"e7b965d568005d5d5fe48ef5cce16d3e315ae363f1db109e1e09f2d4b2dd2cf4"} Jul 02 15:27:07.783219 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:07.783185 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fdm7r" event={"ID":"e7056290-1f84-464b-9b53-afd3bc43bec1","Type":"ContainerStarted","Data":"5fea036a56b185e7c58409545584b152bcdf4812ba1e19dcc913c809f789a234"} Jul 02 15:27:07.785022 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:07.784975 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kc7bx" event={"ID":"19761344-4840-4e55-8c33-f01bb0bbb8c3","Type":"ContainerStarted","Data":"332086f4d069be6a6a8d465c1b2cf5de7eb8c6d0cab4874fe1eeb85fcf11c454"} Jul 02 15:27:07.802109 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:07.802049 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-kc7bx" podStartSLOduration=17.744318011 podStartE2EDuration="22.802026194s" totalImagesPullingTime="5.057708183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:26:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:07.800857973 +0000 UTC m=+72.873171686" watchObservedRunningTime="2026-07-02 15:27:07.802026194 +0000 UTC m=+72.874339907" Jul 02 15:27:08.129451 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:08.129413 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-pjjbc\" (UID: \"76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-pjjbc" Jul 02 15:27:08.132156 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:08.132119 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-pjjbc\" (UID: \"76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-pjjbc" Jul 02 15:27:08.230338 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:08.230299 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-metrics-certs\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:27:08.230548 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:08.230412 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ba6b11a-b88f-405b-a92c-99768fca5c8f-service-ca-bundle\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:27:08.231056 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:08.231030 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ba6b11a-b88f-405b-a92c-99768fca5c8f-service-ca-bundle\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:27:08.233112 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:08.233086 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ba6b11a-b88f-405b-a92c-99768fca5c8f-metrics-certs\") pod \"router-default-7d7c49774c-69ntk\" (UID: \"2ba6b11a-b88f-405b-a92c-99768fca5c8f\") " pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:27:08.322938 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:08.322899 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-k7b2s\"" Jul 02 15:27:08.331298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:08.331251 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-pjjbc" Jul 02 15:27:08.427588 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:08.427555 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2gqwl\"" Jul 02 15:27:08.439331 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:08.435095 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:27:08.556441 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:08.556376 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-pjjbc"] Jul 02 15:27:08.560026 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:27:08.559957 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76e0f058_c5ae_41dc_a19a_f4cbd77ba9f8.slice/crio-fa43416a3bb6772270fa37cce9716359f30cd00d0c50b8c51786a72c6f59a79e WatchSource:0}: Error finding container fa43416a3bb6772270fa37cce9716359f30cd00d0c50b8c51786a72c6f59a79e: Status 404 returned error can't find the container with id fa43416a3bb6772270fa37cce9716359f30cd00d0c50b8c51786a72c6f59a79e Jul 02 15:27:08.623116 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:08.623047 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7d7c49774c-69ntk"] Jul 02 15:27:08.625959 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:27:08.625926 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ba6b11a_b88f_405b_a92c_99768fca5c8f.slice/crio-d6d89e1ca384ea62776536caa623c45d6c5bc946c4f1b13a06fe527b672f7c32 WatchSource:0}: Error finding container d6d89e1ca384ea62776536caa623c45d6c5bc946c4f1b13a06fe527b672f7c32: Status 404 returned error can't find the container with id d6d89e1ca384ea62776536caa623c45d6c5bc946c4f1b13a06fe527b672f7c32 Jul 02 15:27:08.791598 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:08.791503 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fdm7r" event={"ID":"e7056290-1f84-464b-9b53-afd3bc43bec1","Type":"ContainerStarted","Data":"884005d9441d26611d0a470cf2e4528723d6f58e5aadffa26e04c126f1b6b45d"} Jul 02 15:27:08.793860 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:08.793805 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qs9xw" event={"ID":"43c7deaa-395b-4e22-81b8-b52ce0f359b9","Type":"ContainerStarted","Data":"13ee4575582a94b86fa17934762b21c76c43105245fd777b3ed65fba0bef4dd8"} Jul 02 15:27:08.795446 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:08.795417 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-pjjbc" event={"ID":"76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8","Type":"ContainerStarted","Data":"fa43416a3bb6772270fa37cce9716359f30cd00d0c50b8c51786a72c6f59a79e"} Jul 02 15:27:08.797145 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:08.797115 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7d7c49774c-69ntk" event={"ID":"2ba6b11a-b88f-405b-a92c-99768fca5c8f","Type":"ContainerStarted","Data":"0b215e1c0c4500f86b29346a579febd813cd7ad34932c2529221907a85dfafc6"} Jul 02 15:27:08.797279 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:08.797164 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7d7c49774c-69ntk" event={"ID":"2ba6b11a-b88f-405b-a92c-99768fca5c8f","Type":"ContainerStarted","Data":"d6d89e1ca384ea62776536caa623c45d6c5bc946c4f1b13a06fe527b672f7c32"} Jul 02 15:27:08.799157 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:08.799132 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-khjtk" event={"ID":"af82554e-e11c-4678-80d1-1872fa59260a","Type":"ContainerStarted","Data":"c084e5d7cfd8b79c8a1ac248e679903d88deeae40b6d5f248f6844d8213117ad"} Jul 02 15:27:08.801172 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:08.801134 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66f696bff6-4w865" event={"ID":"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1","Type":"ContainerStarted","Data":"5688dccf208006f4eee35bcddcc5a388dfa52eb31bebf688c873523ed573a3e8"} Jul 02 15:27:08.806076 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:08.806025 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fdm7r" podStartSLOduration=67.812989331 podStartE2EDuration="1m12.805981686s" totalImagesPullingTime="4.992992355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:08.805520785 +0000 UTC m=+73.877834498" watchObservedRunningTime="2026-07-02 15:27:08.805981686 +0000 UTC m=+73.878295403" Jul 02 15:27:08.825153 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:08.825088 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-66f696bff6-4w865" podStartSLOduration=72.825070956 podStartE2EDuration="1m12.825070956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:25:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:08.82345418 +0000 UTC m=+73.895767893" watchObservedRunningTime="2026-07-02 15:27:08.825070956 +0000 UTC m=+73.897384668" Jul 02 15:27:08.844418 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:08.844353 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7d7c49774c-69ntk" podStartSLOduration=32.844336444 podStartE2EDuration="32.844336444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:26:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:08.842648479 +0000 UTC m=+73.914962216" watchObservedRunningTime="2026-07-02 15:27:08.844336444 +0000 UTC m=+73.916650155" Jul 02 15:27:08.864595 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:08.863750 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qs9xw" podStartSLOduration=66.020307417 podStartE2EDuration="1m12.863729157s" totalImagesPullingTime="6.84342174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:08.862962102 +0000 UTC m=+73.935275817" watchObservedRunningTime="2026-07-02 15:27:08.863729157 +0000 UTC m=+73.936042872" Jul 02 15:27:09.436132 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:09.436069 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:27:09.439301 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:09.439273 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:27:09.808315 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:09.808224 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-khjtk" event={"ID":"af82554e-e11c-4678-80d1-1872fa59260a","Type":"ContainerStarted","Data":"5c759881735158d4621c1b9062085c05d339ccd6bcd4fbbfb9c0d5ca16c0f11f"} Jul 02 15:27:09.808890 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:09.808859 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:27:09.809008 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:09.808902 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:27:09.809872 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:09.809852 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7d7c49774c-69ntk" Jul 02 15:27:10.815887 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:10.815144 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-pjjbc" event={"ID":"76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8","Type":"ContainerStarted","Data":"3066c968465be9a11e2bff782ddb64ddbcb0a20d8b665aaa0457e5ac19e22c0e"} Jul 02 15:27:10.818526 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:10.818491 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cvjvk" event={"ID":"fabe6b91-ef60-4c9c-83b9-9d522cd51fcd","Type":"ContainerStarted","Data":"bfbe19eb05734bfbc7d5ddd042288d7f59b9a9b0f5f8f4ce726aa3cbfa98baca"} Jul 02 15:27:10.922024 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:10.921567 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-pjjbc" podStartSLOduration=32.835924763 podStartE2EDuration="34.921543097s" totalImagesPullingTime="2.085618334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:26:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:10.858813798 +0000 UTC m=+75.931127534" watchObservedRunningTime="2026-07-02 15:27:10.921543097 +0000 UTC m=+75.993856812" Jul 02 15:27:10.923873 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:10.922557 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f8cfcd8d-n72tl"] Jul 02 15:27:10.926032 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:10.925967 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-bf67bfdd7-dkd67"] Jul 02 15:27:10.926152 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:10.926093 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f8cfcd8d-n72tl" Jul 02 15:27:10.929598 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:10.929405 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 02 15:27:10.930308 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:10.929825 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v"] Jul 02 15:27:10.930308 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:10.930171 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bf67bfdd7-dkd67" Jul 02 15:27:10.933972 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:10.933416 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v" Jul 02 15:27:10.934472 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:10.934450 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 02 15:27:10.937171 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:10.936616 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 02 15:27:10.937171 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:10.936639 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-ct6h7\"" Jul 02 15:27:10.937171 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:10.936908 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 02 15:27:10.937171 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:10.936974 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 02 15:27:10.937671 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:10.937649 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 02 15:27:10.954901 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:10.954180 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 02 15:27:10.954901 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:10.954372 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 02 15:27:10.954901 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:10.954455 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 02 15:27:10.959263 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:10.959236 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f8cfcd8d-n72tl"] Jul 02 15:27:10.960807 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:10.960758 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-bf67bfdd7-dkd67"] Jul 02 15:27:10.965312 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:10.965292 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v"] Jul 02 15:27:11.011191 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.011157 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5499b6fb8f-z6f4q"] Jul 02 15:27:11.014584 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.014555 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-z6f4q" Jul 02 15:27:11.018092 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.018044 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-46dsk\"" Jul 02 15:27:11.018296 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.018279 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 15:27:11.020095 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.020073 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 15:27:11.030843 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.030774 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-z6f4q"] Jul 02 15:27:11.056983 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.056936 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/051120b9-b0ef-4b44-9c04-abd842b71dfc-klusterlet-config\") pod \"klusterlet-addon-workmgr-bf67bfdd7-dkd67\" (UID: \"051120b9-b0ef-4b44-9c04-abd842b71dfc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bf67bfdd7-dkd67" Jul 02 15:27:11.057248 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.057227 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3466dcd6-9fbb-47aa-b069-3287fabfdd92-additional-service-ca\") pod \"cluster-proxy-proxy-agent-89b66f545-sbt7v\" (UID: \"3466dcd6-9fbb-47aa-b069-3287fabfdd92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v" Jul 02 15:27:11.057393 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.057380 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkr8n\" (UniqueName: \"kubernetes.io/projected/130abe89-26dd-4127-b5e1-3fc7ea58c57e-kube-api-access-gkr8n\") pod \"managed-serviceaccount-addon-agent-68f8cfcd8d-n72tl\" (UID: \"130abe89-26dd-4127-b5e1-3fc7ea58c57e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f8cfcd8d-n72tl" Jul 02 15:27:11.057545 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.057532 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3466dcd6-9fbb-47aa-b069-3287fabfdd92-ca\") pod \"cluster-proxy-proxy-agent-89b66f545-sbt7v\" (UID: \"3466dcd6-9fbb-47aa-b069-3287fabfdd92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v" Jul 02 15:27:11.057691 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.057668 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtlg5\" (UniqueName: \"kubernetes.io/projected/051120b9-b0ef-4b44-9c04-abd842b71dfc-kube-api-access-rtlg5\") pod \"klusterlet-addon-workmgr-bf67bfdd7-dkd67\" (UID: \"051120b9-b0ef-4b44-9c04-abd842b71dfc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bf67bfdd7-dkd67" Jul 02 15:27:11.057819 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.057708 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3466dcd6-9fbb-47aa-b069-3287fabfdd92-hub\") pod \"cluster-proxy-proxy-agent-89b66f545-sbt7v\" (UID: \"3466dcd6-9fbb-47aa-b069-3287fabfdd92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v" Jul 02 15:27:11.057819 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.057753 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3466dcd6-9fbb-47aa-b069-3287fabfdd92-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-89b66f545-sbt7v\" (UID: \"3466dcd6-9fbb-47aa-b069-3287fabfdd92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v" Jul 02 15:27:11.057819 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.057778 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/051120b9-b0ef-4b44-9c04-abd842b71dfc-tmp\") pod \"klusterlet-addon-workmgr-bf67bfdd7-dkd67\" (UID: \"051120b9-b0ef-4b44-9c04-abd842b71dfc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bf67bfdd7-dkd67" Jul 02 15:27:11.057819 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.057810 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/130abe89-26dd-4127-b5e1-3fc7ea58c57e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68f8cfcd8d-n72tl\" (UID: \"130abe89-26dd-4127-b5e1-3fc7ea58c57e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f8cfcd8d-n72tl" Jul 02 15:27:11.058074 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.057881 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3466dcd6-9fbb-47aa-b069-3287fabfdd92-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-89b66f545-sbt7v\" (UID: \"3466dcd6-9fbb-47aa-b069-3287fabfdd92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v" Jul 02 15:27:11.058074 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.057935 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhdrx\" (UniqueName: \"kubernetes.io/projected/3466dcd6-9fbb-47aa-b069-3287fabfdd92-kube-api-access-hhdrx\") pod \"cluster-proxy-proxy-agent-89b66f545-sbt7v\" (UID: \"3466dcd6-9fbb-47aa-b069-3287fabfdd92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v" Jul 02 15:27:11.158638 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.158546 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3466dcd6-9fbb-47aa-b069-3287fabfdd92-additional-service-ca\") pod \"cluster-proxy-proxy-agent-89b66f545-sbt7v\" (UID: \"3466dcd6-9fbb-47aa-b069-3287fabfdd92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v" Jul 02 15:27:11.158638 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.158602 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkr8n\" (UniqueName: \"kubernetes.io/projected/130abe89-26dd-4127-b5e1-3fc7ea58c57e-kube-api-access-gkr8n\") pod \"managed-serviceaccount-addon-agent-68f8cfcd8d-n72tl\" (UID: \"130abe89-26dd-4127-b5e1-3fc7ea58c57e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f8cfcd8d-n72tl" Jul 02 15:27:11.158638 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.158622 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3466dcd6-9fbb-47aa-b069-3287fabfdd92-ca\") pod \"cluster-proxy-proxy-agent-89b66f545-sbt7v\" (UID: \"3466dcd6-9fbb-47aa-b069-3287fabfdd92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v" Jul 02 15:27:11.158920 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.158642 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtlg5\" (UniqueName: \"kubernetes.io/projected/051120b9-b0ef-4b44-9c04-abd842b71dfc-kube-api-access-rtlg5\") pod \"klusterlet-addon-workmgr-bf67bfdd7-dkd67\" (UID: \"051120b9-b0ef-4b44-9c04-abd842b71dfc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bf67bfdd7-dkd67" Jul 02 15:27:11.158920 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.158675 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3466dcd6-9fbb-47aa-b069-3287fabfdd92-hub\") pod \"cluster-proxy-proxy-agent-89b66f545-sbt7v\" (UID: \"3466dcd6-9fbb-47aa-b069-3287fabfdd92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v" Jul 02 15:27:11.158920 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.158717 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3466dcd6-9fbb-47aa-b069-3287fabfdd92-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-89b66f545-sbt7v\" (UID: \"3466dcd6-9fbb-47aa-b069-3287fabfdd92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v" Jul 02 15:27:11.158920 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.158737 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/051120b9-b0ef-4b44-9c04-abd842b71dfc-tmp\") pod \"klusterlet-addon-workmgr-bf67bfdd7-dkd67\" (UID: \"051120b9-b0ef-4b44-9c04-abd842b71dfc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bf67bfdd7-dkd67" Jul 02 15:27:11.158920 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.158767 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brmgd\" (UniqueName: \"kubernetes.io/projected/c2c1c5db-355a-4fa4-9a58-b915d32be6b6-kube-api-access-brmgd\") pod \"downloads-5499b6fb8f-z6f4q\" (UID: \"c2c1c5db-355a-4fa4-9a58-b915d32be6b6\") " pod="openshift-console/downloads-5499b6fb8f-z6f4q" Jul 02 15:27:11.158920 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.158799 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/130abe89-26dd-4127-b5e1-3fc7ea58c57e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68f8cfcd8d-n72tl\" (UID: \"130abe89-26dd-4127-b5e1-3fc7ea58c57e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f8cfcd8d-n72tl" Jul 02 15:27:11.158920 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.158838 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3466dcd6-9fbb-47aa-b069-3287fabfdd92-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-89b66f545-sbt7v\" (UID: \"3466dcd6-9fbb-47aa-b069-3287fabfdd92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v" Jul 02 15:27:11.158920 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.158872 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhdrx\" (UniqueName: \"kubernetes.io/projected/3466dcd6-9fbb-47aa-b069-3287fabfdd92-kube-api-access-hhdrx\") pod \"cluster-proxy-proxy-agent-89b66f545-sbt7v\" (UID: \"3466dcd6-9fbb-47aa-b069-3287fabfdd92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v" Jul 02 15:27:11.158920 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.158918 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/051120b9-b0ef-4b44-9c04-abd842b71dfc-klusterlet-config\") pod \"klusterlet-addon-workmgr-bf67bfdd7-dkd67\" (UID: \"051120b9-b0ef-4b44-9c04-abd842b71dfc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bf67bfdd7-dkd67" Jul 02 15:27:11.159785 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.159609 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/051120b9-b0ef-4b44-9c04-abd842b71dfc-tmp\") pod \"klusterlet-addon-workmgr-bf67bfdd7-dkd67\" (UID: \"051120b9-b0ef-4b44-9c04-abd842b71dfc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bf67bfdd7-dkd67" Jul 02 15:27:11.160152 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.160076 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3466dcd6-9fbb-47aa-b069-3287fabfdd92-additional-service-ca\") pod \"cluster-proxy-proxy-agent-89b66f545-sbt7v\" (UID: \"3466dcd6-9fbb-47aa-b069-3287fabfdd92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v" Jul 02 15:27:11.161762 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.161733 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3466dcd6-9fbb-47aa-b069-3287fabfdd92-ca\") pod \"cluster-proxy-proxy-agent-89b66f545-sbt7v\" (UID: \"3466dcd6-9fbb-47aa-b069-3287fabfdd92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v" Jul 02 15:27:11.162496 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.162471 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3466dcd6-9fbb-47aa-b069-3287fabfdd92-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-89b66f545-sbt7v\" (UID: \"3466dcd6-9fbb-47aa-b069-3287fabfdd92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v" Jul 02 15:27:11.162585 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.162477 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3466dcd6-9fbb-47aa-b069-3287fabfdd92-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-89b66f545-sbt7v\" (UID: \"3466dcd6-9fbb-47aa-b069-3287fabfdd92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v" Jul 02 15:27:11.163047 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.163006 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/051120b9-b0ef-4b44-9c04-abd842b71dfc-klusterlet-config\") pod \"klusterlet-addon-workmgr-bf67bfdd7-dkd67\" (UID: \"051120b9-b0ef-4b44-9c04-abd842b71dfc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bf67bfdd7-dkd67" Jul 02 15:27:11.163869 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.163849 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/130abe89-26dd-4127-b5e1-3fc7ea58c57e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68f8cfcd8d-n72tl\" (UID: \"130abe89-26dd-4127-b5e1-3fc7ea58c57e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f8cfcd8d-n72tl" Jul 02 15:27:11.164334 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.164312 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3466dcd6-9fbb-47aa-b069-3287fabfdd92-hub\") pod \"cluster-proxy-proxy-agent-89b66f545-sbt7v\" (UID: \"3466dcd6-9fbb-47aa-b069-3287fabfdd92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v" Jul 02 15:27:11.170820 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.170755 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkr8n\" (UniqueName: \"kubernetes.io/projected/130abe89-26dd-4127-b5e1-3fc7ea58c57e-kube-api-access-gkr8n\") pod \"managed-serviceaccount-addon-agent-68f8cfcd8d-n72tl\" (UID: \"130abe89-26dd-4127-b5e1-3fc7ea58c57e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f8cfcd8d-n72tl" Jul 02 15:27:11.171678 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.171642 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtlg5\" (UniqueName: \"kubernetes.io/projected/051120b9-b0ef-4b44-9c04-abd842b71dfc-kube-api-access-rtlg5\") pod \"klusterlet-addon-workmgr-bf67bfdd7-dkd67\" (UID: \"051120b9-b0ef-4b44-9c04-abd842b71dfc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bf67bfdd7-dkd67" Jul 02 15:27:11.171767 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.171732 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhdrx\" (UniqueName: \"kubernetes.io/projected/3466dcd6-9fbb-47aa-b069-3287fabfdd92-kube-api-access-hhdrx\") pod \"cluster-proxy-proxy-agent-89b66f545-sbt7v\" (UID: \"3466dcd6-9fbb-47aa-b069-3287fabfdd92\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v" Jul 02 15:27:11.247948 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.247912 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f8cfcd8d-n72tl" Jul 02 15:27:11.259603 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.259565 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brmgd\" (UniqueName: \"kubernetes.io/projected/c2c1c5db-355a-4fa4-9a58-b915d32be6b6-kube-api-access-brmgd\") pod \"downloads-5499b6fb8f-z6f4q\" (UID: \"c2c1c5db-355a-4fa4-9a58-b915d32be6b6\") " pod="openshift-console/downloads-5499b6fb8f-z6f4q" Jul 02 15:27:11.262369 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.262347 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bf67bfdd7-dkd67" Jul 02 15:27:11.270981 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.270955 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v" Jul 02 15:27:11.273554 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.273496 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brmgd\" (UniqueName: \"kubernetes.io/projected/c2c1c5db-355a-4fa4-9a58-b915d32be6b6-kube-api-access-brmgd\") pod \"downloads-5499b6fb8f-z6f4q\" (UID: \"c2c1c5db-355a-4fa4-9a58-b915d32be6b6\") " pod="openshift-console/downloads-5499b6fb8f-z6f4q" Jul 02 15:27:11.336838 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.336593 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-z6f4q" Jul 02 15:27:11.378042 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.375521 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-w47ph"] Jul 02 15:27:11.407325 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.406266 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-w47ph"] Jul 02 15:27:11.407325 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.406391 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-w47ph" Jul 02 15:27:11.419028 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.418190 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-wgbx8\"" Jul 02 15:27:11.419028 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.418432 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 02 15:27:11.477374 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.477188 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f8cfcd8d-n72tl"] Jul 02 15:27:11.522947 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.522903 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v"] Jul 02 15:27:11.525647 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:27:11.525612 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3466dcd6_9fbb_47aa_b069_3287fabfdd92.slice/crio-e4379b94c1461a45316382825e51f1c4efd70562b3437c83845f2f431a667581 WatchSource:0}: Error finding container e4379b94c1461a45316382825e51f1c4efd70562b3437c83845f2f431a667581: Status 404 returned error can't find the container with id e4379b94c1461a45316382825e51f1c4efd70562b3437c83845f2f431a667581 Jul 02 15:27:11.536780 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.536755 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-bf67bfdd7-dkd67"] Jul 02 15:27:11.540009 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:27:11.539957 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod051120b9_b0ef_4b44_9c04_abd842b71dfc.slice/crio-4dee6eebb800e1d7b5ec3f461ec7568fe1d325b6d5b08ceff59ea1a0ccbd63f1 WatchSource:0}: Error finding container 4dee6eebb800e1d7b5ec3f461ec7568fe1d325b6d5b08ceff59ea1a0ccbd63f1: Status 404 returned error can't find the container with id 4dee6eebb800e1d7b5ec3f461ec7568fe1d325b6d5b08ceff59ea1a0ccbd63f1 Jul 02 15:27:11.565136 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.565086 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d9d4c6a3-aa74-44bb-877f-b2c4d19a6923-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-w47ph\" (UID: \"d9d4c6a3-aa74-44bb-877f-b2c4d19a6923\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-w47ph" Jul 02 15:27:11.596347 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.596301 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-z6f4q"] Jul 02 15:27:11.666701 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.666600 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d9d4c6a3-aa74-44bb-877f-b2c4d19a6923-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-w47ph\" (UID: \"d9d4c6a3-aa74-44bb-877f-b2c4d19a6923\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-w47ph" Jul 02 15:27:11.666951 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:27:11.666927 2573 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 02 15:27:11.667115 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:27:11.667023 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9d4c6a3-aa74-44bb-877f-b2c4d19a6923-tls-certificates podName:d9d4c6a3-aa74-44bb-877f-b2c4d19a6923 nodeName:}" failed. No retries permitted until 2026-07-02 15:27:12.166979923 +0000 UTC m=+77.239293616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/d9d4c6a3-aa74-44bb-877f-b2c4d19a6923-tls-certificates") pod "prometheus-operator-admission-webhook-7ddc8784d4-w47ph" (UID: "d9d4c6a3-aa74-44bb-877f-b2c4d19a6923") : secret "prometheus-operator-admission-webhook-tls" not found Jul 02 15:27:11.826375 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.826274 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cvjvk" event={"ID":"fabe6b91-ef60-4c9c-83b9-9d522cd51fcd","Type":"ContainerStarted","Data":"86009fab9b16a07fcb13e9f0847e0887e965668ae0387e325cf3eaa49dea7541"} Jul 02 15:27:11.826860 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.826465 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cvjvk" Jul 02 15:27:11.827967 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.827936 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bf67bfdd7-dkd67" event={"ID":"051120b9-b0ef-4b44-9c04-abd842b71dfc","Type":"ContainerStarted","Data":"4dee6eebb800e1d7b5ec3f461ec7568fe1d325b6d5b08ceff59ea1a0ccbd63f1"} Jul 02 15:27:11.829375 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.829337 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v" event={"ID":"3466dcd6-9fbb-47aa-b069-3287fabfdd92","Type":"ContainerStarted","Data":"e4379b94c1461a45316382825e51f1c4efd70562b3437c83845f2f431a667581"} Jul 02 15:27:11.830847 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.830819 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f8cfcd8d-n72tl" event={"ID":"130abe89-26dd-4127-b5e1-3fc7ea58c57e","Type":"ContainerStarted","Data":"f8453344b8b493423292710239cffd9c69fda2e033a4ec410ef7a08b80b5527f"} Jul 02 15:27:11.832178 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.832151 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-z6f4q" event={"ID":"c2c1c5db-355a-4fa4-9a58-b915d32be6b6","Type":"ContainerStarted","Data":"460b3f45ec56c31f47749c883f2c138a12bdaeadeebdbad948d3f6bcd900f5e8"} Jul 02 15:27:11.847214 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:11.847159 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cvjvk" podStartSLOduration=36.996666438 podStartE2EDuration="40.84713826s" totalImagesPullingTime="3.850471822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:11.845488104 +0000 UTC m=+76.917801844" watchObservedRunningTime="2026-07-02 15:27:11.84713826 +0000 UTC m=+76.919451973" Jul 02 15:27:12.173152 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:12.173114 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d9d4c6a3-aa74-44bb-877f-b2c4d19a6923-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-w47ph\" (UID: \"d9d4c6a3-aa74-44bb-877f-b2c4d19a6923\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-w47ph" Jul 02 15:27:12.176251 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:12.176220 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d9d4c6a3-aa74-44bb-877f-b2c4d19a6923-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-w47ph\" (UID: \"d9d4c6a3-aa74-44bb-877f-b2c4d19a6923\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-w47ph" Jul 02 15:27:12.334955 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:12.334824 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-w47ph" Jul 02 15:27:12.756946 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:12.756860 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-g5scp" Jul 02 15:27:12.761817 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:12.761785 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7fdbdf9c99-g5scp" Jul 02 15:27:13.375800 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:13.375766 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-w47ph"] Jul 02 15:27:13.383039 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:27:13.382976 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9d4c6a3_aa74_44bb_877f_b2c4d19a6923.slice/crio-7e3c893e9bd01fa45012cb515a574757671dc2768924575ed743cd047d0adbd8 WatchSource:0}: Error finding container 7e3c893e9bd01fa45012cb515a574757671dc2768924575ed743cd047d0adbd8: Status 404 returned error can't find the container with id 7e3c893e9bd01fa45012cb515a574757671dc2768924575ed743cd047d0adbd8 Jul 02 15:27:13.853094 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:13.853053 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-khjtk" event={"ID":"af82554e-e11c-4678-80d1-1872fa59260a","Type":"ContainerStarted","Data":"96ba76a0d66725563412697455b423d00c08542aa5ffa2742dee273089737ad2"} Jul 02 15:27:13.861678 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:13.861573 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-w47ph" event={"ID":"d9d4c6a3-aa74-44bb-877f-b2c4d19a6923","Type":"ContainerStarted","Data":"7e3c893e9bd01fa45012cb515a574757671dc2768924575ed743cd047d0adbd8"} Jul 02 15:27:13.873873 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:13.872019 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-khjtk" podStartSLOduration=17.270943643 podStartE2EDuration="28.87198099s" totalImagesPullingTime="11.601037347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:26:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:13.871014077 +0000 UTC m=+78.943327812" watchObservedRunningTime="2026-07-02 15:27:13.87198099 +0000 UTC m=+78.944294703" Jul 02 15:27:20.904387 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:20.904355 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bf67bfdd7-dkd67" event={"ID":"051120b9-b0ef-4b44-9c04-abd842b71dfc","Type":"ContainerStarted","Data":"630288efeea6b8ea79087f5bb9c10539650f4f2b35fbb2e09c2b28a19b5141eb"} Jul 02 15:27:20.904826 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:20.904532 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bf67bfdd7-dkd67" Jul 02 15:27:20.906263 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:20.906228 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-w47ph" event={"ID":"d9d4c6a3-aa74-44bb-877f-b2c4d19a6923","Type":"ContainerStarted","Data":"3b8aca018b1a4982a9e0941ce242c9108e7f617d26d6acc5dd1f2f6df76cac91"} Jul 02 15:27:20.906408 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:20.906281 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-w47ph" Jul 02 15:27:20.906725 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:20.906699 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bf67bfdd7-dkd67" Jul 02 15:27:20.909314 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:20.909281 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v" event={"ID":"3466dcd6-9fbb-47aa-b069-3287fabfdd92","Type":"ContainerStarted","Data":"1293de5fea74d59f645796b9902c0f159321bcbc6167bbe2f8c3e8514c079dc8"} Jul 02 15:27:20.909434 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:20.909326 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v" event={"ID":"3466dcd6-9fbb-47aa-b069-3287fabfdd92","Type":"ContainerStarted","Data":"7f690f790a48e331235770e62b62754ed14f779012379799c96e15c7ea3e8224"} Jul 02 15:27:20.909434 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:20.909345 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v" event={"ID":"3466dcd6-9fbb-47aa-b069-3287fabfdd92","Type":"ContainerStarted","Data":"002110c03ac72a5f359ba801533bb5d5c670b3f7292e49167c3814724ad6f292"} Jul 02 15:27:20.911436 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:20.911409 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-w47ph" Jul 02 15:27:20.911699 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:20.911678 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f8cfcd8d-n72tl" event={"ID":"130abe89-26dd-4127-b5e1-3fc7ea58c57e","Type":"ContainerStarted","Data":"d928d7ccbe87826f7b3319e6f52e421e3b9143be3dd0d383b08e45fda9522261"} Jul 02 15:27:20.922082 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:20.922025 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bf67bfdd7-dkd67" podStartSLOduration=2.3155270740000002 podStartE2EDuration="10.922004843s" totalImagesPullingTime="8.606477769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:27:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:20.920039944 +0000 UTC m=+85.992353657" watchObservedRunningTime="2026-07-02 15:27:20.922004843 +0000 UTC m=+85.994318553" Jul 02 15:27:20.934718 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:20.934665 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68f8cfcd8d-n72tl" podStartSLOduration=2.294629653 podStartE2EDuration="10.934649797s" totalImagesPullingTime="8.640020144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:27:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:20.933548506 +0000 UTC m=+86.005862216" watchObservedRunningTime="2026-07-02 15:27:20.934649797 +0000 UTC m=+86.006963508" Jul 02 15:27:20.951644 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:20.951589 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-89b66f545-sbt7v" podStartSLOduration=2.32961338 podStartE2EDuration="10.95157033s" totalImagesPullingTime="8.62195695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:27:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:20.951063761 +0000 UTC m=+86.023377474" watchObservedRunningTime="2026-07-02 15:27:20.95157033 +0000 UTC m=+86.023884043" Jul 02 15:27:20.966364 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:20.966318 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-w47ph" podStartSLOduration=3.224092727 podStartE2EDuration="9.966302533s" totalImagesPullingTime="6.742209806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:27:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:20.965425936 +0000 UTC m=+86.037739666" watchObservedRunningTime="2026-07-02 15:27:20.966302533 +0000 UTC m=+86.038616245" Jul 02 15:27:21.839762 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:21.839728 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cvjvk" Jul 02 15:27:23.454036 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:23.453969 2573 patch_prober.go:28] interesting pod/image-registry-66f696bff6-4w865 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 02 15:27:23.454507 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:23.454060 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-66f696bff6-4w865" podUID="e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 15:27:29.851325 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:29.851285 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hdl46"] Jul 02 15:27:30.033840 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.033096 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.041968 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.040500 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 15:27:30.041968 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.040747 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 15:27:30.041968 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.040930 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 15:27:30.041968 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.041190 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 15:27:30.041968 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.041436 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7gr7j\"" Jul 02 15:27:30.124127 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.124035 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2c88d39-d329-4a8d-8901-fbe8c032a976-metrics-client-ca\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.124127 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.124097 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a2c88d39-d329-4a8d-8901-fbe8c032a976-node-exporter-tls\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.124346 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.124127 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a2c88d39-d329-4a8d-8901-fbe8c032a976-node-exporter-accelerators-collector-config\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.124346 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.124170 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2c88d39-d329-4a8d-8901-fbe8c032a976-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.124346 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.124206 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2c88d39-d329-4a8d-8901-fbe8c032a976-sys\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.124346 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.124229 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6pkk\" (UniqueName: \"kubernetes.io/projected/a2c88d39-d329-4a8d-8901-fbe8c032a976-kube-api-access-k6pkk\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.124346 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.124272 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a2c88d39-d329-4a8d-8901-fbe8c032a976-node-exporter-textfile\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.124346 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.124307 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a2c88d39-d329-4a8d-8901-fbe8c032a976-root\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.124346 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.124332 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a2c88d39-d329-4a8d-8901-fbe8c032a976-node-exporter-wtmp\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.226420 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.225544 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2c88d39-d329-4a8d-8901-fbe8c032a976-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.226420 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.225607 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2c88d39-d329-4a8d-8901-fbe8c032a976-sys\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.226420 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.225634 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6pkk\" (UniqueName: \"kubernetes.io/projected/a2c88d39-d329-4a8d-8901-fbe8c032a976-kube-api-access-k6pkk\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.226420 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.225680 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a2c88d39-d329-4a8d-8901-fbe8c032a976-node-exporter-textfile\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.226420 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.225708 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2c88d39-d329-4a8d-8901-fbe8c032a976-sys\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.226420 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.225715 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a2c88d39-d329-4a8d-8901-fbe8c032a976-root\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.226420 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.225756 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a2c88d39-d329-4a8d-8901-fbe8c032a976-root\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.226420 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.225757 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a2c88d39-d329-4a8d-8901-fbe8c032a976-node-exporter-wtmp\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.226420 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.225879 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a2c88d39-d329-4a8d-8901-fbe8c032a976-node-exporter-wtmp\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.226420 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.225981 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2c88d39-d329-4a8d-8901-fbe8c032a976-metrics-client-ca\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.226420 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.226057 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a2c88d39-d329-4a8d-8901-fbe8c032a976-node-exporter-tls\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.226420 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:27:30.226137 2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 02 15:27:30.226420 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.226171 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a2c88d39-d329-4a8d-8901-fbe8c032a976-node-exporter-accelerators-collector-config\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.226420 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:27:30.226196 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2c88d39-d329-4a8d-8901-fbe8c032a976-node-exporter-tls podName:a2c88d39-d329-4a8d-8901-fbe8c032a976 nodeName:}" failed. No retries permitted until 2026-07-02 15:27:30.726174676 +0000 UTC m=+95.798488366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a2c88d39-d329-4a8d-8901-fbe8c032a976-node-exporter-tls") pod "node-exporter-hdl46" (UID: "a2c88d39-d329-4a8d-8901-fbe8c032a976") : secret "node-exporter-tls" not found Jul 02 15:27:30.226420 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.226193 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a2c88d39-d329-4a8d-8901-fbe8c032a976-node-exporter-textfile\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.227495 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.226620 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2c88d39-d329-4a8d-8901-fbe8c032a976-metrics-client-ca\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.227495 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.226643 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a2c88d39-d329-4a8d-8901-fbe8c032a976-node-exporter-accelerators-collector-config\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.229118 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.229074 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2c88d39-d329-4a8d-8901-fbe8c032a976-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.238344 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.238299 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6pkk\" (UniqueName: \"kubernetes.io/projected/a2c88d39-d329-4a8d-8901-fbe8c032a976-kube-api-access-k6pkk\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.731779 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.731740 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a2c88d39-d329-4a8d-8901-fbe8c032a976-node-exporter-tls\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.734380 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.734349 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a2c88d39-d329-4a8d-8901-fbe8c032a976-node-exporter-tls\") pod \"node-exporter-hdl46\" (UID: \"a2c88d39-d329-4a8d-8901-fbe8c032a976\") " pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:30.824279 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.824246 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:27:30.954060 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:30.954025 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hdl46" Jul 02 15:27:31.007449 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:27:31.007416 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2c88d39_d329_4a8d_8901_fbe8c032a976.slice/crio-40ad637578a17b16e9033bf42bca1cb1480f02c74e354905d573cdfae64c1064 WatchSource:0}: Error finding container 40ad637578a17b16e9033bf42bca1cb1480f02c74e354905d573cdfae64c1064: Status 404 returned error can't find the container with id 40ad637578a17b16e9033bf42bca1cb1480f02c74e354905d573cdfae64c1064 Jul 02 15:27:31.970488 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:31.970443 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hdl46" event={"ID":"a2c88d39-d329-4a8d-8901-fbe8c032a976","Type":"ContainerStarted","Data":"40ad637578a17b16e9033bf42bca1cb1480f02c74e354905d573cdfae64c1064"} Jul 02 15:27:31.973818 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:31.972956 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-z6f4q" event={"ID":"c2c1c5db-355a-4fa4-9a58-b915d32be6b6","Type":"ContainerStarted","Data":"408101fa504155d8a0a9246b96b8d59072fd18d1c9d6f4ad8af85c1373ac3ff9"} Jul 02 15:27:31.974174 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:31.973864 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5499b6fb8f-z6f4q" Jul 02 15:27:31.986836 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:31.986797 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5499b6fb8f-z6f4q" Jul 02 15:27:31.994188 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:31.993965 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5499b6fb8f-z6f4q" podStartSLOduration=2.548288702 podStartE2EDuration="21.993942299s" totalImagesPullingTime="19.445653597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:27:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:31.991445399 +0000 UTC m=+97.063759112" watchObservedRunningTime="2026-07-02 15:27:31.993942299 +0000 UTC m=+97.066256016" Jul 02 15:27:32.760468 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:32.759828 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nb2v6" Jul 02 15:27:33.985282 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:33.985243 2573 generic.go:356] "Generic (PLEG): container finished" podID="a2c88d39-d329-4a8d-8901-fbe8c032a976" containerID="82205e76faf991f3707de7dc340534a3e468a9fa7f7b77ea2e11949fe6e5e13d" exitCode=0 Jul 02 15:27:33.985735 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:33.985329 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hdl46" event={"ID":"a2c88d39-d329-4a8d-8901-fbe8c032a976","Type":"ContainerDied","Data":"82205e76faf991f3707de7dc340534a3e468a9fa7f7b77ea2e11949fe6e5e13d"} Jul 02 15:27:34.993943 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:34.993862 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hdl46" event={"ID":"a2c88d39-d329-4a8d-8901-fbe8c032a976","Type":"ContainerStarted","Data":"401eccd33282c1e327e210942ecc15fd5f266b2ef8d68dec1bc07cfe332bf23a"} Jul 02 15:27:34.993943 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:34.993917 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hdl46" event={"ID":"a2c88d39-d329-4a8d-8901-fbe8c032a976","Type":"ContainerStarted","Data":"a413b7b91d51fe36d01ddc48537a90667b7811b04d60ebbf3ac387f24d98a641"} Jul 02 15:27:35.016054 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:35.015978 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hdl46" podStartSLOduration=4.017525092 podStartE2EDuration="6.015954174s" totalImagesPullingTime="1.900082133s" totalInitContainerRuntime="98.346949ms" isStatefulPod=true podCreationTimestamp="2026-07-02 15:27:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:27:35.013309396 +0000 UTC m=+100.085623110" watchObservedRunningTime="2026-07-02 15:27:35.015954174 +0000 UTC m=+100.088267885" Jul 02 15:27:39.072444 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:39.072406 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66f696bff6-4w865"] Jul 02 15:27:50.058445 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:50.058412 2573 generic.go:356] "Generic (PLEG): container finished" podID="8fded7d4-f80c-4108-b1bd-438c5607386d" containerID="c27855f3578184bb69a334b61535887498c6a3853a67a6f09676d15acc82a01b" exitCode=0 Jul 02 15:27:50.058846 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:50.058480 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-5hn5p" event={"ID":"8fded7d4-f80c-4108-b1bd-438c5607386d","Type":"ContainerDied","Data":"c27855f3578184bb69a334b61535887498c6a3853a67a6f09676d15acc82a01b"} Jul 02 15:27:50.058846 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:50.058805 2573 scope.go:117] "RemoveContainer" containerID="c27855f3578184bb69a334b61535887498c6a3853a67a6f09676d15acc82a01b" Jul 02 15:27:51.064730 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:27:51.064700 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-79964ff6f9-5hn5p" event={"ID":"8fded7d4-f80c-4108-b1bd-438c5607386d","Type":"ContainerStarted","Data":"672eae867e2e937ea0dec21ba9fa3749ba295edd278640c1b31187d51b3ea098"} Jul 02 15:28:00.105635 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:00.105599 2573 generic.go:356] "Generic (PLEG): container finished" podID="cd214bd3-835e-4a77-ad2c-f4a61e793bba" containerID="2f3e72d45d738cfe58395a80623803a67d84063eff84be258e7c929715fd81d1" exitCode=0 Jul 02 15:28:00.106073 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:00.105674 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-qcglg" event={"ID":"cd214bd3-835e-4a77-ad2c-f4a61e793bba","Type":"ContainerDied","Data":"2f3e72d45d738cfe58395a80623803a67d84063eff84be258e7c929715fd81d1"} Jul 02 15:28:00.106126 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:00.106080 2573 scope.go:117] "RemoveContainer" containerID="2f3e72d45d738cfe58395a80623803a67d84063eff84be258e7c929715fd81d1" Jul 02 15:28:01.111982 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:01.111942 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-qcglg" event={"ID":"cd214bd3-835e-4a77-ad2c-f4a61e793bba","Type":"ContainerStarted","Data":"a4fb1b31f8575691dc58b64e7bfbe2b2eab5cea091e372bd16302dd959a651c9"} Jul 02 15:28:04.102940 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:04.102899 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-66f696bff6-4w865" podUID="e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1" containerName="registry" containerID="cri-o://5688dccf208006f4eee35bcddcc5a388dfa52eb31bebf688c873523ed573a3e8" gracePeriod=30 Jul 02 15:28:04.375622 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:04.375542 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:28:04.542144 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:04.542103 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-tls\") pod \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " Jul 02 15:28:04.542144 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:04.542152 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-ca-trust-extracted\") pod \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " Jul 02 15:28:04.542417 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:04.542213 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-certificates\") pod \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " Jul 02 15:28:04.542417 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:04.542254 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-trusted-ca\") pod \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " Jul 02 15:28:04.542417 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:04.542285 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-image-registry-private-configuration\") pod \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " Jul 02 15:28:04.542417 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:04.542315 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4s9st\" (UniqueName: \"kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-kube-api-access-4s9st\") pod \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " Jul 02 15:28:04.542417 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:04.542350 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-bound-sa-token\") pod \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " Jul 02 15:28:04.542417 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:04.542376 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-installation-pull-secrets\") pod \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\" (UID: \"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1\") " Jul 02 15:28:04.542715 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:04.542688 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1" (UID: "e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:28:04.542715 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:04.542703 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1" (UID: "e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:28:04.544812 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:04.544776 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1" (UID: "e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:28:04.544940 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:04.544839 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1" (UID: "e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:28:04.544940 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:04.544869 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1" (UID: "e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:28:04.545104 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:04.545048 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-kube-api-access-4s9st" (OuterVolumeSpecName: "kube-api-access-4s9st") pod "e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1" (UID: "e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1"). InnerVolumeSpecName "kube-api-access-4s9st". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:28:04.545167 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:04.545140 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1" (UID: "e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:28:04.551421 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:04.551393 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1" (UID: "e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:28:04.643868 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:04.643780 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-trusted-ca\") on node \"ip-10-0-138-41.ec2.internal\" DevicePath \"\"" Jul 02 15:28:04.643868 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:04.643818 2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-image-registry-private-configuration\") on node \"ip-10-0-138-41.ec2.internal\" DevicePath \"\"" Jul 02 15:28:04.643868 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:04.643830 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4s9st\" (UniqueName: \"kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-kube-api-access-4s9st\") on node \"ip-10-0-138-41.ec2.internal\" DevicePath \"\"" Jul 02 15:28:04.643868 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:04.643840 2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-bound-sa-token\") on node \"ip-10-0-138-41.ec2.internal\" DevicePath \"\"" Jul 02 15:28:04.643868 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:04.643849 2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-installation-pull-secrets\") on node \"ip-10-0-138-41.ec2.internal\" DevicePath \"\"" Jul 02 15:28:04.643868 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:04.643857 2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-tls\") on node \"ip-10-0-138-41.ec2.internal\" DevicePath \"\"" Jul 02 15:28:04.643868 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:04.643867 2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-ca-trust-extracted\") on node \"ip-10-0-138-41.ec2.internal\" DevicePath \"\"" Jul 02 15:28:04.643868 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:04.643875 2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1-registry-certificates\") on node \"ip-10-0-138-41.ec2.internal\" DevicePath \"\"" Jul 02 15:28:05.129542 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:05.129509 2573 generic.go:356] "Generic (PLEG): container finished" podID="e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1" containerID="5688dccf208006f4eee35bcddcc5a388dfa52eb31bebf688c873523ed573a3e8" exitCode=0 Jul 02 15:28:05.129940 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:05.129552 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66f696bff6-4w865" Jul 02 15:28:05.129940 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:05.129598 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66f696bff6-4w865" event={"ID":"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1","Type":"ContainerDied","Data":"5688dccf208006f4eee35bcddcc5a388dfa52eb31bebf688c873523ed573a3e8"} Jul 02 15:28:05.129940 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:05.129647 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66f696bff6-4w865" event={"ID":"e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1","Type":"ContainerDied","Data":"e7b965d568005d5d5fe48ef5cce16d3e315ae363f1db109e1e09f2d4b2dd2cf4"} Jul 02 15:28:05.129940 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:05.129667 2573 scope.go:117] "RemoveContainer" containerID="5688dccf208006f4eee35bcddcc5a388dfa52eb31bebf688c873523ed573a3e8" Jul 02 15:28:05.138692 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:05.138676 2573 scope.go:117] "RemoveContainer" containerID="5688dccf208006f4eee35bcddcc5a388dfa52eb31bebf688c873523ed573a3e8" Jul 02 15:28:05.138940 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:28:05.138919 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5688dccf208006f4eee35bcddcc5a388dfa52eb31bebf688c873523ed573a3e8\": container with ID starting with 5688dccf208006f4eee35bcddcc5a388dfa52eb31bebf688c873523ed573a3e8 not found: ID does not exist" containerID="5688dccf208006f4eee35bcddcc5a388dfa52eb31bebf688c873523ed573a3e8" Jul 02 15:28:05.139018 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:05.138946 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5688dccf208006f4eee35bcddcc5a388dfa52eb31bebf688c873523ed573a3e8"} err="failed to get container status \"5688dccf208006f4eee35bcddcc5a388dfa52eb31bebf688c873523ed573a3e8\": rpc error: code = NotFound desc = could not find container \"5688dccf208006f4eee35bcddcc5a388dfa52eb31bebf688c873523ed573a3e8\": container with ID starting with 5688dccf208006f4eee35bcddcc5a388dfa52eb31bebf688c873523ed573a3e8 not found: ID does not exist" Jul 02 15:28:05.150956 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:05.150923 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66f696bff6-4w865"] Jul 02 15:28:05.157227 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:05.157200 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-66f696bff6-4w865"] Jul 02 15:28:05.415738 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:05.415661 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1" path="/var/lib/kubelet/pods/e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1/volumes" Jul 02 15:28:10.152443 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:10.152410 2573 generic.go:356] "Generic (PLEG): container finished" podID="f09efd02-cadc-487d-a7d3-c6f46620278b" containerID="c2e0d2b2894e530609e3c04265d41ff5d5ba4a016703426dfed81197b30fe697" exitCode=0 Jul 02 15:28:10.152856 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:10.152449 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-8lcv4" event={"ID":"f09efd02-cadc-487d-a7d3-c6f46620278b","Type":"ContainerDied","Data":"c2e0d2b2894e530609e3c04265d41ff5d5ba4a016703426dfed81197b30fe697"} Jul 02 15:28:10.152856 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:10.152756 2573 scope.go:117] "RemoveContainer" containerID="c2e0d2b2894e530609e3c04265d41ff5d5ba4a016703426dfed81197b30fe697" Jul 02 15:28:11.159126 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:28:11.159094 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-8lcv4" event={"ID":"f09efd02-cadc-487d-a7d3-c6f46620278b","Type":"ContainerStarted","Data":"907fd96ab803953904e0181552286abc3da65644835f48f76066ec9f2af72db1"} Jul 02 15:30:55.347304 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:30:55.347277 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-g5scp_2a799b2e-a2de-4260-8fe4-0cb5242c0952/console-operator/1.log" Jul 02 15:30:55.352070 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:30:55.352049 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-g5scp_2a799b2e-a2de-4260-8fe4-0cb5242c0952/console-operator/1.log" Jul 02 15:30:55.358500 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:30:55.358474 2573 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 15:31:21.432063 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.432025 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77"] Jul 02 15:31:21.434481 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.432478 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1" containerName="registry" Jul 02 15:31:21.434481 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.432497 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1" containerName="registry" Jul 02 15:31:21.434481 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.432557 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8c4b8ae-77e7-4e4a-b15f-aa6753fb5ea1" containerName="registry" Jul 02 15:31:21.435463 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.435443 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77" Jul 02 15:31:21.438643 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.438621 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fhrwk\"" Jul 02 15:31:21.438754 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.438660 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 15:31:21.439165 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.439145 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 15:31:21.440232 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.440215 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 15:31:21.441510 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.441493 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 15:31:21.445091 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.445070 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e582348-7c54-4b5c-b209-281bf5d0f4db-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d66c884b7-m6d77\" (UID: \"8e582348-7c54-4b5c-b209-281bf5d0f4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77" Jul 02 15:31:21.445191 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.445109 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e582348-7c54-4b5c-b209-281bf5d0f4db-tmp\") pod \"opendatahub-operator-controller-manager-6d66c884b7-m6d77\" (UID: \"8e582348-7c54-4b5c-b209-281bf5d0f4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77" Jul 02 15:31:21.445191 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.445140 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8e582348-7c54-4b5c-b209-281bf5d0f4db-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d66c884b7-m6d77\" (UID: \"8e582348-7c54-4b5c-b209-281bf5d0f4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77" Jul 02 15:31:21.445191 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.445179 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2qsb\" (UniqueName: \"kubernetes.io/projected/8e582348-7c54-4b5c-b209-281bf5d0f4db-kube-api-access-m2qsb\") pod \"opendatahub-operator-controller-manager-6d66c884b7-m6d77\" (UID: \"8e582348-7c54-4b5c-b209-281bf5d0f4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77" Jul 02 15:31:21.445345 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.445276 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8e582348-7c54-4b5c-b209-281bf5d0f4db-manifests\") pod \"opendatahub-operator-controller-manager-6d66c884b7-m6d77\" (UID: \"8e582348-7c54-4b5c-b209-281bf5d0f4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77" Jul 02 15:31:21.494113 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.494079 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77"] Jul 02 15:31:21.546129 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.546093 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e582348-7c54-4b5c-b209-281bf5d0f4db-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d66c884b7-m6d77\" (UID: \"8e582348-7c54-4b5c-b209-281bf5d0f4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77" Jul 02 15:31:21.546345 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.546146 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e582348-7c54-4b5c-b209-281bf5d0f4db-tmp\") pod \"opendatahub-operator-controller-manager-6d66c884b7-m6d77\" (UID: \"8e582348-7c54-4b5c-b209-281bf5d0f4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77" Jul 02 15:31:21.546345 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.546263 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8e582348-7c54-4b5c-b209-281bf5d0f4db-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d66c884b7-m6d77\" (UID: \"8e582348-7c54-4b5c-b209-281bf5d0f4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77" Jul 02 15:31:21.546345 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.546309 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2qsb\" (UniqueName: \"kubernetes.io/projected/8e582348-7c54-4b5c-b209-281bf5d0f4db-kube-api-access-m2qsb\") pod \"opendatahub-operator-controller-manager-6d66c884b7-m6d77\" (UID: \"8e582348-7c54-4b5c-b209-281bf5d0f4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77" Jul 02 15:31:21.546503 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.546370 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8e582348-7c54-4b5c-b209-281bf5d0f4db-manifests\") pod \"opendatahub-operator-controller-manager-6d66c884b7-m6d77\" (UID: \"8e582348-7c54-4b5c-b209-281bf5d0f4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77" Jul 02 15:31:21.546749 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.546721 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8e582348-7c54-4b5c-b209-281bf5d0f4db-manifests\") pod \"opendatahub-operator-controller-manager-6d66c884b7-m6d77\" (UID: \"8e582348-7c54-4b5c-b209-281bf5d0f4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77" Jul 02 15:31:21.548679 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.548638 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e582348-7c54-4b5c-b209-281bf5d0f4db-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d66c884b7-m6d77\" (UID: \"8e582348-7c54-4b5c-b209-281bf5d0f4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77" Jul 02 15:31:21.548800 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.548727 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e582348-7c54-4b5c-b209-281bf5d0f4db-tmp\") pod \"opendatahub-operator-controller-manager-6d66c884b7-m6d77\" (UID: \"8e582348-7c54-4b5c-b209-281bf5d0f4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77" Jul 02 15:31:21.548951 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.548933 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8e582348-7c54-4b5c-b209-281bf5d0f4db-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d66c884b7-m6d77\" (UID: \"8e582348-7c54-4b5c-b209-281bf5d0f4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77" Jul 02 15:31:21.560372 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.560347 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2qsb\" (UniqueName: \"kubernetes.io/projected/8e582348-7c54-4b5c-b209-281bf5d0f4db-kube-api-access-m2qsb\") pod \"opendatahub-operator-controller-manager-6d66c884b7-m6d77\" (UID: \"8e582348-7c54-4b5c-b209-281bf5d0f4db\") " pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77" Jul 02 15:31:21.745640 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.745552 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77" Jul 02 15:31:21.890779 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.890632 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77"] Jul 02 15:31:21.893888 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:31:21.893860 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e582348_7c54_4b5c_b209_281bf5d0f4db.slice/crio-f2a5711d5611fef23e6aa5381aa421f26d906fbb4ec0d809500a4acd879a8b18 WatchSource:0}: Error finding container f2a5711d5611fef23e6aa5381aa421f26d906fbb4ec0d809500a4acd879a8b18: Status 404 returned error can't find the container with id f2a5711d5611fef23e6aa5381aa421f26d906fbb4ec0d809500a4acd879a8b18 Jul 02 15:31:21.895717 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.895700 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 15:31:21.904155 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:21.904130 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77" event={"ID":"8e582348-7c54-4b5c-b209-281bf5d0f4db","Type":"ContainerStarted","Data":"f2a5711d5611fef23e6aa5381aa421f26d906fbb4ec0d809500a4acd879a8b18"} Jul 02 15:31:25.923471 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:25.923430 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77" event={"ID":"8e582348-7c54-4b5c-b209-281bf5d0f4db","Type":"ContainerStarted","Data":"6a4e2564fc6707bb2ed2b7880d81d958aec6840be29e604b55419fb1d06b62af"} Jul 02 15:31:26.929489 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:26.929454 2573 generic.go:356] "Generic (PLEG): container finished" podID="8e582348-7c54-4b5c-b209-281bf5d0f4db" containerID="6a4e2564fc6707bb2ed2b7880d81d958aec6840be29e604b55419fb1d06b62af" exitCode=0 Jul 02 15:31:26.929987 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:26.929531 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77" event={"ID":"8e582348-7c54-4b5c-b209-281bf5d0f4db","Type":"ContainerDied","Data":"6a4e2564fc6707bb2ed2b7880d81d958aec6840be29e604b55419fb1d06b62af"} Jul 02 15:31:27.935400 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:27.935362 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77" event={"ID":"8e582348-7c54-4b5c-b209-281bf5d0f4db","Type":"ContainerStarted","Data":"e57bd656c71200bb4a8e5efc8555a77a5a9f5de4f521d9bf4765dc8ab2dcb128"} Jul 02 15:31:27.935769 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:27.935470 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77" Jul 02 15:31:27.959119 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:27.959073 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77" podStartSLOduration=2.432331431 podStartE2EDuration="6.959057597s" totalImagesPullingTime="3.505190959s" totalInitContainerRuntime="1.021535207s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:31:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:31:27.957480775 +0000 UTC m=+333.029794537" watchObservedRunningTime="2026-07-02 15:31:27.959057597 +0000 UTC m=+333.031371308" Jul 02 15:31:38.942136 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:38.942105 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d66c884b7-m6d77" Jul 02 15:31:49.792701 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:49.792625 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-578857ff64-qdpsl"] Jul 02 15:31:49.795876 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:49.795859 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-578857ff64-qdpsl" Jul 02 15:31:49.803739 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:49.803717 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 02 15:31:49.804312 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:49.804289 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 02 15:31:49.804692 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:49.804677 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vppxt\"" Jul 02 15:31:49.804692 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:49.804686 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 02 15:31:49.804827 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:49.804699 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 02 15:31:49.804827 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:49.804679 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 02 15:31:49.889422 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:49.889385 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vnzq\" (UniqueName: \"kubernetes.io/projected/2d2f5918-fb14-44cc-bc6c-484f451b3156-kube-api-access-6vnzq\") pod \"lws-controller-manager-578857ff64-qdpsl\" (UID: \"2d2f5918-fb14-44cc-bc6c-484f451b3156\") " pod="openshift-lws-operator/lws-controller-manager-578857ff64-qdpsl" Jul 02 15:31:49.889601 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:49.889464 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d2f5918-fb14-44cc-bc6c-484f451b3156-cert\") pod \"lws-controller-manager-578857ff64-qdpsl\" (UID: \"2d2f5918-fb14-44cc-bc6c-484f451b3156\") " pod="openshift-lws-operator/lws-controller-manager-578857ff64-qdpsl" Jul 02 15:31:49.889601 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:49.889482 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d2f5918-fb14-44cc-bc6c-484f451b3156-metrics-cert\") pod \"lws-controller-manager-578857ff64-qdpsl\" (UID: \"2d2f5918-fb14-44cc-bc6c-484f451b3156\") " pod="openshift-lws-operator/lws-controller-manager-578857ff64-qdpsl" Jul 02 15:31:49.889601 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:49.889505 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2d2f5918-fb14-44cc-bc6c-484f451b3156-manager-config\") pod \"lws-controller-manager-578857ff64-qdpsl\" (UID: \"2d2f5918-fb14-44cc-bc6c-484f451b3156\") " pod="openshift-lws-operator/lws-controller-manager-578857ff64-qdpsl" Jul 02 15:31:49.950308 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:49.950273 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-578857ff64-qdpsl"] Jul 02 15:31:49.990060 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:49.990019 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d2f5918-fb14-44cc-bc6c-484f451b3156-cert\") pod \"lws-controller-manager-578857ff64-qdpsl\" (UID: \"2d2f5918-fb14-44cc-bc6c-484f451b3156\") " pod="openshift-lws-operator/lws-controller-manager-578857ff64-qdpsl" Jul 02 15:31:49.990060 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:49.990063 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d2f5918-fb14-44cc-bc6c-484f451b3156-metrics-cert\") pod \"lws-controller-manager-578857ff64-qdpsl\" (UID: \"2d2f5918-fb14-44cc-bc6c-484f451b3156\") " pod="openshift-lws-operator/lws-controller-manager-578857ff64-qdpsl" Jul 02 15:31:49.990274 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:49.990093 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2d2f5918-fb14-44cc-bc6c-484f451b3156-manager-config\") pod \"lws-controller-manager-578857ff64-qdpsl\" (UID: \"2d2f5918-fb14-44cc-bc6c-484f451b3156\") " pod="openshift-lws-operator/lws-controller-manager-578857ff64-qdpsl" Jul 02 15:31:49.990274 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:49.990126 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vnzq\" (UniqueName: \"kubernetes.io/projected/2d2f5918-fb14-44cc-bc6c-484f451b3156-kube-api-access-6vnzq\") pod \"lws-controller-manager-578857ff64-qdpsl\" (UID: \"2d2f5918-fb14-44cc-bc6c-484f451b3156\") " pod="openshift-lws-operator/lws-controller-manager-578857ff64-qdpsl" Jul 02 15:31:49.990759 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:49.990731 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2d2f5918-fb14-44cc-bc6c-484f451b3156-manager-config\") pod \"lws-controller-manager-578857ff64-qdpsl\" (UID: \"2d2f5918-fb14-44cc-bc6c-484f451b3156\") " pod="openshift-lws-operator/lws-controller-manager-578857ff64-qdpsl" Jul 02 15:31:49.992605 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:49.992580 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d2f5918-fb14-44cc-bc6c-484f451b3156-cert\") pod \"lws-controller-manager-578857ff64-qdpsl\" (UID: \"2d2f5918-fb14-44cc-bc6c-484f451b3156\") " pod="openshift-lws-operator/lws-controller-manager-578857ff64-qdpsl" Jul 02 15:31:49.992690 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:49.992606 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d2f5918-fb14-44cc-bc6c-484f451b3156-metrics-cert\") pod \"lws-controller-manager-578857ff64-qdpsl\" (UID: \"2d2f5918-fb14-44cc-bc6c-484f451b3156\") " pod="openshift-lws-operator/lws-controller-manager-578857ff64-qdpsl" Jul 02 15:31:49.998617 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:49.998589 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vnzq\" (UniqueName: \"kubernetes.io/projected/2d2f5918-fb14-44cc-bc6c-484f451b3156-kube-api-access-6vnzq\") pod \"lws-controller-manager-578857ff64-qdpsl\" (UID: \"2d2f5918-fb14-44cc-bc6c-484f451b3156\") " pod="openshift-lws-operator/lws-controller-manager-578857ff64-qdpsl" Jul 02 15:31:50.105243 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:50.105210 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-578857ff64-qdpsl" Jul 02 15:31:50.241247 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:50.241221 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-578857ff64-qdpsl"] Jul 02 15:31:50.243630 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:31:50.243602 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d2f5918_fb14_44cc_bc6c_484f451b3156.slice/crio-ea55e6f4d4b8fbb0d7065bdd104460053b26ace57616151e5d65e735f1820d4b WatchSource:0}: Error finding container ea55e6f4d4b8fbb0d7065bdd104460053b26ace57616151e5d65e735f1820d4b: Status 404 returned error can't find the container with id ea55e6f4d4b8fbb0d7065bdd104460053b26ace57616151e5d65e735f1820d4b Jul 02 15:31:51.036803 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:51.036760 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-578857ff64-qdpsl" event={"ID":"2d2f5918-fb14-44cc-bc6c-484f451b3156","Type":"ContainerStarted","Data":"ea55e6f4d4b8fbb0d7065bdd104460053b26ace57616151e5d65e735f1820d4b"} Jul 02 15:31:53.049231 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:53.049129 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-578857ff64-qdpsl" event={"ID":"2d2f5918-fb14-44cc-bc6c-484f451b3156","Type":"ContainerStarted","Data":"7b2c0c45b453ae834af84020a8080abfd139565041ff470452feb94a082480d9"} Jul 02 15:31:53.049231 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:53.049203 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-578857ff64-qdpsl" Jul 02 15:31:53.096656 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:31:53.096595 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-578857ff64-qdpsl" podStartSLOduration=1.609972118 podStartE2EDuration="4.096578801s" totalImagesPullingTime="2.486606683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:31:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:31:53.095182889 +0000 UTC m=+358.167496631" watchObservedRunningTime="2026-07-02 15:31:53.096578801 +0000 UTC m=+358.168892513" Jul 02 15:32:04.055934 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:04.055895 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-578857ff64-qdpsl" Jul 02 15:32:42.518467 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:42.518428 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n7m25"] Jul 02 15:32:42.523510 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:42.523487 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n7m25" Jul 02 15:32:42.528272 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:42.528246 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 15:32:42.529015 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:42.528968 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 15:32:42.529139 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:42.529050 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-w5hg8\"" Jul 02 15:32:42.542500 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:42.542477 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n7m25"] Jul 02 15:32:42.652378 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:42.652337 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ktjj\" (UniqueName: \"kubernetes.io/projected/9cc204d3-0592-4bbe-9898-aaff29935677-kube-api-access-2ktjj\") pod \"kuadrant-operator-catalog-n7m25\" (UID: \"9cc204d3-0592-4bbe-9898-aaff29935677\") " pod="kuadrant-system/kuadrant-operator-catalog-n7m25" Jul 02 15:32:42.752747 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:42.752714 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ktjj\" (UniqueName: \"kubernetes.io/projected/9cc204d3-0592-4bbe-9898-aaff29935677-kube-api-access-2ktjj\") pod \"kuadrant-operator-catalog-n7m25\" (UID: \"9cc204d3-0592-4bbe-9898-aaff29935677\") " pod="kuadrant-system/kuadrant-operator-catalog-n7m25" Jul 02 15:32:42.764766 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:42.764731 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ktjj\" (UniqueName: \"kubernetes.io/projected/9cc204d3-0592-4bbe-9898-aaff29935677-kube-api-access-2ktjj\") pod \"kuadrant-operator-catalog-n7m25\" (UID: \"9cc204d3-0592-4bbe-9898-aaff29935677\") " pod="kuadrant-system/kuadrant-operator-catalog-n7m25" Jul 02 15:32:42.834013 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:42.833960 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n7m25" Jul 02 15:32:42.872429 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:42.872394 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n7m25"] Jul 02 15:32:42.968411 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:42.968382 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n7m25"] Jul 02 15:32:42.971600 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:32:42.971565 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cc204d3_0592_4bbe_9898_aaff29935677.slice/crio-3f4d98cbe8a1ee824cd0357e2b365ca8d7f02fc364337a10a96dc5dd65e53d96 WatchSource:0}: Error finding container 3f4d98cbe8a1ee824cd0357e2b365ca8d7f02fc364337a10a96dc5dd65e53d96: Status 404 returned error can't find the container with id 3f4d98cbe8a1ee824cd0357e2b365ca8d7f02fc364337a10a96dc5dd65e53d96 Jul 02 15:32:43.083040 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:43.083009 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zzqkf"] Jul 02 15:32:43.087642 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:43.087588 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zzqkf" Jul 02 15:32:43.099482 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:43.099451 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zzqkf"] Jul 02 15:32:43.257372 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:43.257330 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv98b\" (UniqueName: \"kubernetes.io/projected/fae4eee2-d888-4c4b-b32c-172000719654-kube-api-access-vv98b\") pod \"kuadrant-operator-catalog-zzqkf\" (UID: \"fae4eee2-d888-4c4b-b32c-172000719654\") " pod="kuadrant-system/kuadrant-operator-catalog-zzqkf" Jul 02 15:32:43.265878 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:43.265837 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n7m25" event={"ID":"9cc204d3-0592-4bbe-9898-aaff29935677","Type":"ContainerStarted","Data":"3f4d98cbe8a1ee824cd0357e2b365ca8d7f02fc364337a10a96dc5dd65e53d96"} Jul 02 15:32:43.358871 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:43.358782 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv98b\" (UniqueName: \"kubernetes.io/projected/fae4eee2-d888-4c4b-b32c-172000719654-kube-api-access-vv98b\") pod \"kuadrant-operator-catalog-zzqkf\" (UID: \"fae4eee2-d888-4c4b-b32c-172000719654\") " pod="kuadrant-system/kuadrant-operator-catalog-zzqkf" Jul 02 15:32:43.367863 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:43.367835 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv98b\" (UniqueName: \"kubernetes.io/projected/fae4eee2-d888-4c4b-b32c-172000719654-kube-api-access-vv98b\") pod \"kuadrant-operator-catalog-zzqkf\" (UID: \"fae4eee2-d888-4c4b-b32c-172000719654\") " pod="kuadrant-system/kuadrant-operator-catalog-zzqkf" Jul 02 15:32:43.403587 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:43.403550 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zzqkf" Jul 02 15:32:43.546935 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:43.546910 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zzqkf"] Jul 02 15:32:43.549081 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:32:43.549053 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfae4eee2_d888_4c4b_b32c_172000719654.slice/crio-4bb703ca1c9c0c3cad20b860496c7a1189ed5d4bdaa75e4dc80a4617ae1b8ed2 WatchSource:0}: Error finding container 4bb703ca1c9c0c3cad20b860496c7a1189ed5d4bdaa75e4dc80a4617ae1b8ed2: Status 404 returned error can't find the container with id 4bb703ca1c9c0c3cad20b860496c7a1189ed5d4bdaa75e4dc80a4617ae1b8ed2 Jul 02 15:32:44.274103 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:44.274068 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zzqkf" event={"ID":"fae4eee2-d888-4c4b-b32c-172000719654","Type":"ContainerStarted","Data":"4bb703ca1c9c0c3cad20b860496c7a1189ed5d4bdaa75e4dc80a4617ae1b8ed2"} Jul 02 15:32:46.284639 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:46.284597 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zzqkf" event={"ID":"fae4eee2-d888-4c4b-b32c-172000719654","Type":"ContainerStarted","Data":"1ef88f6b56f4732686077993cdc92c3cd7f1cc64604b235176660102b792f6b0"} Jul 02 15:32:46.285980 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:46.285952 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n7m25" event={"ID":"9cc204d3-0592-4bbe-9898-aaff29935677","Type":"ContainerStarted","Data":"674b7d06513b58e5b1b313832da134e4db9394ff19c33dae4810500a7514ddb8"} Jul 02 15:32:46.286112 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:46.286060 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-n7m25" podUID="9cc204d3-0592-4bbe-9898-aaff29935677" containerName="registry-server" containerID="cri-o://674b7d06513b58e5b1b313832da134e4db9394ff19c33dae4810500a7514ddb8" gracePeriod=2 Jul 02 15:32:46.304628 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:46.304583 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zzqkf" podStartSLOduration=1.28615182 podStartE2EDuration="3.304568854s" totalImagesPullingTime="2.018417034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:32:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:32:46.304319251 +0000 UTC m=+411.376632964" watchObservedRunningTime="2026-07-02 15:32:46.304568854 +0000 UTC m=+411.376882565" Jul 02 15:32:46.321810 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:46.321768 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-n7m25" podStartSLOduration=1.722186868 podStartE2EDuration="4.321752641s" totalImagesPullingTime="2.599565773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:32:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:32:46.320636932 +0000 UTC m=+411.392950643" watchObservedRunningTime="2026-07-02 15:32:46.321752641 +0000 UTC m=+411.394066352" Jul 02 15:32:46.531492 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:46.531459 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n7m25" Jul 02 15:32:46.687068 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:46.687037 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ktjj\" (UniqueName: \"kubernetes.io/projected/9cc204d3-0592-4bbe-9898-aaff29935677-kube-api-access-2ktjj\") pod \"9cc204d3-0592-4bbe-9898-aaff29935677\" (UID: \"9cc204d3-0592-4bbe-9898-aaff29935677\") " Jul 02 15:32:46.689168 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:46.689144 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cc204d3-0592-4bbe-9898-aaff29935677-kube-api-access-2ktjj" (OuterVolumeSpecName: "kube-api-access-2ktjj") pod "9cc204d3-0592-4bbe-9898-aaff29935677" (UID: "9cc204d3-0592-4bbe-9898-aaff29935677"). InnerVolumeSpecName "kube-api-access-2ktjj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:32:46.788487 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:46.788456 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ktjj\" (UniqueName: \"kubernetes.io/projected/9cc204d3-0592-4bbe-9898-aaff29935677-kube-api-access-2ktjj\") on node \"ip-10-0-138-41.ec2.internal\" DevicePath \"\"" Jul 02 15:32:47.291301 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:47.291263 2573 generic.go:356] "Generic (PLEG): container finished" podID="9cc204d3-0592-4bbe-9898-aaff29935677" containerID="674b7d06513b58e5b1b313832da134e4db9394ff19c33dae4810500a7514ddb8" exitCode=0 Jul 02 15:32:47.291698 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:47.291308 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n7m25" Jul 02 15:32:47.291698 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:47.291344 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n7m25" event={"ID":"9cc204d3-0592-4bbe-9898-aaff29935677","Type":"ContainerDied","Data":"674b7d06513b58e5b1b313832da134e4db9394ff19c33dae4810500a7514ddb8"} Jul 02 15:32:47.291698 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:47.291393 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n7m25" event={"ID":"9cc204d3-0592-4bbe-9898-aaff29935677","Type":"ContainerDied","Data":"3f4d98cbe8a1ee824cd0357e2b365ca8d7f02fc364337a10a96dc5dd65e53d96"} Jul 02 15:32:47.291698 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:47.291413 2573 scope.go:117] "RemoveContainer" containerID="674b7d06513b58e5b1b313832da134e4db9394ff19c33dae4810500a7514ddb8" Jul 02 15:32:47.301160 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:47.301118 2573 scope.go:117] "RemoveContainer" containerID="674b7d06513b58e5b1b313832da134e4db9394ff19c33dae4810500a7514ddb8" Jul 02 15:32:47.301391 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:32:47.301371 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"674b7d06513b58e5b1b313832da134e4db9394ff19c33dae4810500a7514ddb8\": container with ID starting with 674b7d06513b58e5b1b313832da134e4db9394ff19c33dae4810500a7514ddb8 not found: ID does not exist" containerID="674b7d06513b58e5b1b313832da134e4db9394ff19c33dae4810500a7514ddb8" Jul 02 15:32:47.301450 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:47.301399 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"674b7d06513b58e5b1b313832da134e4db9394ff19c33dae4810500a7514ddb8"} err="failed to get container status \"674b7d06513b58e5b1b313832da134e4db9394ff19c33dae4810500a7514ddb8\": rpc error: code = NotFound desc = could not find container \"674b7d06513b58e5b1b313832da134e4db9394ff19c33dae4810500a7514ddb8\": container with ID starting with 674b7d06513b58e5b1b313832da134e4db9394ff19c33dae4810500a7514ddb8 not found: ID does not exist" Jul 02 15:32:47.313025 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:47.312982 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n7m25"] Jul 02 15:32:47.316803 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:47.316780 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n7m25"] Jul 02 15:32:47.416723 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:47.416681 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cc204d3-0592-4bbe-9898-aaff29935677" path="/var/lib/kubelet/pods/9cc204d3-0592-4bbe-9898-aaff29935677/volumes" Jul 02 15:32:53.404316 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:53.404264 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-zzqkf" Jul 02 15:32:53.404763 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:53.404342 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-zzqkf" Jul 02 15:32:53.426545 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:53.426518 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-zzqkf" Jul 02 15:32:54.343500 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:32:54.343469 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-zzqkf" Jul 02 15:33:18.156563 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:18.156477 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9qw"] Jul 02 15:33:18.157047 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:18.156790 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cc204d3-0592-4bbe-9898-aaff29935677" containerName="registry-server" Jul 02 15:33:18.157047 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:18.156802 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cc204d3-0592-4bbe-9898-aaff29935677" containerName="registry-server" Jul 02 15:33:18.157047 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:18.156863 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cc204d3-0592-4bbe-9898-aaff29935677" containerName="registry-server" Jul 02 15:33:18.163342 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:18.163308 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9qw" Jul 02 15:33:18.170141 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:18.169870 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-sk9b9\"" Jul 02 15:33:18.176933 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:18.176909 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9qw"] Jul 02 15:33:18.244803 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:18.244762 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg669\" (UniqueName: \"kubernetes.io/projected/12e98926-b468-4261-8f8b-a0b267bab9bf-kube-api-access-bg669\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cl9qw\" (UID: \"12e98926-b468-4261-8f8b-a0b267bab9bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9qw" Jul 02 15:33:18.244803 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:18.244809 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12e98926-b468-4261-8f8b-a0b267bab9bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cl9qw\" (UID: \"12e98926-b468-4261-8f8b-a0b267bab9bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9qw" Jul 02 15:33:18.345913 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:18.345875 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg669\" (UniqueName: \"kubernetes.io/projected/12e98926-b468-4261-8f8b-a0b267bab9bf-kube-api-access-bg669\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cl9qw\" (UID: \"12e98926-b468-4261-8f8b-a0b267bab9bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9qw" Jul 02 15:33:18.345913 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:18.345917 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12e98926-b468-4261-8f8b-a0b267bab9bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cl9qw\" (UID: \"12e98926-b468-4261-8f8b-a0b267bab9bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9qw" Jul 02 15:33:18.346331 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:18.346313 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12e98926-b468-4261-8f8b-a0b267bab9bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cl9qw\" (UID: \"12e98926-b468-4261-8f8b-a0b267bab9bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9qw" Jul 02 15:33:18.355099 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:18.355069 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg669\" (UniqueName: \"kubernetes.io/projected/12e98926-b468-4261-8f8b-a0b267bab9bf-kube-api-access-bg669\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cl9qw\" (UID: \"12e98926-b468-4261-8f8b-a0b267bab9bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9qw" Jul 02 15:33:18.474023 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:18.473904 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9qw" Jul 02 15:33:18.633344 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:18.633318 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9qw"] Jul 02 15:33:18.635894 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:33:18.635862 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12e98926_b468_4261_8f8b_a0b267bab9bf.slice/crio-543f7b577a082bf48f4465ec75643301bfefbb63de6e533fb3b25bd42942548f WatchSource:0}: Error finding container 543f7b577a082bf48f4465ec75643301bfefbb63de6e533fb3b25bd42942548f: Status 404 returned error can't find the container with id 543f7b577a082bf48f4465ec75643301bfefbb63de6e533fb3b25bd42942548f Jul 02 15:33:19.429471 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:19.429436 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9qw" event={"ID":"12e98926-b468-4261-8f8b-a0b267bab9bf","Type":"ContainerStarted","Data":"543f7b577a082bf48f4465ec75643301bfefbb63de6e533fb3b25bd42942548f"} Jul 02 15:33:25.460605 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:25.460504 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9qw" event={"ID":"12e98926-b468-4261-8f8b-a0b267bab9bf","Type":"ContainerStarted","Data":"2aaf174cce39985b113db9e49b05950b13b26c429dfabbe55d3400af53f854a1"} Jul 02 15:33:25.460605 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:25.460594 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9qw" Jul 02 15:33:25.492086 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:25.492036 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9qw" podStartSLOduration=1.059525523 podStartE2EDuration="7.492021414s" totalImagesPullingTime="6.432495891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:33:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:33:25.490540687 +0000 UTC m=+450.562854399" watchObservedRunningTime="2026-07-02 15:33:25.492021414 +0000 UTC m=+450.564335116" Jul 02 15:33:36.467391 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:36.467360 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9qw" Jul 02 15:33:38.502098 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:38.502056 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9qw"] Jul 02 15:33:38.502573 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:38.502313 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9qw" podUID="12e98926-b468-4261-8f8b-a0b267bab9bf" containerName="manager" containerID="cri-o://2aaf174cce39985b113db9e49b05950b13b26c429dfabbe55d3400af53f854a1" gracePeriod=2 Jul 02 15:33:38.511906 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:38.511880 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9qw"] Jul 02 15:33:38.544639 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:38.544611 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k62ls"] Jul 02 15:33:38.544930 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:38.544915 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12e98926-b468-4261-8f8b-a0b267bab9bf" containerName="manager" Jul 02 15:33:38.544930 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:38.544929 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="12e98926-b468-4261-8f8b-a0b267bab9bf" containerName="manager" Jul 02 15:33:38.545135 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:38.545010 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="12e98926-b468-4261-8f8b-a0b267bab9bf" containerName="manager" Jul 02 15:33:38.547952 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:38.547931 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k62ls" Jul 02 15:33:38.551254 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:33:38.551224 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cl9qw\" is forbidden: User \"system:node:ip-10-0-138-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-41.ec2.internal' and this object" podUID="12e98926-b468-4261-8f8b-a0b267bab9bf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9qw" Jul 02 15:33:38.581675 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:38.581645 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k62ls"] Jul 02 15:33:38.735919 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:38.735888 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8jzn\" (UniqueName: \"kubernetes.io/projected/75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb-kube-api-access-s8jzn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k62ls\" (UID: \"75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k62ls" Jul 02 15:33:38.736077 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:38.735974 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k62ls\" (UID: \"75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k62ls" Jul 02 15:33:38.744615 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:38.744593 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9qw" Jul 02 15:33:38.747026 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:33:38.746974 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cl9qw\" is forbidden: User \"system:node:ip-10-0-138-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-41.ec2.internal' and this object" podUID="12e98926-b468-4261-8f8b-a0b267bab9bf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9qw" Jul 02 15:33:38.836607 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:38.836560 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8jzn\" (UniqueName: \"kubernetes.io/projected/75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb-kube-api-access-s8jzn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k62ls\" (UID: \"75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k62ls" Jul 02 15:33:38.836782 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:38.836654 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k62ls\" (UID: \"75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k62ls" Jul 02 15:33:38.836983 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:38.836965 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k62ls\" (UID: \"75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k62ls" Jul 02 15:33:38.846044 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:38.846015 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8jzn\" (UniqueName: \"kubernetes.io/projected/75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb-kube-api-access-s8jzn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k62ls\" (UID: \"75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k62ls" Jul 02 15:33:38.894636 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:38.894599 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k62ls" Jul 02 15:33:38.937757 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:38.937711 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12e98926-b468-4261-8f8b-a0b267bab9bf-extensions-socket-volume\") pod \"12e98926-b468-4261-8f8b-a0b267bab9bf\" (UID: \"12e98926-b468-4261-8f8b-a0b267bab9bf\") " Jul 02 15:33:38.937950 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:38.937831 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bg669\" (UniqueName: \"kubernetes.io/projected/12e98926-b468-4261-8f8b-a0b267bab9bf-kube-api-access-bg669\") pod \"12e98926-b468-4261-8f8b-a0b267bab9bf\" (UID: \"12e98926-b468-4261-8f8b-a0b267bab9bf\") " Jul 02 15:33:38.938203 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:38.938176 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12e98926-b468-4261-8f8b-a0b267bab9bf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "12e98926-b468-4261-8f8b-a0b267bab9bf" (UID: "12e98926-b468-4261-8f8b-a0b267bab9bf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:33:38.939822 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:38.939800 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12e98926-b468-4261-8f8b-a0b267bab9bf-kube-api-access-bg669" (OuterVolumeSpecName: "kube-api-access-bg669") pod "12e98926-b468-4261-8f8b-a0b267bab9bf" (UID: "12e98926-b468-4261-8f8b-a0b267bab9bf"). InnerVolumeSpecName "kube-api-access-bg669". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:33:39.028736 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:39.028712 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k62ls"] Jul 02 15:33:39.030406 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:33:39.030381 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75c0c44d_ac2f_4e36_a1c8_09c7a0a2ddcb.slice/crio-ee1f9ac7ec56ac83a667303934f02c3e076467490ed20e49ffa8f727ef8513db WatchSource:0}: Error finding container ee1f9ac7ec56ac83a667303934f02c3e076467490ed20e49ffa8f727ef8513db: Status 404 returned error can't find the container with id ee1f9ac7ec56ac83a667303934f02c3e076467490ed20e49ffa8f727ef8513db Jul 02 15:33:39.038298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:39.038278 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bg669\" (UniqueName: \"kubernetes.io/projected/12e98926-b468-4261-8f8b-a0b267bab9bf-kube-api-access-bg669\") on node \"ip-10-0-138-41.ec2.internal\" DevicePath \"\"" Jul 02 15:33:39.038298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:39.038298 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12e98926-b468-4261-8f8b-a0b267bab9bf-extensions-socket-volume\") on node \"ip-10-0-138-41.ec2.internal\" DevicePath \"\"" Jul 02 15:33:39.416361 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:39.416281 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12e98926-b468-4261-8f8b-a0b267bab9bf" path="/var/lib/kubelet/pods/12e98926-b468-4261-8f8b-a0b267bab9bf/volumes" Jul 02 15:33:39.526458 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:39.526426 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k62ls" event={"ID":"75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb","Type":"ContainerStarted","Data":"cce5f5237f83da7152f03087d3542a9a1ec4231d280542637857448ff88787e7"} Jul 02 15:33:39.526859 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:39.526492 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k62ls" Jul 02 15:33:39.526859 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:39.526512 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k62ls" event={"ID":"75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb","Type":"ContainerStarted","Data":"ee1f9ac7ec56ac83a667303934f02c3e076467490ed20e49ffa8f727ef8513db"} Jul 02 15:33:39.527696 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:39.527671 2573 generic.go:356] "Generic (PLEG): container finished" podID="12e98926-b468-4261-8f8b-a0b267bab9bf" containerID="2aaf174cce39985b113db9e49b05950b13b26c429dfabbe55d3400af53f854a1" exitCode=0 Jul 02 15:33:39.527812 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:39.527720 2573 scope.go:117] "RemoveContainer" containerID="2aaf174cce39985b113db9e49b05950b13b26c429dfabbe55d3400af53f854a1" Jul 02 15:33:39.527812 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:39.527719 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cl9qw" Jul 02 15:33:39.530536 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:39.530515 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cl8lr"] Jul 02 15:33:39.534352 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:39.534330 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cl8lr" Jul 02 15:33:39.538400 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:39.538380 2573 scope.go:117] "RemoveContainer" containerID="2aaf174cce39985b113db9e49b05950b13b26c429dfabbe55d3400af53f854a1" Jul 02 15:33:39.538736 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:33:39.538716 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2aaf174cce39985b113db9e49b05950b13b26c429dfabbe55d3400af53f854a1\": container with ID starting with 2aaf174cce39985b113db9e49b05950b13b26c429dfabbe55d3400af53f854a1 not found: ID does not exist" containerID="2aaf174cce39985b113db9e49b05950b13b26c429dfabbe55d3400af53f854a1" Jul 02 15:33:39.538796 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:39.538746 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2aaf174cce39985b113db9e49b05950b13b26c429dfabbe55d3400af53f854a1"} err="failed to get container status \"2aaf174cce39985b113db9e49b05950b13b26c429dfabbe55d3400af53f854a1\": rpc error: code = NotFound desc = could not find container \"2aaf174cce39985b113db9e49b05950b13b26c429dfabbe55d3400af53f854a1\": container with ID starting with 2aaf174cce39985b113db9e49b05950b13b26c429dfabbe55d3400af53f854a1 not found: ID does not exist" Jul 02 15:33:39.541173 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:39.541147 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/190d7ec1-9971-4104-aec7-99e7c824960c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cl8lr\" (UID: \"190d7ec1-9971-4104-aec7-99e7c824960c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cl8lr" Jul 02 15:33:39.541298 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:39.541279 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqglr\" (UniqueName: \"kubernetes.io/projected/190d7ec1-9971-4104-aec7-99e7c824960c-kube-api-access-qqglr\") pod \"kuadrant-operator-controller-manager-86878c769f-cl8lr\" (UID: \"190d7ec1-9971-4104-aec7-99e7c824960c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cl8lr" Jul 02 15:33:39.551899 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:39.551870 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cl8lr"] Jul 02 15:33:39.559801 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:39.559754 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k62ls" podStartSLOduration=1.559737792 podStartE2EDuration="1.559737792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:33:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:33:39.55798358 +0000 UTC m=+464.630297292" watchObservedRunningTime="2026-07-02 15:33:39.559737792 +0000 UTC m=+464.632051503" Jul 02 15:33:39.641612 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:39.641580 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqglr\" (UniqueName: \"kubernetes.io/projected/190d7ec1-9971-4104-aec7-99e7c824960c-kube-api-access-qqglr\") pod \"kuadrant-operator-controller-manager-86878c769f-cl8lr\" (UID: \"190d7ec1-9971-4104-aec7-99e7c824960c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cl8lr" Jul 02 15:33:39.641795 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:39.641650 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/190d7ec1-9971-4104-aec7-99e7c824960c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cl8lr\" (UID: \"190d7ec1-9971-4104-aec7-99e7c824960c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cl8lr" Jul 02 15:33:39.642058 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:39.642037 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/190d7ec1-9971-4104-aec7-99e7c824960c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cl8lr\" (UID: \"190d7ec1-9971-4104-aec7-99e7c824960c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cl8lr" Jul 02 15:33:39.650446 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:39.650416 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqglr\" (UniqueName: \"kubernetes.io/projected/190d7ec1-9971-4104-aec7-99e7c824960c-kube-api-access-qqglr\") pod \"kuadrant-operator-controller-manager-86878c769f-cl8lr\" (UID: \"190d7ec1-9971-4104-aec7-99e7c824960c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cl8lr" Jul 02 15:33:39.844342 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:39.844309 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cl8lr" Jul 02 15:33:39.996433 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:39.996404 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cl8lr"] Jul 02 15:33:39.999158 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:33:39.999130 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod190d7ec1_9971_4104_aec7_99e7c824960c.slice/crio-4254f559cd208e12a4d9229eaa6dbd10a299c6a68e1fa13a00db5f86f4b422a4 WatchSource:0}: Error finding container 4254f559cd208e12a4d9229eaa6dbd10a299c6a68e1fa13a00db5f86f4b422a4: Status 404 returned error can't find the container with id 4254f559cd208e12a4d9229eaa6dbd10a299c6a68e1fa13a00db5f86f4b422a4 Jul 02 15:33:40.534269 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:40.534228 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cl8lr" event={"ID":"190d7ec1-9971-4104-aec7-99e7c824960c","Type":"ContainerStarted","Data":"485da1f153bcde9d658fcfcef34101ed213b3bf818992aa5928899f89ef53782"} Jul 02 15:33:40.534753 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:40.534293 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cl8lr" event={"ID":"190d7ec1-9971-4104-aec7-99e7c824960c","Type":"ContainerStarted","Data":"4254f559cd208e12a4d9229eaa6dbd10a299c6a68e1fa13a00db5f86f4b422a4"} Jul 02 15:33:40.534753 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:40.534400 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cl8lr" Jul 02 15:33:40.556807 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:40.556755 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cl8lr" podStartSLOduration=1.5567384130000002 podStartE2EDuration="1.556738413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:33:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:33:40.554390729 +0000 UTC m=+465.626704441" watchObservedRunningTime="2026-07-02 15:33:40.556738413 +0000 UTC m=+465.629052124" Jul 02 15:33:50.538539 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:50.538508 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k62ls" Jul 02 15:33:51.542564 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:51.542529 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cl8lr" Jul 02 15:33:51.606635 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:51.606600 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k62ls"] Jul 02 15:33:51.606840 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:51.606802 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k62ls" podUID="75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb" containerName="manager" containerID="cri-o://cce5f5237f83da7152f03087d3542a9a1ec4231d280542637857448ff88787e7" gracePeriod=10 Jul 02 15:33:51.854950 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:51.854926 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k62ls" Jul 02 15:33:51.947861 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:51.947824 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8jzn\" (UniqueName: \"kubernetes.io/projected/75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb-kube-api-access-s8jzn\") pod \"75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb\" (UID: \"75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb\") " Jul 02 15:33:51.948055 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:51.947906 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb-extensions-socket-volume\") pod \"75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb\" (UID: \"75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb\") " Jul 02 15:33:51.948283 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:51.948259 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb" (UID: "75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:33:51.949949 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:51.949929 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb-kube-api-access-s8jzn" (OuterVolumeSpecName: "kube-api-access-s8jzn") pod "75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb" (UID: "75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb"). InnerVolumeSpecName "kube-api-access-s8jzn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:33:52.049389 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:52.049350 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8jzn\" (UniqueName: \"kubernetes.io/projected/75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb-kube-api-access-s8jzn\") on node \"ip-10-0-138-41.ec2.internal\" DevicePath \"\"" Jul 02 15:33:52.049389 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:52.049380 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb-extensions-socket-volume\") on node \"ip-10-0-138-41.ec2.internal\" DevicePath \"\"" Jul 02 15:33:52.590558 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:52.590521 2573 generic.go:356] "Generic (PLEG): container finished" podID="75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb" containerID="cce5f5237f83da7152f03087d3542a9a1ec4231d280542637857448ff88787e7" exitCode=0 Jul 02 15:33:52.590971 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:52.590567 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k62ls" Jul 02 15:33:52.590971 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:52.590598 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k62ls" event={"ID":"75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb","Type":"ContainerDied","Data":"cce5f5237f83da7152f03087d3542a9a1ec4231d280542637857448ff88787e7"} Jul 02 15:33:52.590971 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:52.590659 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k62ls" event={"ID":"75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb","Type":"ContainerDied","Data":"ee1f9ac7ec56ac83a667303934f02c3e076467490ed20e49ffa8f727ef8513db"} Jul 02 15:33:52.590971 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:52.590685 2573 scope.go:117] "RemoveContainer" containerID="cce5f5237f83da7152f03087d3542a9a1ec4231d280542637857448ff88787e7" Jul 02 15:33:52.600048 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:52.600030 2573 scope.go:117] "RemoveContainer" containerID="cce5f5237f83da7152f03087d3542a9a1ec4231d280542637857448ff88787e7" Jul 02 15:33:52.600307 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:33:52.600289 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cce5f5237f83da7152f03087d3542a9a1ec4231d280542637857448ff88787e7\": container with ID starting with cce5f5237f83da7152f03087d3542a9a1ec4231d280542637857448ff88787e7 not found: ID does not exist" containerID="cce5f5237f83da7152f03087d3542a9a1ec4231d280542637857448ff88787e7" Jul 02 15:33:52.600359 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:52.600317 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cce5f5237f83da7152f03087d3542a9a1ec4231d280542637857448ff88787e7"} err="failed to get container status \"cce5f5237f83da7152f03087d3542a9a1ec4231d280542637857448ff88787e7\": rpc error: code = NotFound desc = could not find container \"cce5f5237f83da7152f03087d3542a9a1ec4231d280542637857448ff88787e7\": container with ID starting with cce5f5237f83da7152f03087d3542a9a1ec4231d280542637857448ff88787e7 not found: ID does not exist" Jul 02 15:33:52.612858 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:52.612826 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k62ls"] Jul 02 15:33:52.616790 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:52.616764 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k62ls"] Jul 02 15:33:53.418137 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:33:53.418101 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb" path="/var/lib/kubelet/pods/75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb/volumes" Jul 02 15:34:10.107729 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:10.107681 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4lqmd"] Jul 02 15:34:10.108096 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:10.108030 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb" containerName="manager" Jul 02 15:34:10.108096 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:10.108044 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb" containerName="manager" Jul 02 15:34:10.108185 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:10.108116 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="75c0c44d-ac2f-4e36-a1c8-09c7a0a2ddcb" containerName="manager" Jul 02 15:34:10.112107 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:10.112089 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4lqmd" Jul 02 15:34:10.114965 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:10.114944 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 02 15:34:10.115096 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:10.115019 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-s8dmg\"" Jul 02 15:34:10.122219 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:10.122181 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4lqmd"] Jul 02 15:34:10.201507 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:10.201473 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4lqmd"] Jul 02 15:34:10.210684 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:10.210655 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzz5z\" (UniqueName: \"kubernetes.io/projected/02603b7f-de31-4635-8c41-a13a1ab7ad08-kube-api-access-pzz5z\") pod \"limitador-limitador-64c94fd64f-4lqmd\" (UID: \"02603b7f-de31-4635-8c41-a13a1ab7ad08\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4lqmd" Jul 02 15:34:10.210847 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:10.210721 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/02603b7f-de31-4635-8c41-a13a1ab7ad08-config-file\") pod \"limitador-limitador-64c94fd64f-4lqmd\" (UID: \"02603b7f-de31-4635-8c41-a13a1ab7ad08\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4lqmd" Jul 02 15:34:10.311586 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:10.311546 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/02603b7f-de31-4635-8c41-a13a1ab7ad08-config-file\") pod \"limitador-limitador-64c94fd64f-4lqmd\" (UID: \"02603b7f-de31-4635-8c41-a13a1ab7ad08\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4lqmd" Jul 02 15:34:10.311758 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:10.311602 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzz5z\" (UniqueName: \"kubernetes.io/projected/02603b7f-de31-4635-8c41-a13a1ab7ad08-kube-api-access-pzz5z\") pod \"limitador-limitador-64c94fd64f-4lqmd\" (UID: \"02603b7f-de31-4635-8c41-a13a1ab7ad08\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4lqmd" Jul 02 15:34:10.312236 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:10.312215 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/02603b7f-de31-4635-8c41-a13a1ab7ad08-config-file\") pod \"limitador-limitador-64c94fd64f-4lqmd\" (UID: \"02603b7f-de31-4635-8c41-a13a1ab7ad08\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4lqmd" Jul 02 15:34:10.321081 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:10.321055 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzz5z\" (UniqueName: \"kubernetes.io/projected/02603b7f-de31-4635-8c41-a13a1ab7ad08-kube-api-access-pzz5z\") pod \"limitador-limitador-64c94fd64f-4lqmd\" (UID: \"02603b7f-de31-4635-8c41-a13a1ab7ad08\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4lqmd" Jul 02 15:34:10.423546 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:10.423469 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4lqmd" Jul 02 15:34:10.559635 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:10.559610 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4lqmd"] Jul 02 15:34:10.562155 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:34:10.562123 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02603b7f_de31_4635_8c41_a13a1ab7ad08.slice/crio-d648ce96e929b19656b3cffd5ed4f756ed428f05aaf1c9780317f6cb9f20e61b WatchSource:0}: Error finding container d648ce96e929b19656b3cffd5ed4f756ed428f05aaf1c9780317f6cb9f20e61b: Status 404 returned error can't find the container with id d648ce96e929b19656b3cffd5ed4f756ed428f05aaf1c9780317f6cb9f20e61b Jul 02 15:34:10.673060 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:10.673023 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4lqmd" event={"ID":"02603b7f-de31-4635-8c41-a13a1ab7ad08","Type":"ContainerStarted","Data":"d648ce96e929b19656b3cffd5ed4f756ed428f05aaf1c9780317f6cb9f20e61b"} Jul 02 15:34:11.097836 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:11.097802 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-g6v7n"] Jul 02 15:34:11.102080 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:11.102054 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-g6v7n" Jul 02 15:34:11.104872 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:11.104849 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kltg6\"" Jul 02 15:34:11.108666 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:11.108632 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g6v7n"] Jul 02 15:34:11.220810 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:11.220773 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r75x7\" (UniqueName: \"kubernetes.io/projected/779dfd0c-1612-4b2f-846a-378489060a35-kube-api-access-r75x7\") pod \"authorino-75d556bd77-g6v7n\" (UID: \"779dfd0c-1612-4b2f-846a-378489060a35\") " pod="kuadrant-system/authorino-75d556bd77-g6v7n" Jul 02 15:34:11.321642 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:11.321606 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r75x7\" (UniqueName: \"kubernetes.io/projected/779dfd0c-1612-4b2f-846a-378489060a35-kube-api-access-r75x7\") pod \"authorino-75d556bd77-g6v7n\" (UID: \"779dfd0c-1612-4b2f-846a-378489060a35\") " pod="kuadrant-system/authorino-75d556bd77-g6v7n" Jul 02 15:34:11.336897 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:11.336851 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r75x7\" (UniqueName: \"kubernetes.io/projected/779dfd0c-1612-4b2f-846a-378489060a35-kube-api-access-r75x7\") pod \"authorino-75d556bd77-g6v7n\" (UID: \"779dfd0c-1612-4b2f-846a-378489060a35\") " pod="kuadrant-system/authorino-75d556bd77-g6v7n" Jul 02 15:34:11.413599 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:11.413517 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-g6v7n" Jul 02 15:34:11.585767 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:11.585436 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g6v7n"] Jul 02 15:34:11.680565 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:11.680479 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-g6v7n" event={"ID":"779dfd0c-1612-4b2f-846a-378489060a35","Type":"ContainerStarted","Data":"dc434dfe401da02f4fca394973fd36fc53e6af91c3a4e4e7b09110d20c238d96"} Jul 02 15:34:13.695514 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:13.695058 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4lqmd" event={"ID":"02603b7f-de31-4635-8c41-a13a1ab7ad08","Type":"ContainerStarted","Data":"15411c7978ca8cd4a5550c97fbaeccc53be7592089edb82a0788d1caaf60dcc8"} Jul 02 15:34:13.695514 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:13.695207 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-4lqmd" Jul 02 15:34:13.714776 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:13.714726 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-4lqmd" podStartSLOduration=0.925342669 podStartE2EDuration="3.714706421s" totalImagesPullingTime="2.789363752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:34:13.71366739 +0000 UTC m=+498.785981103" watchObservedRunningTime="2026-07-02 15:34:13.714706421 +0000 UTC m=+498.787020134" Jul 02 15:34:16.710480 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:16.710444 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-g6v7n" event={"ID":"779dfd0c-1612-4b2f-846a-378489060a35","Type":"ContainerStarted","Data":"f8d4cdc7957f7bab8f691b9ad9546b9fce2dd1cf9004ce4d78b9664ec48312e2"} Jul 02 15:34:16.726225 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:16.726171 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-g6v7n" podStartSLOduration=1.624849609 podStartE2EDuration="5.726155005s" totalImagesPullingTime="4.101305396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:34:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:34:16.724581513 +0000 UTC m=+501.796895225" watchObservedRunningTime="2026-07-02 15:34:16.726155005 +0000 UTC m=+501.798468716" Jul 02 15:34:24.701453 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:24.701424 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-4lqmd" Jul 02 15:34:25.949435 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:25.949397 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4lqmd"] Jul 02 15:34:25.949864 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:25.949599 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-4lqmd" podUID="02603b7f-de31-4635-8c41-a13a1ab7ad08" containerName="limitador" containerID="cri-o://15411c7978ca8cd4a5550c97fbaeccc53be7592089edb82a0788d1caaf60dcc8" gracePeriod=30 Jul 02 15:34:26.757920 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:26.757877 2573 generic.go:356] "Generic (PLEG): container finished" podID="02603b7f-de31-4635-8c41-a13a1ab7ad08" containerID="15411c7978ca8cd4a5550c97fbaeccc53be7592089edb82a0788d1caaf60dcc8" exitCode=0 Jul 02 15:34:26.758115 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:26.757949 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4lqmd" event={"ID":"02603b7f-de31-4635-8c41-a13a1ab7ad08","Type":"ContainerDied","Data":"15411c7978ca8cd4a5550c97fbaeccc53be7592089edb82a0788d1caaf60dcc8"} Jul 02 15:34:26.889388 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:26.889360 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4lqmd" Jul 02 15:34:26.961558 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:26.961523 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzz5z\" (UniqueName: \"kubernetes.io/projected/02603b7f-de31-4635-8c41-a13a1ab7ad08-kube-api-access-pzz5z\") pod \"02603b7f-de31-4635-8c41-a13a1ab7ad08\" (UID: \"02603b7f-de31-4635-8c41-a13a1ab7ad08\") " Jul 02 15:34:26.961961 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:26.961579 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/02603b7f-de31-4635-8c41-a13a1ab7ad08-config-file\") pod \"02603b7f-de31-4635-8c41-a13a1ab7ad08\" (UID: \"02603b7f-de31-4635-8c41-a13a1ab7ad08\") " Jul 02 15:34:26.962035 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:26.961956 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02603b7f-de31-4635-8c41-a13a1ab7ad08-config-file" (OuterVolumeSpecName: "config-file") pod "02603b7f-de31-4635-8c41-a13a1ab7ad08" (UID: "02603b7f-de31-4635-8c41-a13a1ab7ad08"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:34:26.963704 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:26.963685 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02603b7f-de31-4635-8c41-a13a1ab7ad08-kube-api-access-pzz5z" (OuterVolumeSpecName: "kube-api-access-pzz5z") pod "02603b7f-de31-4635-8c41-a13a1ab7ad08" (UID: "02603b7f-de31-4635-8c41-a13a1ab7ad08"). InnerVolumeSpecName "kube-api-access-pzz5z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:34:27.062782 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:27.062754 2573 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/02603b7f-de31-4635-8c41-a13a1ab7ad08-config-file\") on node \"ip-10-0-138-41.ec2.internal\" DevicePath \"\"" Jul 02 15:34:27.062782 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:27.062782 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzz5z\" (UniqueName: \"kubernetes.io/projected/02603b7f-de31-4635-8c41-a13a1ab7ad08-kube-api-access-pzz5z\") on node \"ip-10-0-138-41.ec2.internal\" DevicePath \"\"" Jul 02 15:34:27.763360 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:27.763286 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4lqmd" Jul 02 15:34:27.763360 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:27.763296 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4lqmd" event={"ID":"02603b7f-de31-4635-8c41-a13a1ab7ad08","Type":"ContainerDied","Data":"d648ce96e929b19656b3cffd5ed4f756ed428f05aaf1c9780317f6cb9f20e61b"} Jul 02 15:34:27.763360 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:27.763347 2573 scope.go:117] "RemoveContainer" containerID="15411c7978ca8cd4a5550c97fbaeccc53be7592089edb82a0788d1caaf60dcc8" Jul 02 15:34:27.780383 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:27.780361 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4lqmd"] Jul 02 15:34:27.784077 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:27.784058 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4lqmd"] Jul 02 15:34:29.416765 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:29.416731 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02603b7f-de31-4635-8c41-a13a1ab7ad08" path="/var/lib/kubelet/pods/02603b7f-de31-4635-8c41-a13a1ab7ad08/volumes" Jul 02 15:34:31.639626 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:31.639589 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-nkvwj"] Jul 02 15:34:31.640115 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:31.639973 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02603b7f-de31-4635-8c41-a13a1ab7ad08" containerName="limitador" Jul 02 15:34:31.640115 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:31.639985 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="02603b7f-de31-4635-8c41-a13a1ab7ad08" containerName="limitador" Jul 02 15:34:31.640115 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:31.640057 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="02603b7f-de31-4635-8c41-a13a1ab7ad08" containerName="limitador" Jul 02 15:34:31.644456 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:31.644431 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-nkvwj" Jul 02 15:34:31.646907 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:31.646886 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 02 15:34:31.647074 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:31.646953 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8j5tq\"" Jul 02 15:34:31.650792 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:31.650764 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-nkvwj"] Jul 02 15:34:31.693868 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:31.693830 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dc3473d1-52a0-4784-aa3e-6d920da5f8ab-data\") pod \"postgres-69fb4594cf-nkvwj\" (UID: \"dc3473d1-52a0-4784-aa3e-6d920da5f8ab\") " pod="opendatahub/postgres-69fb4594cf-nkvwj" Jul 02 15:34:31.694072 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:31.693875 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45w8q\" (UniqueName: \"kubernetes.io/projected/dc3473d1-52a0-4784-aa3e-6d920da5f8ab-kube-api-access-45w8q\") pod \"postgres-69fb4594cf-nkvwj\" (UID: \"dc3473d1-52a0-4784-aa3e-6d920da5f8ab\") " pod="opendatahub/postgres-69fb4594cf-nkvwj" Jul 02 15:34:31.795112 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:31.795081 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dc3473d1-52a0-4784-aa3e-6d920da5f8ab-data\") pod \"postgres-69fb4594cf-nkvwj\" (UID: \"dc3473d1-52a0-4784-aa3e-6d920da5f8ab\") " pod="opendatahub/postgres-69fb4594cf-nkvwj" Jul 02 15:34:31.795283 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:31.795125 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45w8q\" (UniqueName: \"kubernetes.io/projected/dc3473d1-52a0-4784-aa3e-6d920da5f8ab-kube-api-access-45w8q\") pod \"postgres-69fb4594cf-nkvwj\" (UID: \"dc3473d1-52a0-4784-aa3e-6d920da5f8ab\") " pod="opendatahub/postgres-69fb4594cf-nkvwj" Jul 02 15:34:31.795469 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:31.795449 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dc3473d1-52a0-4784-aa3e-6d920da5f8ab-data\") pod \"postgres-69fb4594cf-nkvwj\" (UID: \"dc3473d1-52a0-4784-aa3e-6d920da5f8ab\") " pod="opendatahub/postgres-69fb4594cf-nkvwj" Jul 02 15:34:31.804357 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:31.804333 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45w8q\" (UniqueName: \"kubernetes.io/projected/dc3473d1-52a0-4784-aa3e-6d920da5f8ab-kube-api-access-45w8q\") pod \"postgres-69fb4594cf-nkvwj\" (UID: \"dc3473d1-52a0-4784-aa3e-6d920da5f8ab\") " pod="opendatahub/postgres-69fb4594cf-nkvwj" Jul 02 15:34:31.958437 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:31.958350 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-nkvwj" Jul 02 15:34:32.091858 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:32.091835 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-nkvwj"] Jul 02 15:34:32.094350 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:34:32.094316 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc3473d1_52a0_4784_aa3e_6d920da5f8ab.slice/crio-6edf98f8b80f99209d6499d624f2f6cf467640ba81232a45b5c600477f79dec1 WatchSource:0}: Error finding container 6edf98f8b80f99209d6499d624f2f6cf467640ba81232a45b5c600477f79dec1: Status 404 returned error can't find the container with id 6edf98f8b80f99209d6499d624f2f6cf467640ba81232a45b5c600477f79dec1 Jul 02 15:34:32.787333 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:32.787297 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-nkvwj" event={"ID":"dc3473d1-52a0-4784-aa3e-6d920da5f8ab","Type":"ContainerStarted","Data":"6edf98f8b80f99209d6499d624f2f6cf467640ba81232a45b5c600477f79dec1"} Jul 02 15:34:38.822573 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:38.822533 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-nkvwj" event={"ID":"dc3473d1-52a0-4784-aa3e-6d920da5f8ab","Type":"ContainerStarted","Data":"d2ebbaa06270ded7fdebf5fdedd78307d69a116ba53b2fb4ae9dc6a48b627741"} Jul 02 15:34:38.823046 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:38.822624 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-nkvwj" Jul 02 15:34:38.847167 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:38.847113 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-nkvwj" podStartSLOduration=2.144291925 podStartE2EDuration="7.84709655s" totalImagesPullingTime="5.702804625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:34:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:34:38.845560227 +0000 UTC m=+523.917873939" watchObservedRunningTime="2026-07-02 15:34:38.84709655 +0000 UTC m=+523.919410262" Jul 02 15:34:44.856569 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:44.856540 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-nkvwj" Jul 02 15:34:55.621414 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:55.621370 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-xkjrh"] Jul 02 15:34:55.627043 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:55.627020 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-xkjrh" Jul 02 15:34:55.630033 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:55.629984 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-xxsmj\"" Jul 02 15:34:55.631026 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:55.630986 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 02 15:34:55.631026 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:55.631020 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 02 15:34:55.635775 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:55.635751 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-xkjrh"] Jul 02 15:34:55.713163 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:55.713062 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbdnn\" (UniqueName: \"kubernetes.io/projected/3cbf798d-d4b7-4840-9fc8-b8b14352f83f-kube-api-access-tbdnn\") pod \"keycloak-operator-d8b9d7b4d-xkjrh\" (UID: \"3cbf798d-d4b7-4840-9fc8-b8b14352f83f\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-xkjrh" Jul 02 15:34:55.814646 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:55.814593 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbdnn\" (UniqueName: \"kubernetes.io/projected/3cbf798d-d4b7-4840-9fc8-b8b14352f83f-kube-api-access-tbdnn\") pod \"keycloak-operator-d8b9d7b4d-xkjrh\" (UID: \"3cbf798d-d4b7-4840-9fc8-b8b14352f83f\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-xkjrh" Jul 02 15:34:55.823805 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:55.823767 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbdnn\" (UniqueName: \"kubernetes.io/projected/3cbf798d-d4b7-4840-9fc8-b8b14352f83f-kube-api-access-tbdnn\") pod \"keycloak-operator-d8b9d7b4d-xkjrh\" (UID: \"3cbf798d-d4b7-4840-9fc8-b8b14352f83f\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-xkjrh" Jul 02 15:34:55.938960 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:55.938903 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-xkjrh" Jul 02 15:34:56.075939 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:56.075913 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-xkjrh"] Jul 02 15:34:56.907595 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:34:56.907544 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-xkjrh" event={"ID":"3cbf798d-d4b7-4840-9fc8-b8b14352f83f","Type":"ContainerStarted","Data":"2dbd8f2442c8b4c466c9b4300188f6596dba26b19a2d15a2de70f4963009adbf"} Jul 02 15:35:02.940605 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:35:02.940561 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-xkjrh" event={"ID":"3cbf798d-d4b7-4840-9fc8-b8b14352f83f","Type":"ContainerStarted","Data":"3c267cdda2ccd404dac5bb1821dc9f0f35cdb72809bc7ec417b4405569dbadb3"} Jul 02 15:35:02.967501 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:35:02.967430 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d8b9d7b4d-xkjrh" podStartSLOduration=2.1325148 podStartE2EDuration="7.967407888s" totalImagesPullingTime="5.834893088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:34:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:35:02.963326978 +0000 UTC m=+548.035640691" watchObservedRunningTime="2026-07-02 15:35:02.967407888 +0000 UTC m=+548.039721601" Jul 02 15:35:44.376337 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:35:44.376299 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g6v7n"] Jul 02 15:35:44.376782 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:35:44.376486 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-g6v7n" podUID="779dfd0c-1612-4b2f-846a-378489060a35" containerName="authorino" containerID="cri-o://f8d4cdc7957f7bab8f691b9ad9546b9fce2dd1cf9004ce4d78b9664ec48312e2" gracePeriod=30 Jul 02 15:35:44.633794 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:35:44.633721 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-g6v7n" Jul 02 15:35:44.730987 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:35:44.730948 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r75x7\" (UniqueName: \"kubernetes.io/projected/779dfd0c-1612-4b2f-846a-378489060a35-kube-api-access-r75x7\") pod \"779dfd0c-1612-4b2f-846a-378489060a35\" (UID: \"779dfd0c-1612-4b2f-846a-378489060a35\") " Jul 02 15:35:44.732950 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:35:44.732926 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/779dfd0c-1612-4b2f-846a-378489060a35-kube-api-access-r75x7" (OuterVolumeSpecName: "kube-api-access-r75x7") pod "779dfd0c-1612-4b2f-846a-378489060a35" (UID: "779dfd0c-1612-4b2f-846a-378489060a35"). InnerVolumeSpecName "kube-api-access-r75x7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:35:44.831845 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:35:44.831808 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r75x7\" (UniqueName: \"kubernetes.io/projected/779dfd0c-1612-4b2f-846a-378489060a35-kube-api-access-r75x7\") on node \"ip-10-0-138-41.ec2.internal\" DevicePath \"\"" Jul 02 15:35:45.134551 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:35:45.134513 2573 generic.go:356] "Generic (PLEG): container finished" podID="779dfd0c-1612-4b2f-846a-378489060a35" containerID="f8d4cdc7957f7bab8f691b9ad9546b9fce2dd1cf9004ce4d78b9664ec48312e2" exitCode=0 Jul 02 15:35:45.134735 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:35:45.134571 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-g6v7n" Jul 02 15:35:45.134735 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:35:45.134604 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-g6v7n" event={"ID":"779dfd0c-1612-4b2f-846a-378489060a35","Type":"ContainerDied","Data":"f8d4cdc7957f7bab8f691b9ad9546b9fce2dd1cf9004ce4d78b9664ec48312e2"} Jul 02 15:35:45.134735 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:35:45.134649 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-g6v7n" event={"ID":"779dfd0c-1612-4b2f-846a-378489060a35","Type":"ContainerDied","Data":"dc434dfe401da02f4fca394973fd36fc53e6af91c3a4e4e7b09110d20c238d96"} Jul 02 15:35:45.134735 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:35:45.134667 2573 scope.go:117] "RemoveContainer" containerID="f8d4cdc7957f7bab8f691b9ad9546b9fce2dd1cf9004ce4d78b9664ec48312e2" Jul 02 15:35:45.144449 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:35:45.144429 2573 scope.go:117] "RemoveContainer" containerID="f8d4cdc7957f7bab8f691b9ad9546b9fce2dd1cf9004ce4d78b9664ec48312e2" Jul 02 15:35:45.144715 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:35:45.144696 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8d4cdc7957f7bab8f691b9ad9546b9fce2dd1cf9004ce4d78b9664ec48312e2\": container with ID starting with f8d4cdc7957f7bab8f691b9ad9546b9fce2dd1cf9004ce4d78b9664ec48312e2 not found: ID does not exist" containerID="f8d4cdc7957f7bab8f691b9ad9546b9fce2dd1cf9004ce4d78b9664ec48312e2" Jul 02 15:35:45.144753 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:35:45.144727 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8d4cdc7957f7bab8f691b9ad9546b9fce2dd1cf9004ce4d78b9664ec48312e2"} err="failed to get container status \"f8d4cdc7957f7bab8f691b9ad9546b9fce2dd1cf9004ce4d78b9664ec48312e2\": rpc error: code = NotFound desc = could not find container \"f8d4cdc7957f7bab8f691b9ad9546b9fce2dd1cf9004ce4d78b9664ec48312e2\": container with ID starting with f8d4cdc7957f7bab8f691b9ad9546b9fce2dd1cf9004ce4d78b9664ec48312e2 not found: ID does not exist" Jul 02 15:35:45.164496 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:35:45.164467 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g6v7n"] Jul 02 15:35:45.170954 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:35:45.170925 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g6v7n"] Jul 02 15:35:45.417933 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:35:45.417854 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="779dfd0c-1612-4b2f-846a-378489060a35" path="/var/lib/kubelet/pods/779dfd0c-1612-4b2f-846a-378489060a35/volumes" Jul 02 15:35:55.376662 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:35:55.376632 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-g5scp_2a799b2e-a2de-4260-8fe4-0cb5242c0952/console-operator/1.log" Jul 02 15:35:55.378973 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:35:55.378952 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-g5scp_2a799b2e-a2de-4260-8fe4-0cb5242c0952/console-operator/1.log" Jul 02 15:36:27.919405 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:36:27.919369 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-8tcgn"] Jul 02 15:36:27.921817 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:36:27.919701 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="779dfd0c-1612-4b2f-846a-378489060a35" containerName="authorino" Jul 02 15:36:27.921817 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:36:27.919713 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="779dfd0c-1612-4b2f-846a-378489060a35" containerName="authorino" Jul 02 15:36:27.921817 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:36:27.919770 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="779dfd0c-1612-4b2f-846a-378489060a35" containerName="authorino" Jul 02 15:36:27.922738 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:36:27.922718 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-8tcgn" Jul 02 15:36:27.925724 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:36:27.925703 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-72fzw\"" Jul 02 15:36:27.926194 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:36:27.926171 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 02 15:36:27.933187 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:36:27.933146 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-8tcgn"] Jul 02 15:36:28.010796 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:36:28.010758 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd9vt\" (UniqueName: \"kubernetes.io/projected/4d5f78c3-824b-49f3-af2b-f8f4a7661416-kube-api-access-dd9vt\") pod \"payload-processing-7bbcb654f4-8tcgn\" (UID: \"4d5f78c3-824b-49f3-af2b-f8f4a7661416\") " pod="openshift-ingress/payload-processing-7bbcb654f4-8tcgn" Jul 02 15:36:28.010981 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:36:28.010806 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d5f78c3-824b-49f3-af2b-f8f4a7661416-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-8tcgn\" (UID: \"4d5f78c3-824b-49f3-af2b-f8f4a7661416\") " pod="openshift-ingress/payload-processing-7bbcb654f4-8tcgn" Jul 02 15:36:28.111506 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:36:28.111470 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd9vt\" (UniqueName: \"kubernetes.io/projected/4d5f78c3-824b-49f3-af2b-f8f4a7661416-kube-api-access-dd9vt\") pod \"payload-processing-7bbcb654f4-8tcgn\" (UID: \"4d5f78c3-824b-49f3-af2b-f8f4a7661416\") " pod="openshift-ingress/payload-processing-7bbcb654f4-8tcgn" Jul 02 15:36:28.111680 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:36:28.111535 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d5f78c3-824b-49f3-af2b-f8f4a7661416-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-8tcgn\" (UID: \"4d5f78c3-824b-49f3-af2b-f8f4a7661416\") " pod="openshift-ingress/payload-processing-7bbcb654f4-8tcgn" Jul 02 15:36:28.112452 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:36:28.112422 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d5f78c3-824b-49f3-af2b-f8f4a7661416-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-8tcgn\" (UID: \"4d5f78c3-824b-49f3-af2b-f8f4a7661416\") " pod="openshift-ingress/payload-processing-7bbcb654f4-8tcgn" Jul 02 15:36:28.120813 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:36:28.120769 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd9vt\" (UniqueName: \"kubernetes.io/projected/4d5f78c3-824b-49f3-af2b-f8f4a7661416-kube-api-access-dd9vt\") pod \"payload-processing-7bbcb654f4-8tcgn\" (UID: \"4d5f78c3-824b-49f3-af2b-f8f4a7661416\") " pod="openshift-ingress/payload-processing-7bbcb654f4-8tcgn" Jul 02 15:36:28.235487 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:36:28.235395 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-8tcgn" Jul 02 15:36:28.375707 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:36:28.375682 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-8tcgn"] Jul 02 15:36:28.377573 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:36:28.377544 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d5f78c3_824b_49f3_af2b_f8f4a7661416.slice/crio-bfe73cd0430a3322a388cf5e5775dc07d9d316fcf8284753075bb854141d21eb WatchSource:0}: Error finding container bfe73cd0430a3322a388cf5e5775dc07d9d316fcf8284753075bb854141d21eb: Status 404 returned error can't find the container with id bfe73cd0430a3322a388cf5e5775dc07d9d316fcf8284753075bb854141d21eb Jul 02 15:36:28.379526 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:36:28.379511 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 15:36:29.345908 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:36:29.345867 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-8tcgn" event={"ID":"4d5f78c3-824b-49f3-af2b-f8f4a7661416","Type":"ContainerStarted","Data":"bfe73cd0430a3322a388cf5e5775dc07d9d316fcf8284753075bb854141d21eb"} Jul 02 15:36:31.358161 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:36:31.358124 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-8tcgn" event={"ID":"4d5f78c3-824b-49f3-af2b-f8f4a7661416","Type":"ContainerStarted","Data":"323fb22deb6ed765cbc38aeb9fd39a8d9fa1f184b1d73eaeb5b309b2a8734ed4"} Jul 02 15:36:31.358565 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:36:31.358266 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-8tcgn" Jul 02 15:36:31.375099 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:36:31.375047 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7bbcb654f4-8tcgn" podStartSLOduration=2.10326395 podStartE2EDuration="4.374984636s" totalImagesPullingTime="2.271720686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:36:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:36:31.374343153 +0000 UTC m=+636.446656867" watchObservedRunningTime="2026-07-02 15:36:31.374984636 +0000 UTC m=+636.447298348" Jul 02 15:36:42.364152 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:36:42.364123 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-8tcgn" Jul 02 15:37:49.381759 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.381672 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl"] Jul 02 15:37:49.385321 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.385302 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" Jul 02 15:37:49.387944 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.387912 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 02 15:37:49.388838 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.388819 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 02 15:37:49.388938 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.388908 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 02 15:37:49.388938 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.388918 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5mqnd\"" Jul 02 15:37:49.394650 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.394629 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl"] Jul 02 15:37:49.503324 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.503284 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2dd569f3-9382-44ee-a16c-d4a13a528654-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl\" (UID: \"2dd569f3-9382-44ee-a16c-d4a13a528654\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" Jul 02 15:37:49.503523 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.503336 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2dd569f3-9382-44ee-a16c-d4a13a528654-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl\" (UID: \"2dd569f3-9382-44ee-a16c-d4a13a528654\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" Jul 02 15:37:49.503523 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.503395 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqhtm\" (UniqueName: \"kubernetes.io/projected/2dd569f3-9382-44ee-a16c-d4a13a528654-kube-api-access-fqhtm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl\" (UID: \"2dd569f3-9382-44ee-a16c-d4a13a528654\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" Jul 02 15:37:49.503523 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.503449 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2dd569f3-9382-44ee-a16c-d4a13a528654-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl\" (UID: \"2dd569f3-9382-44ee-a16c-d4a13a528654\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" Jul 02 15:37:49.503523 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.503477 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dd569f3-9382-44ee-a16c-d4a13a528654-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl\" (UID: \"2dd569f3-9382-44ee-a16c-d4a13a528654\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" Jul 02 15:37:49.503669 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.503567 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2dd569f3-9382-44ee-a16c-d4a13a528654-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl\" (UID: \"2dd569f3-9382-44ee-a16c-d4a13a528654\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" Jul 02 15:37:49.604535 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.604501 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqhtm\" (UniqueName: \"kubernetes.io/projected/2dd569f3-9382-44ee-a16c-d4a13a528654-kube-api-access-fqhtm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl\" (UID: \"2dd569f3-9382-44ee-a16c-d4a13a528654\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" Jul 02 15:37:49.604744 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.604687 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2dd569f3-9382-44ee-a16c-d4a13a528654-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl\" (UID: \"2dd569f3-9382-44ee-a16c-d4a13a528654\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" Jul 02 15:37:49.604821 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.604755 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dd569f3-9382-44ee-a16c-d4a13a528654-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl\" (UID: \"2dd569f3-9382-44ee-a16c-d4a13a528654\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" Jul 02 15:37:49.604962 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.604939 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2dd569f3-9382-44ee-a16c-d4a13a528654-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl\" (UID: \"2dd569f3-9382-44ee-a16c-d4a13a528654\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" Jul 02 15:37:49.605074 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.605059 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2dd569f3-9382-44ee-a16c-d4a13a528654-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl\" (UID: \"2dd569f3-9382-44ee-a16c-d4a13a528654\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" Jul 02 15:37:49.605138 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.605111 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2dd569f3-9382-44ee-a16c-d4a13a528654-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl\" (UID: \"2dd569f3-9382-44ee-a16c-d4a13a528654\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" Jul 02 15:37:49.605362 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.605334 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2dd569f3-9382-44ee-a16c-d4a13a528654-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl\" (UID: \"2dd569f3-9382-44ee-a16c-d4a13a528654\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" Jul 02 15:37:49.605432 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.605364 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2dd569f3-9382-44ee-a16c-d4a13a528654-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl\" (UID: \"2dd569f3-9382-44ee-a16c-d4a13a528654\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" Jul 02 15:37:49.605484 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.605449 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dd569f3-9382-44ee-a16c-d4a13a528654-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl\" (UID: \"2dd569f3-9382-44ee-a16c-d4a13a528654\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" Jul 02 15:37:49.607390 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.607373 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2dd569f3-9382-44ee-a16c-d4a13a528654-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl\" (UID: \"2dd569f3-9382-44ee-a16c-d4a13a528654\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" Jul 02 15:37:49.607663 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.607645 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2dd569f3-9382-44ee-a16c-d4a13a528654-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl\" (UID: \"2dd569f3-9382-44ee-a16c-d4a13a528654\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" Jul 02 15:37:49.612334 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.612312 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqhtm\" (UniqueName: \"kubernetes.io/projected/2dd569f3-9382-44ee-a16c-d4a13a528654-kube-api-access-fqhtm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl\" (UID: \"2dd569f3-9382-44ee-a16c-d4a13a528654\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" Jul 02 15:37:49.697175 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.697085 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" Jul 02 15:37:49.846222 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:49.846182 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl"] Jul 02 15:37:49.848032 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:37:49.847986 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dd569f3_9382_44ee_a16c_d4a13a528654.slice/crio-3df339e263e24952e447c145413743134bb147c0056ed48006a181f6c2bf7027 WatchSource:0}: Error finding container 3df339e263e24952e447c145413743134bb147c0056ed48006a181f6c2bf7027: Status 404 returned error can't find the container with id 3df339e263e24952e447c145413743134bb147c0056ed48006a181f6c2bf7027 Jul 02 15:37:50.733069 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:50.733022 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" event={"ID":"2dd569f3-9382-44ee-a16c-d4a13a528654","Type":"ContainerStarted","Data":"3df339e263e24952e447c145413743134bb147c0056ed48006a181f6c2bf7027"} Jul 02 15:37:51.739889 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:51.739849 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" event={"ID":"2dd569f3-9382-44ee-a16c-d4a13a528654","Type":"ContainerStarted","Data":"b696ac16ccefb24cb9d9b96a9fad8f00cf0c2af6f9c3f3031bff1a09c7e3e307"} Jul 02 15:37:51.763517 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:51.763462 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" podStartSLOduration=1.594970582 podStartE2EDuration="2.763446377s" totalImagesPullingTime="1.168475795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:37:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:37:51.761192008 +0000 UTC m=+716.833505732" watchObservedRunningTime="2026-07-02 15:37:51.763446377 +0000 UTC m=+716.835760089" Jul 02 15:37:59.697255 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:59.697213 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" Jul 02 15:37:59.697627 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:59.697291 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" Jul 02 15:37:59.709950 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:59.709919 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" Jul 02 15:37:59.788376 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:37:59.788349 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl" Jul 02 15:38:39.768373 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:39.768330 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf"] Jul 02 15:38:39.771350 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:39.771324 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" Jul 02 15:38:39.774189 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:39.774161 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 02 15:38:39.782652 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:39.782623 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf"] Jul 02 15:38:39.951237 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:39.951191 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08f17ab0-e0d0-4c68-b5fa-684fb81060c6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx9mf\" (UID: \"08f17ab0-e0d0-4c68-b5fa-684fb81060c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" Jul 02 15:38:39.951409 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:39.951257 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7q7m\" (UniqueName: \"kubernetes.io/projected/08f17ab0-e0d0-4c68-b5fa-684fb81060c6-kube-api-access-l7q7m\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx9mf\" (UID: \"08f17ab0-e0d0-4c68-b5fa-684fb81060c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" Jul 02 15:38:39.951409 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:39.951277 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08f17ab0-e0d0-4c68-b5fa-684fb81060c6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx9mf\" (UID: \"08f17ab0-e0d0-4c68-b5fa-684fb81060c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" Jul 02 15:38:39.951409 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:39.951346 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08f17ab0-e0d0-4c68-b5fa-684fb81060c6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx9mf\" (UID: \"08f17ab0-e0d0-4c68-b5fa-684fb81060c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" Jul 02 15:38:39.951515 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:39.951402 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08f17ab0-e0d0-4c68-b5fa-684fb81060c6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx9mf\" (UID: \"08f17ab0-e0d0-4c68-b5fa-684fb81060c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" Jul 02 15:38:39.951515 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:39.951437 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08f17ab0-e0d0-4c68-b5fa-684fb81060c6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx9mf\" (UID: \"08f17ab0-e0d0-4c68-b5fa-684fb81060c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" Jul 02 15:38:40.052469 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:40.052370 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7q7m\" (UniqueName: \"kubernetes.io/projected/08f17ab0-e0d0-4c68-b5fa-684fb81060c6-kube-api-access-l7q7m\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx9mf\" (UID: \"08f17ab0-e0d0-4c68-b5fa-684fb81060c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" Jul 02 15:38:40.052469 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:40.052409 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08f17ab0-e0d0-4c68-b5fa-684fb81060c6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx9mf\" (UID: \"08f17ab0-e0d0-4c68-b5fa-684fb81060c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" Jul 02 15:38:40.052469 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:40.052437 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08f17ab0-e0d0-4c68-b5fa-684fb81060c6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx9mf\" (UID: \"08f17ab0-e0d0-4c68-b5fa-684fb81060c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" Jul 02 15:38:40.052469 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:40.052456 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08f17ab0-e0d0-4c68-b5fa-684fb81060c6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx9mf\" (UID: \"08f17ab0-e0d0-4c68-b5fa-684fb81060c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" Jul 02 15:38:40.052790 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:40.052477 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08f17ab0-e0d0-4c68-b5fa-684fb81060c6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx9mf\" (UID: \"08f17ab0-e0d0-4c68-b5fa-684fb81060c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" Jul 02 15:38:40.052790 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:40.052635 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08f17ab0-e0d0-4c68-b5fa-684fb81060c6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx9mf\" (UID: \"08f17ab0-e0d0-4c68-b5fa-684fb81060c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" Jul 02 15:38:40.052887 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:40.052862 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08f17ab0-e0d0-4c68-b5fa-684fb81060c6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx9mf\" (UID: \"08f17ab0-e0d0-4c68-b5fa-684fb81060c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" Jul 02 15:38:40.052963 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:40.052937 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08f17ab0-e0d0-4c68-b5fa-684fb81060c6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx9mf\" (UID: \"08f17ab0-e0d0-4c68-b5fa-684fb81060c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" Jul 02 15:38:40.053104 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:40.052971 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08f17ab0-e0d0-4c68-b5fa-684fb81060c6-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx9mf\" (UID: \"08f17ab0-e0d0-4c68-b5fa-684fb81060c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" Jul 02 15:38:40.054744 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:40.054721 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08f17ab0-e0d0-4c68-b5fa-684fb81060c6-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx9mf\" (UID: \"08f17ab0-e0d0-4c68-b5fa-684fb81060c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" Jul 02 15:38:40.055037 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:40.055016 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08f17ab0-e0d0-4c68-b5fa-684fb81060c6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx9mf\" (UID: \"08f17ab0-e0d0-4c68-b5fa-684fb81060c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" Jul 02 15:38:40.061661 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:40.061640 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7q7m\" (UniqueName: \"kubernetes.io/projected/08f17ab0-e0d0-4c68-b5fa-684fb81060c6-kube-api-access-l7q7m\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wx9mf\" (UID: \"08f17ab0-e0d0-4c68-b5fa-684fb81060c6\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" Jul 02 15:38:40.084412 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:40.084388 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" Jul 02 15:38:40.217315 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:40.217289 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf"] Jul 02 15:38:40.219963 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:38:40.219933 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08f17ab0_e0d0_4c68_b5fa_684fb81060c6.slice/crio-20ab9f2d7a91ae5efa59ce98a81721428ff526cae8b54b24d32ab2570dd6c3fc WatchSource:0}: Error finding container 20ab9f2d7a91ae5efa59ce98a81721428ff526cae8b54b24d32ab2570dd6c3fc: Status 404 returned error can't find the container with id 20ab9f2d7a91ae5efa59ce98a81721428ff526cae8b54b24d32ab2570dd6c3fc Jul 02 15:38:40.971259 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:40.971225 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" event={"ID":"08f17ab0-e0d0-4c68-b5fa-684fb81060c6","Type":"ContainerStarted","Data":"bfb19cfd7a02a9ce88c71c2986267cb8244fd7af36e6f0d0ad471d29c50ee0f8"} Jul 02 15:38:40.971666 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:40.971284 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" event={"ID":"08f17ab0-e0d0-4c68-b5fa-684fb81060c6","Type":"ContainerStarted","Data":"20ab9f2d7a91ae5efa59ce98a81721428ff526cae8b54b24d32ab2570dd6c3fc"} Jul 02 15:38:40.988625 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:40.988576 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" podStartSLOduration=1.746974346 podStartE2EDuration="1.988560064s" totalImagesPullingTime="241.585718ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:38:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:38:40.987694259 +0000 UTC m=+766.060007971" watchObservedRunningTime="2026-07-02 15:38:40.988560064 +0000 UTC m=+766.060873776" Jul 02 15:38:50.084948 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:50.084907 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" Jul 02 15:38:50.085446 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:50.085021 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" Jul 02 15:38:50.097585 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:50.097559 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" Jul 02 15:38:51.030476 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:38:51.030448 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wx9mf" Jul 02 15:40:28.474410 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:40:28.474374 2573 generic.go:356] "Generic (PLEG): container finished" podID="4d5f78c3-824b-49f3-af2b-f8f4a7661416" containerID="323fb22deb6ed765cbc38aeb9fd39a8d9fa1f184b1d73eaeb5b309b2a8734ed4" exitCode=2 Jul 02 15:40:28.474814 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:40:28.474451 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-8tcgn" event={"ID":"4d5f78c3-824b-49f3-af2b-f8f4a7661416","Type":"ContainerDied","Data":"323fb22deb6ed765cbc38aeb9fd39a8d9fa1f184b1d73eaeb5b309b2a8734ed4"} Jul 02 15:40:28.474873 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:40:28.474857 2573 scope.go:117] "RemoveContainer" containerID="323fb22deb6ed765cbc38aeb9fd39a8d9fa1f184b1d73eaeb5b309b2a8734ed4" Jul 02 15:40:29.481686 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:40:29.481650 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-8tcgn" event={"ID":"4d5f78c3-824b-49f3-af2b-f8f4a7661416","Type":"ContainerStarted","Data":"b1007f05bfb0559bc67eca852ef9e45156ea77c07bdb4db916fda956d8fabc01"} Jul 02 15:40:29.482137 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:40:29.481856 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-8tcgn" Jul 02 15:40:40.488750 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:40:40.488704 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-8tcgn" Jul 02 15:40:55.405455 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:40:55.405373 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-g5scp_2a799b2e-a2de-4260-8fe4-0cb5242c0952/console-operator/1.log" Jul 02 15:40:55.405951 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:40:55.405495 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-g5scp_2a799b2e-a2de-4260-8fe4-0cb5242c0952/console-operator/1.log" Jul 02 15:41:01.634476 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:01.634443 2573 generic.go:356] "Generic (PLEG): container finished" podID="4d5f78c3-824b-49f3-af2b-f8f4a7661416" containerID="b1007f05bfb0559bc67eca852ef9e45156ea77c07bdb4db916fda956d8fabc01" exitCode=2 Jul 02 15:41:01.634872 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:01.634513 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-8tcgn" event={"ID":"4d5f78c3-824b-49f3-af2b-f8f4a7661416","Type":"ContainerDied","Data":"b1007f05bfb0559bc67eca852ef9e45156ea77c07bdb4db916fda956d8fabc01"} Jul 02 15:41:01.634872 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:01.634573 2573 scope.go:117] "RemoveContainer" containerID="323fb22deb6ed765cbc38aeb9fd39a8d9fa1f184b1d73eaeb5b309b2a8734ed4" Jul 02 15:41:01.634966 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:01.634876 2573 scope.go:117] "RemoveContainer" containerID="b1007f05bfb0559bc67eca852ef9e45156ea77c07bdb4db916fda956d8fabc01" Jul 02 15:41:01.635115 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:41:01.635093 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7bbcb654f4-8tcgn_openshift-ingress(4d5f78c3-824b-49f3-af2b-f8f4a7661416)\"" pod="openshift-ingress/payload-processing-7bbcb654f4-8tcgn" podUID="4d5f78c3-824b-49f3-af2b-f8f4a7661416" Jul 02 15:41:07.115697 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:07.115666 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d66c884b7-m6d77_8e582348-7c54-4b5c-b209-281bf5d0f4db/copy-manifests/0.log" Jul 02 15:41:07.122934 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:07.122911 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d66c884b7-m6d77_8e582348-7c54-4b5c-b209-281bf5d0f4db/manager/0.log" Jul 02 15:41:07.364685 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:07.364659 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-nkvwj_dc3473d1-52a0-4784-aa3e-6d920da5f8ab/postgres/0.log" Jul 02 15:41:08.236066 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:08.236017 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7bbcb654f4-8tcgn" Jul 02 15:41:08.236493 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:08.236421 2573 scope.go:117] "RemoveContainer" containerID="b1007f05bfb0559bc67eca852ef9e45156ea77c07bdb4db916fda956d8fabc01" Jul 02 15:41:08.236630 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:41:08.236611 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7bbcb654f4-8tcgn_openshift-ingress(4d5f78c3-824b-49f3-af2b-f8f4a7661416)\"" pod="openshift-ingress/payload-processing-7bbcb654f4-8tcgn" podUID="4d5f78c3-824b-49f3-af2b-f8f4a7661416" Jul 02 15:41:09.085498 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:09.085463 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zzqkf_fae4eee2-d888-4c4b-b32c-172000719654/registry-server/0.log" Jul 02 15:41:09.212236 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:09.212205 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-cl8lr_190d7ec1-9971-4104-aec7-99e7c824960c/manager/0.log" Jul 02 15:41:10.487757 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:10.487719 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-8tcgn" Jul 02 15:41:10.488281 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:10.488223 2573 scope.go:117] "RemoveContainer" containerID="b1007f05bfb0559bc67eca852ef9e45156ea77c07bdb4db916fda956d8fabc01" Jul 02 15:41:10.488448 ip-10-0-138-41 kubenswrapper[2573]: E0702 15:41:10.488423 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7bbcb654f4-8tcgn_openshift-ingress(4d5f78c3-824b-49f3-af2b-f8f4a7661416)\"" pod="openshift-ingress/payload-processing-7bbcb654f4-8tcgn" podUID="4d5f78c3-824b-49f3-af2b-f8f4a7661416" Jul 02 15:41:10.522524 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:10.522494 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-8tcgn_4d5f78c3-824b-49f3-af2b-f8f4a7661416/payload-processing/1.log" Jul 02 15:41:10.633310 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:10.633278 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d7c49774c-69ntk_2ba6b11a-b88f-405b-a92c-99768fca5c8f/router/0.log" Jul 02 15:41:10.982336 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:10.982307 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-cbcpl_2dd569f3-9382-44ee-a16c-d4a13a528654/main/0.log" Jul 02 15:41:11.443037 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:11.442984 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-wx9mf_08f17ab0-e0d0-4c68-b5fa-684fb81060c6/main/0.log" Jul 02 15:41:18.734165 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:18.734131 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qs9xw_43c7deaa-395b-4e22-81b8-b52ce0f359b9/global-pull-secret-syncer/0.log" Jul 02 15:41:18.809772 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:18.809737 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cpn2h_f8fad264-8fc9-4e9e-b870-a5fc8fac6f67/konnectivity-agent/0.log" Jul 02 15:41:18.905078 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:18.905052 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-41.ec2.internal_a69f5b6d35760bc20e58af7c0e937070/haproxy/0.log" Jul 02 15:41:21.411403 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:21.411368 2573 scope.go:117] "RemoveContainer" containerID="b1007f05bfb0559bc67eca852ef9e45156ea77c07bdb4db916fda956d8fabc01" Jul 02 15:41:21.729023 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:21.728930 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-8tcgn" event={"ID":"4d5f78c3-824b-49f3-af2b-f8f4a7661416","Type":"ContainerStarted","Data":"99d7364addbe4b678e213d3000dd81f770d6acd0672c8ed6ca24d5529f48187b"} Jul 02 15:41:21.729179 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:21.729160 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-8tcgn" Jul 02 15:41:23.648088 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:23.648055 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zzqkf_fae4eee2-d888-4c4b-b32c-172000719654/registry-server/0.log" Jul 02 15:41:23.684673 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:23.684640 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-cl8lr_190d7ec1-9971-4104-aec7-99e7c824960c/manager/0.log" Jul 02 15:41:25.768237 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:25.768160 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-pjjbc_76e0f058-c5ae-41dc-a19a-f4cbd77ba9f8/cluster-monitoring-operator/0.log" Jul 02 15:41:26.189425 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:26.189373 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hdl46_a2c88d39-d329-4a8d-8901-fbe8c032a976/node-exporter/0.log" Jul 02 15:41:26.217894 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:26.217866 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hdl46_a2c88d39-d329-4a8d-8901-fbe8c032a976/kube-rbac-proxy/0.log" Jul 02 15:41:26.244488 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:26.244460 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hdl46_a2c88d39-d329-4a8d-8901-fbe8c032a976/init-textfile/0.log" Jul 02 15:41:26.888867 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:26.888842 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-w47ph_d9d4c6a3-aa74-44bb-877f-b2c4d19a6923/prometheus-operator-admission-webhook/0.log" Jul 02 15:41:28.276742 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:28.276709 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cdb5968b9-kc7bx_19761344-4840-4e55-8c33-f01bb0bbb8c3/networking-console-plugin/0.log" Jul 02 15:41:28.901077 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:28.901042 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-g5scp_2a799b2e-a2de-4260-8fe4-0cb5242c0952/console-operator/1.log" Jul 02 15:41:28.905500 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:28.905474 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7fdbdf9c99-g5scp_2a799b2e-a2de-4260-8fe4-0cb5242c0952/console-operator/2.log" Jul 02 15:41:29.024606 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.024574 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kzv4s/perf-node-gather-daemonset-gzthr"] Jul 02 15:41:29.027890 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.027872 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-gzthr" Jul 02 15:41:29.030714 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.030689 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kzv4s\"/\"openshift-service-ca.crt\"" Jul 02 15:41:29.031395 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.031377 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kzv4s\"/\"default-dockercfg-2tq5g\"" Jul 02 15:41:29.031490 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.031399 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kzv4s\"/\"kube-root-ca.crt\"" Jul 02 15:41:29.038592 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.038568 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kzv4s/perf-node-gather-daemonset-gzthr"] Jul 02 15:41:29.151579 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.151488 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfmfg\" (UniqueName: \"kubernetes.io/projected/d4d6a450-7abb-4240-adf3-40fc7a1cb726-kube-api-access-xfmfg\") pod \"perf-node-gather-daemonset-gzthr\" (UID: \"d4d6a450-7abb-4240-adf3-40fc7a1cb726\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-gzthr" Jul 02 15:41:29.151579 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.151538 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d4d6a450-7abb-4240-adf3-40fc7a1cb726-podres\") pod \"perf-node-gather-daemonset-gzthr\" (UID: \"d4d6a450-7abb-4240-adf3-40fc7a1cb726\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-gzthr" Jul 02 15:41:29.151579 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.151562 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4d6a450-7abb-4240-adf3-40fc7a1cb726-lib-modules\") pod \"perf-node-gather-daemonset-gzthr\" (UID: \"d4d6a450-7abb-4240-adf3-40fc7a1cb726\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-gzthr" Jul 02 15:41:29.151811 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.151589 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4d6a450-7abb-4240-adf3-40fc7a1cb726-sys\") pod \"perf-node-gather-daemonset-gzthr\" (UID: \"d4d6a450-7abb-4240-adf3-40fc7a1cb726\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-gzthr" Jul 02 15:41:29.151811 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.151702 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d4d6a450-7abb-4240-adf3-40fc7a1cb726-proc\") pod \"perf-node-gather-daemonset-gzthr\" (UID: \"d4d6a450-7abb-4240-adf3-40fc7a1cb726\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-gzthr" Jul 02 15:41:29.252441 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.252402 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4d6a450-7abb-4240-adf3-40fc7a1cb726-lib-modules\") pod \"perf-node-gather-daemonset-gzthr\" (UID: \"d4d6a450-7abb-4240-adf3-40fc7a1cb726\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-gzthr" Jul 02 15:41:29.252441 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.252443 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4d6a450-7abb-4240-adf3-40fc7a1cb726-sys\") pod \"perf-node-gather-daemonset-gzthr\" (UID: \"d4d6a450-7abb-4240-adf3-40fc7a1cb726\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-gzthr" Jul 02 15:41:29.252682 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.252493 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d4d6a450-7abb-4240-adf3-40fc7a1cb726-proc\") pod \"perf-node-gather-daemonset-gzthr\" (UID: \"d4d6a450-7abb-4240-adf3-40fc7a1cb726\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-gzthr" Jul 02 15:41:29.252682 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.252520 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfmfg\" (UniqueName: \"kubernetes.io/projected/d4d6a450-7abb-4240-adf3-40fc7a1cb726-kube-api-access-xfmfg\") pod \"perf-node-gather-daemonset-gzthr\" (UID: \"d4d6a450-7abb-4240-adf3-40fc7a1cb726\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-gzthr" Jul 02 15:41:29.252682 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.252546 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d4d6a450-7abb-4240-adf3-40fc7a1cb726-podres\") pod \"perf-node-gather-daemonset-gzthr\" (UID: \"d4d6a450-7abb-4240-adf3-40fc7a1cb726\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-gzthr" Jul 02 15:41:29.252682 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.252583 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4d6a450-7abb-4240-adf3-40fc7a1cb726-lib-modules\") pod \"perf-node-gather-daemonset-gzthr\" (UID: \"d4d6a450-7abb-4240-adf3-40fc7a1cb726\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-gzthr" Jul 02 15:41:29.252682 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.252607 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d4d6a450-7abb-4240-adf3-40fc7a1cb726-proc\") pod \"perf-node-gather-daemonset-gzthr\" (UID: \"d4d6a450-7abb-4240-adf3-40fc7a1cb726\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-gzthr" Jul 02 15:41:29.252682 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.252589 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4d6a450-7abb-4240-adf3-40fc7a1cb726-sys\") pod \"perf-node-gather-daemonset-gzthr\" (UID: \"d4d6a450-7abb-4240-adf3-40fc7a1cb726\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-gzthr" Jul 02 15:41:29.252682 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.252655 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d4d6a450-7abb-4240-adf3-40fc7a1cb726-podres\") pod \"perf-node-gather-daemonset-gzthr\" (UID: \"d4d6a450-7abb-4240-adf3-40fc7a1cb726\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-gzthr" Jul 02 15:41:29.261181 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.261157 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfmfg\" (UniqueName: \"kubernetes.io/projected/d4d6a450-7abb-4240-adf3-40fc7a1cb726-kube-api-access-xfmfg\") pod \"perf-node-gather-daemonset-gzthr\" (UID: \"d4d6a450-7abb-4240-adf3-40fc7a1cb726\") " pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-gzthr" Jul 02 15:41:29.338860 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.338824 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-gzthr" Jul 02 15:41:29.460152 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.460121 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5499b6fb8f-z6f4q_c2c1c5db-355a-4fa4-9a58-b915d32be6b6/download-server/0.log" Jul 02 15:41:29.471481 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.471445 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kzv4s/perf-node-gather-daemonset-gzthr"] Jul 02 15:41:29.474559 ip-10-0-138-41 kubenswrapper[2573]: W0702 15:41:29.474530 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd4d6a450_7abb_4240_adf3_40fc7a1cb726.slice/crio-d5b506035d2927fd085d784ed1bef08ea8c88d99ff42f0752feae17bec5a074a WatchSource:0}: Error finding container d5b506035d2927fd085d784ed1bef08ea8c88d99ff42f0752feae17bec5a074a: Status 404 returned error can't find the container with id d5b506035d2927fd085d784ed1bef08ea8c88d99ff42f0752feae17bec5a074a Jul 02 15:41:29.766860 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.766771 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-gzthr" event={"ID":"d4d6a450-7abb-4240-adf3-40fc7a1cb726","Type":"ContainerStarted","Data":"3be5c2e6173ee6aeac9b09e9ae4d19d9a6823bc5d09211f2ecea3e0913c2009a"} Jul 02 15:41:29.766860 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.766831 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-gzthr" event={"ID":"d4d6a450-7abb-4240-adf3-40fc7a1cb726","Type":"ContainerStarted","Data":"d5b506035d2927fd085d784ed1bef08ea8c88d99ff42f0752feae17bec5a074a"} Jul 02 15:41:29.767074 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.766889 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-gzthr" Jul 02 15:41:29.785551 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:29.785504 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-gzthr" podStartSLOduration=0.785490549 podStartE2EDuration="785.490549ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:41:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:41:29.783365702 +0000 UTC m=+934.855679413" watchObservedRunningTime="2026-07-02 15:41:29.785490549 +0000 UTC m=+934.857804260" Jul 02 15:41:30.050817 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:30.050731 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-69d9f679db-k2jm9_a97a5d82-e5f7-4a9d-ba2b-00efec3db99a/volume-data-source-validator/0.log" Jul 02 15:41:31.079133 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:31.079100 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cvjvk_fabe6b91-ef60-4c9c-83b9-9d522cd51fcd/dns/0.log" Jul 02 15:41:31.100259 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:31.100235 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cvjvk_fabe6b91-ef60-4c9c-83b9-9d522cd51fcd/kube-rbac-proxy/0.log" Jul 02 15:41:31.251773 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:31.251740 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dvrtk_61c2c69b-7481-4ef5-a874-aa280ce47dee/dns-node-resolver/0.log" Jul 02 15:41:31.936702 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:31.936673 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qrttf_1ba1a511-b4bb-4e2d-b876-9d3d9a54dae7/node-ca/0.log" Jul 02 15:41:32.735580 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:32.735552 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-8tcgn" Jul 02 15:41:33.105943 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:33.105889 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-8tcgn_4d5f78c3-824b-49f3-af2b-f8f4a7661416/payload-processing/2.log" Jul 02 15:41:33.106549 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:33.106527 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-8tcgn_4d5f78c3-824b-49f3-af2b-f8f4a7661416/payload-processing/1.log" Jul 02 15:41:33.126260 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:33.126231 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d7c49774c-69ntk_2ba6b11a-b88f-405b-a92c-99768fca5c8f/router/0.log" Jul 02 15:41:33.761846 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:33.761814 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2snr8_429e5081-104e-4014-a5d9-825d1da547ce/serve-healthcheck-canary/0.log" Jul 02 15:41:34.285433 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:34.285401 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-qcglg_cd214bd3-835e-4a77-ad2c-f4a61e793bba/insights-operator/0.log" Jul 02 15:41:34.285604 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:34.285453 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-qcglg_cd214bd3-835e-4a77-ad2c-f4a61e793bba/insights-operator/1.log" Jul 02 15:41:34.306809 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:34.306781 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-khjtk_af82554e-e11c-4678-80d1-1872fa59260a/kube-rbac-proxy/0.log" Jul 02 15:41:34.329123 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:34.329098 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-khjtk_af82554e-e11c-4678-80d1-1872fa59260a/exporter/0.log" Jul 02 15:41:34.350573 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:34.350547 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-khjtk_af82554e-e11c-4678-80d1-1872fa59260a/extractor/0.log" Jul 02 15:41:35.781794 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:35.781769 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kzv4s/perf-node-gather-daemonset-gzthr" Jul 02 15:41:37.070922 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:37.070844 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d66c884b7-m6d77_8e582348-7c54-4b5c-b209-281bf5d0f4db/manager/0.log" Jul 02 15:41:37.100734 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:37.100704 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d66c884b7-m6d77_8e582348-7c54-4b5c-b209-281bf5d0f4db/copy-manifests/0.log" Jul 02 15:41:37.219694 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:37.219667 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-nkvwj_dc3473d1-52a0-4784-aa3e-6d920da5f8ab/postgres/0.log" Jul 02 15:41:38.670787 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:38.670752 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-578857ff64-qdpsl_2d2f5918-fb14-44cc-bc6c-484f451b3156/manager/0.log" Jul 02 15:41:39.308838 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:39.308810 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-8tcgn_4d5f78c3-824b-49f3-af2b-f8f4a7661416/payload-processing/2.log" Jul 02 15:41:39.310043 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:39.310026 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-8tcgn_4d5f78c3-824b-49f3-af2b-f8f4a7661416/payload-processing/1.log" Jul 02 15:41:39.333434 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:39.333409 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d7c49774c-69ntk_2ba6b11a-b88f-405b-a92c-99768fca5c8f/router/0.log" Jul 02 15:41:40.531421 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:40.531378 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-8tcgn_4d5f78c3-824b-49f3-af2b-f8f4a7661416/payload-processing/2.log" Jul 02 15:41:40.532383 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:40.532336 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-8tcgn_4d5f78c3-824b-49f3-af2b-f8f4a7661416/payload-processing/1.log" Jul 02 15:41:40.545630 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:40.545602 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d7c49774c-69ntk_2ba6b11a-b88f-405b-a92c-99768fca5c8f/router/0.log" Jul 02 15:41:43.750248 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:43.750210 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-t4tfs_da7ee8a7-e3cf-4210-91fb-86e3a689464c/migrator/0.log" Jul 02 15:41:43.779600 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:43.779567 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-t4tfs_da7ee8a7-e3cf-4210-91fb-86e3a689464c/graceful-termination/0.log" Jul 02 15:41:44.148897 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:44.148863 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-5hn5p_8fded7d4-f80c-4108-b1bd-438c5607386d/kube-storage-version-migrator-operator/1.log" Jul 02 15:41:44.149665 ip-10-0-138-41 kubenswrapper[2573]: I0702 15:41:44.149645 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-79964ff6f9-5hn5p_8fded7d4-f80c-4108-b1bd-438c5607386d/kube-storage-version-migrator-operator/0.log"