Jul 05 13:18:24.685932 ip-10-0-135-121 systemd[1]: Starting Kubernetes Kubelet... Jul 05 13:18:25.008796 ip-10-0-135-121 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 13:18:25.008796 ip-10-0-135-121 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 05 13:18:25.008796 ip-10-0-135-121 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 13:18:25.008796 ip-10-0-135-121 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 05 13:18:25.008796 ip-10-0-135-121 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 13:18:25.009524 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.009445 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 05 13:18:25.015176 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015155 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 13:18:25.015176 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015173 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 13:18:25.015176 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015178 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 13:18:25.015176 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015181 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 13:18:25.015363 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015184 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 13:18:25.015363 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015187 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 13:18:25.015363 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015190 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 13:18:25.015363 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015193 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 13:18:25.015363 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015197 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 13:18:25.015363 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015200 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 13:18:25.015363 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015204 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 13:18:25.015363 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015207 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 13:18:25.015363 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015210 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 13:18:25.015363 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015213 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 13:18:25.015363 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015216 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 13:18:25.015363 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015219 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 13:18:25.015363 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015222 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 13:18:25.015363 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015225 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 13:18:25.015363 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015227 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 13:18:25.015363 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015230 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 13:18:25.015363 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015233 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 13:18:25.015363 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015236 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 13:18:25.015363 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015239 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 13:18:25.015363 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015242 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 13:18:25.015830 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015245 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 13:18:25.015830 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015248 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 13:18:25.015830 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015251 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 13:18:25.015830 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015254 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 13:18:25.015830 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015257 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 13:18:25.015830 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015259 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 13:18:25.015830 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015262 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 13:18:25.015830 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015266 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 13:18:25.015830 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015268 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 13:18:25.015830 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015271 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 13:18:25.015830 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015274 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 13:18:25.015830 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015276 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 13:18:25.015830 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015279 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 13:18:25.015830 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015283 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 13:18:25.015830 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015285 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 13:18:25.015830 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015289 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 13:18:25.015830 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015305 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 13:18:25.015830 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015310 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 13:18:25.015830 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015315 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 13:18:25.016285 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015318 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 13:18:25.016285 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015321 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 13:18:25.016285 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015324 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 13:18:25.016285 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015327 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 13:18:25.016285 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015329 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 13:18:25.016285 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015332 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 13:18:25.016285 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015335 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 13:18:25.016285 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015337 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 13:18:25.016285 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015342 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 13:18:25.016285 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015345 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 13:18:25.016285 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015349 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 13:18:25.016285 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015352 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 13:18:25.016285 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015355 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 13:18:25.016285 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015358 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 05 13:18:25.016285 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015362 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 13:18:25.016285 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015366 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 13:18:25.016285 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015369 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 13:18:25.016285 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015373 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 13:18:25.016285 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015376 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 13:18:25.016285 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015378 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 13:18:25.016791 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015381 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 13:18:25.016791 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015384 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 13:18:25.016791 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015387 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 13:18:25.016791 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015390 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 13:18:25.016791 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015392 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 13:18:25.016791 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015395 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 13:18:25.016791 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015399 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 13:18:25.016791 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015402 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 13:18:25.016791 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015405 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 13:18:25.016791 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015408 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 13:18:25.016791 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015411 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 13:18:25.016791 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015413 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 13:18:25.016791 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015416 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 13:18:25.016791 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015419 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 13:18:25.016791 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015421 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 13:18:25.016791 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015424 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 13:18:25.016791 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015427 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 13:18:25.016791 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015429 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 13:18:25.016791 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015432 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 13:18:25.016791 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015434 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 13:18:25.017259 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015438 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 13:18:25.017259 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015440 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 13:18:25.017259 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015443 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 13:18:25.017259 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015445 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 13:18:25.017259 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015448 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 13:18:25.017259 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015451 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 13:18:25.017259 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015454 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 13:18:25.017259 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015456 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 13:18:25.017259 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015459 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 13:18:25.017259 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015461 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 13:18:25.017259 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015464 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 13:18:25.017259 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015466 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 13:18:25.017259 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015469 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 13:18:25.017259 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015472 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 13:18:25.017259 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015474 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 13:18:25.017259 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.015477 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 13:18:25.017259 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016176 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 13:18:25.017259 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016182 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 13:18:25.017259 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016187 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 13:18:25.017259 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016190 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 13:18:25.017772 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016193 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 13:18:25.017772 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016195 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 13:18:25.017772 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016198 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 13:18:25.017772 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016201 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 13:18:25.017772 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016203 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 13:18:25.017772 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016206 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 13:18:25.017772 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016209 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 13:18:25.017772 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016212 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 13:18:25.017772 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016214 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 13:18:25.017772 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016217 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 13:18:25.017772 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016220 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 13:18:25.017772 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016222 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 13:18:25.017772 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016225 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 13:18:25.017772 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016228 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 13:18:25.017772 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016231 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 13:18:25.017772 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016234 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 13:18:25.017772 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016237 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 13:18:25.017772 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016239 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 13:18:25.017772 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016242 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 13:18:25.017772 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016245 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 13:18:25.018247 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016247 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 13:18:25.018247 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016250 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 13:18:25.018247 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016252 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 13:18:25.018247 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016255 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 13:18:25.018247 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016257 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 13:18:25.018247 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016260 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 13:18:25.018247 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016263 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 13:18:25.018247 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016266 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 13:18:25.018247 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016268 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 13:18:25.018247 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016271 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 13:18:25.018247 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016274 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 13:18:25.018247 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016277 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 13:18:25.018247 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016280 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 13:18:25.018247 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016282 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 13:18:25.018247 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016285 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 13:18:25.018247 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016288 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 13:18:25.018247 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016306 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 13:18:25.018247 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016309 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 13:18:25.018247 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016312 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 13:18:25.018247 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016315 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 13:18:25.018801 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016318 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 13:18:25.018801 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016322 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 13:18:25.018801 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016326 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 13:18:25.018801 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016329 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 13:18:25.018801 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016332 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 13:18:25.018801 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016335 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 13:18:25.018801 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016342 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 13:18:25.018801 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016345 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 13:18:25.018801 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016348 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 13:18:25.018801 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016351 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 13:18:25.018801 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016353 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 13:18:25.018801 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016356 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 13:18:25.018801 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016359 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 13:18:25.018801 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016361 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 13:18:25.018801 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016364 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 13:18:25.018801 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016367 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 13:18:25.018801 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016372 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 13:18:25.018801 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016376 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 13:18:25.019257 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016378 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 13:18:25.019257 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016381 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 13:18:25.019257 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016384 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 13:18:25.019257 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016386 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 13:18:25.019257 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016389 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 13:18:25.019257 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016393 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 13:18:25.019257 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016396 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 13:18:25.019257 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016398 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 13:18:25.019257 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016401 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 13:18:25.019257 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016404 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 13:18:25.019257 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016406 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 13:18:25.019257 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016409 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 13:18:25.019257 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016413 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 13:18:25.019257 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016415 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 13:18:25.019257 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016418 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 13:18:25.019257 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016421 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 13:18:25.019257 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016423 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 13:18:25.019257 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016426 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 13:18:25.019257 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016429 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 13:18:25.019257 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016431 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 13:18:25.019754 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016434 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 13:18:25.019754 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016438 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 13:18:25.019754 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016442 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 13:18:25.019754 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016444 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 13:18:25.019754 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016447 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 13:18:25.019754 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016449 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 13:18:25.019754 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016452 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 13:18:25.019754 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016457 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 13:18:25.019754 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016460 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 13:18:25.019754 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016463 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 05 13:18:25.019754 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016466 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 13:18:25.019754 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016468 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 13:18:25.019754 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016471 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 13:18:25.019754 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016474 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 13:18:25.019754 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016478 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 13:18:25.019754 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016482 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 13:18:25.019754 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016485 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 13:18:25.019754 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016864 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 13:18:25.019754 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016868 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 13:18:25.020204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016871 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 13:18:25.020204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016874 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 13:18:25.020204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016876 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 13:18:25.020204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016881 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 13:18:25.020204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016885 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 13:18:25.020204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016888 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 13:18:25.020204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016891 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 13:18:25.020204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016894 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 13:18:25.020204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016897 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 13:18:25.020204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016899 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 13:18:25.020204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016902 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 13:18:25.020204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016904 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 13:18:25.020204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016907 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 13:18:25.020204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016910 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 13:18:25.020204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016913 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 13:18:25.020204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016916 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 13:18:25.020204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016918 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 13:18:25.020204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016921 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 13:18:25.020204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016923 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 13:18:25.020657 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016926 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 13:18:25.020657 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016929 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 13:18:25.020657 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016932 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 13:18:25.020657 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016934 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 13:18:25.020657 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016937 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 13:18:25.020657 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016940 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 13:18:25.020657 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016942 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 13:18:25.020657 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016945 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 13:18:25.020657 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016947 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 13:18:25.020657 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016950 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 13:18:25.020657 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016953 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 13:18:25.020657 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016956 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 13:18:25.020657 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016958 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 13:18:25.020657 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016961 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 13:18:25.020657 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016963 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 13:18:25.020657 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016966 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 13:18:25.020657 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016969 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 13:18:25.020657 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016973 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 13:18:25.020657 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016976 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 13:18:25.021117 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016979 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 13:18:25.021117 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016981 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 13:18:25.021117 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016984 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 13:18:25.021117 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016986 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 13:18:25.021117 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016989 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 13:18:25.021117 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016992 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 05 13:18:25.021117 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016995 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 13:18:25.021117 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.016997 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 13:18:25.021117 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017000 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 13:18:25.021117 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017003 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 13:18:25.021117 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017005 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 13:18:25.021117 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017008 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 13:18:25.021117 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017010 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 13:18:25.021117 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017013 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 13:18:25.021117 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017016 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 13:18:25.021117 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017019 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 13:18:25.021117 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017022 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 13:18:25.021117 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017024 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 13:18:25.021117 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017027 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 13:18:25.021117 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017029 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 13:18:25.021616 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017032 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 13:18:25.021616 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017035 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 13:18:25.021616 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017037 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 13:18:25.021616 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017040 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 13:18:25.021616 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017042 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 13:18:25.021616 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017045 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 13:18:25.021616 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017047 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 13:18:25.021616 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017050 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 13:18:25.021616 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017052 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 13:18:25.021616 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017055 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 13:18:25.021616 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017057 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 13:18:25.021616 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017060 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 13:18:25.021616 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017062 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 13:18:25.021616 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017065 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 13:18:25.021616 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017067 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 13:18:25.021616 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017070 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 13:18:25.021616 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017072 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 13:18:25.021616 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017075 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 13:18:25.021616 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017077 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 13:18:25.021616 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017081 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 13:18:25.022095 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017083 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 13:18:25.022095 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017086 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 13:18:25.022095 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017089 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 13:18:25.022095 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017093 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 13:18:25.022095 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017096 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 13:18:25.022095 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017099 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 13:18:25.022095 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017102 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 13:18:25.022095 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017105 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 13:18:25.022095 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017108 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 13:18:25.022095 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017110 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 13:18:25.022095 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017113 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 13:18:25.022095 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017115 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 13:18:25.022095 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017118 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 13:18:25.022095 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017121 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 13:18:25.022095 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017123 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 13:18:25.022095 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017125 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 13:18:25.022095 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017128 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 13:18:25.022095 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017130 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 13:18:25.022095 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017133 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 13:18:25.022573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017201 2565 flags.go:64] FLAG: --address="0.0.0.0" Jul 05 13:18:25.022573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017208 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 05 13:18:25.022573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017218 2565 flags.go:64] FLAG: --anonymous-auth="true" Jul 05 13:18:25.022573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017222 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 05 13:18:25.022573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017226 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 05 13:18:25.022573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017229 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 05 13:18:25.022573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017233 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 05 13:18:25.022573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017237 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 05 13:18:25.022573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017240 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 05 13:18:25.022573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017243 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 05 13:18:25.022573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017247 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 05 13:18:25.022573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017250 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 05 13:18:25.022573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017253 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 05 13:18:25.022573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017256 2565 flags.go:64] FLAG: --cgroup-root="" Jul 05 13:18:25.022573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017258 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 05 13:18:25.022573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017262 2565 flags.go:64] FLAG: --client-ca-file="" Jul 05 13:18:25.022573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017266 2565 flags.go:64] FLAG: --cloud-provider="external" Jul 05 13:18:25.022573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017269 2565 flags.go:64] FLAG: --cluster-dns="[]" Jul 05 13:18:25.022573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017273 2565 flags.go:64] FLAG: --cluster-domain="" Jul 05 13:18:25.022573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017276 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 05 13:18:25.022573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017280 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 05 13:18:25.022573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017283 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 05 13:18:25.022573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017286 2565 flags.go:64] FLAG: --container-log-max-files="5" Jul 05 13:18:25.022573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017303 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 05 13:18:25.023156 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017306 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 05 13:18:25.023156 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017310 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 05 13:18:25.023156 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017313 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 05 13:18:25.023156 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017316 2565 flags.go:64] FLAG: --contention-profiling="false" Jul 05 13:18:25.023156 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017319 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 05 13:18:25.023156 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017322 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 05 13:18:25.023156 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017325 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 05 13:18:25.023156 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017328 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 05 13:18:25.023156 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017331 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 05 13:18:25.023156 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017334 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 05 13:18:25.023156 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017337 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 05 13:18:25.023156 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017340 2565 flags.go:64] FLAG: --enable-load-reader="false" Jul 05 13:18:25.023156 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017343 2565 flags.go:64] FLAG: --enable-server="true" Jul 05 13:18:25.023156 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017346 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 05 13:18:25.023156 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017349 2565 flags.go:64] FLAG: --event-burst="100" Jul 05 13:18:25.023156 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017352 2565 flags.go:64] FLAG: --event-qps="50" Jul 05 13:18:25.023156 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017355 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 05 13:18:25.023156 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017358 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 05 13:18:25.023156 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017362 2565 flags.go:64] FLAG: --eviction-hard="" Jul 05 13:18:25.023156 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017365 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 05 13:18:25.023156 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017368 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 05 13:18:25.023156 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017371 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 05 13:18:25.023156 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017374 2565 flags.go:64] FLAG: --eviction-soft="" Jul 05 13:18:25.023156 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017377 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 05 13:18:25.023156 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017379 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 05 13:18:25.023772 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017383 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 05 13:18:25.023772 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017386 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jul 05 13:18:25.023772 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017391 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 05 13:18:25.023772 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017395 2565 flags.go:64] FLAG: --fail-swap-on="true" Jul 05 13:18:25.023772 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017398 2565 flags.go:64] FLAG: --feature-gates="" Jul 05 13:18:25.023772 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017401 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jul 05 13:18:25.023772 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017404 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 05 13:18:25.023772 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017407 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 05 13:18:25.023772 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017410 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 05 13:18:25.023772 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017413 2565 flags.go:64] FLAG: --healthz-port="10248" Jul 05 13:18:25.023772 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017416 2565 flags.go:64] FLAG: --help="false" Jul 05 13:18:25.023772 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017419 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-135-121.ec2.internal" Jul 05 13:18:25.023772 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017422 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 05 13:18:25.023772 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017426 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jul 05 13:18:25.023772 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017428 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 05 13:18:25.023772 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017432 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 05 13:18:25.023772 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017435 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 05 13:18:25.023772 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017438 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 05 13:18:25.023772 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017441 2565 flags.go:64] FLAG: --image-service-endpoint="" Jul 05 13:18:25.023772 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017444 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 05 13:18:25.023772 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017447 2565 flags.go:64] FLAG: --kube-api-burst="100" Jul 05 13:18:25.023772 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017450 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 05 13:18:25.023772 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017453 2565 flags.go:64] FLAG: --kube-api-qps="50" Jul 05 13:18:25.023772 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017456 2565 flags.go:64] FLAG: --kube-reserved="" Jul 05 13:18:25.024375 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017459 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 05 13:18:25.024375 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017461 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 05 13:18:25.024375 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017464 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jul 05 13:18:25.024375 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017467 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 05 13:18:25.024375 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017470 2565 flags.go:64] FLAG: --lock-file="" Jul 05 13:18:25.024375 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017473 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 05 13:18:25.024375 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017476 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 05 13:18:25.024375 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017479 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 05 13:18:25.024375 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017484 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jul 05 13:18:25.024375 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017488 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 05 13:18:25.024375 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017493 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jul 05 13:18:25.024375 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017496 2565 flags.go:64] FLAG: --logging-format="text" Jul 05 13:18:25.024375 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017499 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 05 13:18:25.024375 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017502 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 05 13:18:25.024375 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017505 2565 flags.go:64] FLAG: --manifest-url="" Jul 05 13:18:25.024375 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017508 2565 flags.go:64] FLAG: --manifest-url-header="" Jul 05 13:18:25.024375 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017512 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 05 13:18:25.024375 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017515 2565 flags.go:64] FLAG: --max-open-files="1000000" Jul 05 13:18:25.024375 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017519 2565 flags.go:64] FLAG: --max-pods="110" Jul 05 13:18:25.024375 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017522 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 05 13:18:25.024375 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017525 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 05 13:18:25.024375 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017527 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jul 05 13:18:25.024375 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017530 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 05 13:18:25.024375 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017533 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 05 13:18:25.024375 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017536 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 05 13:18:25.024974 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017539 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 05 13:18:25.024974 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017546 2565 flags.go:64] FLAG: --node-status-max-images="50" Jul 05 13:18:25.024974 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017549 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 05 13:18:25.024974 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017552 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jul 05 13:18:25.024974 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017555 2565 flags.go:64] FLAG: --pod-cidr="" Jul 05 13:18:25.024974 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017558 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 05 13:18:25.024974 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017563 2565 flags.go:64] FLAG: --pod-manifest-path="" Jul 05 13:18:25.024974 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017566 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jul 05 13:18:25.024974 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017569 2565 flags.go:64] FLAG: --pods-per-core="0" Jul 05 13:18:25.024974 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017572 2565 flags.go:64] FLAG: --port="10250" Jul 05 13:18:25.024974 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017575 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 05 13:18:25.024974 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017578 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e3e653eb115216d7" Jul 05 13:18:25.024974 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017581 2565 flags.go:64] FLAG: --qos-reserved="" Jul 05 13:18:25.024974 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017584 2565 flags.go:64] FLAG: --read-only-port="10255" Jul 05 13:18:25.024974 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017587 2565 flags.go:64] FLAG: --register-node="true" Jul 05 13:18:25.024974 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017590 2565 flags.go:64] FLAG: --register-with-taints="" Jul 05 13:18:25.024974 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017593 2565 flags.go:64] FLAG: --registry-burst="10" Jul 05 13:18:25.024974 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017604 2565 flags.go:64] FLAG: --registry-qps="5" Jul 05 13:18:25.024974 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017608 2565 flags.go:64] FLAG: --reserved-cpus="" Jul 05 13:18:25.024974 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017611 2565 flags.go:64] FLAG: --reserved-memory="" Jul 05 13:18:25.024974 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017615 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 05 13:18:25.024974 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017618 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 05 13:18:25.024974 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017621 2565 flags.go:64] FLAG: --rotate-certificates="false" Jul 05 13:18:25.024974 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017624 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 05 13:18:25.024974 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017627 2565 flags.go:64] FLAG: --runonce="false" Jul 05 13:18:25.025589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017630 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 05 13:18:25.025589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017633 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 05 13:18:25.025589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017636 2565 flags.go:64] FLAG: --seccomp-default="false" Jul 05 13:18:25.025589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017639 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 05 13:18:25.025589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017641 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 05 13:18:25.025589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017645 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 05 13:18:25.025589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017648 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 05 13:18:25.025589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017651 2565 flags.go:64] FLAG: --storage-driver-password="root" Jul 05 13:18:25.025589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017654 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jul 05 13:18:25.025589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017657 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jul 05 13:18:25.025589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017660 2565 flags.go:64] FLAG: --storage-driver-user="root" Jul 05 13:18:25.025589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017662 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 05 13:18:25.025589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017665 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 05 13:18:25.025589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017668 2565 flags.go:64] FLAG: --system-cgroups="" Jul 05 13:18:25.025589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017671 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 05 13:18:25.025589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017676 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 05 13:18:25.025589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017679 2565 flags.go:64] FLAG: --tls-cert-file="" Jul 05 13:18:25.025589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017682 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 05 13:18:25.025589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017686 2565 flags.go:64] FLAG: --tls-min-version="" Jul 05 13:18:25.025589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017689 2565 flags.go:64] FLAG: --tls-private-key-file="" Jul 05 13:18:25.025589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017691 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jul 05 13:18:25.025589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017694 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 05 13:18:25.025589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017697 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jul 05 13:18:25.025589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017700 2565 flags.go:64] FLAG: --v="2" Jul 05 13:18:25.025589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017705 2565 flags.go:64] FLAG: --version="false" Jul 05 13:18:25.026196 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017713 2565 flags.go:64] FLAG: --vmodule="" Jul 05 13:18:25.026196 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017717 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 05 13:18:25.026196 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.017721 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 05 13:18:25.026196 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017827 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 13:18:25.026196 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017831 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 13:18:25.026196 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017834 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 13:18:25.026196 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017837 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 13:18:25.026196 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017840 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 13:18:25.026196 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017842 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 13:18:25.026196 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017846 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 13:18:25.026196 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017848 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 13:18:25.026196 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017851 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 13:18:25.026196 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017854 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 13:18:25.026196 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017857 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 13:18:25.026196 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017859 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 13:18:25.026196 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017862 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 13:18:25.026196 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017864 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 13:18:25.026196 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017867 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 13:18:25.026196 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017870 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 13:18:25.026196 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017873 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 13:18:25.026699 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017876 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 13:18:25.026699 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017880 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 13:18:25.026699 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017883 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 13:18:25.026699 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017885 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 13:18:25.026699 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017888 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 13:18:25.026699 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017890 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 13:18:25.026699 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017893 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 13:18:25.026699 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017896 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 13:18:25.026699 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017898 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 13:18:25.026699 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017901 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 13:18:25.026699 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017904 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 13:18:25.026699 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017908 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 13:18:25.026699 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017912 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 13:18:25.026699 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017915 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 13:18:25.026699 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017919 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 13:18:25.026699 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017922 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 05 13:18:25.026699 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017926 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 13:18:25.026699 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017930 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 13:18:25.026699 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017933 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 13:18:25.027210 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017935 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 13:18:25.027210 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017938 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 13:18:25.027210 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017941 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 13:18:25.027210 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017943 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 13:18:25.027210 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017946 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 13:18:25.027210 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017949 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 13:18:25.027210 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017952 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 13:18:25.027210 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017954 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 13:18:25.027210 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017957 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 13:18:25.027210 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017959 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 13:18:25.027210 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017962 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 13:18:25.027210 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017965 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 13:18:25.027210 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017967 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 13:18:25.027210 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017970 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 13:18:25.027210 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017972 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 13:18:25.027210 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017975 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 13:18:25.027210 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017978 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 13:18:25.027210 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017980 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 13:18:25.027210 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017982 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 13:18:25.027823 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017985 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 13:18:25.027823 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017988 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 13:18:25.027823 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017990 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 13:18:25.027823 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017993 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 13:18:25.027823 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017995 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 13:18:25.027823 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.017999 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 13:18:25.027823 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018002 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 13:18:25.027823 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018005 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 13:18:25.027823 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018014 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 13:18:25.027823 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018017 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 13:18:25.027823 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018020 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 13:18:25.027823 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018022 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 13:18:25.027823 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018025 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 13:18:25.027823 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018028 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 13:18:25.027823 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018030 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 13:18:25.027823 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018033 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 13:18:25.027823 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018035 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 13:18:25.027823 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018038 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 13:18:25.027823 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018041 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 13:18:25.027823 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018043 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 13:18:25.028332 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018046 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 13:18:25.028332 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018048 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 13:18:25.028332 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018051 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 13:18:25.028332 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018054 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 13:18:25.028332 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018056 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 13:18:25.028332 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018059 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 13:18:25.028332 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018061 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 13:18:25.028332 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018064 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 13:18:25.028332 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018067 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 13:18:25.028332 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018069 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 13:18:25.028332 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018072 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 13:18:25.028332 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018075 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 13:18:25.028332 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018077 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 13:18:25.028332 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018080 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 13:18:25.028332 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018082 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 13:18:25.028332 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018085 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 13:18:25.028332 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018087 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 13:18:25.028332 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018091 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 13:18:25.028332 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018095 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 13:18:25.028332 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018098 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 13:18:25.028833 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018100 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 13:18:25.028833 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018103 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 13:18:25.028833 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018106 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 13:18:25.028833 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.018108 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 13:18:25.028833 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.018633 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 13:18:25.028833 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.025049 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 05 13:18:25.028833 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.025065 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 05 13:18:25.028833 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.025077 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 05 13:18:25.028833 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.025083 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 05 13:18:25.028833 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025152 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 13:18:25.028833 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025158 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 13:18:25.028833 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025161 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 13:18:25.028833 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025165 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 13:18:25.028833 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025168 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 13:18:25.028833 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025171 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 13:18:25.029204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025174 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 13:18:25.029204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025177 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 13:18:25.029204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025180 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 13:18:25.029204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025183 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 13:18:25.029204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025186 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 13:18:25.029204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025189 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 13:18:25.029204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025191 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 13:18:25.029204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025194 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 13:18:25.029204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025197 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 13:18:25.029204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025199 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 13:18:25.029204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025202 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 13:18:25.029204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025205 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 13:18:25.029204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025208 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 13:18:25.029204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025210 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 13:18:25.029204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025214 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 13:18:25.029204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025217 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 13:18:25.029204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025220 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 13:18:25.029204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025223 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 13:18:25.029204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025226 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 13:18:25.029204 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025243 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 13:18:25.029710 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025247 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 13:18:25.029710 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025251 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 13:18:25.029710 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025254 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 13:18:25.029710 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025257 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 13:18:25.029710 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025260 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 13:18:25.029710 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025262 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 05 13:18:25.029710 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025265 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 13:18:25.029710 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025267 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 13:18:25.029710 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025270 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 13:18:25.029710 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025274 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 13:18:25.029710 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025278 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 13:18:25.029710 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025281 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 13:18:25.029710 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025284 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 13:18:25.029710 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025286 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 13:18:25.029710 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025289 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 13:18:25.029710 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025306 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 13:18:25.029710 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025309 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 13:18:25.029710 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025312 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 13:18:25.029710 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025315 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 13:18:25.029710 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025317 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 13:18:25.030194 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025320 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 13:18:25.030194 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025323 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 13:18:25.030194 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025325 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 13:18:25.030194 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025328 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 13:18:25.030194 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025331 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 13:18:25.030194 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025333 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 13:18:25.030194 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025336 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 13:18:25.030194 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025339 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 13:18:25.030194 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025342 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 13:18:25.030194 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025345 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 13:18:25.030194 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025347 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 13:18:25.030194 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025351 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 13:18:25.030194 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025353 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 13:18:25.030194 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025356 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 13:18:25.030194 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025359 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 13:18:25.030194 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025361 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 13:18:25.030194 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025364 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 13:18:25.030194 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025366 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 13:18:25.030194 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025369 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 13:18:25.030194 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025371 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 13:18:25.030685 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025374 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 13:18:25.030685 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025377 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 13:18:25.030685 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025379 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 13:18:25.030685 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025381 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 13:18:25.030685 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025384 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 13:18:25.030685 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025386 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 13:18:25.030685 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025389 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 13:18:25.030685 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025393 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 13:18:25.030685 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025396 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 13:18:25.030685 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025399 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 13:18:25.030685 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025402 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 13:18:25.030685 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025405 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 13:18:25.030685 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025407 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 13:18:25.030685 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025410 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 13:18:25.030685 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025412 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 13:18:25.030685 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025415 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 13:18:25.030685 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025417 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 13:18:25.030685 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025420 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 13:18:25.030685 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025422 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 13:18:25.031152 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025425 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 13:18:25.031152 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025427 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 13:18:25.031152 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025430 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 13:18:25.031152 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025433 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 13:18:25.031152 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025435 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 13:18:25.031152 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025444 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 13:18:25.031152 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025447 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 13:18:25.031152 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025450 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 13:18:25.031152 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025453 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 13:18:25.031152 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025456 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 13:18:25.031152 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025458 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 13:18:25.031152 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025462 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 13:18:25.031152 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025465 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 13:18:25.031152 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025468 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 13:18:25.031548 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.025474 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 13:18:25.031548 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025611 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 13:18:25.031548 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025615 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 13:18:25.031548 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025618 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 13:18:25.031548 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025621 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 13:18:25.031548 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025624 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 13:18:25.031548 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025626 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 13:18:25.031548 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025630 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 13:18:25.031548 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025634 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 13:18:25.031548 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025637 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 13:18:25.031548 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025640 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 13:18:25.031548 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025643 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 13:18:25.031548 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025646 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 13:18:25.031548 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025649 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 13:18:25.031548 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025652 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 13:18:25.031922 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025654 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 13:18:25.031922 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025657 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 13:18:25.031922 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025661 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 13:18:25.031922 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025664 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 13:18:25.031922 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025667 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 13:18:25.031922 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025670 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 13:18:25.031922 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025673 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 13:18:25.031922 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025676 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 13:18:25.031922 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025679 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 13:18:25.031922 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025688 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 13:18:25.031922 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025692 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 13:18:25.031922 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025694 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 05 13:18:25.031922 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025697 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 13:18:25.031922 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025700 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 13:18:25.031922 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025702 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 13:18:25.031922 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025705 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 13:18:25.031922 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025707 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 13:18:25.031922 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025710 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 13:18:25.031922 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025713 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 13:18:25.031922 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025715 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 13:18:25.032403 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025718 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 13:18:25.032403 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025720 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 13:18:25.032403 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025723 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 13:18:25.032403 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025725 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 13:18:25.032403 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025728 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 13:18:25.032403 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025730 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 13:18:25.032403 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025733 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 13:18:25.032403 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025735 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 13:18:25.032403 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025738 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 13:18:25.032403 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025741 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 13:18:25.032403 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025744 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 13:18:25.032403 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025746 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 13:18:25.032403 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025749 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 13:18:25.032403 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025751 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 13:18:25.032403 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025754 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 13:18:25.032403 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025756 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 13:18:25.032403 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025759 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 13:18:25.032403 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025761 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 13:18:25.032403 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025764 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 13:18:25.032403 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025766 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 13:18:25.032878 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025769 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 13:18:25.032878 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025771 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 13:18:25.032878 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025780 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 13:18:25.032878 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025782 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 13:18:25.032878 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025785 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 13:18:25.032878 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025787 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 13:18:25.032878 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025790 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 13:18:25.032878 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025792 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 13:18:25.032878 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025795 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 13:18:25.032878 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025797 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 13:18:25.032878 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025800 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 13:18:25.032878 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025802 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 13:18:25.032878 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025805 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 13:18:25.032878 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025807 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 13:18:25.032878 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025810 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 13:18:25.032878 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025813 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 13:18:25.032878 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025815 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 13:18:25.032878 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025820 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 13:18:25.032878 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025822 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 13:18:25.033333 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025825 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 13:18:25.033333 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025827 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 13:18:25.033333 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025830 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 13:18:25.033333 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025834 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 13:18:25.033333 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025837 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 13:18:25.033333 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025840 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 13:18:25.033333 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025842 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 13:18:25.033333 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025845 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 13:18:25.033333 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025848 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 13:18:25.033333 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025850 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 13:18:25.033333 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025853 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 13:18:25.033333 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025855 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 13:18:25.033333 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025858 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 13:18:25.033333 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025860 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 13:18:25.033333 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025863 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 13:18:25.033333 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025865 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 13:18:25.033333 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025873 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 13:18:25.033333 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025876 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 13:18:25.033333 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025879 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 13:18:25.033782 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025881 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 13:18:25.033782 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025884 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 13:18:25.033782 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025886 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 13:18:25.033782 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025889 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 13:18:25.033782 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025891 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 13:18:25.033782 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025894 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 13:18:25.033782 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:25.025896 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 13:18:25.033782 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.025901 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 13:18:25.033782 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.026009 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jul 05 13:18:25.033782 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.029255 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 05 13:18:25.033782 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.030404 2565 server.go:1019] "Starting client certificate rotation" Jul 05 13:18:25.033782 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.030510 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 05 13:18:25.033782 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.030550 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 05 13:18:25.034114 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.032654 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 05 13:18:25.036873 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.036846 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 05 13:18:25.047589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.047573 2565 log.go:25] "Validated CRI v1 runtime API" Jul 05 13:18:25.049651 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.049636 2565 log.go:25] "Validated CRI v1 image API" Jul 05 13:18:25.050471 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.050453 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 05 13:18:25.054174 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.054153 2565 fs.go:135] Filesystem UUIDs: map[7603fcf2-735a-47b0-b529-09b1c7b89557:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8c3dd434-c893-4b51-92b5-4b51dd7ce9e5:/dev/nvme0n1p3] Jul 05 13:18:25.054237 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.054173 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 05 13:18:25.058354 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.058336 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 05 13:18:25.059266 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.059159 2565 manager.go:216] Machine: {Timestamp:2026-07-05 13:18:25.057934602 +0000 UTC m=+0.275757985 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099920 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2916e47be1fc5db0b17d75babf3d14 SystemUUID:ec2916e4-7be1-fc5d-b0b1-7d75babf3d14 BootID:f13a4629-283d-46b1-8ce4-7b70b49a1181 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c6:71:8b:48:b7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c6:71:8b:48:b7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:8d:c6:a0:57:19 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 05 13:18:25.059266 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.059261 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 05 13:18:25.059394 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.059382 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 05 13:18:25.062113 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.062086 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 05 13:18:25.062252 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.062116 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-121.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 05 13:18:25.062775 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.062765 2565 topology_manager.go:138] "Creating topology manager with none policy" Jul 05 13:18:25.062810 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.062776 2565 container_manager_linux.go:309] "Creating device plugin manager" Jul 05 13:18:25.062810 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.062784 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 05 13:18:25.063349 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.063339 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 05 13:18:25.064656 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.064646 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 05 13:18:25.068439 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.068428 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 05 13:18:25.068557 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.068547 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 05 13:18:25.068600 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.068576 2565 kubelet.go:486] "Attempting to sync node with API server" Jul 05 13:18:25.068600 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.068595 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 05 13:18:25.068664 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.068608 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 05 13:18:25.068664 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.068618 2565 kubelet.go:398] "Adding apiserver pod source" Jul 05 13:18:25.068664 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.068626 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 05 13:18:25.069018 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.069006 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 05 13:18:25.069052 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.069026 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 05 13:18:25.070984 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.070965 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 05 13:18:25.072794 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.072782 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 05 13:18:25.072848 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.072811 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 05 13:18:25.073858 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.073847 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 05 13:18:25.073903 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.073866 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 05 13:18:25.073903 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.073877 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 05 13:18:25.073903 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.073885 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 05 13:18:25.073976 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.073914 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 05 13:18:25.073976 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.073920 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 05 13:18:25.073976 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.073929 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 05 13:18:25.073976 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.073934 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 05 13:18:25.073976 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.073940 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 05 13:18:25.073976 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.073945 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 05 13:18:25.073976 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.073960 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 05 13:18:25.073976 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.073966 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 05 13:18:25.075144 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.075132 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 05 13:18:25.075144 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.075144 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 05 13:18:25.078271 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.078253 2565 server.go:1268] "Started kubelet" Jul 05 13:18:25.078414 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.078362 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 05 13:18:25.081426 ip-10-0-135-121 systemd[1]: Started Kubernetes Kubelet. Jul 05 13:18:25.082841 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.081322 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 05 13:18:25.082841 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.082227 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 05 13:18:25.082841 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.082580 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7w8j5" Jul 05 13:18:25.083484 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.083467 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 05 13:18:25.083734 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.083710 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-121.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 05 13:18:25.084141 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:25.084112 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 05 13:18:25.084631 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.084610 2565 server.go:310] "Adding debug handlers to kubelet server" Jul 05 13:18:25.086208 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:25.086191 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 05 13:18:25.087356 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:25.087329 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-121.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 05 13:18:25.088040 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:25.087305 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-121.ec2.internal.18bf6740b53c66b9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-121.ec2.internal,UID:ip-10-0-135-121.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-121.ec2.internal,},FirstTimestamp:2026-07-05 13:18:25.078208185 +0000 UTC m=+0.296031549,LastTimestamp:2026-07-05 13:18:25.078208185 +0000 UTC m=+0.296031549,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-121.ec2.internal,}" Jul 05 13:18:25.088190 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.088174 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7w8j5" Jul 05 13:18:25.090307 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.090275 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 05 13:18:25.090307 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.090287 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 05 13:18:25.090454 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:25.090418 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found" Jul 05 13:18:25.090926 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.090867 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 05 13:18:25.091019 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.090973 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 05 13:18:25.091019 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.091000 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 05 13:18:25.091164 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.091082 2565 reconstruct.go:97] "Volume reconstruction finished" Jul 05 13:18:25.091164 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.091094 2565 reconciler.go:29] "Reconciler: start to sync state" Jul 05 13:18:25.091286 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.091271 2565 factory.go:55] Registering systemd factory Jul 05 13:18:25.091363 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.091308 2565 factory.go:223] Registration of the systemd container factory successfully Jul 05 13:18:25.091582 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.091566 2565 factory.go:153] Registering CRI-O factory Jul 05 13:18:25.091582 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.091583 2565 factory.go:223] Registration of the crio container factory successfully Jul 05 13:18:25.091724 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.091631 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 05 13:18:25.091724 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.091653 2565 factory.go:103] Registering Raw factory Jul 05 13:18:25.091724 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.091668 2565 manager.go:1196] Started watching for new ooms in manager Jul 05 13:18:25.092780 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.092510 2565 manager.go:349] Starting recovery of all containers Jul 05 13:18:25.094225 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.094203 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 13:18:25.098221 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:25.098199 2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-121.ec2.internal\" not found" node="ip-10-0-135-121.ec2.internal" Jul 05 13:18:25.103207 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.103192 2565 manager.go:354] Recovery completed Jul 05 13:18:25.104558 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:25.104535 2565 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 05 13:18:25.107733 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.107722 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 13:18:25.110184 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.110166 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientMemory" Jul 05 13:18:25.110358 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.110340 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 13:18:25.110439 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.110368 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientPID" Jul 05 13:18:25.111187 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.111174 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 05 13:18:25.111187 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.111186 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 05 13:18:25.111271 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.111205 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 05 13:18:25.111271 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.111225 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 13:18:25.112650 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.112634 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientMemory" Jul 05 13:18:25.112718 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.112661 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 13:18:25.112718 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.112672 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientPID" Jul 05 13:18:25.113618 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.113604 2565 policy_none.go:49] "None policy: Start" Jul 05 13:18:25.113650 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.113623 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 05 13:18:25.113650 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.113637 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 05 13:18:25.115650 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.115633 2565 policy_none.go:47] "Start" Jul 05 13:18:25.156558 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.156545 2565 manager.go:337] "Starting Device Plugin manager" Jul 05 13:18:25.156638 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:25.156578 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 05 13:18:25.156638 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.156587 2565 server.go:87] "Starting device plugin registration server" Jul 05 13:18:25.156814 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.156801 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 05 13:18:25.156908 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.156813 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 05 13:18:25.156960 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.156935 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 05 13:18:25.157062 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.157046 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 05 13:18:25.157062 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:25.157061 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 05 13:18:25.158652 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:25.158485 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 05 13:18:25.158652 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:25.158536 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-121.ec2.internal\" not found" Jul 05 13:18:26.810621 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.810591 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 05 13:18:26.811840 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.811825 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 05 13:18:26.811927 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.811857 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 05 13:18:26.811927 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.811881 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jul 05 13:18:26.811927 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:26.811912 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 05 13:18:26.814199 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.814177 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 13:18:26.829860 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.829837 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 13:18:26.830736 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.830721 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientMemory" Jul 05 13:18:26.830834 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.830755 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 13:18:26.830834 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.830770 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientPID" Jul 05 13:18:26.830941 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.830848 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-121.ec2.internal" Jul 05 13:18:26.839028 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.838988 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-121.ec2.internal" Jul 05 13:18:26.839028 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:26.839007 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-121.ec2.internal\": node \"ip-10-0-135-121.ec2.internal\" not found" Jul 05 13:18:26.853126 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:26.853108 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found" Jul 05 13:18:26.912356 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.912318 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal"] Jul 05 13:18:26.912486 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.912426 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 13:18:26.914086 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.914069 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientMemory" Jul 05 13:18:26.914174 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.914101 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 13:18:26.914174 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.914115 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientPID" Jul 05 13:18:26.916496 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.916482 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 13:18:26.916601 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.916584 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" Jul 05 13:18:26.916651 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.916617 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 13:18:26.917198 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.917184 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientMemory" Jul 05 13:18:26.917276 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.917205 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientMemory" Jul 05 13:18:26.917276 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.917207 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 13:18:26.917276 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.917253 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientPID" Jul 05 13:18:26.917395 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.917223 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 13:18:26.917395 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.917291 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientPID" Jul 05 13:18:26.919473 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.919460 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal" Jul 05 13:18:26.919548 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.919484 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 13:18:26.920159 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.920145 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientMemory" Jul 05 13:18:26.920235 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.920170 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 13:18:26.920235 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.920183 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientPID" Jul 05 13:18:26.940535 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:26.940516 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-121.ec2.internal\" not found" node="ip-10-0-135-121.ec2.internal" Jul 05 13:18:26.944746 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:26.944732 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-121.ec2.internal\" not found" node="ip-10-0-135-121.ec2.internal" Jul 05 13:18:26.953301 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:26.953283 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found" Jul 05 13:18:26.964402 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.964356 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/99c4126045d45ecfe73709fe851a3e37-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal\" (UID: \"99c4126045d45ecfe73709fe851a3e37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" Jul 05 13:18:26.964453 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.964408 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99c4126045d45ecfe73709fe851a3e37-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal\" (UID: \"99c4126045d45ecfe73709fe851a3e37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" Jul 05 13:18:26.964453 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:26.964427 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e5efd728fef4d484917909757bf24398-config\") pod \"kube-apiserver-proxy-ip-10-0-135-121.ec2.internal\" (UID: \"e5efd728fef4d484917909757bf24398\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal" Jul 05 13:18:27.053562 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:27.053537 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found" Jul 05 13:18:27.064798 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.064773 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/99c4126045d45ecfe73709fe851a3e37-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal\" (UID: \"99c4126045d45ecfe73709fe851a3e37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" Jul 05 13:18:27.064903 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.064861 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/99c4126045d45ecfe73709fe851a3e37-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal\" (UID: \"99c4126045d45ecfe73709fe851a3e37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" Jul 05 13:18:27.064903 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.064873 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99c4126045d45ecfe73709fe851a3e37-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal\" (UID: \"99c4126045d45ecfe73709fe851a3e37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" Jul 05 13:18:27.065007 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.064903 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e5efd728fef4d484917909757bf24398-config\") pod \"kube-apiserver-proxy-ip-10-0-135-121.ec2.internal\" (UID: \"e5efd728fef4d484917909757bf24398\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal" Jul 05 13:18:27.065007 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.064943 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e5efd728fef4d484917909757bf24398-config\") pod \"kube-apiserver-proxy-ip-10-0-135-121.ec2.internal\" (UID: \"e5efd728fef4d484917909757bf24398\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal" Jul 05 13:18:27.065007 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.064952 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99c4126045d45ecfe73709fe851a3e37-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal\" (UID: \"99c4126045d45ecfe73709fe851a3e37\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" Jul 05 13:18:27.154268 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:27.154196 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found" Jul 05 13:18:27.243701 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.243668 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" Jul 05 13:18:27.247390 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.247362 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal" Jul 05 13:18:27.254389 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:27.254372 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found" Jul 05 13:18:27.354889 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:27.354853 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found" Jul 05 13:18:27.455391 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:27.455321 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found" Jul 05 13:18:27.466843 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.466821 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 13:18:27.563815 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.563782 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" Jul 05 13:18:27.574599 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.574579 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 05 13:18:27.576055 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.576043 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal" Jul 05 13:18:27.584654 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.584637 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 05 13:18:27.602786 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.602770 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 05 13:18:27.602907 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.602890 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 05 13:18:27.602951 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.602936 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 05 13:18:27.602990 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.602936 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 05 13:18:27.642105 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.642079 2565 apiserver.go:52] "Watching apiserver" Jul 05 13:18:27.659358 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.659338 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 05 13:18:27.661433 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.660195 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-n9xhq","openshift-network-operator/iptables-alerter-f9fdd","kube-system/global-pull-secret-syncer-xms2g","kube-system/konnectivity-agent-d7sjf","kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal","openshift-cluster-node-tuning-operator/tuned-lv52r","openshift-dns/node-resolver-fd7rj","openshift-multus/multus-vjtd2","openshift-multus/network-metrics-daemon-fsfvp","openshift-ovn-kubernetes/ovnkube-node-thmmq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg","openshift-image-registry/node-ca-tss2s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal","openshift-multus/multus-additional-cni-plugins-92dw2"] Jul 05 13:18:27.662956 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.662936 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 05 13:18:27.663336 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.663317 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fd7rj" Jul 05 13:18:27.664287 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.664239 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-04 13:13:26 +0000 UTC" deadline="2028-03-07 15:44:58.054548736 +0000 UTC" Jul 05 13:18:27.664370 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.664289 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14666h26m30.390264769s" Jul 05 13:18:27.665682 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.665665 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 05 13:18:27.665682 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.665679 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9xl59\"" Jul 05 13:18:27.665778 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.665672 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 05 13:18:27.665942 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.665927 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.667452 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.667430 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-system-cni-dir\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.667515 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.667468 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-multus-cni-dir\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.667515 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.667493 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15bf4c96-57a0-4f71-af70-f0fbe98e4495-cni-binary-copy\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.667591 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.667515 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-host-run-netns\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.667591 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.667539 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-host-var-lib-cni-bin\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.667591 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.667583 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-host-var-lib-kubelet\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.667715 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.667612 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dwnk\" (UniqueName: \"kubernetes.io/projected/1044be9c-adcd-4685-845f-4ab24fe04c00-kube-api-access-5dwnk\") pod \"node-resolver-fd7rj\" (UID: \"1044be9c-adcd-4685-845f-4ab24fe04c00\") " pod="openshift-dns/node-resolver-fd7rj" Jul 05 13:18:27.667715 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.667656 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-cnibin\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.667715 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.667699 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-multus-conf-dir\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.667868 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.667721 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-os-release\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.667868 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.667738 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-multus-socket-dir-parent\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.667868 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.667766 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-host-var-lib-cni-multus\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.667868 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.667795 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-hostroot\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.667868 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.667834 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/15bf4c96-57a0-4f71-af70-f0fbe98e4495-multus-daemon-config\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.667868 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.667858 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkx5l\" (UniqueName: \"kubernetes.io/projected/15bf4c96-57a0-4f71-af70-f0fbe98e4495-kube-api-access-pkx5l\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.668074 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.667885 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1044be9c-adcd-4685-845f-4ab24fe04c00-tmp-dir\") pod \"node-resolver-fd7rj\" (UID: \"1044be9c-adcd-4685-845f-4ab24fe04c00\") " pod="openshift-dns/node-resolver-fd7rj" Jul 05 13:18:27.668074 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.667908 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-host-run-k8s-cni-cncf-io\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.668074 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.667947 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-host-run-multus-certs\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.668074 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.667971 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-etc-kubernetes\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.668074 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.667988 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1044be9c-adcd-4685-845f-4ab24fe04c00-hosts-file\") pod \"node-resolver-fd7rj\" (UID: \"1044be9c-adcd-4685-845f-4ab24fe04c00\") " pod="openshift-dns/node-resolver-fd7rj" Jul 05 13:18:27.668524 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.668510 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:27.668584 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:27.668567 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xms2g" podUID="4ce057ad-491a-4f76-b9df-0a4da94dd152" Jul 05 13:18:27.668762 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.668745 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 05 13:18:27.668854 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.668840 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rl8zf\"" Jul 05 13:18:27.668915 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.668841 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 05 13:18:27.669038 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.669024 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 05 13:18:27.669104 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.669086 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 05 13:18:27.671185 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.671170 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d7sjf" Jul 05 13:18:27.672867 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.672849 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 05 13:18:27.673166 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.673151 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 05 13:18:27.673242 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.673177 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kqc6m\"" Jul 05 13:18:27.673320 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.673307 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 05 13:18:27.673820 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.673791 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:18:27.673896 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:27.673865 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xhq" podUID="ef04f0f0-451b-4254-86bc-2cd6b4ce6016" Jul 05 13:18:27.676465 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.676449 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.678526 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.678510 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 05 13:18:27.678619 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.678552 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nxvnr\"" Jul 05 13:18:27.678619 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.678552 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 05 13:18:27.679127 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.679110 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:27.679222 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:27.679202 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsfvp" podUID="d06fcb3d-95c9-4837-8b5f-f8455c806cf3" Jul 05 13:18:27.681794 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.681778 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-92dw2" Jul 05 13:18:27.683747 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.683733 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 05 13:18:27.683857 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.683768 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-frvwf\"" Jul 05 13:18:27.683935 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.683923 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 05 13:18:27.684412 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.684394 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f9fdd" Jul 05 13:18:27.687295 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.687266 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 05 13:18:27.687511 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.687494 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.690071 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.690043 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 05 13:18:27.690320 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.690308 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" Jul 05 13:18:27.690863 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.690849 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 05 13:18:27.691098 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.691083 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 05 13:18:27.692117 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.692103 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 05 13:18:27.692193 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.692103 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 05 13:18:27.692533 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.692519 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 05 13:18:27.692593 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.692581 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kn7fx\"" Jul 05 13:18:27.693087 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.693072 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tss2s" Jul 05 13:18:27.694861 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.694837 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 05 13:18:27.694959 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.694885 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 05 13:18:27.695741 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.695720 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 05 13:18:27.696281 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.696178 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 05 13:18:27.696281 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.696200 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 05 13:18:27.696281 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.696248 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 05 13:18:27.696499 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.696350 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 05 13:18:27.696971 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.696839 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 05 13:18:27.696971 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.696847 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-l7r8q\"" Jul 05 13:18:27.696971 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.696941 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sh7n4\"" Jul 05 13:18:27.706427 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.706060 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lt68h\"" Jul 05 13:18:27.709580 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.709560 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bzhxv" Jul 05 13:18:27.728653 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.728635 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bzhxv" Jul 05 13:18:27.764767 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.764750 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 05 13:18:27.768148 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768130 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fc48db1b-17f3-442b-b816-20457c2f17ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-92dw2\" (UID: \"fc48db1b-17f3-442b-b816-20457c2f17ca\") " pod="openshift-multus/multus-additional-cni-plugins-92dw2" Jul 05 13:18:27.768224 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768154 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-host-run-netns\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.768224 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768171 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-run-systemd\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.768224 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768186 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/afa1ab82-2769-4e52-b460-539ebe048f8a-ovn-node-metrics-cert\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.768224 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768203 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2kxl\" (UniqueName: \"kubernetes.io/projected/9ff80b38-49a5-468f-8088-b6021a50b374-kube-api-access-p2kxl\") pod \"aws-ebs-csi-driver-node-7mxzg\" (UID: \"9ff80b38-49a5-468f-8088-b6021a50b374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" Jul 05 13:18:27.768224 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768222 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb3e727d-7877-482d-bd5f-a2cbcbd9dae4-host\") pod \"node-ca-tss2s\" (UID: \"eb3e727d-7877-482d-bd5f-a2cbcbd9dae4\") " pod="openshift-image-registry/node-ca-tss2s" Jul 05 13:18:27.768383 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768251 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1044be9c-adcd-4685-845f-4ab24fe04c00-hosts-file\") pod \"node-resolver-fd7rj\" (UID: \"1044be9c-adcd-4685-845f-4ab24fe04c00\") " pod="openshift-dns/node-resolver-fd7rj" Jul 05 13:18:27.768383 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768274 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15bf4c96-57a0-4f71-af70-f0fbe98e4495-cni-binary-copy\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.768383 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768289 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-host-run-netns\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.768383 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768324 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-multus-conf-dir\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.768383 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768360 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1044be9c-adcd-4685-845f-4ab24fe04c00-hosts-file\") pod \"node-resolver-fd7rj\" (UID: \"1044be9c-adcd-4685-845f-4ab24fe04c00\") " pod="openshift-dns/node-resolver-fd7rj" Jul 05 13:18:27.768383 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768368 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-multus-conf-dir\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.768570 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768393 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs\") pod \"network-metrics-daemon-fsfvp\" (UID: \"d06fcb3d-95c9-4837-8b5f-f8455c806cf3\") " pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:27.768570 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768421 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c27r6\" (UniqueName: \"kubernetes.io/projected/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-kube-api-access-c27r6\") pod \"network-metrics-daemon-fsfvp\" (UID: \"d06fcb3d-95c9-4837-8b5f-f8455c806cf3\") " pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:27.768570 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768394 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-host-run-netns\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.768570 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768444 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-host-cni-netd\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.768570 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768480 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-run\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.768570 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768500 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqq6h\" (UniqueName: \"kubernetes.io/projected/c1cda0e8-44a0-41b6-82ad-9e67877d9235-kube-api-access-cqq6h\") pod \"iptables-alerter-f9fdd\" (UID: \"c1cda0e8-44a0-41b6-82ad-9e67877d9235\") " pod="openshift-network-operator/iptables-alerter-f9fdd" Jul 05 13:18:27.768570 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768515 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ff80b38-49a5-468f-8088-b6021a50b374-registration-dir\") pod \"aws-ebs-csi-driver-node-7mxzg\" (UID: \"9ff80b38-49a5-468f-8088-b6021a50b374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" Jul 05 13:18:27.768570 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768533 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-os-release\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.768570 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768549 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkx5l\" (UniqueName: \"kubernetes.io/projected/15bf4c96-57a0-4f71-af70-f0fbe98e4495-kube-api-access-pkx5l\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.768570 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768565 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/63bc4840-4a3a-4d25-84c8-97c63b44aca3-agent-certs\") pod \"konnectivity-agent-d7sjf\" (UID: \"63bc4840-4a3a-4d25-84c8-97c63b44aca3\") " pod="kube-system/konnectivity-agent-d7sjf" Jul 05 13:18:27.768930 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768579 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fc48db1b-17f3-442b-b816-20457c2f17ca-os-release\") pod \"multus-additional-cni-plugins-92dw2\" (UID: \"fc48db1b-17f3-442b-b816-20457c2f17ca\") " pod="openshift-multus/multus-additional-cni-plugins-92dw2" Jul 05 13:18:27.768930 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768579 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-os-release\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.768930 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768595 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4ce057ad-491a-4f76-b9df-0a4da94dd152-kubelet-config\") pod \"global-pull-secret-syncer-xms2g\" (UID: \"4ce057ad-491a-4f76-b9df-0a4da94dd152\") " pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:27.768930 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768638 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-var-lib-openvswitch\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.768930 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768678 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb3e727d-7877-482d-bd5f-a2cbcbd9dae4-serviceca\") pod \"node-ca-tss2s\" (UID: \"eb3e727d-7877-482d-bd5f-a2cbcbd9dae4\") " pod="openshift-image-registry/node-ca-tss2s" Jul 05 13:18:27.768930 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768706 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1044be9c-adcd-4685-845f-4ab24fe04c00-tmp-dir\") pod \"node-resolver-fd7rj\" (UID: \"1044be9c-adcd-4685-845f-4ab24fe04c00\") " pod="openshift-dns/node-resolver-fd7rj" Jul 05 13:18:27.768930 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768736 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfp2x\" (UniqueName: \"kubernetes.io/projected/ef04f0f0-451b-4254-86bc-2cd6b4ce6016-kube-api-access-vfp2x\") pod \"network-check-target-n9xhq\" (UID: \"ef04f0f0-451b-4254-86bc-2cd6b4ce6016\") " pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:18:27.768930 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768763 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-var-lib-kubelet\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.768930 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768784 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc48db1b-17f3-442b-b816-20457c2f17ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-92dw2\" (UID: \"fc48db1b-17f3-442b-b816-20457c2f17ca\") " pod="openshift-multus/multus-additional-cni-plugins-92dw2" Jul 05 13:18:27.768930 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768793 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15bf4c96-57a0-4f71-af70-f0fbe98e4495-cni-binary-copy\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.768930 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768801 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-system-cni-dir\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.768930 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768845 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-host-var-lib-cni-bin\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.768930 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768866 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-system-cni-dir\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.768930 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768868 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-etc-modprobe-d\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.768930 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768904 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-etc-sysconfig\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.768930 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768932 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-etc-tuned\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.769387 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768947 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/afa1ab82-2769-4e52-b460-539ebe048f8a-ovnkube-config\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.769387 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768955 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1044be9c-adcd-4685-845f-4ab24fe04c00-tmp-dir\") pod \"node-resolver-fd7rj\" (UID: \"1044be9c-adcd-4685-845f-4ab24fe04c00\") " pod="openshift-dns/node-resolver-fd7rj" Jul 05 13:18:27.769387 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768966 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-cnibin\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.769387 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768908 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-host-var-lib-cni-bin\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.769387 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.768987 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-etc-sysctl-d\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.769387 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769012 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-host\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.769387 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769035 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c1cda0e8-44a0-41b6-82ad-9e67877d9235-iptables-alerter-script\") pod \"iptables-alerter-f9fdd\" (UID: \"c1cda0e8-44a0-41b6-82ad-9e67877d9235\") " pod="openshift-network-operator/iptables-alerter-f9fdd" Jul 05 13:18:27.769387 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769039 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-cnibin\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.769387 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769068 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ce057ad-491a-4f76-b9df-0a4da94dd152-original-pull-secret\") pod \"global-pull-secret-syncer-xms2g\" (UID: \"4ce057ad-491a-4f76-b9df-0a4da94dd152\") " pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:27.769387 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769087 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-log-socket\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.769387 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769101 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-host-cni-bin\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.769387 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769118 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-hostroot\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.769387 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769147 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-run-ovn\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.769387 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769171 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ff80b38-49a5-468f-8088-b6021a50b374-etc-selinux\") pod \"aws-ebs-csi-driver-node-7mxzg\" (UID: \"9ff80b38-49a5-468f-8088-b6021a50b374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" Jul 05 13:18:27.769387 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769190 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ff80b38-49a5-468f-8088-b6021a50b374-sys-fs\") pod \"aws-ebs-csi-driver-node-7mxzg\" (UID: \"9ff80b38-49a5-468f-8088-b6021a50b374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" Jul 05 13:18:27.769387 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769206 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-host-run-k8s-cni-cncf-io\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.769387 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769214 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-hostroot\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.769902 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769228 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-etc-kubernetes\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.769902 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769244 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/63bc4840-4a3a-4d25-84c8-97c63b44aca3-konnectivity-ca\") pod \"konnectivity-agent-d7sjf\" (UID: \"63bc4840-4a3a-4d25-84c8-97c63b44aca3\") " pod="kube-system/konnectivity-agent-d7sjf" Jul 05 13:18:27.769902 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769245 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-host-run-k8s-cni-cncf-io\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.769902 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769261 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-etc-kubernetes\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.769902 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769265 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-etc-systemd\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.769902 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769306 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-lib-modules\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.769902 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769321 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc48db1b-17f3-442b-b816-20457c2f17ca-system-cni-dir\") pod \"multus-additional-cni-plugins-92dw2\" (UID: \"fc48db1b-17f3-442b-b816-20457c2f17ca\") " pod="openshift-multus/multus-additional-cni-plugins-92dw2" Jul 05 13:18:27.769902 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769335 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-run-openvswitch\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.769902 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769352 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/afa1ab82-2769-4e52-b460-539ebe048f8a-env-overrides\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.769902 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769376 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-host-var-lib-kubelet\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.769902 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769400 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24v7x\" (UniqueName: \"kubernetes.io/projected/fc48db1b-17f3-442b-b816-20457c2f17ca-kube-api-access-24v7x\") pod \"multus-additional-cni-plugins-92dw2\" (UID: \"fc48db1b-17f3-442b-b816-20457c2f17ca\") " pod="openshift-multus/multus-additional-cni-plugins-92dw2" Jul 05 13:18:27.769902 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769415 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4ce057ad-491a-4f76-b9df-0a4da94dd152-dbus\") pod \"global-pull-secret-syncer-xms2g\" (UID: \"4ce057ad-491a-4f76-b9df-0a4da94dd152\") " pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:27.769902 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769442 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-host-var-lib-kubelet\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.769902 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769442 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-node-log\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.769902 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769466 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwk6d\" (UniqueName: \"kubernetes.io/projected/eb3e727d-7877-482d-bd5f-a2cbcbd9dae4-kube-api-access-pwk6d\") pod \"node-ca-tss2s\" (UID: \"eb3e727d-7877-482d-bd5f-a2cbcbd9dae4\") " pod="openshift-image-registry/node-ca-tss2s" Jul 05 13:18:27.769902 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769482 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-host-slash\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.769902 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769497 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-etc-openvswitch\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.770404 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769516 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-host-run-ovn-kubernetes\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.770404 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769537 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ff80b38-49a5-468f-8088-b6021a50b374-device-dir\") pod \"aws-ebs-csi-driver-node-7mxzg\" (UID: \"9ff80b38-49a5-468f-8088-b6021a50b374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" Jul 05 13:18:27.770404 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769560 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-multus-socket-dir-parent\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.770404 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769577 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/15bf4c96-57a0-4f71-af70-f0fbe98e4495-multus-daemon-config\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.770404 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769603 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-etc-kubernetes\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.770404 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769671 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-multus-socket-dir-parent\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.770404 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769685 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-tmp\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.770404 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769707 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc48db1b-17f3-442b-b816-20457c2f17ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-92dw2\" (UID: \"fc48db1b-17f3-442b-b816-20457c2f17ca\") " pod="openshift-multus/multus-additional-cni-plugins-92dw2" Jul 05 13:18:27.770404 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769726 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.770404 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769745 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgcvt\" (UniqueName: \"kubernetes.io/projected/afa1ab82-2769-4e52-b460-539ebe048f8a-kube-api-access-kgcvt\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.770404 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769790 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ff80b38-49a5-468f-8088-b6021a50b374-socket-dir\") pod \"aws-ebs-csi-driver-node-7mxzg\" (UID: \"9ff80b38-49a5-468f-8088-b6021a50b374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" Jul 05 13:18:27.770404 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769847 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-host-run-multus-certs\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.770404 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769866 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-host-run-multus-certs\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.770404 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769872 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ff80b38-49a5-468f-8088-b6021a50b374-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7mxzg\" (UID: \"9ff80b38-49a5-468f-8088-b6021a50b374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" Jul 05 13:18:27.770404 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769915 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-multus-cni-dir\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.770404 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769940 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-sys\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.770855 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769962 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc48db1b-17f3-442b-b816-20457c2f17ca-cnibin\") pod \"multus-additional-cni-plugins-92dw2\" (UID: \"fc48db1b-17f3-442b-b816-20457c2f17ca\") " pod="openshift-multus/multus-additional-cni-plugins-92dw2" Jul 05 13:18:27.770855 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.769987 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fc48db1b-17f3-442b-b816-20457c2f17ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-92dw2\" (UID: \"fc48db1b-17f3-442b-b816-20457c2f17ca\") " pod="openshift-multus/multus-additional-cni-plugins-92dw2" Jul 05 13:18:27.770855 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.770020 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-systemd-units\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.770855 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.770042 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/15bf4c96-57a0-4f71-af70-f0fbe98e4495-multus-daemon-config\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.770855 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.770055 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dwnk\" (UniqueName: \"kubernetes.io/projected/1044be9c-adcd-4685-845f-4ab24fe04c00-kube-api-access-5dwnk\") pod \"node-resolver-fd7rj\" (UID: \"1044be9c-adcd-4685-845f-4ab24fe04c00\") " pod="openshift-dns/node-resolver-fd7rj" Jul 05 13:18:27.770855 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.770067 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-multus-cni-dir\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.770855 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.770078 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-etc-sysctl-conf\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.770855 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.770099 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c1cda0e8-44a0-41b6-82ad-9e67877d9235-host-slash\") pod \"iptables-alerter-f9fdd\" (UID: \"c1cda0e8-44a0-41b6-82ad-9e67877d9235\") " pod="openshift-network-operator/iptables-alerter-f9fdd" Jul 05 13:18:27.770855 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.770112 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-host-kubelet\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.770855 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.770127 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-host-var-lib-cni-multus\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.770855 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.770141 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/afa1ab82-2769-4e52-b460-539ebe048f8a-ovnkube-script-lib\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.770855 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.770166 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf22b\" (UniqueName: \"kubernetes.io/projected/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-kube-api-access-rf22b\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.770855 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.770183 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/15bf4c96-57a0-4f71-af70-f0fbe98e4495-host-var-lib-cni-multus\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.777923 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.777902 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 05 13:18:27.781087 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.781070 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkx5l\" (UniqueName: \"kubernetes.io/projected/15bf4c96-57a0-4f71-af70-f0fbe98e4495-kube-api-access-pkx5l\") pod \"multus-vjtd2\" (UID: \"15bf4c96-57a0-4f71-af70-f0fbe98e4495\") " pod="openshift-multus/multus-vjtd2" Jul 05 13:18:27.781398 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.781382 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dwnk\" (UniqueName: \"kubernetes.io/projected/1044be9c-adcd-4685-845f-4ab24fe04c00-kube-api-access-5dwnk\") pod \"node-resolver-fd7rj\" (UID: \"1044be9c-adcd-4685-845f-4ab24fe04c00\") " pod="openshift-dns/node-resolver-fd7rj" Jul 05 13:18:27.829830 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:27.829793 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5efd728fef4d484917909757bf24398.slice/crio-fd4ce9d069eba775a57ec813413ae871d517823ad704828b1105aeddd01a7a5a WatchSource:0}: Error finding container fd4ce9d069eba775a57ec813413ae871d517823ad704828b1105aeddd01a7a5a: Status 404 returned error can't find the container with id fd4ce9d069eba775a57ec813413ae871d517823ad704828b1105aeddd01a7a5a Jul 05 13:18:27.830224 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:27.830202 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99c4126045d45ecfe73709fe851a3e37.slice/crio-54fba312b76b866f096f0a8eb09f7cb2622e8a32ff962ddb2a6e12ef680ef544 WatchSource:0}: Error finding container 54fba312b76b866f096f0a8eb09f7cb2622e8a32ff962ddb2a6e12ef680ef544: Status 404 returned error can't find the container with id 54fba312b76b866f096f0a8eb09f7cb2622e8a32ff962ddb2a6e12ef680ef544 Jul 05 13:18:27.834252 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.834239 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 13:18:27.871209 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.871187 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf22b\" (UniqueName: \"kubernetes.io/projected/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-kube-api-access-rf22b\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.871346 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.871223 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fc48db1b-17f3-442b-b816-20457c2f17ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-92dw2\" (UID: \"fc48db1b-17f3-442b-b816-20457c2f17ca\") " pod="openshift-multus/multus-additional-cni-plugins-92dw2" Jul 05 13:18:27.871346 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.871240 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-host-run-netns\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.871346 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.871258 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-run-systemd\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.871346 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.871282 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/afa1ab82-2769-4e52-b460-539ebe048f8a-ovn-node-metrics-cert\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.871346 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.871332 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-host-run-netns\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.871557 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.871335 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-run-systemd\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.871557 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.871357 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2kxl\" (UniqueName: \"kubernetes.io/projected/9ff80b38-49a5-468f-8088-b6021a50b374-kube-api-access-p2kxl\") pod \"aws-ebs-csi-driver-node-7mxzg\" (UID: \"9ff80b38-49a5-468f-8088-b6021a50b374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" Jul 05 13:18:27.871557 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.871403 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb3e727d-7877-482d-bd5f-a2cbcbd9dae4-host\") pod \"node-ca-tss2s\" (UID: \"eb3e727d-7877-482d-bd5f-a2cbcbd9dae4\") " pod="openshift-image-registry/node-ca-tss2s" Jul 05 13:18:27.871557 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.871434 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs\") pod \"network-metrics-daemon-fsfvp\" (UID: \"d06fcb3d-95c9-4837-8b5f-f8455c806cf3\") " pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:27.871557 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.871461 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c27r6\" (UniqueName: \"kubernetes.io/projected/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-kube-api-access-c27r6\") pod \"network-metrics-daemon-fsfvp\" (UID: \"d06fcb3d-95c9-4837-8b5f-f8455c806cf3\") " pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:27.871557 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.871498 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb3e727d-7877-482d-bd5f-a2cbcbd9dae4-host\") pod \"node-ca-tss2s\" (UID: \"eb3e727d-7877-482d-bd5f-a2cbcbd9dae4\") " pod="openshift-image-registry/node-ca-tss2s" Jul 05 13:18:27.871819 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:27.871562 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:27.871819 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.871608 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-host-cni-netd\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.871819 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:27.871656 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs podName:d06fcb3d-95c9-4837-8b5f-f8455c806cf3 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:28.371614906 +0000 UTC m=+2.016925366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs") pod "network-metrics-daemon-fsfvp" (UID: "d06fcb3d-95c9-4837-8b5f-f8455c806cf3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:27.871819 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.871653 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-host-cni-netd\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.871819 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.871683 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-run\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.871819 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.871728 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-run\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.871819 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.871759 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqq6h\" (UniqueName: \"kubernetes.io/projected/c1cda0e8-44a0-41b6-82ad-9e67877d9235-kube-api-access-cqq6h\") pod \"iptables-alerter-f9fdd\" (UID: \"c1cda0e8-44a0-41b6-82ad-9e67877d9235\") " pod="openshift-network-operator/iptables-alerter-f9fdd" Jul 05 13:18:27.871819 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.871789 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ff80b38-49a5-468f-8088-b6021a50b374-registration-dir\") pod \"aws-ebs-csi-driver-node-7mxzg\" (UID: \"9ff80b38-49a5-468f-8088-b6021a50b374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" Jul 05 13:18:27.872127 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.871839 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/63bc4840-4a3a-4d25-84c8-97c63b44aca3-agent-certs\") pod \"konnectivity-agent-d7sjf\" (UID: \"63bc4840-4a3a-4d25-84c8-97c63b44aca3\") " pod="kube-system/konnectivity-agent-d7sjf" Jul 05 13:18:27.872127 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.871865 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fc48db1b-17f3-442b-b816-20457c2f17ca-os-release\") pod \"multus-additional-cni-plugins-92dw2\" (UID: \"fc48db1b-17f3-442b-b816-20457c2f17ca\") " pod="openshift-multus/multus-additional-cni-plugins-92dw2" Jul 05 13:18:27.872127 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.871881 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fc48db1b-17f3-442b-b816-20457c2f17ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-92dw2\" (UID: \"fc48db1b-17f3-442b-b816-20457c2f17ca\") " pod="openshift-multus/multus-additional-cni-plugins-92dw2" Jul 05 13:18:27.872127 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.871889 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4ce057ad-491a-4f76-b9df-0a4da94dd152-kubelet-config\") pod \"global-pull-secret-syncer-xms2g\" (UID: \"4ce057ad-491a-4f76-b9df-0a4da94dd152\") " pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:27.872127 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.871921 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9ff80b38-49a5-468f-8088-b6021a50b374-registration-dir\") pod \"aws-ebs-csi-driver-node-7mxzg\" (UID: \"9ff80b38-49a5-468f-8088-b6021a50b374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" Jul 05 13:18:27.872350 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.872232 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fc48db1b-17f3-442b-b816-20457c2f17ca-os-release\") pod \"multus-additional-cni-plugins-92dw2\" (UID: \"fc48db1b-17f3-442b-b816-20457c2f17ca\") " pod="openshift-multus/multus-additional-cni-plugins-92dw2" Jul 05 13:18:27.872350 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.872262 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-var-lib-openvswitch\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.872350 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.872309 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb3e727d-7877-482d-bd5f-a2cbcbd9dae4-serviceca\") pod \"node-ca-tss2s\" (UID: \"eb3e727d-7877-482d-bd5f-a2cbcbd9dae4\") " pod="openshift-image-registry/node-ca-tss2s" Jul 05 13:18:27.872509 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.872356 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfp2x\" (UniqueName: \"kubernetes.io/projected/ef04f0f0-451b-4254-86bc-2cd6b4ce6016-kube-api-access-vfp2x\") pod \"network-check-target-n9xhq\" (UID: \"ef04f0f0-451b-4254-86bc-2cd6b4ce6016\") " pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:18:27.872509 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.872392 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-var-lib-kubelet\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.872509 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.872424 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc48db1b-17f3-442b-b816-20457c2f17ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-92dw2\" (UID: \"fc48db1b-17f3-442b-b816-20457c2f17ca\") " pod="openshift-multus/multus-additional-cni-plugins-92dw2" Jul 05 13:18:27.872509 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.872455 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-etc-modprobe-d\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.872509 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.872486 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-etc-sysconfig\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.872764 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.872513 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-etc-tuned\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.872764 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.872546 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/afa1ab82-2769-4e52-b460-539ebe048f8a-ovnkube-config\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.872764 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.872547 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-var-lib-openvswitch\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.872764 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.872600 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-etc-sysctl-d\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.872764 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.872635 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-host\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.872764 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.872666 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c1cda0e8-44a0-41b6-82ad-9e67877d9235-iptables-alerter-script\") pod \"iptables-alerter-f9fdd\" (UID: \"c1cda0e8-44a0-41b6-82ad-9e67877d9235\") " pod="openshift-network-operator/iptables-alerter-f9fdd" Jul 05 13:18:27.872764 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.872698 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ce057ad-491a-4f76-b9df-0a4da94dd152-original-pull-secret\") pod \"global-pull-secret-syncer-xms2g\" (UID: \"4ce057ad-491a-4f76-b9df-0a4da94dd152\") " pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:27.872764 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.872723 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-log-socket\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.872764 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.872751 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-host-cni-bin\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.873203 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.872355 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4ce057ad-491a-4f76-b9df-0a4da94dd152-kubelet-config\") pod \"global-pull-secret-syncer-xms2g\" (UID: \"4ce057ad-491a-4f76-b9df-0a4da94dd152\") " pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:27.873203 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.872837 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-run-ovn\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.873203 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.872968 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-etc-sysctl-d\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.873203 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.873023 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-host\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.873203 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.873162 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/afa1ab82-2769-4e52-b460-539ebe048f8a-ovnkube-config\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.873609 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.873583 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c1cda0e8-44a0-41b6-82ad-9e67877d9235-iptables-alerter-script\") pod \"iptables-alerter-f9fdd\" (UID: \"c1cda0e8-44a0-41b6-82ad-9e67877d9235\") " pod="openshift-network-operator/iptables-alerter-f9fdd" Jul 05 13:18:27.873609 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.873601 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb3e727d-7877-482d-bd5f-a2cbcbd9dae4-serviceca\") pod \"node-ca-tss2s\" (UID: \"eb3e727d-7877-482d-bd5f-a2cbcbd9dae4\") " pod="openshift-image-registry/node-ca-tss2s" Jul 05 13:18:27.873752 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.873696 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-etc-sysconfig\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.873752 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.873698 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fc48db1b-17f3-442b-b816-20457c2f17ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-92dw2\" (UID: \"fc48db1b-17f3-442b-b816-20457c2f17ca\") " pod="openshift-multus/multus-additional-cni-plugins-92dw2" Jul 05 13:18:27.873752 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.873716 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-etc-modprobe-d\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.873926 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.873767 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-var-lib-kubelet\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.874015 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.873983 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-log-socket\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.874136 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.874042 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-host-cni-bin\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.874136 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.874104 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-run-ovn\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.874136 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:27.874117 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:27.874293 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.874145 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ff80b38-49a5-468f-8088-b6021a50b374-etc-selinux\") pod \"aws-ebs-csi-driver-node-7mxzg\" (UID: \"9ff80b38-49a5-468f-8088-b6021a50b374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" Jul 05 13:18:27.874293 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:27.874175 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ce057ad-491a-4f76-b9df-0a4da94dd152-original-pull-secret podName:4ce057ad-491a-4f76-b9df-0a4da94dd152 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:28.374157901 +0000 UTC m=+2.019468360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ce057ad-491a-4f76-b9df-0a4da94dd152-original-pull-secret") pod "global-pull-secret-syncer-xms2g" (UID: "4ce057ad-491a-4f76-b9df-0a4da94dd152") : object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:27.874293 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.874192 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ff80b38-49a5-468f-8088-b6021a50b374-sys-fs\") pod \"aws-ebs-csi-driver-node-7mxzg\" (UID: \"9ff80b38-49a5-468f-8088-b6021a50b374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" Jul 05 13:18:27.874293 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.874245 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/63bc4840-4a3a-4d25-84c8-97c63b44aca3-konnectivity-ca\") pod \"konnectivity-agent-d7sjf\" (UID: \"63bc4840-4a3a-4d25-84c8-97c63b44aca3\") " pod="kube-system/konnectivity-agent-d7sjf" Jul 05 13:18:27.874293 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.874261 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9ff80b38-49a5-468f-8088-b6021a50b374-etc-selinux\") pod \"aws-ebs-csi-driver-node-7mxzg\" (UID: \"9ff80b38-49a5-468f-8088-b6021a50b374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" Jul 05 13:18:27.874293 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.874276 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-etc-systemd\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.874582 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.874308 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-lib-modules\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.874582 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.874337 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc48db1b-17f3-442b-b816-20457c2f17ca-system-cni-dir\") pod \"multus-additional-cni-plugins-92dw2\" (UID: \"fc48db1b-17f3-442b-b816-20457c2f17ca\") " pod="openshift-multus/multus-additional-cni-plugins-92dw2" Jul 05 13:18:27.874582 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.874415 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9ff80b38-49a5-468f-8088-b6021a50b374-sys-fs\") pod \"aws-ebs-csi-driver-node-7mxzg\" (UID: \"9ff80b38-49a5-468f-8088-b6021a50b374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" Jul 05 13:18:27.874582 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.874471 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-etc-systemd\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.874582 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.874513 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fc48db1b-17f3-442b-b816-20457c2f17ca-system-cni-dir\") pod \"multus-additional-cni-plugins-92dw2\" (UID: \"fc48db1b-17f3-442b-b816-20457c2f17ca\") " pod="openshift-multus/multus-additional-cni-plugins-92dw2" Jul 05 13:18:27.874835 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.874584 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-lib-modules\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.874835 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.874625 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-run-openvswitch\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.874835 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.874655 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/afa1ab82-2769-4e52-b460-539ebe048f8a-env-overrides\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.874835 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.874719 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-run-openvswitch\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.874835 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.874773 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24v7x\" (UniqueName: \"kubernetes.io/projected/fc48db1b-17f3-442b-b816-20457c2f17ca-kube-api-access-24v7x\") pod \"multus-additional-cni-plugins-92dw2\" (UID: \"fc48db1b-17f3-442b-b816-20457c2f17ca\") " pod="openshift-multus/multus-additional-cni-plugins-92dw2" Jul 05 13:18:27.874835 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.874828 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4ce057ad-491a-4f76-b9df-0a4da94dd152-dbus\") pod \"global-pull-secret-syncer-xms2g\" (UID: \"4ce057ad-491a-4f76-b9df-0a4da94dd152\") " pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:27.875130 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.874837 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/63bc4840-4a3a-4d25-84c8-97c63b44aca3-konnectivity-ca\") pod \"konnectivity-agent-d7sjf\" (UID: \"63bc4840-4a3a-4d25-84c8-97c63b44aca3\") " pod="kube-system/konnectivity-agent-d7sjf" Jul 05 13:18:27.875130 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.874859 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-node-log\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.875130 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.874895 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/63bc4840-4a3a-4d25-84c8-97c63b44aca3-agent-certs\") pod \"konnectivity-agent-d7sjf\" (UID: \"63bc4840-4a3a-4d25-84c8-97c63b44aca3\") " pod="kube-system/konnectivity-agent-d7sjf" Jul 05 13:18:27.875130 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.874920 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-node-log\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.875130 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.874981 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4ce057ad-491a-4f76-b9df-0a4da94dd152-dbus\") pod \"global-pull-secret-syncer-xms2g\" (UID: \"4ce057ad-491a-4f76-b9df-0a4da94dd152\") " pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:27.875130 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875024 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwk6d\" (UniqueName: \"kubernetes.io/projected/eb3e727d-7877-482d-bd5f-a2cbcbd9dae4-kube-api-access-pwk6d\") pod \"node-ca-tss2s\" (UID: \"eb3e727d-7877-482d-bd5f-a2cbcbd9dae4\") " pod="openshift-image-registry/node-ca-tss2s" Jul 05 13:18:27.875130 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875049 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-host-slash\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.875130 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875056 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/afa1ab82-2769-4e52-b460-539ebe048f8a-env-overrides\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.875130 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875086 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-etc-openvswitch\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.875130 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875118 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-host-run-ovn-kubernetes\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.875664 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875146 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ff80b38-49a5-468f-8088-b6021a50b374-device-dir\") pod \"aws-ebs-csi-driver-node-7mxzg\" (UID: \"9ff80b38-49a5-468f-8088-b6021a50b374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" Jul 05 13:18:27.875664 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875171 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-etc-kubernetes\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.875664 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875214 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-tmp\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.875664 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875227 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-host-run-ovn-kubernetes\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.875664 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875247 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc48db1b-17f3-442b-b816-20457c2f17ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-92dw2\" (UID: \"fc48db1b-17f3-442b-b816-20457c2f17ca\") " pod="openshift-multus/multus-additional-cni-plugins-92dw2" Jul 05 13:18:27.875664 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875272 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-host-slash\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.875664 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875276 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.875664 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875312 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-etc-openvswitch\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.875664 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875336 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9ff80b38-49a5-468f-8088-b6021a50b374-device-dir\") pod \"aws-ebs-csi-driver-node-7mxzg\" (UID: \"9ff80b38-49a5-468f-8088-b6021a50b374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" Jul 05 13:18:27.875664 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875358 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.875664 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875396 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-etc-kubernetes\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.875664 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875410 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgcvt\" (UniqueName: \"kubernetes.io/projected/afa1ab82-2769-4e52-b460-539ebe048f8a-kube-api-access-kgcvt\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.875664 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875444 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ff80b38-49a5-468f-8088-b6021a50b374-socket-dir\") pod \"aws-ebs-csi-driver-node-7mxzg\" (UID: \"9ff80b38-49a5-468f-8088-b6021a50b374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" Jul 05 13:18:27.875664 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875476 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ff80b38-49a5-468f-8088-b6021a50b374-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7mxzg\" (UID: \"9ff80b38-49a5-468f-8088-b6021a50b374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" Jul 05 13:18:27.875664 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875504 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-sys\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.875664 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875528 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc48db1b-17f3-442b-b816-20457c2f17ca-cnibin\") pod \"multus-additional-cni-plugins-92dw2\" (UID: \"fc48db1b-17f3-442b-b816-20457c2f17ca\") " pod="openshift-multus/multus-additional-cni-plugins-92dw2" Jul 05 13:18:27.875664 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875562 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fc48db1b-17f3-442b-b816-20457c2f17ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-92dw2\" (UID: \"fc48db1b-17f3-442b-b816-20457c2f17ca\") " pod="openshift-multus/multus-additional-cni-plugins-92dw2" Jul 05 13:18:27.876463 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875595 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-systemd-units\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.876463 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875627 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-etc-sysctl-conf\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.876463 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875656 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c1cda0e8-44a0-41b6-82ad-9e67877d9235-host-slash\") pod \"iptables-alerter-f9fdd\" (UID: \"c1cda0e8-44a0-41b6-82ad-9e67877d9235\") " pod="openshift-network-operator/iptables-alerter-f9fdd" Jul 05 13:18:27.876463 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875688 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-host-kubelet\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.876463 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.875724 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/afa1ab82-2769-4e52-b460-539ebe048f8a-ovnkube-script-lib\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.876463 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.876032 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fc48db1b-17f3-442b-b816-20457c2f17ca-cnibin\") pod \"multus-additional-cni-plugins-92dw2\" (UID: \"fc48db1b-17f3-442b-b816-20457c2f17ca\") " pod="openshift-multus/multus-additional-cni-plugins-92dw2" Jul 05 13:18:27.876463 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.876281 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-etc-sysctl-conf\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.876463 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.876300 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/afa1ab82-2769-4e52-b460-539ebe048f8a-ovnkube-script-lib\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.876463 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.876344 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-etc-tuned\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.876463 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.876388 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9ff80b38-49a5-468f-8088-b6021a50b374-socket-dir\") pod \"aws-ebs-csi-driver-node-7mxzg\" (UID: \"9ff80b38-49a5-468f-8088-b6021a50b374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" Jul 05 13:18:27.876463 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.876386 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-systemd-units\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.876463 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.876406 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/afa1ab82-2769-4e52-b460-539ebe048f8a-host-kubelet\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.876463 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.876414 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9ff80b38-49a5-468f-8088-b6021a50b374-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7mxzg\" (UID: \"9ff80b38-49a5-468f-8088-b6021a50b374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" Jul 05 13:18:27.876855 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.876495 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-sys\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.876855 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.876541 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c1cda0e8-44a0-41b6-82ad-9e67877d9235-host-slash\") pod \"iptables-alerter-f9fdd\" (UID: \"c1cda0e8-44a0-41b6-82ad-9e67877d9235\") " pod="openshift-network-operator/iptables-alerter-f9fdd" Jul 05 13:18:27.876855 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.876763 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/afa1ab82-2769-4e52-b460-539ebe048f8a-ovn-node-metrics-cert\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.877721 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.877680 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fc48db1b-17f3-442b-b816-20457c2f17ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-92dw2\" (UID: \"fc48db1b-17f3-442b-b816-20457c2f17ca\") " pod="openshift-multus/multus-additional-cni-plugins-92dw2" Jul 05 13:18:27.877721 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.877678 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-tmp\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.878332 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.878312 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fc48db1b-17f3-442b-b816-20457c2f17ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-92dw2\" (UID: \"fc48db1b-17f3-442b-b816-20457c2f17ca\") " pod="openshift-multus/multus-additional-cni-plugins-92dw2" Jul 05 13:18:27.880181 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.880161 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2kxl\" (UniqueName: \"kubernetes.io/projected/9ff80b38-49a5-468f-8088-b6021a50b374-kube-api-access-p2kxl\") pod \"aws-ebs-csi-driver-node-7mxzg\" (UID: \"9ff80b38-49a5-468f-8088-b6021a50b374\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" Jul 05 13:18:27.880285 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.880271 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf22b\" (UniqueName: \"kubernetes.io/projected/206d63d1-e37a-4d07-88fb-2f2aa710aa8d-kube-api-access-rf22b\") pod \"tuned-lv52r\" (UID: \"206d63d1-e37a-4d07-88fb-2f2aa710aa8d\") " pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:27.880378 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.880361 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c27r6\" (UniqueName: \"kubernetes.io/projected/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-kube-api-access-c27r6\") pod \"network-metrics-daemon-fsfvp\" (UID: \"d06fcb3d-95c9-4837-8b5f-f8455c806cf3\") " pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:27.883619 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:27.883602 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 13:18:27.883619 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:27.883619 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 13:18:27.883760 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:27.883629 2565 projected.go:196] Error preparing data for projected volume kube-api-access-vfp2x for pod openshift-network-diagnostics/network-check-target-n9xhq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:27.883760 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:27.883678 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef04f0f0-451b-4254-86bc-2cd6b4ce6016-kube-api-access-vfp2x podName:ef04f0f0-451b-4254-86bc-2cd6b4ce6016 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:28.38366554 +0000 UTC m=+2.028975982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vfp2x" (UniqueName: "kubernetes.io/projected/ef04f0f0-451b-4254-86bc-2cd6b4ce6016-kube-api-access-vfp2x") pod "network-check-target-n9xhq" (UID: "ef04f0f0-451b-4254-86bc-2cd6b4ce6016") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:27.884922 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.884903 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwk6d\" (UniqueName: \"kubernetes.io/projected/eb3e727d-7877-482d-bd5f-a2cbcbd9dae4-kube-api-access-pwk6d\") pod \"node-ca-tss2s\" (UID: \"eb3e727d-7877-482d-bd5f-a2cbcbd9dae4\") " pod="openshift-image-registry/node-ca-tss2s" Jul 05 13:18:27.885262 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.885244 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgcvt\" (UniqueName: \"kubernetes.io/projected/afa1ab82-2769-4e52-b460-539ebe048f8a-kube-api-access-kgcvt\") pod \"ovnkube-node-thmmq\" (UID: \"afa1ab82-2769-4e52-b460-539ebe048f8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:27.885450 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.885430 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqq6h\" (UniqueName: \"kubernetes.io/projected/c1cda0e8-44a0-41b6-82ad-9e67877d9235-kube-api-access-cqq6h\") pod \"iptables-alerter-f9fdd\" (UID: \"c1cda0e8-44a0-41b6-82ad-9e67877d9235\") " pod="openshift-network-operator/iptables-alerter-f9fdd" Jul 05 13:18:27.885687 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.885672 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24v7x\" (UniqueName: \"kubernetes.io/projected/fc48db1b-17f3-442b-b816-20457c2f17ca-kube-api-access-24v7x\") pod \"multus-additional-cni-plugins-92dw2\" (UID: \"fc48db1b-17f3-442b-b816-20457c2f17ca\") " pod="openshift-multus/multus-additional-cni-plugins-92dw2" Jul 05 13:18:27.998491 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:27.998426 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fd7rj" Jul 05 13:18:28.008069 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:28.008039 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1044be9c_adcd_4685_845f_4ab24fe04c00.slice/crio-76001991e71081b79557c40bb53e5bc6cd61651b1d76255cbb1f140e88f29042 WatchSource:0}: Error finding container 76001991e71081b79557c40bb53e5bc6cd61651b1d76255cbb1f140e88f29042: Status 404 returned error can't find the container with id 76001991e71081b79557c40bb53e5bc6cd61651b1d76255cbb1f140e88f29042 Jul 05 13:18:28.026376 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.026358 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vjtd2" Jul 05 13:18:28.034558 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:28.034538 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15bf4c96_57a0_4f71_af70_f0fbe98e4495.slice/crio-bbb214f029536f0b135db697784ceec45068a6759df60ec87139dcb58ad21856 WatchSource:0}: Error finding container bbb214f029536f0b135db697784ceec45068a6759df60ec87139dcb58ad21856: Status 404 returned error can't find the container with id bbb214f029536f0b135db697784ceec45068a6759df60ec87139dcb58ad21856 Jul 05 13:18:28.042661 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.042646 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d7sjf" Jul 05 13:18:28.046281 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.046264 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lv52r" Jul 05 13:18:28.050796 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:28.050771 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63bc4840_4a3a_4d25_84c8_97c63b44aca3.slice/crio-6618a238df51a9d7b57f9d54c9be7d2976c77a112036136a58bddfcd53f958ba WatchSource:0}: Error finding container 6618a238df51a9d7b57f9d54c9be7d2976c77a112036136a58bddfcd53f958ba: Status 404 returned error can't find the container with id 6618a238df51a9d7b57f9d54c9be7d2976c77a112036136a58bddfcd53f958ba Jul 05 13:18:28.054760 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:28.054743 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod206d63d1_e37a_4d07_88fb_2f2aa710aa8d.slice/crio-ef6d358113d76c94b321f6dbaf2af7f4953fc216d71e61ffebb5b932325e55b3 WatchSource:0}: Error finding container ef6d358113d76c94b321f6dbaf2af7f4953fc216d71e61ffebb5b932325e55b3: Status 404 returned error can't find the container with id ef6d358113d76c94b321f6dbaf2af7f4953fc216d71e61ffebb5b932325e55b3 Jul 05 13:18:28.061899 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.061877 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-92dw2" Jul 05 13:18:28.070736 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:28.070719 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc48db1b_17f3_442b_b816_20457c2f17ca.slice/crio-a98b8a969f355ab4ffb143f005d7791e96cc2ccc255d43b6747a7e8394a74b23 WatchSource:0}: Error finding container a98b8a969f355ab4ffb143f005d7791e96cc2ccc255d43b6747a7e8394a74b23: Status 404 returned error can't find the container with id a98b8a969f355ab4ffb143f005d7791e96cc2ccc255d43b6747a7e8394a74b23 Jul 05 13:18:28.077369 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.077356 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f9fdd" Jul 05 13:18:28.086153 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:28.086134 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1cda0e8_44a0_41b6_82ad_9e67877d9235.slice/crio-24c4ba8f84896f16815fcfcef781c281e6b8272ba0b2c062e29a182e7005fd9e WatchSource:0}: Error finding container 24c4ba8f84896f16815fcfcef781c281e6b8272ba0b2c062e29a182e7005fd9e: Status 404 returned error can't find the container with id 24c4ba8f84896f16815fcfcef781c281e6b8272ba0b2c062e29a182e7005fd9e Jul 05 13:18:28.095380 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.095357 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:28.102877 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:28.102859 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafa1ab82_2769_4e52_b460_539ebe048f8a.slice/crio-5049b7cc3f5a128812abe45a452640ea3d04791c7a23fdda469293070ef997ae WatchSource:0}: Error finding container 5049b7cc3f5a128812abe45a452640ea3d04791c7a23fdda469293070ef997ae: Status 404 returned error can't find the container with id 5049b7cc3f5a128812abe45a452640ea3d04791c7a23fdda469293070ef997ae Jul 05 13:18:28.108750 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.108734 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 13:18:28.112520 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.112506 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" Jul 05 13:18:28.118296 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.118279 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tss2s" Jul 05 13:18:28.120206 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:28.120187 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff80b38_49a5_468f_8088_b6021a50b374.slice/crio-d29ef37d719d8b6cefafad5b62ecf96c74573f010b6576bcd4c8bf707c02e8bf WatchSource:0}: Error finding container d29ef37d719d8b6cefafad5b62ecf96c74573f010b6576bcd4c8bf707c02e8bf: Status 404 returned error can't find the container with id d29ef37d719d8b6cefafad5b62ecf96c74573f010b6576bcd4c8bf707c02e8bf Jul 05 13:18:28.126531 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:18:28.126499 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb3e727d_7877_482d_bd5f_a2cbcbd9dae4.slice/crio-272c72d72520c0cf29c2ccd9fd193d93317dd9d0882cb389ae4647be7c16e8cc WatchSource:0}: Error finding container 272c72d72520c0cf29c2ccd9fd193d93317dd9d0882cb389ae4647be7c16e8cc: Status 404 returned error can't find the container with id 272c72d72520c0cf29c2ccd9fd193d93317dd9d0882cb389ae4647be7c16e8cc Jul 05 13:18:28.379125 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.379045 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs\") pod \"network-metrics-daemon-fsfvp\" (UID: \"d06fcb3d-95c9-4837-8b5f-f8455c806cf3\") " pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:28.379281 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.379119 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ce057ad-491a-4f76-b9df-0a4da94dd152-original-pull-secret\") pod \"global-pull-secret-syncer-xms2g\" (UID: \"4ce057ad-491a-4f76-b9df-0a4da94dd152\") " pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:28.379281 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:28.379270 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:28.379396 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:28.379329 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ce057ad-491a-4f76-b9df-0a4da94dd152-original-pull-secret podName:4ce057ad-491a-4f76-b9df-0a4da94dd152 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:29.379309663 +0000 UTC m=+3.024620126 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ce057ad-491a-4f76-b9df-0a4da94dd152-original-pull-secret") pod "global-pull-secret-syncer-xms2g" (UID: "4ce057ad-491a-4f76-b9df-0a4da94dd152") : object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:28.379828 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:28.379723 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:28.379828 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:28.379780 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs podName:d06fcb3d-95c9-4837-8b5f-f8455c806cf3 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:29.379763018 +0000 UTC m=+3.025073479 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs") pod "network-metrics-daemon-fsfvp" (UID: "d06fcb3d-95c9-4837-8b5f-f8455c806cf3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:28.432306 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.432276 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 13:18:28.480138 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.479484 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfp2x\" (UniqueName: \"kubernetes.io/projected/ef04f0f0-451b-4254-86bc-2cd6b4ce6016-kube-api-access-vfp2x\") pod \"network-check-target-n9xhq\" (UID: \"ef04f0f0-451b-4254-86bc-2cd6b4ce6016\") " pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:18:28.480138 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:28.479644 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 13:18:28.480138 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:28.479666 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 13:18:28.480138 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:28.479678 2565 projected.go:196] Error preparing data for projected volume kube-api-access-vfp2x for pod openshift-network-diagnostics/network-check-target-n9xhq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:28.480138 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:28.479730 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef04f0f0-451b-4254-86bc-2cd6b4ce6016-kube-api-access-vfp2x podName:ef04f0f0-451b-4254-86bc-2cd6b4ce6016 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:29.4797117 +0000 UTC m=+3.125022153 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vfp2x" (UniqueName: "kubernetes.io/projected/ef04f0f0-451b-4254-86bc-2cd6b4ce6016-kube-api-access-vfp2x") pod "network-check-target-n9xhq" (UID: "ef04f0f0-451b-4254-86bc-2cd6b4ce6016") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:28.577434 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.577240 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 13:18:28.731724 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.731585 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 13:13:27 +0000 UTC" deadline="2028-04-18 06:15:36.164891946 +0000 UTC" Jul 05 13:18:28.731724 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.731633 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15664h57m7.43326329s" Jul 05 13:18:28.813570 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.813540 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:18:28.813891 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:28.813660 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xhq" podUID="ef04f0f0-451b-4254-86bc-2cd6b4ce6016" Jul 05 13:18:28.830352 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.830276 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" event={"ID":"99c4126045d45ecfe73709fe851a3e37","Type":"ContainerStarted","Data":"54fba312b76b866f096f0a8eb09f7cb2622e8a32ff962ddb2a6e12ef680ef544"} Jul 05 13:18:28.845664 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.845464 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" event={"ID":"afa1ab82-2769-4e52-b460-539ebe048f8a","Type":"ContainerStarted","Data":"5049b7cc3f5a128812abe45a452640ea3d04791c7a23fdda469293070ef997ae"} Jul 05 13:18:28.864651 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.864591 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-92dw2" event={"ID":"fc48db1b-17f3-442b-b816-20457c2f17ca","Type":"ContainerStarted","Data":"a98b8a969f355ab4ffb143f005d7791e96cc2ccc255d43b6747a7e8394a74b23"} Jul 05 13:18:28.883318 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.883287 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vjtd2" event={"ID":"15bf4c96-57a0-4f71-af70-f0fbe98e4495","Type":"ContainerStarted","Data":"bbb214f029536f0b135db697784ceec45068a6759df60ec87139dcb58ad21856"} Jul 05 13:18:28.899680 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.899590 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fd7rj" event={"ID":"1044be9c-adcd-4685-845f-4ab24fe04c00","Type":"ContainerStarted","Data":"76001991e71081b79557c40bb53e5bc6cd61651b1d76255cbb1f140e88f29042"} Jul 05 13:18:28.907725 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.907695 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tss2s" event={"ID":"eb3e727d-7877-482d-bd5f-a2cbcbd9dae4","Type":"ContainerStarted","Data":"272c72d72520c0cf29c2ccd9fd193d93317dd9d0882cb389ae4647be7c16e8cc"} Jul 05 13:18:28.913196 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.913168 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" event={"ID":"9ff80b38-49a5-468f-8088-b6021a50b374","Type":"ContainerStarted","Data":"d29ef37d719d8b6cefafad5b62ecf96c74573f010b6576bcd4c8bf707c02e8bf"} Jul 05 13:18:28.919116 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.919090 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f9fdd" event={"ID":"c1cda0e8-44a0-41b6-82ad-9e67877d9235","Type":"ContainerStarted","Data":"24c4ba8f84896f16815fcfcef781c281e6b8272ba0b2c062e29a182e7005fd9e"} Jul 05 13:18:28.957392 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.957356 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lv52r" event={"ID":"206d63d1-e37a-4d07-88fb-2f2aa710aa8d","Type":"ContainerStarted","Data":"ef6d358113d76c94b321f6dbaf2af7f4953fc216d71e61ffebb5b932325e55b3"} Jul 05 13:18:28.959784 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.959753 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d7sjf" event={"ID":"63bc4840-4a3a-4d25-84c8-97c63b44aca3","Type":"ContainerStarted","Data":"6618a238df51a9d7b57f9d54c9be7d2976c77a112036136a58bddfcd53f958ba"} Jul 05 13:18:28.978710 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:28.978670 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal" event={"ID":"e5efd728fef4d484917909757bf24398","Type":"ContainerStarted","Data":"fd4ce9d069eba775a57ec813413ae871d517823ad704828b1105aeddd01a7a5a"} Jul 05 13:18:29.390687 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:29.389856 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ce057ad-491a-4f76-b9df-0a4da94dd152-original-pull-secret\") pod \"global-pull-secret-syncer-xms2g\" (UID: \"4ce057ad-491a-4f76-b9df-0a4da94dd152\") " pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:29.390687 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:29.389944 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs\") pod \"network-metrics-daemon-fsfvp\" (UID: \"d06fcb3d-95c9-4837-8b5f-f8455c806cf3\") " pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:29.390687 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:29.390089 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:29.390687 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:29.390152 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs podName:d06fcb3d-95c9-4837-8b5f-f8455c806cf3 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:31.390131208 +0000 UTC m=+5.035441673 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs") pod "network-metrics-daemon-fsfvp" (UID: "d06fcb3d-95c9-4837-8b5f-f8455c806cf3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:29.390687 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:29.390586 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:29.390687 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:29.390637 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ce057ad-491a-4f76-b9df-0a4da94dd152-original-pull-secret podName:4ce057ad-491a-4f76-b9df-0a4da94dd152 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:31.390621524 +0000 UTC m=+5.035931982 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ce057ad-491a-4f76-b9df-0a4da94dd152-original-pull-secret") pod "global-pull-secret-syncer-xms2g" (UID: "4ce057ad-491a-4f76-b9df-0a4da94dd152") : object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:29.490371 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:29.490330 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfp2x\" (UniqueName: \"kubernetes.io/projected/ef04f0f0-451b-4254-86bc-2cd6b4ce6016-kube-api-access-vfp2x\") pod \"network-check-target-n9xhq\" (UID: \"ef04f0f0-451b-4254-86bc-2cd6b4ce6016\") " pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:18:29.490551 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:29.490492 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 13:18:29.490551 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:29.490517 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 13:18:29.490551 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:29.490529 2565 projected.go:196] Error preparing data for projected volume kube-api-access-vfp2x for pod openshift-network-diagnostics/network-check-target-n9xhq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:29.490708 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:29.490587 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef04f0f0-451b-4254-86bc-2cd6b4ce6016-kube-api-access-vfp2x podName:ef04f0f0-451b-4254-86bc-2cd6b4ce6016 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:31.490568892 +0000 UTC m=+5.135879335 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vfp2x" (UniqueName: "kubernetes.io/projected/ef04f0f0-451b-4254-86bc-2cd6b4ce6016-kube-api-access-vfp2x") pod "network-check-target-n9xhq" (UID: "ef04f0f0-451b-4254-86bc-2cd6b4ce6016") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:29.732170 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:29.732048 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 13:13:27 +0000 UTC" deadline="2028-01-14 19:43:00.459330686 +0000 UTC" Jul 05 13:18:29.732170 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:29.732112 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13398h24m30.727222626s" Jul 05 13:18:29.812426 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:29.812397 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:29.812587 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:29.812529 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xms2g" podUID="4ce057ad-491a-4f76-b9df-0a4da94dd152" Jul 05 13:18:29.812979 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:29.812959 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:29.813124 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:29.813067 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsfvp" podUID="d06fcb3d-95c9-4837-8b5f-f8455c806cf3" Jul 05 13:18:30.418715 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:30.418507 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 13:18:30.813201 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:30.813130 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:18:30.813751 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:30.813267 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xhq" podUID="ef04f0f0-451b-4254-86bc-2cd6b4ce6016" Jul 05 13:18:31.408191 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:31.407335 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ce057ad-491a-4f76-b9df-0a4da94dd152-original-pull-secret\") pod \"global-pull-secret-syncer-xms2g\" (UID: \"4ce057ad-491a-4f76-b9df-0a4da94dd152\") " pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:31.408191 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:31.407436 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs\") pod \"network-metrics-daemon-fsfvp\" (UID: \"d06fcb3d-95c9-4837-8b5f-f8455c806cf3\") " pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:31.408191 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:31.407586 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:31.408191 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:31.407652 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs podName:d06fcb3d-95c9-4837-8b5f-f8455c806cf3 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:35.407630135 +0000 UTC m=+9.052940600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs") pod "network-metrics-daemon-fsfvp" (UID: "d06fcb3d-95c9-4837-8b5f-f8455c806cf3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:31.408191 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:31.408054 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:31.408191 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:31.408104 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ce057ad-491a-4f76-b9df-0a4da94dd152-original-pull-secret podName:4ce057ad-491a-4f76-b9df-0a4da94dd152 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:35.408089476 +0000 UTC m=+9.053399919 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ce057ad-491a-4f76-b9df-0a4da94dd152-original-pull-secret") pod "global-pull-secret-syncer-xms2g" (UID: "4ce057ad-491a-4f76-b9df-0a4da94dd152") : object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:31.508589 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:31.508545 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfp2x\" (UniqueName: \"kubernetes.io/projected/ef04f0f0-451b-4254-86bc-2cd6b4ce6016-kube-api-access-vfp2x\") pod \"network-check-target-n9xhq\" (UID: \"ef04f0f0-451b-4254-86bc-2cd6b4ce6016\") " pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:18:31.508761 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:31.508710 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 13:18:31.508761 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:31.508736 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 13:18:31.508761 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:31.508750 2565 projected.go:196] Error preparing data for projected volume kube-api-access-vfp2x for pod openshift-network-diagnostics/network-check-target-n9xhq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:31.509095 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:31.508829 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef04f0f0-451b-4254-86bc-2cd6b4ce6016-kube-api-access-vfp2x podName:ef04f0f0-451b-4254-86bc-2cd6b4ce6016 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:35.508794008 +0000 UTC m=+9.154104465 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vfp2x" (UniqueName: "kubernetes.io/projected/ef04f0f0-451b-4254-86bc-2cd6b4ce6016-kube-api-access-vfp2x") pod "network-check-target-n9xhq" (UID: "ef04f0f0-451b-4254-86bc-2cd6b4ce6016") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:31.813068 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:31.812984 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:31.813225 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:31.813126 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsfvp" podUID="d06fcb3d-95c9-4837-8b5f-f8455c806cf3" Jul 05 13:18:31.813608 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:31.813486 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:31.813608 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:31.813579 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xms2g" podUID="4ce057ad-491a-4f76-b9df-0a4da94dd152" Jul 05 13:18:32.813095 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:32.813063 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:18:32.813281 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:32.813234 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xhq" podUID="ef04f0f0-451b-4254-86bc-2cd6b4ce6016" Jul 05 13:18:33.813215 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:33.812695 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:33.813215 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:33.812840 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xms2g" podUID="4ce057ad-491a-4f76-b9df-0a4da94dd152" Jul 05 13:18:33.813215 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:33.812953 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:33.813215 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:33.813133 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsfvp" podUID="d06fcb3d-95c9-4837-8b5f-f8455c806cf3" Jul 05 13:18:34.813311 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:34.812835 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:18:34.813311 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:34.812939 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xhq" podUID="ef04f0f0-451b-4254-86bc-2cd6b4ce6016" Jul 05 13:18:35.444858 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:35.444734 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs\") pod \"network-metrics-daemon-fsfvp\" (UID: \"d06fcb3d-95c9-4837-8b5f-f8455c806cf3\") " pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:35.444858 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:35.444824 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ce057ad-491a-4f76-b9df-0a4da94dd152-original-pull-secret\") pod \"global-pull-secret-syncer-xms2g\" (UID: \"4ce057ad-491a-4f76-b9df-0a4da94dd152\") " pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:35.445116 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:35.444924 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:35.445116 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:35.444944 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:35.445116 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:35.444999 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs podName:d06fcb3d-95c9-4837-8b5f-f8455c806cf3 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:43.444977281 +0000 UTC m=+17.090287747 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs") pod "network-metrics-daemon-fsfvp" (UID: "d06fcb3d-95c9-4837-8b5f-f8455c806cf3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:35.445116 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:35.445020 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ce057ad-491a-4f76-b9df-0a4da94dd152-original-pull-secret podName:4ce057ad-491a-4f76-b9df-0a4da94dd152 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:43.445010173 +0000 UTC m=+17.090320618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ce057ad-491a-4f76-b9df-0a4da94dd152-original-pull-secret") pod "global-pull-secret-syncer-xms2g" (UID: "4ce057ad-491a-4f76-b9df-0a4da94dd152") : object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:35.545718 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:35.545677 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfp2x\" (UniqueName: \"kubernetes.io/projected/ef04f0f0-451b-4254-86bc-2cd6b4ce6016-kube-api-access-vfp2x\") pod \"network-check-target-n9xhq\" (UID: \"ef04f0f0-451b-4254-86bc-2cd6b4ce6016\") " pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:18:35.545900 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:35.545880 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 13:18:35.545985 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:35.545908 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 13:18:35.545985 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:35.545921 2565 projected.go:196] Error preparing data for projected volume kube-api-access-vfp2x for pod openshift-network-diagnostics/network-check-target-n9xhq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:35.545985 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:35.545978 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef04f0f0-451b-4254-86bc-2cd6b4ce6016-kube-api-access-vfp2x podName:ef04f0f0-451b-4254-86bc-2cd6b4ce6016 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:43.545961031 +0000 UTC m=+17.191271472 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vfp2x" (UniqueName: "kubernetes.io/projected/ef04f0f0-451b-4254-86bc-2cd6b4ce6016-kube-api-access-vfp2x") pod "network-check-target-n9xhq" (UID: "ef04f0f0-451b-4254-86bc-2cd6b4ce6016") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:35.812620 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:35.812509 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:35.812774 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:35.812509 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:35.812774 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:35.812652 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsfvp" podUID="d06fcb3d-95c9-4837-8b5f-f8455c806cf3" Jul 05 13:18:35.812774 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:35.812733 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xms2g" podUID="4ce057ad-491a-4f76-b9df-0a4da94dd152" Jul 05 13:18:36.813935 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:36.813897 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:18:36.814366 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:36.814013 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xhq" podUID="ef04f0f0-451b-4254-86bc-2cd6b4ce6016" Jul 05 13:18:37.812459 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:37.812430 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:37.812617 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:37.812435 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:37.813077 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:37.812722 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsfvp" podUID="d06fcb3d-95c9-4837-8b5f-f8455c806cf3" Jul 05 13:18:37.813196 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:37.813070 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xms2g" podUID="4ce057ad-491a-4f76-b9df-0a4da94dd152" Jul 05 13:18:38.813150 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:38.813111 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:18:38.813590 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:38.813209 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xhq" podUID="ef04f0f0-451b-4254-86bc-2cd6b4ce6016" Jul 05 13:18:39.812698 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:39.812671 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:39.812698 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:39.812684 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:39.812942 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:39.812791 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xms2g" podUID="4ce057ad-491a-4f76-b9df-0a4da94dd152" Jul 05 13:18:39.812942 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:39.812921 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsfvp" podUID="d06fcb3d-95c9-4837-8b5f-f8455c806cf3" Jul 05 13:18:40.812099 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:40.812070 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:18:40.812479 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:40.812165 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xhq" podUID="ef04f0f0-451b-4254-86bc-2cd6b4ce6016" Jul 05 13:18:41.813089 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:41.813051 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:41.813089 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:41.813091 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:41.813574 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:41.813186 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsfvp" podUID="d06fcb3d-95c9-4837-8b5f-f8455c806cf3" Jul 05 13:18:41.813574 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:41.813308 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xms2g" podUID="4ce057ad-491a-4f76-b9df-0a4da94dd152" Jul 05 13:18:42.812969 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:42.812935 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:18:42.813133 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:42.813066 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xhq" podUID="ef04f0f0-451b-4254-86bc-2cd6b4ce6016" Jul 05 13:18:43.504549 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:43.504469 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs\") pod \"network-metrics-daemon-fsfvp\" (UID: \"d06fcb3d-95c9-4837-8b5f-f8455c806cf3\") " pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:43.504549 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:43.504523 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ce057ad-491a-4f76-b9df-0a4da94dd152-original-pull-secret\") pod \"global-pull-secret-syncer-xms2g\" (UID: \"4ce057ad-491a-4f76-b9df-0a4da94dd152\") " pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:43.504766 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:43.504642 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:43.504766 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:43.504658 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:43.504766 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:43.504710 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs podName:d06fcb3d-95c9-4837-8b5f-f8455c806cf3 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:59.504695025 +0000 UTC m=+33.150005485 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs") pod "network-metrics-daemon-fsfvp" (UID: "d06fcb3d-95c9-4837-8b5f-f8455c806cf3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:43.504766 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:43.504727 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ce057ad-491a-4f76-b9df-0a4da94dd152-original-pull-secret podName:4ce057ad-491a-4f76-b9df-0a4da94dd152 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:59.504720631 +0000 UTC m=+33.150031072 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ce057ad-491a-4f76-b9df-0a4da94dd152-original-pull-secret") pod "global-pull-secret-syncer-xms2g" (UID: "4ce057ad-491a-4f76-b9df-0a4da94dd152") : object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:43.605923 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:43.605892 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfp2x\" (UniqueName: \"kubernetes.io/projected/ef04f0f0-451b-4254-86bc-2cd6b4ce6016-kube-api-access-vfp2x\") pod \"network-check-target-n9xhq\" (UID: \"ef04f0f0-451b-4254-86bc-2cd6b4ce6016\") " pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:18:43.606086 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:43.606035 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 13:18:43.606086 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:43.606055 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 13:18:43.606086 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:43.606067 2565 projected.go:196] Error preparing data for projected volume kube-api-access-vfp2x for pod openshift-network-diagnostics/network-check-target-n9xhq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:43.606233 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:43.606123 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef04f0f0-451b-4254-86bc-2cd6b4ce6016-kube-api-access-vfp2x podName:ef04f0f0-451b-4254-86bc-2cd6b4ce6016 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:59.60611078 +0000 UTC m=+33.251421233 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vfp2x" (UniqueName: "kubernetes.io/projected/ef04f0f0-451b-4254-86bc-2cd6b4ce6016-kube-api-access-vfp2x") pod "network-check-target-n9xhq" (UID: "ef04f0f0-451b-4254-86bc-2cd6b4ce6016") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:43.812575 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:43.812501 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:43.812575 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:43.812541 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:43.812763 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:43.812641 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xms2g" podUID="4ce057ad-491a-4f76-b9df-0a4da94dd152" Jul 05 13:18:43.812763 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:43.812751 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsfvp" podUID="d06fcb3d-95c9-4837-8b5f-f8455c806cf3" Jul 05 13:18:44.813006 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:44.812902 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:18:44.813466 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:44.813024 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xhq" podUID="ef04f0f0-451b-4254-86bc-2cd6b4ce6016" Jul 05 13:18:45.812899 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:45.812872 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:45.813068 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:45.812879 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:45.813068 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:45.812969 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xms2g" podUID="4ce057ad-491a-4f76-b9df-0a4da94dd152" Jul 05 13:18:45.813471 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:45.813092 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsfvp" podUID="d06fcb3d-95c9-4837-8b5f-f8455c806cf3" Jul 05 13:18:46.813766 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:46.813730 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:18:46.814203 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:46.813856 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xhq" podUID="ef04f0f0-451b-4254-86bc-2cd6b4ce6016" Jul 05 13:18:47.812579 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:47.812403 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:47.812752 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:47.812678 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xms2g" podUID="4ce057ad-491a-4f76-b9df-0a4da94dd152" Jul 05 13:18:47.813040 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:47.812413 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:47.813040 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:47.812958 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsfvp" podUID="d06fcb3d-95c9-4837-8b5f-f8455c806cf3" Jul 05 13:18:48.015603 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:48.015437 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" event={"ID":"afa1ab82-2769-4e52-b460-539ebe048f8a","Type":"ContainerStarted","Data":"3b51942ed047e182e015559baa56360a9ab248e60c4f18990313dd5d4facc383"} Jul 05 13:18:48.018217 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:48.018108 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vjtd2" event={"ID":"15bf4c96-57a0-4f71-af70-f0fbe98e4495","Type":"ContainerStarted","Data":"fd98dedc349f6f86e03cdb768ed5db32eb85e95230ac38df5aa129a0f15b5e14"} Jul 05 13:18:48.024138 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:48.024115 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lv52r" event={"ID":"206d63d1-e37a-4d07-88fb-2f2aa710aa8d","Type":"ContainerStarted","Data":"d031b4cf2f82fa20d82bcdb54584e94d5ab529a4c30a761b71a2ba63e659cd67"} Jul 05 13:18:48.026269 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:48.026239 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal" event={"ID":"e5efd728fef4d484917909757bf24398","Type":"ContainerStarted","Data":"0f5278b31c804f2a1f7fde32b2cd6d961e3b0e8993c5af8d2fc884d35b193a98"} Jul 05 13:18:48.036802 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:48.036762 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vjtd2" podStartSLOduration=2.2529118759999998 podStartE2EDuration="22.036749704s" totalImagesPullingTime="19.783837828s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:48.036264015 +0000 UTC m=+21.681574497" watchObservedRunningTime="2026-07-05 13:18:48.036749704 +0000 UTC m=+21.682060166" Jul 05 13:18:48.077003 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:48.076944 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal" podStartSLOduration=21.076923923 podStartE2EDuration="21.076923923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:48.053317563 +0000 UTC m=+21.698628026" watchObservedRunningTime="2026-07-05 13:18:48.076923923 +0000 UTC m=+21.722234432" Jul 05 13:18:48.077153 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:48.077042 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lv52r" podStartSLOduration=2.486898298 podStartE2EDuration="22.077033917s" totalImagesPullingTime="19.590135619s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:48.076242813 +0000 UTC m=+21.721553276" watchObservedRunningTime="2026-07-05 13:18:48.077033917 +0000 UTC m=+21.722344381" Jul 05 13:18:48.812434 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:48.812407 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:18:48.812586 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:48.812508 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xhq" podUID="ef04f0f0-451b-4254-86bc-2cd6b4ce6016" Jul 05 13:18:49.031379 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:49.031291 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" event={"ID":"afa1ab82-2769-4e52-b460-539ebe048f8a","Type":"ContainerStarted","Data":"3d62a5cbf9beea849b761ff4b0c59d4593074451751ba1c8b7afe24ac27663fe"} Jul 05 13:18:49.032060 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:49.031386 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" event={"ID":"afa1ab82-2769-4e52-b460-539ebe048f8a","Type":"ContainerStarted","Data":"0cdb0cbe0916dfebff0e581eb2f9d8103402c74a41e899bf3d43eaf30a0be4dd"} Jul 05 13:18:49.032060 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:49.031433 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" event={"ID":"afa1ab82-2769-4e52-b460-539ebe048f8a","Type":"ContainerStarted","Data":"be209ae386f3fc2331e1775de6a63675a307ecbcafe4884a7bc2c7fb43da818c"} Jul 05 13:18:49.032060 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:49.031473 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" event={"ID":"afa1ab82-2769-4e52-b460-539ebe048f8a","Type":"ContainerStarted","Data":"14ecab88fb8a3efc04d74e9d30daa85cbd7743668b5ca5dcfa142099b0258b43"} Jul 05 13:18:49.032060 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:49.031511 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" event={"ID":"afa1ab82-2769-4e52-b460-539ebe048f8a","Type":"ContainerStarted","Data":"43cecbc10a6fc4e867483c6a21a0e3c8614fc531192d093817fb675b892b7cf6"} Jul 05 13:18:49.032738 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:49.032714 2565 generic.go:356] "Generic (PLEG): container finished" podID="fc48db1b-17f3-442b-b816-20457c2f17ca" containerID="a3432b5a67b2294b61623211d5f70449178d555ba5c6dc3c40d5005c149b1d59" exitCode=0 Jul 05 13:18:49.032843 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:49.032819 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-92dw2" event={"ID":"fc48db1b-17f3-442b-b816-20457c2f17ca","Type":"ContainerDied","Data":"a3432b5a67b2294b61623211d5f70449178d555ba5c6dc3c40d5005c149b1d59"} Jul 05 13:18:49.034187 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:49.034169 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fd7rj" event={"ID":"1044be9c-adcd-4685-845f-4ab24fe04c00","Type":"ContainerStarted","Data":"0d0b0ad3a4b4d71deb12445bb9fd0705343ed1f14b7fd8bf8d7be26c113542f9"} Jul 05 13:18:49.035676 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:49.035570 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tss2s" event={"ID":"eb3e727d-7877-482d-bd5f-a2cbcbd9dae4","Type":"ContainerStarted","Data":"341e2bf7ad3c2b0e5cdc73b7f8dabd04dbf2493ed9afcaaa65bfdac0c1db2873"} Jul 05 13:18:49.040593 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:49.040570 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" event={"ID":"9ff80b38-49a5-468f-8088-b6021a50b374","Type":"ContainerStarted","Data":"02c8507f822efb2f1e642617cdd38f4c0575412bc9631b358f4141aaa73a4c8d"} Jul 05 13:18:49.041852 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:49.041831 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d7sjf" event={"ID":"63bc4840-4a3a-4d25-84c8-97c63b44aca3","Type":"ContainerStarted","Data":"e031b644371a2f1e6d55c861a68236fd141f6cddb1ff7dc7b29960aad982c7c0"} Jul 05 13:18:49.043231 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:49.043212 2565 generic.go:356] "Generic (PLEG): container finished" podID="99c4126045d45ecfe73709fe851a3e37" containerID="eff71a1f010fb5a4a00cb7f6ce1a46a6210c265599252e33b6fd7413af44ef55" exitCode=0 Jul 05 13:18:49.043340 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:49.043317 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" event={"ID":"99c4126045d45ecfe73709fe851a3e37","Type":"ContainerDied","Data":"eff71a1f010fb5a4a00cb7f6ce1a46a6210c265599252e33b6fd7413af44ef55"} Jul 05 13:18:49.071857 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:49.071825 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tss2s" podStartSLOduration=3.514282132 podStartE2EDuration="23.071794428s" totalImagesPullingTime="19.557512296s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:49.071789742 +0000 UTC m=+22.717100206" watchObservedRunningTime="2026-07-05 13:18:49.071794428 +0000 UTC m=+22.717104869" Jul 05 13:18:49.104370 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:49.104131 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fd7rj" podStartSLOduration=3.423053708 podStartE2EDuration="23.104116486s" totalImagesPullingTime="19.681062778s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:49.103494816 +0000 UTC m=+22.748805279" watchObservedRunningTime="2026-07-05 13:18:49.104116486 +0000 UTC m=+22.749426948" Jul 05 13:18:49.119985 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:49.119939 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-d7sjf" podStartSLOduration=3.610188345 podStartE2EDuration="23.119919662s" totalImagesPullingTime="19.509731317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:18:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:49.119280166 +0000 UTC m=+22.764590630" watchObservedRunningTime="2026-07-05 13:18:49.119919662 +0000 UTC m=+22.765230123" Jul 05 13:18:49.812498 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:49.812474 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:49.812606 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:49.812588 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xms2g" podUID="4ce057ad-491a-4f76-b9df-0a4da94dd152" Jul 05 13:18:49.812722 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:49.812653 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:49.812854 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:49.812793 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsfvp" podUID="d06fcb3d-95c9-4837-8b5f-f8455c806cf3" Jul 05 13:18:49.928602 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:49.928579 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 05 13:18:50.047622 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:50.047542 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" event={"ID":"9ff80b38-49a5-468f-8088-b6021a50b374","Type":"ContainerStarted","Data":"2fb243f87f9abca44b40901095f177f88d7a18eef96ddaa29f3a1e4ec241f125"} Jul 05 13:18:50.049220 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:50.049185 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f9fdd" event={"ID":"c1cda0e8-44a0-41b6-82ad-9e67877d9235","Type":"ContainerStarted","Data":"cf5ccffc1c00e8015715e63e476a8f84fedde59651fd658cef566cb760c5c3b6"} Jul 05 13:18:50.051126 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:50.051095 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" event={"ID":"99c4126045d45ecfe73709fe851a3e37","Type":"ContainerStarted","Data":"cc657b769f223a70543645fe5f3968f9d907f101a7272071d203b581d7dceb64"} Jul 05 13:18:50.111541 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:50.111494 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" podStartSLOduration=23.111478369 podStartE2EDuration="23.111478369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:50.111368396 +0000 UTC m=+23.756678841" watchObservedRunningTime="2026-07-05 13:18:50.111478369 +0000 UTC m=+23.756788832" Jul 05 13:18:50.111737 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:50.111703 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-f9fdd" podStartSLOduration=4.5141899389999995 podStartE2EDuration="24.111690721s" totalImagesPullingTime="19.597500782s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:50.088208992 +0000 UTC m=+23.733519455" watchObservedRunningTime="2026-07-05 13:18:50.111690721 +0000 UTC m=+23.757001211" Jul 05 13:18:50.682941 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:50.682907 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-d7sjf" Jul 05 13:18:50.683501 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:50.683478 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-d7sjf" Jul 05 13:18:50.744287 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:50.744067 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-05T13:18:49.928597699Z","UUID":"5af914a4-6bf3-4b76-b7ca-bc1e2cf33dc9","Handler":null,"Name":"","Endpoint":""} Jul 05 13:18:50.745925 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:50.745905 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 05 13:18:50.746060 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:50.745943 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 05 13:18:50.812517 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:50.812446 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:18:50.812674 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:50.812594 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xhq" podUID="ef04f0f0-451b-4254-86bc-2cd6b4ce6016" Jul 05 13:18:51.058021 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:51.057953 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" event={"ID":"afa1ab82-2769-4e52-b460-539ebe048f8a","Type":"ContainerStarted","Data":"de96f9f59c6739fbe46729fac9a7301d1a6a433b04234160f5d7fbf047113420"} Jul 05 13:18:51.812800 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:51.812774 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:51.812988 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:51.812774 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:51.812988 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:51.812879 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xms2g" podUID="4ce057ad-491a-4f76-b9df-0a4da94dd152" Jul 05 13:18:51.812988 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:51.812974 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsfvp" podUID="d06fcb3d-95c9-4837-8b5f-f8455c806cf3" Jul 05 13:18:52.062134 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:52.062093 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" event={"ID":"9ff80b38-49a5-468f-8088-b6021a50b374","Type":"ContainerStarted","Data":"ab7f681226a3529deeb51532f988e0f7d2e208e9a697f80233f6633a15c4bebb"} Jul 05 13:18:52.062639 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:52.062111 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 05 13:18:52.084124 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:52.084029 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7mxzg" podStartSLOduration=4.173296285 podStartE2EDuration="26.084011715s" totalImagesPullingTime="21.91071543s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:52.083863734 +0000 UTC m=+25.729174216" watchObservedRunningTime="2026-07-05 13:18:52.084011715 +0000 UTC m=+25.729322176" Jul 05 13:18:52.263779 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:52.263746 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-d7sjf" Jul 05 13:18:52.264381 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:52.264356 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-d7sjf" Jul 05 13:18:52.812378 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:52.812346 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:18:52.812537 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:52.812467 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xhq" podUID="ef04f0f0-451b-4254-86bc-2cd6b4ce6016" Jul 05 13:18:53.812347 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:53.812188 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:53.812711 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:53.812245 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:53.812711 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:53.812440 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xms2g" podUID="4ce057ad-491a-4f76-b9df-0a4da94dd152" Jul 05 13:18:53.812711 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:53.812501 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsfvp" podUID="d06fcb3d-95c9-4837-8b5f-f8455c806cf3" Jul 05 13:18:54.069485 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:54.069405 2565 generic.go:356] "Generic (PLEG): container finished" podID="fc48db1b-17f3-442b-b816-20457c2f17ca" containerID="845cadaf95be869f170ed4e13a1582548ba8a7544fe6081e50b75decd4d907c4" exitCode=0 Jul 05 13:18:54.069640 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:54.069499 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-92dw2" event={"ID":"fc48db1b-17f3-442b-b816-20457c2f17ca","Type":"ContainerDied","Data":"845cadaf95be869f170ed4e13a1582548ba8a7544fe6081e50b75decd4d907c4"} Jul 05 13:18:54.073116 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:54.073088 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" event={"ID":"afa1ab82-2769-4e52-b460-539ebe048f8a","Type":"ContainerStarted","Data":"38f467ef57c15b1bf91a18eededf3782b7aa5936c61abf9aa7c7dac06e8535dc"} Jul 05 13:18:54.073381 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:54.073365 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:54.088115 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:54.088087 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:54.122951 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:54.122910 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" podStartSLOduration=8.514489738 podStartE2EDuration="28.122896352s" totalImagesPullingTime="19.608406614s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:18:54.122321565 +0000 UTC m=+27.767632028" watchObservedRunningTime="2026-07-05 13:18:54.122896352 +0000 UTC m=+27.768206815" Jul 05 13:18:54.642891 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:54.642864 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:54.815395 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:54.815368 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:18:54.816007 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:54.815461 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xhq" podUID="ef04f0f0-451b-4254-86bc-2cd6b4ce6016" Jul 05 13:18:55.075986 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:55.075904 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:55.090035 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:55.089995 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:18:55.576738 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:55.576580 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n9xhq"] Jul 05 13:18:55.576901 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:55.576802 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:18:55.576946 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:55.576896 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xhq" podUID="ef04f0f0-451b-4254-86bc-2cd6b4ce6016" Jul 05 13:18:55.580046 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:55.579949 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xms2g"] Jul 05 13:18:55.580163 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:55.580039 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:55.580163 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:55.580120 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xms2g" podUID="4ce057ad-491a-4f76-b9df-0a4da94dd152" Jul 05 13:18:55.580625 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:55.580608 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fsfvp"] Jul 05 13:18:55.580702 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:55.580690 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:55.580835 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:55.580791 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsfvp" podUID="d06fcb3d-95c9-4837-8b5f-f8455c806cf3" Jul 05 13:18:56.079472 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:56.079388 2565 generic.go:356] "Generic (PLEG): container finished" podID="fc48db1b-17f3-442b-b816-20457c2f17ca" containerID="91469e85f933298f551eb19965276e52a6bdfbe95e9e972c8ec52ca20f3d8488" exitCode=0 Jul 05 13:18:56.079922 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:56.079486 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-92dw2" event={"ID":"fc48db1b-17f3-442b-b816-20457c2f17ca","Type":"ContainerDied","Data":"91469e85f933298f551eb19965276e52a6bdfbe95e9e972c8ec52ca20f3d8488"} Jul 05 13:18:56.813802 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:56.813775 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:56.813958 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:56.813875 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xms2g" podUID="4ce057ad-491a-4f76-b9df-0a4da94dd152" Jul 05 13:18:57.812572 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:57.812540 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:57.812950 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:57.812642 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsfvp" podUID="d06fcb3d-95c9-4837-8b5f-f8455c806cf3" Jul 05 13:18:57.812950 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:57.812669 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:18:57.812950 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:57.812716 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xhq" podUID="ef04f0f0-451b-4254-86bc-2cd6b4ce6016" Jul 05 13:18:58.085745 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:58.085711 2565 generic.go:356] "Generic (PLEG): container finished" podID="fc48db1b-17f3-442b-b816-20457c2f17ca" containerID="5300ff32b5ad423769d26be18cf43844f25fe8283210b063c95bd0800c661848" exitCode=0 Jul 05 13:18:58.085901 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:58.085759 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-92dw2" event={"ID":"fc48db1b-17f3-442b-b816-20457c2f17ca","Type":"ContainerDied","Data":"5300ff32b5ad423769d26be18cf43844f25fe8283210b063c95bd0800c661848"} Jul 05 13:18:58.813089 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:58.813054 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:58.813506 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:58.813177 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xms2g" podUID="4ce057ad-491a-4f76-b9df-0a4da94dd152" Jul 05 13:18:59.524567 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:59.524531 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ce057ad-491a-4f76-b9df-0a4da94dd152-original-pull-secret\") pod \"global-pull-secret-syncer-xms2g\" (UID: \"4ce057ad-491a-4f76-b9df-0a4da94dd152\") " pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:18:59.524757 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:59.524607 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs\") pod \"network-metrics-daemon-fsfvp\" (UID: \"d06fcb3d-95c9-4837-8b5f-f8455c806cf3\") " pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:59.524757 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:59.524710 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:59.524757 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:59.524713 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:59.524895 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:59.524762 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs podName:d06fcb3d-95c9-4837-8b5f-f8455c806cf3 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:31.524747171 +0000 UTC m=+65.170057632 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs") pod "network-metrics-daemon-fsfvp" (UID: "d06fcb3d-95c9-4837-8b5f-f8455c806cf3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:59.524895 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:59.524778 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ce057ad-491a-4f76-b9df-0a4da94dd152-original-pull-secret podName:4ce057ad-491a-4f76-b9df-0a4da94dd152 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:31.524770481 +0000 UTC m=+65.170080925 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ce057ad-491a-4f76-b9df-0a4da94dd152-original-pull-secret") pod "global-pull-secret-syncer-xms2g" (UID: "4ce057ad-491a-4f76-b9df-0a4da94dd152") : object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:59.625819 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:59.625775 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfp2x\" (UniqueName: \"kubernetes.io/projected/ef04f0f0-451b-4254-86bc-2cd6b4ce6016-kube-api-access-vfp2x\") pod \"network-check-target-n9xhq\" (UID: \"ef04f0f0-451b-4254-86bc-2cd6b4ce6016\") " pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:18:59.625980 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:59.625927 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 13:18:59.625980 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:59.625944 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 13:18:59.625980 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:59.625954 2565 projected.go:196] Error preparing data for projected volume kube-api-access-vfp2x for pod openshift-network-diagnostics/network-check-target-n9xhq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:59.626118 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:59.626011 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef04f0f0-451b-4254-86bc-2cd6b4ce6016-kube-api-access-vfp2x podName:ef04f0f0-451b-4254-86bc-2cd6b4ce6016 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:31.625993871 +0000 UTC m=+65.271304333 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vfp2x" (UniqueName: "kubernetes.io/projected/ef04f0f0-451b-4254-86bc-2cd6b4ce6016-kube-api-access-vfp2x") pod "network-check-target-n9xhq" (UID: "ef04f0f0-451b-4254-86bc-2cd6b4ce6016") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:59.812780 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:59.812703 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:18:59.812956 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:59.812835 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsfvp" podUID="d06fcb3d-95c9-4837-8b5f-f8455c806cf3" Jul 05 13:18:59.812956 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:18:59.812843 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:18:59.812956 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:18:59.812932 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9xhq" podUID="ef04f0f0-451b-4254-86bc-2cd6b4ce6016" Jul 05 13:19:00.732586 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:00.732559 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeReady" Jul 05 13:19:00.733058 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:00.732711 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 05 13:19:00.812373 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:00.812339 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:19:00.818201 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:00.818177 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 05 13:19:00.836143 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:00.836119 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-smvf9"] Jul 05 13:19:00.870641 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:00.870613 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bx4kp"] Jul 05 13:19:00.870793 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:00.870769 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-smvf9" Jul 05 13:19:00.873849 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:00.873823 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 05 13:19:00.881437 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:00.881357 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-27l8r\"" Jul 05 13:19:00.881566 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:00.881520 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 05 13:19:00.884651 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:00.884628 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-smvf9"] Jul 05 13:19:00.884748 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:00.884673 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bx4kp"] Jul 05 13:19:00.884817 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:00.884764 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bx4kp" Jul 05 13:19:00.892954 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:00.892932 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 05 13:19:00.893230 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:00.893210 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 05 13:19:00.893317 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:00.893214 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 05 13:19:00.893384 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:00.893365 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8s2tf\"" Jul 05 13:19:01.038036 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:01.037951 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfk5d\" (UniqueName: \"kubernetes.io/projected/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-kube-api-access-cfk5d\") pod \"dns-default-smvf9\" (UID: \"e0ec710f-20ca-463a-9cf3-bc60137f4f9f\") " pod="openshift-dns/dns-default-smvf9" Jul 05 13:19:01.038190 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:01.038056 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f3f69bc-f69d-4851-9857-ab68864da3de-cert\") pod \"ingress-canary-bx4kp\" (UID: \"5f3f69bc-f69d-4851-9857-ab68864da3de\") " pod="openshift-ingress-canary/ingress-canary-bx4kp" Jul 05 13:19:01.038190 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:01.038129 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-config-volume\") pod \"dns-default-smvf9\" (UID: \"e0ec710f-20ca-463a-9cf3-bc60137f4f9f\") " pod="openshift-dns/dns-default-smvf9" Jul 05 13:19:01.038190 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:01.038177 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfd5r\" (UniqueName: \"kubernetes.io/projected/5f3f69bc-f69d-4851-9857-ab68864da3de-kube-api-access-qfd5r\") pod \"ingress-canary-bx4kp\" (UID: \"5f3f69bc-f69d-4851-9857-ab68864da3de\") " pod="openshift-ingress-canary/ingress-canary-bx4kp" Jul 05 13:19:01.038328 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:01.038215 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-metrics-tls\") pod \"dns-default-smvf9\" (UID: \"e0ec710f-20ca-463a-9cf3-bc60137f4f9f\") " pod="openshift-dns/dns-default-smvf9" Jul 05 13:19:01.038328 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:01.038246 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-tmp-dir\") pod \"dns-default-smvf9\" (UID: \"e0ec710f-20ca-463a-9cf3-bc60137f4f9f\") " pod="openshift-dns/dns-default-smvf9" Jul 05 13:19:01.139341 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:01.139293 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-config-volume\") pod \"dns-default-smvf9\" (UID: \"e0ec710f-20ca-463a-9cf3-bc60137f4f9f\") " pod="openshift-dns/dns-default-smvf9" Jul 05 13:19:01.139529 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:01.139378 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfd5r\" (UniqueName: \"kubernetes.io/projected/5f3f69bc-f69d-4851-9857-ab68864da3de-kube-api-access-qfd5r\") pod \"ingress-canary-bx4kp\" (UID: \"5f3f69bc-f69d-4851-9857-ab68864da3de\") " pod="openshift-ingress-canary/ingress-canary-bx4kp" Jul 05 13:19:01.139529 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:01.139437 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-metrics-tls\") pod \"dns-default-smvf9\" (UID: \"e0ec710f-20ca-463a-9cf3-bc60137f4f9f\") " pod="openshift-dns/dns-default-smvf9" Jul 05 13:19:01.139529 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:01.139469 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-tmp-dir\") pod \"dns-default-smvf9\" (UID: \"e0ec710f-20ca-463a-9cf3-bc60137f4f9f\") " pod="openshift-dns/dns-default-smvf9" Jul 05 13:19:01.139529 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:01.139523 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfk5d\" (UniqueName: \"kubernetes.io/projected/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-kube-api-access-cfk5d\") pod \"dns-default-smvf9\" (UID: \"e0ec710f-20ca-463a-9cf3-bc60137f4f9f\") " pod="openshift-dns/dns-default-smvf9" Jul 05 13:19:01.139716 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:01.139579 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f3f69bc-f69d-4851-9857-ab68864da3de-cert\") pod \"ingress-canary-bx4kp\" (UID: \"5f3f69bc-f69d-4851-9857-ab68864da3de\") " pod="openshift-ingress-canary/ingress-canary-bx4kp" Jul 05 13:19:01.141588 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:01.140588 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-config-volume\") pod \"dns-default-smvf9\" (UID: \"e0ec710f-20ca-463a-9cf3-bc60137f4f9f\") " pod="openshift-dns/dns-default-smvf9" Jul 05 13:19:01.141588 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:01.140749 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 13:19:01.141588 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:01.141017 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-metrics-tls podName:e0ec710f-20ca-463a-9cf3-bc60137f4f9f nodeName:}" failed. No retries permitted until 2026-07-05 13:19:01.640987621 +0000 UTC m=+35.286298080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-metrics-tls") pod "dns-default-smvf9" (UID: "e0ec710f-20ca-463a-9cf3-bc60137f4f9f") : secret "dns-default-metrics-tls" not found Jul 05 13:19:01.141588 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:01.141330 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-tmp-dir\") pod \"dns-default-smvf9\" (UID: \"e0ec710f-20ca-463a-9cf3-bc60137f4f9f\") " pod="openshift-dns/dns-default-smvf9" Jul 05 13:19:01.145248 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:01.145224 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f3f69bc-f69d-4851-9857-ab68864da3de-cert\") pod \"ingress-canary-bx4kp\" (UID: \"5f3f69bc-f69d-4851-9857-ab68864da3de\") " pod="openshift-ingress-canary/ingress-canary-bx4kp" Jul 05 13:19:01.152591 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:01.152569 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfk5d\" (UniqueName: \"kubernetes.io/projected/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-kube-api-access-cfk5d\") pod \"dns-default-smvf9\" (UID: \"e0ec710f-20ca-463a-9cf3-bc60137f4f9f\") " pod="openshift-dns/dns-default-smvf9" Jul 05 13:19:01.152716 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:01.152684 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfd5r\" (UniqueName: \"kubernetes.io/projected/5f3f69bc-f69d-4851-9857-ab68864da3de-kube-api-access-qfd5r\") pod \"ingress-canary-bx4kp\" (UID: \"5f3f69bc-f69d-4851-9857-ab68864da3de\") " pod="openshift-ingress-canary/ingress-canary-bx4kp" Jul 05 13:19:01.194727 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:01.194694 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bx4kp" Jul 05 13:19:01.643612 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:01.643571 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-metrics-tls\") pod \"dns-default-smvf9\" (UID: \"e0ec710f-20ca-463a-9cf3-bc60137f4f9f\") " pod="openshift-dns/dns-default-smvf9" Jul 05 13:19:01.643784 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:01.643723 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 13:19:01.643864 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:01.643787 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-metrics-tls podName:e0ec710f-20ca-463a-9cf3-bc60137f4f9f nodeName:}" failed. No retries permitted until 2026-07-05 13:19:02.643771118 +0000 UTC m=+36.289081564 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-metrics-tls") pod "dns-default-smvf9" (UID: "e0ec710f-20ca-463a-9cf3-bc60137f4f9f") : secret "dns-default-metrics-tls" not found Jul 05 13:19:01.812349 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:01.812314 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:19:01.812349 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:01.812346 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:19:01.815047 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:01.815025 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 05 13:19:01.815753 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:01.815738 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 05 13:19:01.816043 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:01.816021 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f7gg6\"" Jul 05 13:19:01.816279 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:01.816262 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 05 13:19:01.816801 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:01.816784 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mvgxb\"" Jul 05 13:19:02.252582 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:02.252552 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bx4kp"] Jul 05 13:19:02.323013 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:19:02.322970 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f3f69bc_f69d_4851_9857_ab68864da3de.slice/crio-4c3b3c714ad846069e7316f7a0d6c06bd83a8fa661c66dfdfac9f7a50b899c5c WatchSource:0}: Error finding container 4c3b3c714ad846069e7316f7a0d6c06bd83a8fa661c66dfdfac9f7a50b899c5c: Status 404 returned error can't find the container with id 4c3b3c714ad846069e7316f7a0d6c06bd83a8fa661c66dfdfac9f7a50b899c5c Jul 05 13:19:02.651683 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:02.651652 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-metrics-tls\") pod \"dns-default-smvf9\" (UID: \"e0ec710f-20ca-463a-9cf3-bc60137f4f9f\") " pod="openshift-dns/dns-default-smvf9" Jul 05 13:19:02.651892 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:02.651840 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 13:19:02.651957 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:02.651919 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-metrics-tls podName:e0ec710f-20ca-463a-9cf3-bc60137f4f9f nodeName:}" failed. No retries permitted until 2026-07-05 13:19:04.651898051 +0000 UTC m=+38.297208514 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-metrics-tls") pod "dns-default-smvf9" (UID: "e0ec710f-20ca-463a-9cf3-bc60137f4f9f") : secret "dns-default-metrics-tls" not found Jul 05 13:19:03.099516 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:03.099427 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bx4kp" event={"ID":"5f3f69bc-f69d-4851-9857-ab68864da3de","Type":"ContainerStarted","Data":"4c3b3c714ad846069e7316f7a0d6c06bd83a8fa661c66dfdfac9f7a50b899c5c"} Jul 05 13:19:03.102686 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:03.102657 2565 generic.go:356] "Generic (PLEG): container finished" podID="fc48db1b-17f3-442b-b816-20457c2f17ca" containerID="38fa842278519fa58876b9fdc82c3fbd2131fe900730416f2d2e4ce887024749" exitCode=0 Jul 05 13:19:03.102796 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:03.102703 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-92dw2" event={"ID":"fc48db1b-17f3-442b-b816-20457c2f17ca","Type":"ContainerDied","Data":"38fa842278519fa58876b9fdc82c3fbd2131fe900730416f2d2e4ce887024749"} Jul 05 13:19:04.108548 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:04.108308 2565 generic.go:356] "Generic (PLEG): container finished" podID="fc48db1b-17f3-442b-b816-20457c2f17ca" containerID="46cb8ccd860be6052fa5e1a71ec27c4e10666b7e666f88c1bfec5354c038ba05" exitCode=0 Jul 05 13:19:04.108548 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:04.108375 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-92dw2" event={"ID":"fc48db1b-17f3-442b-b816-20457c2f17ca","Type":"ContainerDied","Data":"46cb8ccd860be6052fa5e1a71ec27c4e10666b7e666f88c1bfec5354c038ba05"} Jul 05 13:19:04.667109 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:04.667081 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-metrics-tls\") pod \"dns-default-smvf9\" (UID: \"e0ec710f-20ca-463a-9cf3-bc60137f4f9f\") " pod="openshift-dns/dns-default-smvf9" Jul 05 13:19:04.667228 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:04.667213 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 13:19:04.667290 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:04.667279 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-metrics-tls podName:e0ec710f-20ca-463a-9cf3-bc60137f4f9f nodeName:}" failed. No retries permitted until 2026-07-05 13:19:08.667258312 +0000 UTC m=+42.312568775 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-metrics-tls") pod "dns-default-smvf9" (UID: "e0ec710f-20ca-463a-9cf3-bc60137f4f9f") : secret "dns-default-metrics-tls" not found Jul 05 13:19:05.112727 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:05.112687 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bx4kp" event={"ID":"5f3f69bc-f69d-4851-9857-ab68864da3de","Type":"ContainerStarted","Data":"cfd6e53d2e3ec8da293d9712255c8fa79fb7616438fad60a947eaa9565e77c0c"} Jul 05 13:19:05.116160 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:05.116137 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-92dw2" event={"ID":"fc48db1b-17f3-442b-b816-20457c2f17ca","Type":"ContainerStarted","Data":"8a88f36c0add54cfbb84bb941a593e748890e5c53c277499a22d5032f5142991"} Jul 05 13:19:05.130890 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:05.130832 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bx4kp" podStartSLOduration=2.52207319 podStartE2EDuration="5.130796889s" totalImagesPullingTime="2.608723699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:05.129691089 +0000 UTC m=+38.775001553" watchObservedRunningTime="2026-07-05 13:19:05.130796889 +0000 UTC m=+38.776107347" Jul 05 13:19:05.153105 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:05.153055 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-92dw2" podStartSLOduration=8.456386215 podStartE2EDuration="39.153040319s" totalImagesPullingTime="30.696654104s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:05.152048822 +0000 UTC m=+38.797359287" watchObservedRunningTime="2026-07-05 13:19:05.153040319 +0000 UTC m=+38.798350783" Jul 05 13:19:08.696573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:08.696528 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-metrics-tls\") pod \"dns-default-smvf9\" (UID: \"e0ec710f-20ca-463a-9cf3-bc60137f4f9f\") " pod="openshift-dns/dns-default-smvf9" Jul 05 13:19:08.697002 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:08.696697 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 13:19:08.697002 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:08.696766 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-metrics-tls podName:e0ec710f-20ca-463a-9cf3-bc60137f4f9f nodeName:}" failed. No retries permitted until 2026-07-05 13:19:16.696749123 +0000 UTC m=+50.342059567 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-metrics-tls") pod "dns-default-smvf9" (UID: "e0ec710f-20ca-463a-9cf3-bc60137f4f9f") : secret "dns-default-metrics-tls" not found Jul 05 13:19:16.753768 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:16.753738 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-metrics-tls\") pod \"dns-default-smvf9\" (UID: \"e0ec710f-20ca-463a-9cf3-bc60137f4f9f\") " pod="openshift-dns/dns-default-smvf9" Jul 05 13:19:16.754249 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:16.753900 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 13:19:16.754249 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:16.753959 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-metrics-tls podName:e0ec710f-20ca-463a-9cf3-bc60137f4f9f nodeName:}" failed. No retries permitted until 2026-07-05 13:19:32.753943577 +0000 UTC m=+66.399254017 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-metrics-tls") pod "dns-default-smvf9" (UID: "e0ec710f-20ca-463a-9cf3-bc60137f4f9f") : secret "dns-default-metrics-tls" not found Jul 05 13:19:19.790344 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:19.790306 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-54c57459b5-lt6zp"] Jul 05 13:19:19.793045 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:19.793024 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:19.795740 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:19.795717 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 05 13:19:19.795871 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:19.795740 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 05 13:19:19.795871 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:19.795738 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 05 13:19:19.795871 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:19.795717 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 05 13:19:19.796468 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:19.796455 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 05 13:19:19.796468 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:19.796461 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fmhj5\"" Jul 05 13:19:19.796545 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:19.796460 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 05 13:19:19.816470 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:19.816447 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54c57459b5-lt6zp"] Jul 05 13:19:19.976528 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:19.976495 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf8df\" (UniqueName: \"kubernetes.io/projected/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-kube-api-access-mf8df\") pod \"router-default-54c57459b5-lt6zp\" (UID: \"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3\") " pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:19.976695 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:19.976549 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-default-certificate\") pod \"router-default-54c57459b5-lt6zp\" (UID: \"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3\") " pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:19.976695 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:19.976577 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-service-ca-bundle\") pod \"router-default-54c57459b5-lt6zp\" (UID: \"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3\") " pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:19.976695 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:19.976595 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-stats-auth\") pod \"router-default-54c57459b5-lt6zp\" (UID: \"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3\") " pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:19.976695 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:19.976616 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-metrics-certs\") pod \"router-default-54c57459b5-lt6zp\" (UID: \"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3\") " pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:20.046762 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.046673 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-74ktv"] Jul 05 13:19:20.049547 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.049530 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-74ktv" Jul 05 13:19:20.053050 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.053032 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 05 13:19:20.053159 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.053125 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 05 13:19:20.053319 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.053296 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 05 13:19:20.053374 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.053350 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 05 13:19:20.053419 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.053371 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-mt24s\"" Jul 05 13:19:20.069859 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.069829 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-74ktv"] Jul 05 13:19:20.077101 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.077079 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf8df\" (UniqueName: \"kubernetes.io/projected/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-kube-api-access-mf8df\") pod \"router-default-54c57459b5-lt6zp\" (UID: \"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3\") " pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:20.077213 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.077130 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-default-certificate\") pod \"router-default-54c57459b5-lt6zp\" (UID: \"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3\") " pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:20.077213 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.077152 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-service-ca-bundle\") pod \"router-default-54c57459b5-lt6zp\" (UID: \"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3\") " pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:20.077213 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.077175 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-stats-auth\") pod \"router-default-54c57459b5-lt6zp\" (UID: \"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3\") " pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:20.077213 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.077204 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-metrics-certs\") pod \"router-default-54c57459b5-lt6zp\" (UID: \"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3\") " pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:20.077414 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:20.077329 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 13:19:20.077414 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:20.077329 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-service-ca-bundle podName:6665a837-1cd2-41d9-86ef-7d3cfcba4dc3 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:20.577305499 +0000 UTC m=+54.222615957 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-service-ca-bundle") pod "router-default-54c57459b5-lt6zp" (UID: "6665a837-1cd2-41d9-86ef-7d3cfcba4dc3") : configmap references non-existent config key: service-ca.crt Jul 05 13:19:20.077414 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:20.077395 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-metrics-certs podName:6665a837-1cd2-41d9-86ef-7d3cfcba4dc3 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:20.577378403 +0000 UTC m=+54.222688852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-metrics-certs") pod "router-default-54c57459b5-lt6zp" (UID: "6665a837-1cd2-41d9-86ef-7d3cfcba4dc3") : secret "router-metrics-certs-default" not found Jul 05 13:19:20.080462 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.080441 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-stats-auth\") pod \"router-default-54c57459b5-lt6zp\" (UID: \"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3\") " pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:20.080558 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.080440 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-default-certificate\") pod \"router-default-54c57459b5-lt6zp\" (UID: \"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3\") " pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:20.089532 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.089505 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf8df\" (UniqueName: \"kubernetes.io/projected/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-kube-api-access-mf8df\") pod \"router-default-54c57459b5-lt6zp\" (UID: \"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3\") " pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:20.096694 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.096672 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cdk6v"] Jul 05 13:19:20.099446 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.099431 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cdk6v" Jul 05 13:19:20.103678 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.103646 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 05 13:19:20.103784 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.103690 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 05 13:19:20.103937 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.103924 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-blldr\"" Jul 05 13:19:20.119627 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.119593 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cdk6v"] Jul 05 13:19:20.178075 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.178036 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9qtm\" (UniqueName: \"kubernetes.io/projected/753a929c-de9b-4a2c-bbb4-7310e1fd0b2b-kube-api-access-l9qtm\") pod \"service-ca-operator-5d46d9ffd4-74ktv\" (UID: \"753a929c-de9b-4a2c-bbb4-7310e1fd0b2b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-74ktv" Jul 05 13:19:20.178237 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.178103 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/753a929c-de9b-4a2c-bbb4-7310e1fd0b2b-config\") pod \"service-ca-operator-5d46d9ffd4-74ktv\" (UID: \"753a929c-de9b-4a2c-bbb4-7310e1fd0b2b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-74ktv" Jul 05 13:19:20.178237 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.178165 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/753a929c-de9b-4a2c-bbb4-7310e1fd0b2b-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-74ktv\" (UID: \"753a929c-de9b-4a2c-bbb4-7310e1fd0b2b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-74ktv" Jul 05 13:19:20.279063 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.279029 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/753a929c-de9b-4a2c-bbb4-7310e1fd0b2b-config\") pod \"service-ca-operator-5d46d9ffd4-74ktv\" (UID: \"753a929c-de9b-4a2c-bbb4-7310e1fd0b2b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-74ktv" Jul 05 13:19:20.279234 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.279077 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/753a929c-de9b-4a2c-bbb4-7310e1fd0b2b-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-74ktv\" (UID: \"753a929c-de9b-4a2c-bbb4-7310e1fd0b2b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-74ktv" Jul 05 13:19:20.279234 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.279138 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9qtm\" (UniqueName: \"kubernetes.io/projected/753a929c-de9b-4a2c-bbb4-7310e1fd0b2b-kube-api-access-l9qtm\") pod \"service-ca-operator-5d46d9ffd4-74ktv\" (UID: \"753a929c-de9b-4a2c-bbb4-7310e1fd0b2b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-74ktv" Jul 05 13:19:20.279234 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.279159 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vplbm\" (UniqueName: \"kubernetes.io/projected/3dcf2538-156f-41ad-b79f-1e91f6b65902-kube-api-access-vplbm\") pod \"volume-data-source-validator-5d456fdbcd-cdk6v\" (UID: \"3dcf2538-156f-41ad-b79f-1e91f6b65902\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cdk6v" Jul 05 13:19:20.279718 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.279696 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/753a929c-de9b-4a2c-bbb4-7310e1fd0b2b-config\") pod \"service-ca-operator-5d46d9ffd4-74ktv\" (UID: \"753a929c-de9b-4a2c-bbb4-7310e1fd0b2b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-74ktv" Jul 05 13:19:20.281294 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.281276 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/753a929c-de9b-4a2c-bbb4-7310e1fd0b2b-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-74ktv\" (UID: \"753a929c-de9b-4a2c-bbb4-7310e1fd0b2b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-74ktv" Jul 05 13:19:20.294775 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.294752 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9qtm\" (UniqueName: \"kubernetes.io/projected/753a929c-de9b-4a2c-bbb4-7310e1fd0b2b-kube-api-access-l9qtm\") pod \"service-ca-operator-5d46d9ffd4-74ktv\" (UID: \"753a929c-de9b-4a2c-bbb4-7310e1fd0b2b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-74ktv" Jul 05 13:19:20.357911 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.357831 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-74ktv" Jul 05 13:19:20.380083 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.380049 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vplbm\" (UniqueName: \"kubernetes.io/projected/3dcf2538-156f-41ad-b79f-1e91f6b65902-kube-api-access-vplbm\") pod \"volume-data-source-validator-5d456fdbcd-cdk6v\" (UID: \"3dcf2538-156f-41ad-b79f-1e91f6b65902\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cdk6v" Jul 05 13:19:20.389537 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.389509 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vplbm\" (UniqueName: \"kubernetes.io/projected/3dcf2538-156f-41ad-b79f-1e91f6b65902-kube-api-access-vplbm\") pod \"volume-data-source-validator-5d456fdbcd-cdk6v\" (UID: \"3dcf2538-156f-41ad-b79f-1e91f6b65902\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cdk6v" Jul 05 13:19:20.408790 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.408548 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cdk6v" Jul 05 13:19:20.529173 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.529144 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-74ktv"] Jul 05 13:19:20.532024 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:19:20.532000 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod753a929c_de9b_4a2c_bbb4_7310e1fd0b2b.slice/crio-bed2ca825efb2822afba11fce15a117457182473d05cfbc8d713ca0029e85917 WatchSource:0}: Error finding container bed2ca825efb2822afba11fce15a117457182473d05cfbc8d713ca0029e85917: Status 404 returned error can't find the container with id bed2ca825efb2822afba11fce15a117457182473d05cfbc8d713ca0029e85917 Jul 05 13:19:20.557566 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.557537 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cdk6v"] Jul 05 13:19:20.561784 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:19:20.561752 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dcf2538_156f_41ad_b79f_1e91f6b65902.slice/crio-c4bc0f6b4065312e1b8d40a4714c705643442d9176306c16080876c737fd9123 WatchSource:0}: Error finding container c4bc0f6b4065312e1b8d40a4714c705643442d9176306c16080876c737fd9123: Status 404 returned error can't find the container with id c4bc0f6b4065312e1b8d40a4714c705643442d9176306c16080876c737fd9123 Jul 05 13:19:20.582327 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.582301 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-service-ca-bundle\") pod \"router-default-54c57459b5-lt6zp\" (UID: \"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3\") " pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:20.582434 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:20.582334 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-metrics-certs\") pod \"router-default-54c57459b5-lt6zp\" (UID: \"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3\") " pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:20.582480 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:20.582441 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 13:19:20.582522 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:20.582487 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-service-ca-bundle podName:6665a837-1cd2-41d9-86ef-7d3cfcba4dc3 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:21.582470348 +0000 UTC m=+55.227780807 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-service-ca-bundle") pod "router-default-54c57459b5-lt6zp" (UID: "6665a837-1cd2-41d9-86ef-7d3cfcba4dc3") : configmap references non-existent config key: service-ca.crt Jul 05 13:19:20.582522 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:20.582507 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-metrics-certs podName:6665a837-1cd2-41d9-86ef-7d3cfcba4dc3 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:21.582497178 +0000 UTC m=+55.227807619 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-metrics-certs") pod "router-default-54c57459b5-lt6zp" (UID: "6665a837-1cd2-41d9-86ef-7d3cfcba4dc3") : secret "router-metrics-certs-default" not found Jul 05 13:19:21.156228 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:21.156184 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cdk6v" event={"ID":"3dcf2538-156f-41ad-b79f-1e91f6b65902","Type":"ContainerStarted","Data":"c4bc0f6b4065312e1b8d40a4714c705643442d9176306c16080876c737fd9123"} Jul 05 13:19:21.157863 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:21.157832 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-74ktv" event={"ID":"753a929c-de9b-4a2c-bbb4-7310e1fd0b2b","Type":"ContainerStarted","Data":"bed2ca825efb2822afba11fce15a117457182473d05cfbc8d713ca0029e85917"} Jul 05 13:19:21.591340 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:21.591311 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-service-ca-bundle\") pod \"router-default-54c57459b5-lt6zp\" (UID: \"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3\") " pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:21.591458 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:21.591347 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-metrics-certs\") pod \"router-default-54c57459b5-lt6zp\" (UID: \"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3\") " pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:21.591520 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:21.591456 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 13:19:21.591520 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:21.591481 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-service-ca-bundle podName:6665a837-1cd2-41d9-86ef-7d3cfcba4dc3 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:23.591460545 +0000 UTC m=+57.236771007 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-service-ca-bundle") pod "router-default-54c57459b5-lt6zp" (UID: "6665a837-1cd2-41d9-86ef-7d3cfcba4dc3") : configmap references non-existent config key: service-ca.crt Jul 05 13:19:21.591520 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:21.591509 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-metrics-certs podName:6665a837-1cd2-41d9-86ef-7d3cfcba4dc3 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:23.591491569 +0000 UTC m=+57.236802010 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-metrics-certs") pod "router-default-54c57459b5-lt6zp" (UID: "6665a837-1cd2-41d9-86ef-7d3cfcba4dc3") : secret "router-metrics-certs-default" not found Jul 05 13:19:22.162786 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:22.162751 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cdk6v" event={"ID":"3dcf2538-156f-41ad-b79f-1e91f6b65902","Type":"ContainerStarted","Data":"85021bf84706a2cbd045909bdf0c52a59110c9390d140e513ee8c2ee78efa4d9"} Jul 05 13:19:23.166659 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:23.166628 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-74ktv" event={"ID":"753a929c-de9b-4a2c-bbb4-7310e1fd0b2b","Type":"ContainerStarted","Data":"ccbc6bd48e6f2c4423a3bd44d85e688562152e94bf7a7c3a29856dac5c4c9da0"} Jul 05 13:19:23.184395 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:23.184344 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cdk6v" podStartSLOduration=2.195346811 podStartE2EDuration="3.18432935s" totalImagesPullingTime="988.982539ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:22.186014832 +0000 UTC m=+55.831325319" watchObservedRunningTime="2026-07-05 13:19:23.18432935 +0000 UTC m=+56.829639813" Jul 05 13:19:23.184911 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:23.184878 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-74ktv" podStartSLOduration=1.439440885 podStartE2EDuration="3.184866466s" totalImagesPullingTime="1.745425581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:23.183755984 +0000 UTC m=+56.829066446" watchObservedRunningTime="2026-07-05 13:19:23.184866466 +0000 UTC m=+56.830176928" Jul 05 13:19:23.609403 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:23.609321 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-service-ca-bundle\") pod \"router-default-54c57459b5-lt6zp\" (UID: \"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3\") " pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:23.609403 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:23.609367 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-metrics-certs\") pod \"router-default-54c57459b5-lt6zp\" (UID: \"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3\") " pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:23.609581 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:23.609470 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 13:19:23.609581 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:23.609496 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-service-ca-bundle podName:6665a837-1cd2-41d9-86ef-7d3cfcba4dc3 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:27.609476442 +0000 UTC m=+61.254786904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-service-ca-bundle") pod "router-default-54c57459b5-lt6zp" (UID: "6665a837-1cd2-41d9-86ef-7d3cfcba4dc3") : configmap references non-existent config key: service-ca.crt Jul 05 13:19:23.609581 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:23.609517 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-metrics-certs podName:6665a837-1cd2-41d9-86ef-7d3cfcba4dc3 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:27.609509603 +0000 UTC m=+61.254820044 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-metrics-certs") pod "router-default-54c57459b5-lt6zp" (UID: "6665a837-1cd2-41d9-86ef-7d3cfcba4dc3") : secret "router-metrics-certs-default" not found Jul 05 13:19:23.960303 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:23.960270 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9shv4"] Jul 05 13:19:23.990076 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:23.990051 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9shv4"] Jul 05 13:19:23.990225 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:23.990154 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:23.995722 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:23.995696 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 05 13:19:23.997767 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:23.997747 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 05 13:19:23.997888 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:23.997771 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d74jb\"" Jul 05 13:19:23.997888 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:23.997773 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 05 13:19:24.012238 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:24.012217 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbmbx\" (UniqueName: \"kubernetes.io/projected/a87beecc-8c6a-466a-9fec-8fe341bd19db-kube-api-access-lbmbx\") pod \"insights-runtime-extractor-9shv4\" (UID: \"a87beecc-8c6a-466a-9fec-8fe341bd19db\") " pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:24.012325 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:24.012277 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a87beecc-8c6a-466a-9fec-8fe341bd19db-crio-socket\") pod \"insights-runtime-extractor-9shv4\" (UID: \"a87beecc-8c6a-466a-9fec-8fe341bd19db\") " pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:24.012325 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:24.012304 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a87beecc-8c6a-466a-9fec-8fe341bd19db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9shv4\" (UID: \"a87beecc-8c6a-466a-9fec-8fe341bd19db\") " pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:24.012410 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:24.012361 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a87beecc-8c6a-466a-9fec-8fe341bd19db-data-volume\") pod \"insights-runtime-extractor-9shv4\" (UID: \"a87beecc-8c6a-466a-9fec-8fe341bd19db\") " pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:24.012410 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:24.012401 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a87beecc-8c6a-466a-9fec-8fe341bd19db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9shv4\" (UID: \"a87beecc-8c6a-466a-9fec-8fe341bd19db\") " pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:24.018941 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:24.018927 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 05 13:19:24.112802 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:24.112776 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a87beecc-8c6a-466a-9fec-8fe341bd19db-crio-socket\") pod \"insights-runtime-extractor-9shv4\" (UID: \"a87beecc-8c6a-466a-9fec-8fe341bd19db\") " pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:24.112802 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:24.112824 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a87beecc-8c6a-466a-9fec-8fe341bd19db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9shv4\" (UID: \"a87beecc-8c6a-466a-9fec-8fe341bd19db\") " pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:24.113042 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:24.112874 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a87beecc-8c6a-466a-9fec-8fe341bd19db-data-volume\") pod \"insights-runtime-extractor-9shv4\" (UID: \"a87beecc-8c6a-466a-9fec-8fe341bd19db\") " pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:24.113042 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:24.112884 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a87beecc-8c6a-466a-9fec-8fe341bd19db-crio-socket\") pod \"insights-runtime-extractor-9shv4\" (UID: \"a87beecc-8c6a-466a-9fec-8fe341bd19db\") " pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:24.113042 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:24.112930 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a87beecc-8c6a-466a-9fec-8fe341bd19db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9shv4\" (UID: \"a87beecc-8c6a-466a-9fec-8fe341bd19db\") " pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:24.113042 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:24.112976 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 13:19:24.113042 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:24.112986 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbmbx\" (UniqueName: \"kubernetes.io/projected/a87beecc-8c6a-466a-9fec-8fe341bd19db-kube-api-access-lbmbx\") pod \"insights-runtime-extractor-9shv4\" (UID: \"a87beecc-8c6a-466a-9fec-8fe341bd19db\") " pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:24.113042 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:24.113033 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 13:19:24.113271 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:24.113037 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a87beecc-8c6a-466a-9fec-8fe341bd19db-insights-runtime-extractor-tls podName:a87beecc-8c6a-466a-9fec-8fe341bd19db nodeName:}" failed. No retries permitted until 2026-07-05 13:19:24.613022092 +0000 UTC m=+58.258332533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a87beecc-8c6a-466a-9fec-8fe341bd19db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9shv4" (UID: "a87beecc-8c6a-466a-9fec-8fe341bd19db") : secret "insights-runtime-extractor-tls" not found Jul 05 13:19:24.113271 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:24.113095 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a87beecc-8c6a-466a-9fec-8fe341bd19db-kube-rbac-proxy-cm podName:a87beecc-8c6a-466a-9fec-8fe341bd19db nodeName:}" failed. No retries permitted until 2026-07-05 13:19:24.613078087 +0000 UTC m=+58.258388528 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a87beecc-8c6a-466a-9fec-8fe341bd19db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9shv4" (UID: "a87beecc-8c6a-466a-9fec-8fe341bd19db") : configmap "kube-rbac-proxy" not found Jul 05 13:19:24.113271 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:24.113246 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a87beecc-8c6a-466a-9fec-8fe341bd19db-data-volume\") pod \"insights-runtime-extractor-9shv4\" (UID: \"a87beecc-8c6a-466a-9fec-8fe341bd19db\") " pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:24.149505 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:24.149479 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbmbx\" (UniqueName: \"kubernetes.io/projected/a87beecc-8c6a-466a-9fec-8fe341bd19db-kube-api-access-lbmbx\") pod \"insights-runtime-extractor-9shv4\" (UID: \"a87beecc-8c6a-466a-9fec-8fe341bd19db\") " pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:24.616534 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:24.616483 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a87beecc-8c6a-466a-9fec-8fe341bd19db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9shv4\" (UID: \"a87beecc-8c6a-466a-9fec-8fe341bd19db\") " pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:24.616938 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:24.616616 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 13:19:24.616938 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:24.616677 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a87beecc-8c6a-466a-9fec-8fe341bd19db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9shv4\" (UID: \"a87beecc-8c6a-466a-9fec-8fe341bd19db\") " pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:24.616938 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:24.616688 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a87beecc-8c6a-466a-9fec-8fe341bd19db-insights-runtime-extractor-tls podName:a87beecc-8c6a-466a-9fec-8fe341bd19db nodeName:}" failed. No retries permitted until 2026-07-05 13:19:25.616673493 +0000 UTC m=+59.261983935 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a87beecc-8c6a-466a-9fec-8fe341bd19db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9shv4" (UID: "a87beecc-8c6a-466a-9fec-8fe341bd19db") : secret "insights-runtime-extractor-tls" not found Jul 05 13:19:24.616938 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:24.616769 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 13:19:24.616938 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:24.616831 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a87beecc-8c6a-466a-9fec-8fe341bd19db-kube-rbac-proxy-cm podName:a87beecc-8c6a-466a-9fec-8fe341bd19db nodeName:}" failed. No retries permitted until 2026-07-05 13:19:25.616802364 +0000 UTC m=+59.262112808 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a87beecc-8c6a-466a-9fec-8fe341bd19db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9shv4" (UID: "a87beecc-8c6a-466a-9fec-8fe341bd19db") : configmap "kube-rbac-proxy" not found Jul 05 13:19:25.624616 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:25.624583 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a87beecc-8c6a-466a-9fec-8fe341bd19db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9shv4\" (UID: \"a87beecc-8c6a-466a-9fec-8fe341bd19db\") " pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:25.625075 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:25.624707 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 13:19:25.625075 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:25.624768 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a87beecc-8c6a-466a-9fec-8fe341bd19db-kube-rbac-proxy-cm podName:a87beecc-8c6a-466a-9fec-8fe341bd19db nodeName:}" failed. No retries permitted until 2026-07-05 13:19:27.624752984 +0000 UTC m=+61.270063425 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a87beecc-8c6a-466a-9fec-8fe341bd19db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9shv4" (UID: "a87beecc-8c6a-466a-9fec-8fe341bd19db") : configmap "kube-rbac-proxy" not found Jul 05 13:19:25.625075 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:25.624767 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a87beecc-8c6a-466a-9fec-8fe341bd19db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9shv4\" (UID: \"a87beecc-8c6a-466a-9fec-8fe341bd19db\") " pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:25.625075 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:25.624958 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 13:19:25.625075 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:25.625018 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a87beecc-8c6a-466a-9fec-8fe341bd19db-insights-runtime-extractor-tls podName:a87beecc-8c6a-466a-9fec-8fe341bd19db nodeName:}" failed. No retries permitted until 2026-07-05 13:19:27.625000626 +0000 UTC m=+61.270311067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a87beecc-8c6a-466a-9fec-8fe341bd19db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9shv4" (UID: "a87beecc-8c6a-466a-9fec-8fe341bd19db") : secret "insights-runtime-extractor-tls" not found Jul 05 13:19:25.665101 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:25.665072 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-s8lj7"] Jul 05 13:19:25.667346 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:25.667327 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-s8lj7" Jul 05 13:19:25.679772 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:25.679751 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-px7mx\"" Jul 05 13:19:25.680577 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:25.680559 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 05 13:19:25.680626 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:25.680609 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 05 13:19:25.680671 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:25.680658 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 05 13:19:25.680741 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:25.680725 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 05 13:19:25.695470 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:25.695450 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-s8lj7"] Jul 05 13:19:25.725814 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:25.725790 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/44de14cd-9f63-46d0-b89d-70293217e2f0-signing-key\") pod \"service-ca-758f599c5-s8lj7\" (UID: \"44de14cd-9f63-46d0-b89d-70293217e2f0\") " pod="openshift-service-ca/service-ca-758f599c5-s8lj7" Jul 05 13:19:25.725909 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:25.725831 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/44de14cd-9f63-46d0-b89d-70293217e2f0-signing-cabundle\") pod \"service-ca-758f599c5-s8lj7\" (UID: \"44de14cd-9f63-46d0-b89d-70293217e2f0\") " pod="openshift-service-ca/service-ca-758f599c5-s8lj7" Jul 05 13:19:25.725909 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:25.725852 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kv5x\" (UniqueName: \"kubernetes.io/projected/44de14cd-9f63-46d0-b89d-70293217e2f0-kube-api-access-8kv5x\") pod \"service-ca-758f599c5-s8lj7\" (UID: \"44de14cd-9f63-46d0-b89d-70293217e2f0\") " pod="openshift-service-ca/service-ca-758f599c5-s8lj7" Jul 05 13:19:25.826981 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:25.826952 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/44de14cd-9f63-46d0-b89d-70293217e2f0-signing-key\") pod \"service-ca-758f599c5-s8lj7\" (UID: \"44de14cd-9f63-46d0-b89d-70293217e2f0\") " pod="openshift-service-ca/service-ca-758f599c5-s8lj7" Jul 05 13:19:25.826981 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:25.826983 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/44de14cd-9f63-46d0-b89d-70293217e2f0-signing-cabundle\") pod \"service-ca-758f599c5-s8lj7\" (UID: \"44de14cd-9f63-46d0-b89d-70293217e2f0\") " pod="openshift-service-ca/service-ca-758f599c5-s8lj7" Jul 05 13:19:25.827198 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:25.827006 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kv5x\" (UniqueName: \"kubernetes.io/projected/44de14cd-9f63-46d0-b89d-70293217e2f0-kube-api-access-8kv5x\") pod \"service-ca-758f599c5-s8lj7\" (UID: \"44de14cd-9f63-46d0-b89d-70293217e2f0\") " pod="openshift-service-ca/service-ca-758f599c5-s8lj7" Jul 05 13:19:25.827665 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:25.827642 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/44de14cd-9f63-46d0-b89d-70293217e2f0-signing-cabundle\") pod \"service-ca-758f599c5-s8lj7\" (UID: \"44de14cd-9f63-46d0-b89d-70293217e2f0\") " pod="openshift-service-ca/service-ca-758f599c5-s8lj7" Jul 05 13:19:25.829226 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:25.829210 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/44de14cd-9f63-46d0-b89d-70293217e2f0-signing-key\") pod \"service-ca-758f599c5-s8lj7\" (UID: \"44de14cd-9f63-46d0-b89d-70293217e2f0\") " pod="openshift-service-ca/service-ca-758f599c5-s8lj7" Jul 05 13:19:25.847821 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:25.847772 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kv5x\" (UniqueName: \"kubernetes.io/projected/44de14cd-9f63-46d0-b89d-70293217e2f0-kube-api-access-8kv5x\") pod \"service-ca-758f599c5-s8lj7\" (UID: \"44de14cd-9f63-46d0-b89d-70293217e2f0\") " pod="openshift-service-ca/service-ca-758f599c5-s8lj7" Jul 05 13:19:25.975798 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:25.975766 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-s8lj7" Jul 05 13:19:26.052387 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:26.052361 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fd7rj_1044be9c-adcd-4685-845f-4ab24fe04c00/dns-node-resolver/0.log" Jul 05 13:19:26.117762 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:26.117735 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-s8lj7"] Jul 05 13:19:26.120671 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:19:26.120641 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44de14cd_9f63_46d0_b89d_70293217e2f0.slice/crio-966eac71eef9b8ea17c02dbb6e5d607119699b9531b631bc6e2cd3ce56d08ee2 WatchSource:0}: Error finding container 966eac71eef9b8ea17c02dbb6e5d607119699b9531b631bc6e2cd3ce56d08ee2: Status 404 returned error can't find the container with id 966eac71eef9b8ea17c02dbb6e5d607119699b9531b631bc6e2cd3ce56d08ee2 Jul 05 13:19:26.175538 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:26.175513 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-s8lj7" event={"ID":"44de14cd-9f63-46d0-b89d-70293217e2f0","Type":"ContainerStarted","Data":"038b17757f4ac0685b15d31cd6cb7dc61825a2ee39608c03bb2c14a1f7c232ea"} Jul 05 13:19:26.175632 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:26.175557 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-s8lj7" event={"ID":"44de14cd-9f63-46d0-b89d-70293217e2f0","Type":"ContainerStarted","Data":"966eac71eef9b8ea17c02dbb6e5d607119699b9531b631bc6e2cd3ce56d08ee2"} Jul 05 13:19:27.052323 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:27.052298 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tss2s_eb3e727d-7877-482d-bd5f-a2cbcbd9dae4/node-ca/0.log" Jul 05 13:19:27.092097 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:27.092070 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-thmmq" Jul 05 13:19:27.223030 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:27.222930 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-s8lj7" podStartSLOduration=2.222906771 podStartE2EDuration="2.222906771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:26.217454935 +0000 UTC m=+59.862765397" watchObservedRunningTime="2026-07-05 13:19:27.222906771 +0000 UTC m=+60.868217238" Jul 05 13:19:27.445987 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:27.445950 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bx4kp_5f3f69bc-f69d-4851-9857-ab68864da3de/serve-healthcheck-canary/0.log" Jul 05 13:19:27.642592 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:27.642552 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a87beecc-8c6a-466a-9fec-8fe341bd19db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9shv4\" (UID: \"a87beecc-8c6a-466a-9fec-8fe341bd19db\") " pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:27.642784 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:27.642646 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-service-ca-bundle\") pod \"router-default-54c57459b5-lt6zp\" (UID: \"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3\") " pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:27.642784 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:27.642678 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a87beecc-8c6a-466a-9fec-8fe341bd19db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9shv4\" (UID: \"a87beecc-8c6a-466a-9fec-8fe341bd19db\") " pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:27.642784 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:27.642709 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-metrics-certs\") pod \"router-default-54c57459b5-lt6zp\" (UID: \"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3\") " pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:27.642784 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:27.642724 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 13:19:27.643024 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:27.642797 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a87beecc-8c6a-466a-9fec-8fe341bd19db-insights-runtime-extractor-tls podName:a87beecc-8c6a-466a-9fec-8fe341bd19db nodeName:}" failed. No retries permitted until 2026-07-05 13:19:31.642773837 +0000 UTC m=+65.288084293 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a87beecc-8c6a-466a-9fec-8fe341bd19db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9shv4" (UID: "a87beecc-8c6a-466a-9fec-8fe341bd19db") : secret "insights-runtime-extractor-tls" not found Jul 05 13:19:27.643024 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:27.642866 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 13:19:27.643024 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:27.642923 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-metrics-certs podName:6665a837-1cd2-41d9-86ef-7d3cfcba4dc3 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:35.642908685 +0000 UTC m=+69.288219131 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-metrics-certs") pod "router-default-54c57459b5-lt6zp" (UID: "6665a837-1cd2-41d9-86ef-7d3cfcba4dc3") : secret "router-metrics-certs-default" not found Jul 05 13:19:27.643024 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:27.642991 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-service-ca-bundle podName:6665a837-1cd2-41d9-86ef-7d3cfcba4dc3 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:35.642979105 +0000 UTC m=+69.288289549 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-service-ca-bundle") pod "router-default-54c57459b5-lt6zp" (UID: "6665a837-1cd2-41d9-86ef-7d3cfcba4dc3") : configmap references non-existent config key: service-ca.crt Jul 05 13:19:27.643220 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:27.643032 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 13:19:27.643220 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:27.643060 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a87beecc-8c6a-466a-9fec-8fe341bd19db-kube-rbac-proxy-cm podName:a87beecc-8c6a-466a-9fec-8fe341bd19db nodeName:}" failed. No retries permitted until 2026-07-05 13:19:31.643051184 +0000 UTC m=+65.288361630 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a87beecc-8c6a-466a-9fec-8fe341bd19db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9shv4" (UID: "a87beecc-8c6a-466a-9fec-8fe341bd19db") : configmap "kube-rbac-proxy" not found Jul 05 13:19:31.574502 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:31.574469 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ce057ad-491a-4f76-b9df-0a4da94dd152-original-pull-secret\") pod \"global-pull-secret-syncer-xms2g\" (UID: \"4ce057ad-491a-4f76-b9df-0a4da94dd152\") " pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:19:31.574888 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:31.574580 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs\") pod \"network-metrics-daemon-fsfvp\" (UID: \"d06fcb3d-95c9-4837-8b5f-f8455c806cf3\") " pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:19:31.579782 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:31.579763 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 05 13:19:31.580079 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:31.580065 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 05 13:19:31.585162 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:31.585143 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 05 13:19:31.585224 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:31.585216 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs podName:d06fcb3d-95c9-4837-8b5f-f8455c806cf3 nodeName:}" failed. No retries permitted until 2026-07-05 13:20:35.585195898 +0000 UTC m=+129.230506360 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs") pod "network-metrics-daemon-fsfvp" (UID: "d06fcb3d-95c9-4837-8b5f-f8455c806cf3") : secret "metrics-daemon-secret" not found Jul 05 13:19:31.587247 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:31.587227 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ce057ad-491a-4f76-b9df-0a4da94dd152-original-pull-secret\") pod \"global-pull-secret-syncer-xms2g\" (UID: \"4ce057ad-491a-4f76-b9df-0a4da94dd152\") " pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:19:31.675294 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:31.675264 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfp2x\" (UniqueName: \"kubernetes.io/projected/ef04f0f0-451b-4254-86bc-2cd6b4ce6016-kube-api-access-vfp2x\") pod \"network-check-target-n9xhq\" (UID: \"ef04f0f0-451b-4254-86bc-2cd6b4ce6016\") " pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:19:31.675440 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:31.675301 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a87beecc-8c6a-466a-9fec-8fe341bd19db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9shv4\" (UID: \"a87beecc-8c6a-466a-9fec-8fe341bd19db\") " pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:31.675440 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:31.675409 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 13:19:31.675516 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:31.675449 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a87beecc-8c6a-466a-9fec-8fe341bd19db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9shv4\" (UID: \"a87beecc-8c6a-466a-9fec-8fe341bd19db\") " pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:31.675516 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:31.675465 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a87beecc-8c6a-466a-9fec-8fe341bd19db-insights-runtime-extractor-tls podName:a87beecc-8c6a-466a-9fec-8fe341bd19db nodeName:}" failed. No retries permitted until 2026-07-05 13:19:39.675448028 +0000 UTC m=+73.320758488 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a87beecc-8c6a-466a-9fec-8fe341bd19db-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9shv4" (UID: "a87beecc-8c6a-466a-9fec-8fe341bd19db") : secret "insights-runtime-extractor-tls" not found Jul 05 13:19:31.675516 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:31.675511 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 13:19:31.675625 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:31.675553 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a87beecc-8c6a-466a-9fec-8fe341bd19db-kube-rbac-proxy-cm podName:a87beecc-8c6a-466a-9fec-8fe341bd19db nodeName:}" failed. No retries permitted until 2026-07-05 13:19:39.675541273 +0000 UTC m=+73.320851716 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a87beecc-8c6a-466a-9fec-8fe341bd19db-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9shv4" (UID: "a87beecc-8c6a-466a-9fec-8fe341bd19db") : configmap "kube-rbac-proxy" not found Jul 05 13:19:31.683079 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:31.683055 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 05 13:19:31.687909 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:31.687890 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 05 13:19:31.698894 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:31.698873 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfp2x\" (UniqueName: \"kubernetes.io/projected/ef04f0f0-451b-4254-86bc-2cd6b4ce6016-kube-api-access-vfp2x\") pod \"network-check-target-n9xhq\" (UID: \"ef04f0f0-451b-4254-86bc-2cd6b4ce6016\") " pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:19:31.723477 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:31.723452 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xms2g" Jul 05 13:19:31.827866 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:31.827753 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mvgxb\"" Jul 05 13:19:31.836182 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:31.836157 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:19:31.887107 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:31.887076 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xms2g"] Jul 05 13:19:31.896840 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:19:31.896796 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ce057ad_491a_4f76_b9df_0a4da94dd152.slice/crio-d8257c6cf8ea63039b43590779464f4c777608f7a353d3155e78a0b5f1cd634d WatchSource:0}: Error finding container d8257c6cf8ea63039b43590779464f4c777608f7a353d3155e78a0b5f1cd634d: Status 404 returned error can't find the container with id d8257c6cf8ea63039b43590779464f4c777608f7a353d3155e78a0b5f1cd634d Jul 05 13:19:31.972035 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:31.972008 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n9xhq"] Jul 05 13:19:31.974952 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:19:31.974924 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef04f0f0_451b_4254_86bc_2cd6b4ce6016.slice/crio-096ec895af02efc6e157bc07fd794a82e91684b267e21e0701e498b93a82b833 WatchSource:0}: Error finding container 096ec895af02efc6e157bc07fd794a82e91684b267e21e0701e498b93a82b833: Status 404 returned error can't find the container with id 096ec895af02efc6e157bc07fd794a82e91684b267e21e0701e498b93a82b833 Jul 05 13:19:32.191683 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:32.191649 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xms2g" event={"ID":"4ce057ad-491a-4f76-b9df-0a4da94dd152","Type":"ContainerStarted","Data":"d8257c6cf8ea63039b43590779464f4c777608f7a353d3155e78a0b5f1cd634d"} Jul 05 13:19:32.192767 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:32.192744 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n9xhq" event={"ID":"ef04f0f0-451b-4254-86bc-2cd6b4ce6016","Type":"ContainerStarted","Data":"096ec895af02efc6e157bc07fd794a82e91684b267e21e0701e498b93a82b833"} Jul 05 13:19:32.783663 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:32.783364 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-metrics-tls\") pod \"dns-default-smvf9\" (UID: \"e0ec710f-20ca-463a-9cf3-bc60137f4f9f\") " pod="openshift-dns/dns-default-smvf9" Jul 05 13:19:32.786335 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:32.786309 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0ec710f-20ca-463a-9cf3-bc60137f4f9f-metrics-tls\") pod \"dns-default-smvf9\" (UID: \"e0ec710f-20ca-463a-9cf3-bc60137f4f9f\") " pod="openshift-dns/dns-default-smvf9" Jul 05 13:19:32.984556 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:32.984357 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-27l8r\"" Jul 05 13:19:32.992532 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:32.992496 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-smvf9" Jul 05 13:19:33.170001 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:33.169967 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-smvf9"] Jul 05 13:19:33.174159 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:19:33.174127 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0ec710f_20ca_463a_9cf3_bc60137f4f9f.slice/crio-0b14e69bcbaa114de5e8b62396a9619b131d601fa89f86af75b091b4ead6700c WatchSource:0}: Error finding container 0b14e69bcbaa114de5e8b62396a9619b131d601fa89f86af75b091b4ead6700c: Status 404 returned error can't find the container with id 0b14e69bcbaa114de5e8b62396a9619b131d601fa89f86af75b091b4ead6700c Jul 05 13:19:33.197987 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:33.197943 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-smvf9" event={"ID":"e0ec710f-20ca-463a-9cf3-bc60137f4f9f","Type":"ContainerStarted","Data":"0b14e69bcbaa114de5e8b62396a9619b131d601fa89f86af75b091b4ead6700c"} Jul 05 13:19:35.713119 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:35.713081 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-service-ca-bundle\") pod \"router-default-54c57459b5-lt6zp\" (UID: \"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3\") " pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:35.713610 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:35.713143 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-metrics-certs\") pod \"router-default-54c57459b5-lt6zp\" (UID: \"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3\") " pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:35.713834 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:35.713755 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-service-ca-bundle\") pod \"router-default-54c57459b5-lt6zp\" (UID: \"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3\") " pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:35.715778 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:35.715749 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6665a837-1cd2-41d9-86ef-7d3cfcba4dc3-metrics-certs\") pod \"router-default-54c57459b5-lt6zp\" (UID: \"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3\") " pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:36.005258 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:36.005189 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fmhj5\"" Jul 05 13:19:36.012091 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:36.012075 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:38.027254 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:38.027230 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54c57459b5-lt6zp"] Jul 05 13:19:38.030098 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:19:38.030060 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6665a837_1cd2_41d9_86ef_7d3cfcba4dc3.slice/crio-a77c35a6be3ac9a471c1dd30ba48e4282a6e971108296a4ff292b59e57309bc7 WatchSource:0}: Error finding container a77c35a6be3ac9a471c1dd30ba48e4282a6e971108296a4ff292b59e57309bc7: Status 404 returned error can't find the container with id a77c35a6be3ac9a471c1dd30ba48e4282a6e971108296a4ff292b59e57309bc7 Jul 05 13:19:38.217928 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:38.217892 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54c57459b5-lt6zp" event={"ID":"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3","Type":"ContainerStarted","Data":"06eb7414a93c1ceee2934223b563dd38679a8f326cf486847a4fbd64e1c27b52"} Jul 05 13:19:38.218081 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:38.217972 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54c57459b5-lt6zp" event={"ID":"6665a837-1cd2-41d9-86ef-7d3cfcba4dc3","Type":"ContainerStarted","Data":"a77c35a6be3ac9a471c1dd30ba48e4282a6e971108296a4ff292b59e57309bc7"} Jul 05 13:19:38.219310 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:38.219277 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n9xhq" event={"ID":"ef04f0f0-451b-4254-86bc-2cd6b4ce6016","Type":"ContainerStarted","Data":"2a93ed36a8da8618018356291c360e5cb1e9a67f6e06b66ecbf9689dfea57568"} Jul 05 13:19:38.219449 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:38.219332 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:19:38.220603 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:38.220569 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xms2g" event={"ID":"4ce057ad-491a-4f76-b9df-0a4da94dd152","Type":"ContainerStarted","Data":"b3d5d7395223a45b86ce4cb95fe3e0502675151b75230358534fd8ad4d86004b"} Jul 05 13:19:38.222385 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:38.222359 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-smvf9" event={"ID":"e0ec710f-20ca-463a-9cf3-bc60137f4f9f","Type":"ContainerStarted","Data":"6fba93417e49cb395714185482e80818d4cc2e9a0aa28f3b303157572bb6594b"} Jul 05 13:19:38.222500 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:38.222404 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-smvf9" event={"ID":"e0ec710f-20ca-463a-9cf3-bc60137f4f9f","Type":"ContainerStarted","Data":"85d684b222037c25cc9b377778239e7e0d24a02940c0c0596b0c4074df5fd6d4"} Jul 05 13:19:38.222500 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:38.222491 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-smvf9" Jul 05 13:19:38.251584 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:38.251470 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-54c57459b5-lt6zp" podStartSLOduration=19.251449737 podStartE2EDuration="19.251449737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:38.251336296 +0000 UTC m=+71.896646803" watchObservedRunningTime="2026-07-05 13:19:38.251449737 +0000 UTC m=+71.896760203" Jul 05 13:19:38.329532 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:38.329477 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xms2g" podStartSLOduration=66.420123327 podStartE2EDuration="1m12.329459783s" totalImagesPullingTime="5.909336456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:38.286125602 +0000 UTC m=+71.931436065" watchObservedRunningTime="2026-07-05 13:19:38.329459783 +0000 UTC m=+71.974770268" Jul 05 13:19:38.371554 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:38.371498 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-smvf9" podStartSLOduration=33.751167131 podStartE2EDuration="38.371477943s" totalImagesPullingTime="4.620310812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:38.371445699 +0000 UTC m=+72.016756163" watchObservedRunningTime="2026-07-05 13:19:38.371477943 +0000 UTC m=+72.016788385" Jul 05 13:19:38.372189 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:38.372161 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n9xhq" podStartSLOduration=66.551900006 podStartE2EDuration="1m12.372152866s" totalImagesPullingTime="5.82025286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:18:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:38.329991111 +0000 UTC m=+71.975301575" watchObservedRunningTime="2026-07-05 13:19:38.372152866 +0000 UTC m=+72.017463330" Jul 05 13:19:39.012408 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:39.012370 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:39.014829 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:39.014791 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:39.225627 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:39.225590 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:39.226615 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:39.226595 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-54c57459b5-lt6zp" Jul 05 13:19:39.743525 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:39.743492 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a87beecc-8c6a-466a-9fec-8fe341bd19db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9shv4\" (UID: \"a87beecc-8c6a-466a-9fec-8fe341bd19db\") " pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:39.743688 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:39.743549 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a87beecc-8c6a-466a-9fec-8fe341bd19db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9shv4\" (UID: \"a87beecc-8c6a-466a-9fec-8fe341bd19db\") " pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:39.744017 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:39.743996 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a87beecc-8c6a-466a-9fec-8fe341bd19db-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9shv4\" (UID: \"a87beecc-8c6a-466a-9fec-8fe341bd19db\") " pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:39.745693 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:39.745673 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a87beecc-8c6a-466a-9fec-8fe341bd19db-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9shv4\" (UID: \"a87beecc-8c6a-466a-9fec-8fe341bd19db\") " pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:39.914162 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:39.914131 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d74jb\"" Jul 05 13:19:39.919195 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:39.919174 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9shv4" Jul 05 13:19:40.074082 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:40.074039 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9shv4"] Jul 05 13:19:40.078311 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:19:40.078286 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda87beecc_8c6a_466a_9fec_8fe341bd19db.slice/crio-376e59c959a0761391dc1a4bef44a742da03ac646b90d4456af7a26fcb72ab60 WatchSource:0}: Error finding container 376e59c959a0761391dc1a4bef44a742da03ac646b90d4456af7a26fcb72ab60: Status 404 returned error can't find the container with id 376e59c959a0761391dc1a4bef44a742da03ac646b90d4456af7a26fcb72ab60 Jul 05 13:19:40.230187 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:40.230155 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9shv4" event={"ID":"a87beecc-8c6a-466a-9fec-8fe341bd19db","Type":"ContainerStarted","Data":"376e59c959a0761391dc1a4bef44a742da03ac646b90d4456af7a26fcb72ab60"} Jul 05 13:19:44.248745 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:44.248707 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9shv4" event={"ID":"a87beecc-8c6a-466a-9fec-8fe341bd19db","Type":"ContainerStarted","Data":"cde9ef6e4ba7fa30fc6b66f6a1b59cc9f86cfe70e5297643d899fe7724e481f8"} Jul 05 13:19:45.256435 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:45.256400 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9shv4" event={"ID":"a87beecc-8c6a-466a-9fec-8fe341bd19db","Type":"ContainerStarted","Data":"3ef8f58cdb333970712c45574c7c11bcf62d82ab1c53cec367211ac140761eca"} Jul 05 13:19:47.264598 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:47.264554 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9shv4" event={"ID":"a87beecc-8c6a-466a-9fec-8fe341bd19db","Type":"ContainerStarted","Data":"6df3f81794ec0d290b5d2e7ad6050c605c15dc2c42aa340e6ee8f2c8f141b957"} Jul 05 13:19:47.289915 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:47.289871 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9shv4" podStartSLOduration=17.609229849 podStartE2EDuration="24.289856831s" totalImagesPullingTime="6.680626982s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:19:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:47.288279534 +0000 UTC m=+80.933589997" watchObservedRunningTime="2026-07-05 13:19:47.289856831 +0000 UTC m=+80.935167293" Jul 05 13:19:48.227678 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:48.227643 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-smvf9" Jul 05 13:19:53.763257 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:53.763229 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7c5f98f5-hdn7h"] Jul 05 13:19:53.768687 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:53.768664 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7c5f98f5-hdn7h" Jul 05 13:19:53.773494 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:53.773471 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 05 13:19:53.774205 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:53.774186 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 05 13:19:53.774553 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:53.774533 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 05 13:19:53.798445 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:53.798420 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 05 13:19:53.832380 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:53.832355 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7c5f98f5-hdn7h"] Jul 05 13:19:53.857261 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:53.857237 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ln7l\" (UniqueName: \"kubernetes.io/projected/4ecd256e-b380-4b5d-8fd1-1705f9c3c2ce-kube-api-access-4ln7l\") pod \"klusterlet-addon-workmgr-7c7c5f98f5-hdn7h\" (UID: \"4ecd256e-b380-4b5d-8fd1-1705f9c3c2ce\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7c5f98f5-hdn7h" Jul 05 13:19:53.857373 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:53.857271 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ecd256e-b380-4b5d-8fd1-1705f9c3c2ce-tmp\") pod \"klusterlet-addon-workmgr-7c7c5f98f5-hdn7h\" (UID: \"4ecd256e-b380-4b5d-8fd1-1705f9c3c2ce\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7c5f98f5-hdn7h" Jul 05 13:19:53.857373 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:53.857334 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4ecd256e-b380-4b5d-8fd1-1705f9c3c2ce-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c7c5f98f5-hdn7h\" (UID: \"4ecd256e-b380-4b5d-8fd1-1705f9c3c2ce\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7c5f98f5-hdn7h" Jul 05 13:19:53.896171 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:53.896145 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-tgc6s"] Jul 05 13:19:53.899990 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:53.899975 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-tgc6s" Jul 05 13:19:53.924761 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:53.924736 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 05 13:19:53.924901 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:53.924831 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-kmkjp\"" Jul 05 13:19:53.924966 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:53.924954 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 05 13:19:53.936426 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:53.936408 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-tgc6s"] Jul 05 13:19:53.957741 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:53.957720 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ln7l\" (UniqueName: \"kubernetes.io/projected/4ecd256e-b380-4b5d-8fd1-1705f9c3c2ce-kube-api-access-4ln7l\") pod \"klusterlet-addon-workmgr-7c7c5f98f5-hdn7h\" (UID: \"4ecd256e-b380-4b5d-8fd1-1705f9c3c2ce\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7c5f98f5-hdn7h" Jul 05 13:19:53.957872 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:53.957751 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ecd256e-b380-4b5d-8fd1-1705f9c3c2ce-tmp\") pod \"klusterlet-addon-workmgr-7c7c5f98f5-hdn7h\" (UID: \"4ecd256e-b380-4b5d-8fd1-1705f9c3c2ce\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7c5f98f5-hdn7h" Jul 05 13:19:53.957872 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:53.957791 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4ecd256e-b380-4b5d-8fd1-1705f9c3c2ce-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c7c5f98f5-hdn7h\" (UID: \"4ecd256e-b380-4b5d-8fd1-1705f9c3c2ce\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7c5f98f5-hdn7h" Jul 05 13:19:53.958165 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:53.958150 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ecd256e-b380-4b5d-8fd1-1705f9c3c2ce-tmp\") pod \"klusterlet-addon-workmgr-7c7c5f98f5-hdn7h\" (UID: \"4ecd256e-b380-4b5d-8fd1-1705f9c3c2ce\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7c5f98f5-hdn7h" Jul 05 13:19:53.960254 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:53.960237 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4ecd256e-b380-4b5d-8fd1-1705f9c3c2ce-klusterlet-config\") pod \"klusterlet-addon-workmgr-7c7c5f98f5-hdn7h\" (UID: \"4ecd256e-b380-4b5d-8fd1-1705f9c3c2ce\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7c5f98f5-hdn7h" Jul 05 13:19:54.012092 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.012065 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ln7l\" (UniqueName: \"kubernetes.io/projected/4ecd256e-b380-4b5d-8fd1-1705f9c3c2ce-kube-api-access-4ln7l\") pod \"klusterlet-addon-workmgr-7c7c5f98f5-hdn7h\" (UID: \"4ecd256e-b380-4b5d-8fd1-1705f9c3c2ce\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7c5f98f5-hdn7h" Jul 05 13:19:54.044432 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.044355 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-2k7bm"] Jul 05 13:19:54.048798 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.048778 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-2k7bm" Jul 05 13:19:54.058544 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.058521 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b6d8d93d-a638-4dc3-a52d-f07c013e7031-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-tgc6s\" (UID: \"b6d8d93d-a638-4dc3-a52d-f07c013e7031\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-tgc6s" Jul 05 13:19:54.058657 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.058558 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b6d8d93d-a638-4dc3-a52d-f07c013e7031-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-tgc6s\" (UID: \"b6d8d93d-a638-4dc3-a52d-f07c013e7031\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-tgc6s" Jul 05 13:19:54.061745 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.061726 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 05 13:19:54.077885 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.077855 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7c5f98f5-hdn7h" Jul 05 13:19:54.091409 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.091383 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-2k7bm"] Jul 05 13:19:54.113356 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.113326 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 05 13:19:54.113489 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.113400 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-cnqlk\"" Jul 05 13:19:54.159156 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.159107 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pqsf\" (UniqueName: \"kubernetes.io/projected/13d301ec-70ea-4c9f-b007-bcfb611ef3ec-kube-api-access-2pqsf\") pod \"downloads-685bfb5f64-2k7bm\" (UID: \"13d301ec-70ea-4c9f-b007-bcfb611ef3ec\") " pod="openshift-console/downloads-685bfb5f64-2k7bm" Jul 05 13:19:54.159278 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.159189 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b6d8d93d-a638-4dc3-a52d-f07c013e7031-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-tgc6s\" (UID: \"b6d8d93d-a638-4dc3-a52d-f07c013e7031\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-tgc6s" Jul 05 13:19:54.159278 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.159240 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b6d8d93d-a638-4dc3-a52d-f07c013e7031-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-tgc6s\" (UID: \"b6d8d93d-a638-4dc3-a52d-f07c013e7031\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-tgc6s" Jul 05 13:19:54.160107 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.160054 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b6d8d93d-a638-4dc3-a52d-f07c013e7031-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-tgc6s\" (UID: \"b6d8d93d-a638-4dc3-a52d-f07c013e7031\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-tgc6s" Jul 05 13:19:54.162074 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.162047 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b6d8d93d-a638-4dc3-a52d-f07c013e7031-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-tgc6s\" (UID: \"b6d8d93d-a638-4dc3-a52d-f07c013e7031\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-tgc6s" Jul 05 13:19:54.208590 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.208563 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-tgc6s" Jul 05 13:19:54.260282 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.260246 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pqsf\" (UniqueName: \"kubernetes.io/projected/13d301ec-70ea-4c9f-b007-bcfb611ef3ec-kube-api-access-2pqsf\") pod \"downloads-685bfb5f64-2k7bm\" (UID: \"13d301ec-70ea-4c9f-b007-bcfb611ef3ec\") " pod="openshift-console/downloads-685bfb5f64-2k7bm" Jul 05 13:19:54.284770 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.284740 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-844d586685-58vjx"] Jul 05 13:19:54.289076 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.288761 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:54.305020 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:54.304995 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"image-registry-tls\" is forbidden: User \"system:node:ip-10-0-135-121.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-135-121.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" type="*v1.Secret" Jul 05 13:19:54.305341 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:54.305316 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"image-registry-private-configuration\" is forbidden: User \"system:node:ip-10-0-135-121.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-135-121.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" type="*v1.Secret" Jul 05 13:19:54.305596 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:54.305573 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"installation-pull-secrets\" is forbidden: User \"system:node:ip-10-0-135-121.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-135-121.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" type="*v1.Secret" Jul 05 13:19:54.305926 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:54.305907 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"registry-dockercfg-l4vdf\" is forbidden: User \"system:node:ip-10-0-135-121.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-135-121.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-l4vdf\"" type="*v1.Secret" Jul 05 13:19:54.306219 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:54.306191 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"image-registry-844d586685-58vjx\" is forbidden: User \"system:node:ip-10-0-135-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-135-121.ec2.internal' and this object" podUID="230f66ad-0649-4bdd-95ff-727814d3c024" pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:54.306299 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:54.306270 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"trusted-ca\" is forbidden: User \"system:node:ip-10-0-135-121.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-135-121.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" type="*v1.ConfigMap" Jul 05 13:19:54.361507 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.361485 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/230f66ad-0649-4bdd-95ff-727814d3c024-ca-trust-extracted\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:54.361661 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.361514 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/230f66ad-0649-4bdd-95ff-727814d3c024-trusted-ca\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:54.361661 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.361535 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/230f66ad-0649-4bdd-95ff-727814d3c024-registry-certificates\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:54.361661 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.361564 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/230f66ad-0649-4bdd-95ff-727814d3c024-bound-sa-token\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:54.361661 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.361627 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/230f66ad-0649-4bdd-95ff-727814d3c024-installation-pull-secrets\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:54.361874 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.361676 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmxj4\" (UniqueName: \"kubernetes.io/projected/230f66ad-0649-4bdd-95ff-727814d3c024-kube-api-access-qmxj4\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:54.361874 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.361740 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/230f66ad-0649-4bdd-95ff-727814d3c024-registry-tls\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:54.361874 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.361786 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/230f66ad-0649-4bdd-95ff-727814d3c024-image-registry-private-configuration\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:54.374122 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.374094 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pqsf\" (UniqueName: \"kubernetes.io/projected/13d301ec-70ea-4c9f-b007-bcfb611ef3ec-kube-api-access-2pqsf\") pod \"downloads-685bfb5f64-2k7bm\" (UID: \"13d301ec-70ea-4c9f-b007-bcfb611ef3ec\") " pod="openshift-console/downloads-685bfb5f64-2k7bm" Jul 05 13:19:54.392273 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.392250 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-844d586685-58vjx"] Jul 05 13:19:54.440872 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.440849 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7c5f98f5-hdn7h"] Jul 05 13:19:54.456053 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:19:54.456031 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ecd256e_b380_4b5d_8fd1_1705f9c3c2ce.slice/crio-331c7546bc1d1de2d1bf1502c64daced2f2347b6d8352ca9f499286431435b81 WatchSource:0}: Error finding container 331c7546bc1d1de2d1bf1502c64daced2f2347b6d8352ca9f499286431435b81: Status 404 returned error can't find the container with id 331c7546bc1d1de2d1bf1502c64daced2f2347b6d8352ca9f499286431435b81 Jul 05 13:19:54.462574 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.462555 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/230f66ad-0649-4bdd-95ff-727814d3c024-image-registry-private-configuration\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:54.462644 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.462594 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/230f66ad-0649-4bdd-95ff-727814d3c024-ca-trust-extracted\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:54.462644 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.462611 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/230f66ad-0649-4bdd-95ff-727814d3c024-trusted-ca\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:54.462644 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.462630 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/230f66ad-0649-4bdd-95ff-727814d3c024-registry-certificates\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:54.462740 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.462671 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/230f66ad-0649-4bdd-95ff-727814d3c024-bound-sa-token\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:54.462740 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.462700 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/230f66ad-0649-4bdd-95ff-727814d3c024-installation-pull-secrets\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:54.462828 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.462737 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmxj4\" (UniqueName: \"kubernetes.io/projected/230f66ad-0649-4bdd-95ff-727814d3c024-kube-api-access-qmxj4\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:54.462828 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.462771 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/230f66ad-0649-4bdd-95ff-727814d3c024-registry-tls\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:54.463000 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.462980 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/230f66ad-0649-4bdd-95ff-727814d3c024-ca-trust-extracted\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:54.463327 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.463309 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/230f66ad-0649-4bdd-95ff-727814d3c024-registry-certificates\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:54.538480 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.538449 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmxj4\" (UniqueName: \"kubernetes.io/projected/230f66ad-0649-4bdd-95ff-727814d3c024-kube-api-access-qmxj4\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:54.552031 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.551963 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/230f66ad-0649-4bdd-95ff-727814d3c024-bound-sa-token\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:54.562334 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.562311 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-tgc6s"] Jul 05 13:19:54.563300 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:19:54.563276 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6d8d93d_a638_4dc3_a52d_f07c013e7031.slice/crio-808e8c738661e7e3680ec42b75cdd277c4d5b2ece490f438908f27833bd85051 WatchSource:0}: Error finding container 808e8c738661e7e3680ec42b75cdd277c4d5b2ece490f438908f27833bd85051: Status 404 returned error can't find the container with id 808e8c738661e7e3680ec42b75cdd277c4d5b2ece490f438908f27833bd85051 Jul 05 13:19:54.657776 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.657749 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-2k7bm" Jul 05 13:19:54.829644 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:54.829578 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-2k7bm"] Jul 05 13:19:54.832302 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:19:54.832276 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d301ec_70ea_4c9f_b007_bcfb611ef3ec.slice/crio-e12fce76136e245ee0146154bbf6a337c8343e7b19ba0de2f947d53b357712b0 WatchSource:0}: Error finding container e12fce76136e245ee0146154bbf6a337c8343e7b19ba0de2f947d53b357712b0: Status 404 returned error can't find the container with id e12fce76136e245ee0146154bbf6a337c8343e7b19ba0de2f947d53b357712b0 Jul 05 13:19:55.293070 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:55.293011 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-tgc6s" event={"ID":"b6d8d93d-a638-4dc3-a52d-f07c013e7031","Type":"ContainerStarted","Data":"808e8c738661e7e3680ec42b75cdd277c4d5b2ece490f438908f27833bd85051"} Jul 05 13:19:55.295020 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:55.294995 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7c5f98f5-hdn7h" event={"ID":"4ecd256e-b380-4b5d-8fd1-1705f9c3c2ce","Type":"ContainerStarted","Data":"331c7546bc1d1de2d1bf1502c64daced2f2347b6d8352ca9f499286431435b81"} Jul 05 13:19:55.297078 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:55.297050 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-2k7bm" event={"ID":"13d301ec-70ea-4c9f-b007-bcfb611ef3ec","Type":"ContainerStarted","Data":"e12fce76136e245ee0146154bbf6a337c8343e7b19ba0de2f947d53b357712b0"} Jul 05 13:19:55.308768 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:55.308573 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 05 13:19:55.325013 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:55.324988 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/230f66ad-0649-4bdd-95ff-727814d3c024-registry-tls\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:55.463662 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:55.463629 2565 configmap.go:193] Couldn't get configMap openshift-image-registry/trusted-ca: failed to sync configmap cache: timed out waiting for the condition Jul 05 13:19:55.463796 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:55.463741 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/230f66ad-0649-4bdd-95ff-727814d3c024-trusted-ca podName:230f66ad-0649-4bdd-95ff-727814d3c024 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:55.963716893 +0000 UTC m=+89.609027347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "trusted-ca" (UniqueName: "kubernetes.io/configmap/230f66ad-0649-4bdd-95ff-727814d3c024-trusted-ca") pod "image-registry-844d586685-58vjx" (UID: "230f66ad-0649-4bdd-95ff-727814d3c024") : failed to sync configmap cache: timed out waiting for the condition Jul 05 13:19:55.464207 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:55.464043 2565 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-private-configuration: failed to sync secret cache: timed out waiting for the condition Jul 05 13:19:55.464207 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:55.464121 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/230f66ad-0649-4bdd-95ff-727814d3c024-image-registry-private-configuration podName:230f66ad-0649-4bdd-95ff-727814d3c024 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:55.964101042 +0000 UTC m=+89.609411488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "image-registry-private-configuration" (UniqueName: "kubernetes.io/secret/230f66ad-0649-4bdd-95ff-727814d3c024-image-registry-private-configuration") pod "image-registry-844d586685-58vjx" (UID: "230f66ad-0649-4bdd-95ff-727814d3c024") : failed to sync secret cache: timed out waiting for the condition Jul 05 13:19:55.464207 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:55.464154 2565 secret.go:189] Couldn't get secret openshift-image-registry/installation-pull-secrets: failed to sync secret cache: timed out waiting for the condition Jul 05 13:19:55.464207 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:19:55.464187 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/230f66ad-0649-4bdd-95ff-727814d3c024-installation-pull-secrets podName:230f66ad-0649-4bdd-95ff-727814d3c024 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:55.964176368 +0000 UTC m=+89.609486812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "installation-pull-secrets" (UniqueName: "kubernetes.io/secret/230f66ad-0649-4bdd-95ff-727814d3c024-installation-pull-secrets") pod "image-registry-844d586685-58vjx" (UID: "230f66ad-0649-4bdd-95ff-727814d3c024") : failed to sync secret cache: timed out waiting for the condition Jul 05 13:19:55.605758 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:55.605681 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 05 13:19:55.850652 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:55.850625 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 05 13:19:55.854757 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:55.854734 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-l4vdf\"" Jul 05 13:19:55.903425 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:55.903390 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 05 13:19:55.975522 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:55.975433 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/230f66ad-0649-4bdd-95ff-727814d3c024-image-registry-private-configuration\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:55.975522 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:55.975519 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/230f66ad-0649-4bdd-95ff-727814d3c024-trusted-ca\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:55.975755 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:55.975575 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/230f66ad-0649-4bdd-95ff-727814d3c024-installation-pull-secrets\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:55.976625 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:55.976595 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/230f66ad-0649-4bdd-95ff-727814d3c024-trusted-ca\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:55.978474 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:55.978453 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/230f66ad-0649-4bdd-95ff-727814d3c024-installation-pull-secrets\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:55.978603 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:55.978556 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/230f66ad-0649-4bdd-95ff-727814d3c024-image-registry-private-configuration\") pod \"image-registry-844d586685-58vjx\" (UID: \"230f66ad-0649-4bdd-95ff-727814d3c024\") " pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:56.098636 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:56.098600 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:56.921673 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:56.921646 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-844d586685-58vjx"] Jul 05 13:19:56.926092 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:19:56.926064 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod230f66ad_0649_4bdd_95ff_727814d3c024.slice/crio-901c125af442fab2e6fd390524245d472a68e272346e2a1eeeb52ce95bdcb07a WatchSource:0}: Error finding container 901c125af442fab2e6fd390524245d472a68e272346e2a1eeeb52ce95bdcb07a: Status 404 returned error can't find the container with id 901c125af442fab2e6fd390524245d472a68e272346e2a1eeeb52ce95bdcb07a Jul 05 13:19:57.309487 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:57.309447 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-tgc6s" event={"ID":"b6d8d93d-a638-4dc3-a52d-f07c013e7031","Type":"ContainerStarted","Data":"e38b53f1781768e7ec19285572798f75c982c3c28cb82954dde79e4c47e7ccb3"} Jul 05 13:19:57.311458 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:57.311418 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-844d586685-58vjx" event={"ID":"230f66ad-0649-4bdd-95ff-727814d3c024","Type":"ContainerStarted","Data":"c1bd900739df667faa584a70619a8e0902a569b91263175639ab0e60a1914e98"} Jul 05 13:19:57.311593 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:57.311481 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-844d586685-58vjx" event={"ID":"230f66ad-0649-4bdd-95ff-727814d3c024","Type":"ContainerStarted","Data":"901c125af442fab2e6fd390524245d472a68e272346e2a1eeeb52ce95bdcb07a"} Jul 05 13:19:57.311711 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:57.311691 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:19:57.325954 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:57.325890 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-tgc6s" podStartSLOduration=2.106938288 podStartE2EDuration="4.325872001s" totalImagesPullingTime="2.218933713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:57.324884328 +0000 UTC m=+90.970194820" watchObservedRunningTime="2026-07-05 13:19:57.325872001 +0000 UTC m=+90.971182466" Jul 05 13:19:57.352043 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:57.351150 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-844d586685-58vjx" podStartSLOduration=3.351128562 podStartE2EDuration="3.351128562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:57.348660889 +0000 UTC m=+90.993971378" watchObservedRunningTime="2026-07-05 13:19:57.351128562 +0000 UTC m=+90.996439025" Jul 05 13:19:58.967072 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:58.966979 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-fpz8d"] Jul 05 13:19:58.970359 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:58.970331 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fpz8d" Jul 05 13:19:58.974096 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:58.973867 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 05 13:19:58.974096 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:58.973895 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 05 13:19:58.974364 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:58.974348 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 05 13:19:58.975187 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:58.974777 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-fn7cs\"" Jul 05 13:19:58.975187 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:58.974909 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 05 13:19:58.975187 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:58.975000 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 05 13:19:58.983842 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:58.983785 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-fpz8d"] Jul 05 13:19:59.105320 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:59.105290 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75v5p\" (UniqueName: \"kubernetes.io/projected/e7cb206a-0dfc-4638-ac42-855d4ac363ad-kube-api-access-75v5p\") pod \"prometheus-operator-567f7b8b7c-fpz8d\" (UID: \"e7cb206a-0dfc-4638-ac42-855d4ac363ad\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fpz8d" Jul 05 13:19:59.105480 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:59.105347 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7cb206a-0dfc-4638-ac42-855d4ac363ad-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-fpz8d\" (UID: \"e7cb206a-0dfc-4638-ac42-855d4ac363ad\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fpz8d" Jul 05 13:19:59.105480 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:59.105425 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7cb206a-0dfc-4638-ac42-855d4ac363ad-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-fpz8d\" (UID: \"e7cb206a-0dfc-4638-ac42-855d4ac363ad\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fpz8d" Jul 05 13:19:59.105480 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:59.105465 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7cb206a-0dfc-4638-ac42-855d4ac363ad-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-fpz8d\" (UID: \"e7cb206a-0dfc-4638-ac42-855d4ac363ad\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fpz8d" Jul 05 13:19:59.206952 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:59.206868 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7cb206a-0dfc-4638-ac42-855d4ac363ad-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-fpz8d\" (UID: \"e7cb206a-0dfc-4638-ac42-855d4ac363ad\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fpz8d" Jul 05 13:19:59.206952 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:59.206920 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7cb206a-0dfc-4638-ac42-855d4ac363ad-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-fpz8d\" (UID: \"e7cb206a-0dfc-4638-ac42-855d4ac363ad\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fpz8d" Jul 05 13:19:59.207168 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:59.207146 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75v5p\" (UniqueName: \"kubernetes.io/projected/e7cb206a-0dfc-4638-ac42-855d4ac363ad-kube-api-access-75v5p\") pod \"prometheus-operator-567f7b8b7c-fpz8d\" (UID: \"e7cb206a-0dfc-4638-ac42-855d4ac363ad\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fpz8d" Jul 05 13:19:59.207232 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:59.207202 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7cb206a-0dfc-4638-ac42-855d4ac363ad-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-fpz8d\" (UID: \"e7cb206a-0dfc-4638-ac42-855d4ac363ad\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fpz8d" Jul 05 13:19:59.207969 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:59.207938 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7cb206a-0dfc-4638-ac42-855d4ac363ad-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-fpz8d\" (UID: \"e7cb206a-0dfc-4638-ac42-855d4ac363ad\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fpz8d" Jul 05 13:19:59.209659 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:59.209638 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e7cb206a-0dfc-4638-ac42-855d4ac363ad-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-fpz8d\" (UID: \"e7cb206a-0dfc-4638-ac42-855d4ac363ad\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fpz8d" Jul 05 13:19:59.209791 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:59.209770 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7cb206a-0dfc-4638-ac42-855d4ac363ad-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-fpz8d\" (UID: \"e7cb206a-0dfc-4638-ac42-855d4ac363ad\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fpz8d" Jul 05 13:19:59.216137 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:59.216005 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75v5p\" (UniqueName: \"kubernetes.io/projected/e7cb206a-0dfc-4638-ac42-855d4ac363ad-kube-api-access-75v5p\") pod \"prometheus-operator-567f7b8b7c-fpz8d\" (UID: \"e7cb206a-0dfc-4638-ac42-855d4ac363ad\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fpz8d" Jul 05 13:19:59.282279 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:59.282246 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fpz8d" Jul 05 13:19:59.321701 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:59.320863 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7c5f98f5-hdn7h" event={"ID":"4ecd256e-b380-4b5d-8fd1-1705f9c3c2ce","Type":"ContainerStarted","Data":"2dfed71db8ba1d8f40a932b01a868c27e898c331f0e7a830418cd03733d4a82a"} Jul 05 13:19:59.321701 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:59.321199 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7c5f98f5-hdn7h" Jul 05 13:19:59.323093 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:59.323070 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7c5f98f5-hdn7h" Jul 05 13:19:59.337850 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:59.337700 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7c7c5f98f5-hdn7h" podStartSLOduration=1.900788916 podStartE2EDuration="6.337683174s" totalImagesPullingTime="4.436894258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:59.336978011 +0000 UTC m=+92.982288473" watchObservedRunningTime="2026-07-05 13:19:59.337683174 +0000 UTC m=+92.982993637" Jul 05 13:19:59.435173 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:19:59.435145 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-fpz8d"] Jul 05 13:19:59.438519 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:19:59.438492 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7cb206a_0dfc_4638_ac42_855d4ac363ad.slice/crio-2457ad501a8d49fa6923a016eb70fc37c50bf895e69885d7d0beb21e25ff3f8e WatchSource:0}: Error finding container 2457ad501a8d49fa6923a016eb70fc37c50bf895e69885d7d0beb21e25ff3f8e: Status 404 returned error can't find the container with id 2457ad501a8d49fa6923a016eb70fc37c50bf895e69885d7d0beb21e25ff3f8e Jul 05 13:20:00.326886 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:00.326841 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fpz8d" event={"ID":"e7cb206a-0dfc-4638-ac42-855d4ac363ad","Type":"ContainerStarted","Data":"2457ad501a8d49fa6923a016eb70fc37c50bf895e69885d7d0beb21e25ff3f8e"} Jul 05 13:20:01.332896 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:01.332856 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fpz8d" event={"ID":"e7cb206a-0dfc-4638-ac42-855d4ac363ad","Type":"ContainerStarted","Data":"0342bc14560544932da51262cb8f20ef790b036f04628c9a998970ddf1022b4a"} Jul 05 13:20:01.333338 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:01.332923 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fpz8d" event={"ID":"e7cb206a-0dfc-4638-ac42-855d4ac363ad","Type":"ContainerStarted","Data":"e7b7dcb99fad4054795598730462bbc8721a6da81ad0f4f9782297d8d68fe552"} Jul 05 13:20:01.351676 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:01.351627 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-fpz8d" podStartSLOduration=2.196493424 podStartE2EDuration="3.351610831s" totalImagesPullingTime="1.155117407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:01.350915719 +0000 UTC m=+94.996226211" watchObservedRunningTime="2026-07-05 13:20:01.351610831 +0000 UTC m=+94.996921294" Jul 05 13:20:03.939414 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:03.939373 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-x4c49"] Jul 05 13:20:03.945462 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:03.944910 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-x4c49" Jul 05 13:20:03.955030 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:03.954753 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 05 13:20:03.955030 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:03.954779 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 05 13:20:03.955030 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:03.954932 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-52vsv\"" Jul 05 13:20:04.011560 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.011526 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-x4c49"] Jul 05 13:20:04.051163 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.051122 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56f3c6e2-24e9-4ecf-a08c-4805372e3da0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-x4c49\" (UID: \"56f3c6e2-24e9-4ecf-a08c-4805372e3da0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-x4c49" Jul 05 13:20:04.051895 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.051184 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56f3c6e2-24e9-4ecf-a08c-4805372e3da0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-x4c49\" (UID: \"56f3c6e2-24e9-4ecf-a08c-4805372e3da0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-x4c49" Jul 05 13:20:04.051895 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.051217 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrbzv\" (UniqueName: \"kubernetes.io/projected/56f3c6e2-24e9-4ecf-a08c-4805372e3da0-kube-api-access-vrbzv\") pod \"openshift-state-metrics-54cf96dfcf-x4c49\" (UID: \"56f3c6e2-24e9-4ecf-a08c-4805372e3da0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-x4c49" Jul 05 13:20:04.051895 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.051247 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56f3c6e2-24e9-4ecf-a08c-4805372e3da0-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-x4c49\" (UID: \"56f3c6e2-24e9-4ecf-a08c-4805372e3da0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-x4c49" Jul 05 13:20:04.151871 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.151835 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56f3c6e2-24e9-4ecf-a08c-4805372e3da0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-x4c49\" (UID: \"56f3c6e2-24e9-4ecf-a08c-4805372e3da0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-x4c49" Jul 05 13:20:04.152040 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.151884 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrbzv\" (UniqueName: \"kubernetes.io/projected/56f3c6e2-24e9-4ecf-a08c-4805372e3da0-kube-api-access-vrbzv\") pod \"openshift-state-metrics-54cf96dfcf-x4c49\" (UID: \"56f3c6e2-24e9-4ecf-a08c-4805372e3da0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-x4c49" Jul 05 13:20:04.152040 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.151918 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56f3c6e2-24e9-4ecf-a08c-4805372e3da0-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-x4c49\" (UID: \"56f3c6e2-24e9-4ecf-a08c-4805372e3da0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-x4c49" Jul 05 13:20:04.152040 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.152010 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56f3c6e2-24e9-4ecf-a08c-4805372e3da0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-x4c49\" (UID: \"56f3c6e2-24e9-4ecf-a08c-4805372e3da0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-x4c49" Jul 05 13:20:04.152862 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.152787 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56f3c6e2-24e9-4ecf-a08c-4805372e3da0-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-x4c49\" (UID: \"56f3c6e2-24e9-4ecf-a08c-4805372e3da0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-x4c49" Jul 05 13:20:04.154701 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.154681 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56f3c6e2-24e9-4ecf-a08c-4805372e3da0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-x4c49\" (UID: \"56f3c6e2-24e9-4ecf-a08c-4805372e3da0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-x4c49" Jul 05 13:20:04.154786 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.154714 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/56f3c6e2-24e9-4ecf-a08c-4805372e3da0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-x4c49\" (UID: \"56f3c6e2-24e9-4ecf-a08c-4805372e3da0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-x4c49" Jul 05 13:20:04.165862 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.165783 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t7b2m"] Jul 05 13:20:04.169634 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.169613 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.173168 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.173098 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 05 13:20:04.173282 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.173253 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 05 13:20:04.173509 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.173492 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 05 13:20:04.174221 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.174203 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wrggj\"" Jul 05 13:20:04.182918 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.182901 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrbzv\" (UniqueName: \"kubernetes.io/projected/56f3c6e2-24e9-4ecf-a08c-4805372e3da0-kube-api-access-vrbzv\") pod \"openshift-state-metrics-54cf96dfcf-x4c49\" (UID: \"56f3c6e2-24e9-4ecf-a08c-4805372e3da0\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-x4c49" Jul 05 13:20:04.256529 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.256450 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-x4c49" Jul 05 13:20:04.353726 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.353388 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c6e15d8-a41b-456e-941b-e946fe1fe519-node-exporter-tls\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.353916 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.353900 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c6e15d8-a41b-456e-941b-e946fe1fe519-metrics-client-ca\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.354034 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.354021 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c6e15d8-a41b-456e-941b-e946fe1fe519-node-exporter-wtmp\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.354152 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.354139 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c6e15d8-a41b-456e-941b-e946fe1fe519-node-exporter-accelerators-collector-config\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.354240 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.354228 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfz2g\" (UniqueName: \"kubernetes.io/projected/0c6e15d8-a41b-456e-941b-e946fe1fe519-kube-api-access-nfz2g\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.354607 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.354374 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c6e15d8-a41b-456e-941b-e946fe1fe519-root\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.354607 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.354414 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c6e15d8-a41b-456e-941b-e946fe1fe519-node-exporter-textfile\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.354607 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.354445 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c6e15d8-a41b-456e-941b-e946fe1fe519-sys\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.354607 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.354494 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c6e15d8-a41b-456e-941b-e946fe1fe519-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.443968 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.443802 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-x4c49"] Jul 05 13:20:04.446720 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:20:04.446695 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56f3c6e2_24e9_4ecf_a08c_4805372e3da0.slice/crio-8303d5ce1a48940d26ab744739dea3c70d6901ce051f947d75b94c8498f1504b WatchSource:0}: Error finding container 8303d5ce1a48940d26ab744739dea3c70d6901ce051f947d75b94c8498f1504b: Status 404 returned error can't find the container with id 8303d5ce1a48940d26ab744739dea3c70d6901ce051f947d75b94c8498f1504b Jul 05 13:20:04.455251 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.455223 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c6e15d8-a41b-456e-941b-e946fe1fe519-node-exporter-tls\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.455353 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.455269 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c6e15d8-a41b-456e-941b-e946fe1fe519-metrics-client-ca\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.455353 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.455298 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c6e15d8-a41b-456e-941b-e946fe1fe519-node-exporter-wtmp\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.455353 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.455339 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c6e15d8-a41b-456e-941b-e946fe1fe519-node-exporter-accelerators-collector-config\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.455524 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.455364 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfz2g\" (UniqueName: \"kubernetes.io/projected/0c6e15d8-a41b-456e-941b-e946fe1fe519-kube-api-access-nfz2g\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.455524 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.455420 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c6e15d8-a41b-456e-941b-e946fe1fe519-root\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.455524 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.455443 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c6e15d8-a41b-456e-941b-e946fe1fe519-node-exporter-textfile\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.455524 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.455480 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c6e15d8-a41b-456e-941b-e946fe1fe519-sys\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.455788 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.455526 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c6e15d8-a41b-456e-941b-e946fe1fe519-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.455907 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.455886 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c6e15d8-a41b-456e-941b-e946fe1fe519-node-exporter-wtmp\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.455972 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.455937 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c6e15d8-a41b-456e-941b-e946fe1fe519-metrics-client-ca\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.456074 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.456049 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c6e15d8-a41b-456e-941b-e946fe1fe519-sys\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.456139 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.456121 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c6e15d8-a41b-456e-941b-e946fe1fe519-root\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.456204 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.456170 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c6e15d8-a41b-456e-941b-e946fe1fe519-node-exporter-textfile\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.456394 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.456372 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c6e15d8-a41b-456e-941b-e946fe1fe519-node-exporter-accelerators-collector-config\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.457935 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.457890 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c6e15d8-a41b-456e-941b-e946fe1fe519-node-exporter-tls\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.458050 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.458031 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c6e15d8-a41b-456e-941b-e946fe1fe519-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.467057 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.467030 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfz2g\" (UniqueName: \"kubernetes.io/projected/0c6e15d8-a41b-456e-941b-e946fe1fe519-kube-api-access-nfz2g\") pod \"node-exporter-t7b2m\" (UID: \"0c6e15d8-a41b-456e-941b-e946fe1fe519\") " pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:04.481649 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:04.481624 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t7b2m" Jul 05 13:20:05.355243 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:05.355208 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-x4c49" event={"ID":"56f3c6e2-24e9-4ecf-a08c-4805372e3da0","Type":"ContainerStarted","Data":"de46f57095e572aab9785f9236bc8d5a067ba670b628556c768526322bc18d65"} Jul 05 13:20:05.355663 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:05.355265 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-x4c49" event={"ID":"56f3c6e2-24e9-4ecf-a08c-4805372e3da0","Type":"ContainerStarted","Data":"8303d5ce1a48940d26ab744739dea3c70d6901ce051f947d75b94c8498f1504b"} Jul 05 13:20:07.357074 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.357031 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-66589bf544-trlq9"] Jul 05 13:20:07.361103 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.361081 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:07.367518 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.367484 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 05 13:20:07.368171 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.368106 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 05 13:20:07.368171 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.368157 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 05 13:20:07.369124 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.368969 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 05 13:20:07.369124 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.368971 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 05 13:20:07.369124 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.368997 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pf7xz\"" Jul 05 13:20:07.369124 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.369013 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2vksl7v08bjdn\"" Jul 05 13:20:07.392796 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.392767 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66589bf544-trlq9"] Jul 05 13:20:07.482042 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.482004 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3db82445-c6d6-4705-92ec-340d40fac6c6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66589bf544-trlq9\" (UID: \"3db82445-c6d6-4705-92ec-340d40fac6c6\") " pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:07.482042 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.482040 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3db82445-c6d6-4705-92ec-340d40fac6c6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66589bf544-trlq9\" (UID: \"3db82445-c6d6-4705-92ec-340d40fac6c6\") " pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:07.482297 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.482070 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgp5v\" (UniqueName: \"kubernetes.io/projected/3db82445-c6d6-4705-92ec-340d40fac6c6-kube-api-access-cgp5v\") pod \"thanos-querier-66589bf544-trlq9\" (UID: \"3db82445-c6d6-4705-92ec-340d40fac6c6\") " pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:07.482297 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.482097 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3db82445-c6d6-4705-92ec-340d40fac6c6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66589bf544-trlq9\" (UID: \"3db82445-c6d6-4705-92ec-340d40fac6c6\") " pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:07.482297 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.482152 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3db82445-c6d6-4705-92ec-340d40fac6c6-metrics-client-ca\") pod \"thanos-querier-66589bf544-trlq9\" (UID: \"3db82445-c6d6-4705-92ec-340d40fac6c6\") " pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:07.482297 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.482172 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3db82445-c6d6-4705-92ec-340d40fac6c6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66589bf544-trlq9\" (UID: \"3db82445-c6d6-4705-92ec-340d40fac6c6\") " pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:07.482297 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.482194 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3db82445-c6d6-4705-92ec-340d40fac6c6-secret-thanos-querier-tls\") pod \"thanos-querier-66589bf544-trlq9\" (UID: \"3db82445-c6d6-4705-92ec-340d40fac6c6\") " pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:07.482297 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.482246 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3db82445-c6d6-4705-92ec-340d40fac6c6-secret-grpc-tls\") pod \"thanos-querier-66589bf544-trlq9\" (UID: \"3db82445-c6d6-4705-92ec-340d40fac6c6\") " pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:07.583245 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.583206 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3db82445-c6d6-4705-92ec-340d40fac6c6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66589bf544-trlq9\" (UID: \"3db82445-c6d6-4705-92ec-340d40fac6c6\") " pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:07.583430 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.583255 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3db82445-c6d6-4705-92ec-340d40fac6c6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66589bf544-trlq9\" (UID: \"3db82445-c6d6-4705-92ec-340d40fac6c6\") " pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:07.583430 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.583294 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgp5v\" (UniqueName: \"kubernetes.io/projected/3db82445-c6d6-4705-92ec-340d40fac6c6-kube-api-access-cgp5v\") pod \"thanos-querier-66589bf544-trlq9\" (UID: \"3db82445-c6d6-4705-92ec-340d40fac6c6\") " pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:07.583430 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.583324 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3db82445-c6d6-4705-92ec-340d40fac6c6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66589bf544-trlq9\" (UID: \"3db82445-c6d6-4705-92ec-340d40fac6c6\") " pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:07.585663 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.584316 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3db82445-c6d6-4705-92ec-340d40fac6c6-metrics-client-ca\") pod \"thanos-querier-66589bf544-trlq9\" (UID: \"3db82445-c6d6-4705-92ec-340d40fac6c6\") " pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:07.585663 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.584363 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3db82445-c6d6-4705-92ec-340d40fac6c6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66589bf544-trlq9\" (UID: \"3db82445-c6d6-4705-92ec-340d40fac6c6\") " pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:07.585663 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.584399 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3db82445-c6d6-4705-92ec-340d40fac6c6-secret-thanos-querier-tls\") pod \"thanos-querier-66589bf544-trlq9\" (UID: \"3db82445-c6d6-4705-92ec-340d40fac6c6\") " pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:07.585663 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.584492 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3db82445-c6d6-4705-92ec-340d40fac6c6-secret-grpc-tls\") pod \"thanos-querier-66589bf544-trlq9\" (UID: \"3db82445-c6d6-4705-92ec-340d40fac6c6\") " pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:07.585663 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.585616 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3db82445-c6d6-4705-92ec-340d40fac6c6-metrics-client-ca\") pod \"thanos-querier-66589bf544-trlq9\" (UID: \"3db82445-c6d6-4705-92ec-340d40fac6c6\") " pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:07.587665 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.587640 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3db82445-c6d6-4705-92ec-340d40fac6c6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66589bf544-trlq9\" (UID: \"3db82445-c6d6-4705-92ec-340d40fac6c6\") " pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:07.588100 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.588077 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3db82445-c6d6-4705-92ec-340d40fac6c6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66589bf544-trlq9\" (UID: \"3db82445-c6d6-4705-92ec-340d40fac6c6\") " pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:07.588392 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.588370 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3db82445-c6d6-4705-92ec-340d40fac6c6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66589bf544-trlq9\" (UID: \"3db82445-c6d6-4705-92ec-340d40fac6c6\") " pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:07.588470 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.588449 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3db82445-c6d6-4705-92ec-340d40fac6c6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66589bf544-trlq9\" (UID: \"3db82445-c6d6-4705-92ec-340d40fac6c6\") " pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:07.589739 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.589715 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3db82445-c6d6-4705-92ec-340d40fac6c6-secret-thanos-querier-tls\") pod \"thanos-querier-66589bf544-trlq9\" (UID: \"3db82445-c6d6-4705-92ec-340d40fac6c6\") " pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:07.590061 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.590041 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3db82445-c6d6-4705-92ec-340d40fac6c6-secret-grpc-tls\") pod \"thanos-querier-66589bf544-trlq9\" (UID: \"3db82445-c6d6-4705-92ec-340d40fac6c6\") " pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:07.603384 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.603281 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgp5v\" (UniqueName: \"kubernetes.io/projected/3db82445-c6d6-4705-92ec-340d40fac6c6-kube-api-access-cgp5v\") pod \"thanos-querier-66589bf544-trlq9\" (UID: \"3db82445-c6d6-4705-92ec-340d40fac6c6\") " pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:07.673434 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:07.673396 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:08.625169 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.625136 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d9fbf8f76-bssr2"] Jul 05 13:20:08.633133 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.633097 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d9fbf8f76-bssr2" Jul 05 13:20:08.643161 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.643141 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 05 13:20:08.643640 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.643616 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 05 13:20:08.643924 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.643904 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 05 13:20:08.644153 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.644137 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 05 13:20:08.645114 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.645069 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mnslj\"" Jul 05 13:20:08.665009 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.664978 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 05 13:20:08.695796 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.695733 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d9fbf8f76-bssr2"] Jul 05 13:20:08.718739 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.718704 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 05 13:20:08.795191 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.795153 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd135cd6-3f42-4087-98c3-746010f1c228-console-config\") pod \"console-7d9fbf8f76-bssr2\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " pod="openshift-console/console-7d9fbf8f76-bssr2" Jul 05 13:20:08.795358 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.795213 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6b7s\" (UniqueName: \"kubernetes.io/projected/cd135cd6-3f42-4087-98c3-746010f1c228-kube-api-access-b6b7s\") pod \"console-7d9fbf8f76-bssr2\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " pod="openshift-console/console-7d9fbf8f76-bssr2" Jul 05 13:20:08.795358 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.795302 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd135cd6-3f42-4087-98c3-746010f1c228-oauth-serving-cert\") pod \"console-7d9fbf8f76-bssr2\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " pod="openshift-console/console-7d9fbf8f76-bssr2" Jul 05 13:20:08.795477 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.795372 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd135cd6-3f42-4087-98c3-746010f1c228-trusted-ca-bundle\") pod \"console-7d9fbf8f76-bssr2\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " pod="openshift-console/console-7d9fbf8f76-bssr2" Jul 05 13:20:08.795477 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.795411 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd135cd6-3f42-4087-98c3-746010f1c228-console-serving-cert\") pod \"console-7d9fbf8f76-bssr2\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " pod="openshift-console/console-7d9fbf8f76-bssr2" Jul 05 13:20:08.795642 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.795479 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd135cd6-3f42-4087-98c3-746010f1c228-console-oauth-config\") pod \"console-7d9fbf8f76-bssr2\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " pod="openshift-console/console-7d9fbf8f76-bssr2" Jul 05 13:20:08.795642 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.795556 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd135cd6-3f42-4087-98c3-746010f1c228-service-ca\") pod \"console-7d9fbf8f76-bssr2\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " pod="openshift-console/console-7d9fbf8f76-bssr2" Jul 05 13:20:08.896559 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.896517 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd135cd6-3f42-4087-98c3-746010f1c228-service-ca\") pod \"console-7d9fbf8f76-bssr2\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " pod="openshift-console/console-7d9fbf8f76-bssr2" Jul 05 13:20:08.896559 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.896555 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd135cd6-3f42-4087-98c3-746010f1c228-console-config\") pod \"console-7d9fbf8f76-bssr2\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " pod="openshift-console/console-7d9fbf8f76-bssr2" Jul 05 13:20:08.896834 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.896594 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6b7s\" (UniqueName: \"kubernetes.io/projected/cd135cd6-3f42-4087-98c3-746010f1c228-kube-api-access-b6b7s\") pod \"console-7d9fbf8f76-bssr2\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " pod="openshift-console/console-7d9fbf8f76-bssr2" Jul 05 13:20:08.896834 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.896632 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd135cd6-3f42-4087-98c3-746010f1c228-oauth-serving-cert\") pod \"console-7d9fbf8f76-bssr2\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " pod="openshift-console/console-7d9fbf8f76-bssr2" Jul 05 13:20:08.896834 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.896674 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd135cd6-3f42-4087-98c3-746010f1c228-trusted-ca-bundle\") pod \"console-7d9fbf8f76-bssr2\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " pod="openshift-console/console-7d9fbf8f76-bssr2" Jul 05 13:20:08.896988 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.896864 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd135cd6-3f42-4087-98c3-746010f1c228-console-serving-cert\") pod \"console-7d9fbf8f76-bssr2\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " pod="openshift-console/console-7d9fbf8f76-bssr2" Jul 05 13:20:08.896988 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.896947 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd135cd6-3f42-4087-98c3-746010f1c228-console-oauth-config\") pod \"console-7d9fbf8f76-bssr2\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " pod="openshift-console/console-7d9fbf8f76-bssr2" Jul 05 13:20:08.897434 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.897404 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd135cd6-3f42-4087-98c3-746010f1c228-service-ca\") pod \"console-7d9fbf8f76-bssr2\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " pod="openshift-console/console-7d9fbf8f76-bssr2" Jul 05 13:20:08.897546 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.897446 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd135cd6-3f42-4087-98c3-746010f1c228-console-config\") pod \"console-7d9fbf8f76-bssr2\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " pod="openshift-console/console-7d9fbf8f76-bssr2" Jul 05 13:20:08.897546 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.897450 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd135cd6-3f42-4087-98c3-746010f1c228-oauth-serving-cert\") pod \"console-7d9fbf8f76-bssr2\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " pod="openshift-console/console-7d9fbf8f76-bssr2" Jul 05 13:20:08.897709 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.897682 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd135cd6-3f42-4087-98c3-746010f1c228-trusted-ca-bundle\") pod \"console-7d9fbf8f76-bssr2\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " pod="openshift-console/console-7d9fbf8f76-bssr2" Jul 05 13:20:08.899934 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.899912 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd135cd6-3f42-4087-98c3-746010f1c228-console-serving-cert\") pod \"console-7d9fbf8f76-bssr2\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " pod="openshift-console/console-7d9fbf8f76-bssr2" Jul 05 13:20:08.900038 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.899943 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd135cd6-3f42-4087-98c3-746010f1c228-console-oauth-config\") pod \"console-7d9fbf8f76-bssr2\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " pod="openshift-console/console-7d9fbf8f76-bssr2" Jul 05 13:20:08.939699 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.939666 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6b7s\" (UniqueName: \"kubernetes.io/projected/cd135cd6-3f42-4087-98c3-746010f1c228-kube-api-access-b6b7s\") pod \"console-7d9fbf8f76-bssr2\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " pod="openshift-console/console-7d9fbf8f76-bssr2" Jul 05 13:20:08.944385 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:08.944314 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d9fbf8f76-bssr2" Jul 05 13:20:09.228505 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:09.228428 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n9xhq" Jul 05 13:20:11.935630 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:20:11.935566 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c6e15d8_a41b_456e_941b_e946fe1fe519.slice/crio-4c201391bbaae588ce8826f136a03e978ea11a704a5e797aa0d15dd33a802d93 WatchSource:0}: Error finding container 4c201391bbaae588ce8826f136a03e978ea11a704a5e797aa0d15dd33a802d93: Status 404 returned error can't find the container with id 4c201391bbaae588ce8826f136a03e978ea11a704a5e797aa0d15dd33a802d93 Jul 05 13:20:12.177108 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:12.177085 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d9fbf8f76-bssr2"] Jul 05 13:20:12.194464 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:12.192693 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66589bf544-trlq9"] Jul 05 13:20:12.247540 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:20:12.247504 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3db82445_c6d6_4705_92ec_340d40fac6c6.slice/crio-e497c610445dc188cacacceeade7a939864e60628e9d1eba513157d423294479 WatchSource:0}: Error finding container e497c610445dc188cacacceeade7a939864e60628e9d1eba513157d423294479: Status 404 returned error can't find the container with id e497c610445dc188cacacceeade7a939864e60628e9d1eba513157d423294479 Jul 05 13:20:12.248100 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:20:12.248073 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd135cd6_3f42_4087_98c3_746010f1c228.slice/crio-946a45fd1f475ffc8584c86138bd6f8591435c7d82162ce1c221f98345e71144 WatchSource:0}: Error finding container 946a45fd1f475ffc8584c86138bd6f8591435c7d82162ce1c221f98345e71144: Status 404 returned error can't find the container with id 946a45fd1f475ffc8584c86138bd6f8591435c7d82162ce1c221f98345e71144 Jul 05 13:20:12.386104 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:12.386069 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d9fbf8f76-bssr2" event={"ID":"cd135cd6-3f42-4087-98c3-746010f1c228","Type":"ContainerStarted","Data":"946a45fd1f475ffc8584c86138bd6f8591435c7d82162ce1c221f98345e71144"} Jul 05 13:20:12.387494 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:12.387453 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" event={"ID":"3db82445-c6d6-4705-92ec-340d40fac6c6","Type":"ContainerStarted","Data":"e497c610445dc188cacacceeade7a939864e60628e9d1eba513157d423294479"} Jul 05 13:20:12.389305 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:12.389278 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-2k7bm" event={"ID":"13d301ec-70ea-4c9f-b007-bcfb611ef3ec","Type":"ContainerStarted","Data":"7b919c6b0afbfc1c847a918fecd41af497876c1a735b2c3ff8a9576547dcf02c"} Jul 05 13:20:12.389585 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:12.389568 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-2k7bm" Jul 05 13:20:12.390870 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:12.390842 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t7b2m" event={"ID":"0c6e15d8-a41b-456e-941b-e946fe1fe519","Type":"ContainerStarted","Data":"4c201391bbaae588ce8826f136a03e978ea11a704a5e797aa0d15dd33a802d93"} Jul 05 13:20:12.391049 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:12.391022 2565 patch_prober.go:28] interesting pod/downloads-685bfb5f64-2k7bm container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.15:8080/\": dial tcp 10.134.0.15:8080: connect: connection refused" start-of-body= Jul 05 13:20:12.391120 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:12.391071 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-685bfb5f64-2k7bm" podUID="13d301ec-70ea-4c9f-b007-bcfb611ef3ec" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.15:8080/\": dial tcp 10.134.0.15:8080: connect: connection refused" Jul 05 13:20:12.392840 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:12.392794 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-x4c49" event={"ID":"56f3c6e2-24e9-4ecf-a08c-4805372e3da0","Type":"ContainerStarted","Data":"215482d0ccf73e1dbe187a2ea57781dca96fc695580e6107187e7a80e56c3044"} Jul 05 13:20:13.409403 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:13.409360 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-2k7bm" Jul 05 13:20:13.487630 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:13.486726 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-2k7bm" podStartSLOduration=3.022240731 podStartE2EDuration="20.486699935s" totalImagesPullingTime="17.464459204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:12.582787213 +0000 UTC m=+106.228097702" watchObservedRunningTime="2026-07-05 13:20:13.486699935 +0000 UTC m=+107.132010399" Jul 05 13:20:14.166473 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:14.166383 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d9fbf8f76-bssr2"] Jul 05 13:20:14.407349 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:14.407078 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t7b2m" event={"ID":"0c6e15d8-a41b-456e-941b-e946fe1fe519","Type":"ContainerStarted","Data":"3c5f4fcdd4549472981205772223fdc4bb474ca0070cd6eedaded102448754f0"} Jul 05 13:20:15.415482 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:15.415439 2565 generic.go:356] "Generic (PLEG): container finished" podID="0c6e15d8-a41b-456e-941b-e946fe1fe519" containerID="3c5f4fcdd4549472981205772223fdc4bb474ca0070cd6eedaded102448754f0" exitCode=0 Jul 05 13:20:15.416009 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:15.415559 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t7b2m" event={"ID":"0c6e15d8-a41b-456e-941b-e946fe1fe519","Type":"ContainerDied","Data":"3c5f4fcdd4549472981205772223fdc4bb474ca0070cd6eedaded102448754f0"} Jul 05 13:20:15.420706 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:15.420675 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-x4c49" event={"ID":"56f3c6e2-24e9-4ecf-a08c-4805372e3da0","Type":"ContainerStarted","Data":"7cb4c4e1db1f8c336773224d7b1a019363a056f3c51fce373dee94b83e0aa8fd"} Jul 05 13:20:17.432690 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:17.432657 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" event={"ID":"3db82445-c6d6-4705-92ec-340d40fac6c6","Type":"ContainerStarted","Data":"40db94fa634228e8ca0fae17b902df11b7c8007864816c38728ba6632eef24c3"} Jul 05 13:20:17.433101 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:17.432746 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" event={"ID":"3db82445-c6d6-4705-92ec-340d40fac6c6","Type":"ContainerStarted","Data":"10d60048be271c5410048d336d8a58e68bc910e7cf60f20c889a11d81c1df8bd"} Jul 05 13:20:17.435009 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:17.434980 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t7b2m" event={"ID":"0c6e15d8-a41b-456e-941b-e946fe1fe519","Type":"ContainerStarted","Data":"8aada552cab372b384c782fdc18ad43724914980f912bc78f0b7896e024f29be"} Jul 05 13:20:18.321110 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:18.321079 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-844d586685-58vjx" Jul 05 13:20:18.354438 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:18.354387 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-x4c49" podStartSLOduration=13.407847872 podStartE2EDuration="15.354368578s" totalImagesPullingTime="1.946520706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:20:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:15.472238181 +0000 UTC m=+109.117548663" watchObservedRunningTime="2026-07-05 13:20:18.354368578 +0000 UTC m=+111.999679250" Jul 05 13:20:18.441136 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:18.440878 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d9fbf8f76-bssr2" event={"ID":"cd135cd6-3f42-4087-98c3-746010f1c228","Type":"ContainerStarted","Data":"b6bfcef6736327a635dd4b3ec4fd793d6e31db5bba192b1d48ee7e39c58240b0"} Jul 05 13:20:18.449202 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:18.449074 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" event={"ID":"3db82445-c6d6-4705-92ec-340d40fac6c6","Type":"ContainerStarted","Data":"6f8c2f14566876f61f8bad827e00d903a7e233b17970699a8c0dbccb9852e8dc"} Jul 05 13:20:18.451918 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:18.451893 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t7b2m" event={"ID":"0c6e15d8-a41b-456e-941b-e946fe1fe519","Type":"ContainerStarted","Data":"aebbbad063855b1f454e002a9cfaf0f6e949f4c7f14c22ba0e25c3c646e6f1e4"} Jul 05 13:20:18.482268 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:18.482212 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d9fbf8f76-bssr2" podStartSLOduration=5.337526111 podStartE2EDuration="10.482191178s" totalImagesPullingTime="5.144665067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:20:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:18.478589727 +0000 UTC m=+112.123900191" watchObservedRunningTime="2026-07-05 13:20:18.482191178 +0000 UTC m=+112.127501643" Jul 05 13:20:18.510752 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:18.510702 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t7b2m" podStartSLOduration=12.32482864 podStartE2EDuration="14.510682241s" totalImagesPullingTime="2.049203612s" totalInitContainerRuntime="136.649989ms" isStatefulPod=true podCreationTimestamp="2026-07-05 13:20:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:18.50912539 +0000 UTC m=+112.154435880" watchObservedRunningTime="2026-07-05 13:20:18.510682241 +0000 UTC m=+112.155992706" Jul 05 13:20:18.944491 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:18.944462 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d9fbf8f76-bssr2" Jul 05 13:20:19.459459 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:19.459415 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" event={"ID":"3db82445-c6d6-4705-92ec-340d40fac6c6","Type":"ContainerStarted","Data":"580a7a2375750f6c5e89f22d6fa4c1645355c87b7a6bd7a9066e0bab948fcf27"} Jul 05 13:20:19.459937 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:19.459528 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" event={"ID":"3db82445-c6d6-4705-92ec-340d40fac6c6","Type":"ContainerStarted","Data":"f84328cf9f1183f07bbcbfeb57c249f214577df7afc6e5a9a5fb7c9e4d9cc89d"} Jul 05 13:20:19.459937 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:19.459562 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" event={"ID":"3db82445-c6d6-4705-92ec-340d40fac6c6","Type":"ContainerStarted","Data":"bf1e843396ffab9f2363331847bf21960d9ff257ed1844ef5b51908d25f6a179"} Jul 05 13:20:20.464131 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:20.464095 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:26.474378 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:26.474349 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" Jul 05 13:20:26.507415 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:26.507367 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-66589bf544-trlq9" podStartSLOduration=13.417316489 podStartE2EDuration="19.507352864s" totalImagesPullingTime="6.090036375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:20:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:19.50685113 +0000 UTC m=+113.152161618" watchObservedRunningTime="2026-07-05 13:20:26.507352864 +0000 UTC m=+120.152663327" Jul 05 13:20:35.623122 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:35.623086 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs\") pod \"network-metrics-daemon-fsfvp\" (UID: \"d06fcb3d-95c9-4837-8b5f-f8455c806cf3\") " pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:20:35.625314 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:35.625294 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d06fcb3d-95c9-4837-8b5f-f8455c806cf3-metrics-certs\") pod \"network-metrics-daemon-fsfvp\" (UID: \"d06fcb3d-95c9-4837-8b5f-f8455c806cf3\") " pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:20:35.733579 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:35.733549 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f7gg6\"" Jul 05 13:20:35.741624 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:35.741603 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsfvp" Jul 05 13:20:35.896767 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:35.896739 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fsfvp"] Jul 05 13:20:35.899136 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:20:35.899112 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd06fcb3d_95c9_4837_8b5f_f8455c806cf3.slice/crio-24546c4aaaee66ae05b2a23c43f61fcefb5368c9627c5ded80ca98f826ee922d WatchSource:0}: Error finding container 24546c4aaaee66ae05b2a23c43f61fcefb5368c9627c5ded80ca98f826ee922d: Status 404 returned error can't find the container with id 24546c4aaaee66ae05b2a23c43f61fcefb5368c9627c5ded80ca98f826ee922d Jul 05 13:20:36.524494 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:36.524456 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fsfvp" event={"ID":"d06fcb3d-95c9-4837-8b5f-f8455c806cf3","Type":"ContainerStarted","Data":"24546c4aaaee66ae05b2a23c43f61fcefb5368c9627c5ded80ca98f826ee922d"} Jul 05 13:20:37.529922 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:37.529886 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fsfvp" event={"ID":"d06fcb3d-95c9-4837-8b5f-f8455c806cf3","Type":"ContainerStarted","Data":"542c475e6029c8f6dab4c6ba1663581def3bebfcf240b4d4c984c6e0ea03c0d7"} Jul 05 13:20:37.530322 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:37.529948 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fsfvp" event={"ID":"d06fcb3d-95c9-4837-8b5f-f8455c806cf3","Type":"ContainerStarted","Data":"4dedc8e0d84780d817837cc7441b5af1565e00a3c720ed68e8f543d41b9c1584"} Jul 05 13:20:37.548484 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:37.548439 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fsfvp" podStartSLOduration=130.226961082 podStartE2EDuration="2m11.548424738s" totalImagesPullingTime="1.321463656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:18:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:37.547450663 +0000 UTC m=+131.192761129" watchObservedRunningTime="2026-07-05 13:20:37.548424738 +0000 UTC m=+131.193735200" Jul 05 13:20:38.539951 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:38.539920 2565 generic.go:356] "Generic (PLEG): container finished" podID="753a929c-de9b-4a2c-bbb4-7310e1fd0b2b" containerID="ccbc6bd48e6f2c4423a3bd44d85e688562152e94bf7a7c3a29856dac5c4c9da0" exitCode=0 Jul 05 13:20:38.540324 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:38.540003 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-74ktv" event={"ID":"753a929c-de9b-4a2c-bbb4-7310e1fd0b2b","Type":"ContainerDied","Data":"ccbc6bd48e6f2c4423a3bd44d85e688562152e94bf7a7c3a29856dac5c4c9da0"} Jul 05 13:20:38.540421 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:38.540403 2565 scope.go:117] "RemoveContainer" containerID="ccbc6bd48e6f2c4423a3bd44d85e688562152e94bf7a7c3a29856dac5c4c9da0" Jul 05 13:20:39.544867 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:39.544836 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-74ktv" event={"ID":"753a929c-de9b-4a2c-bbb4-7310e1fd0b2b","Type":"ContainerStarted","Data":"a226f3015e58eb13353caa9d53fe7fec4f1c8aba6eb7c6f12b045db7052ab7d6"} Jul 05 13:20:43.466689 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:43.466638 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7d9fbf8f76-bssr2" podUID="cd135cd6-3f42-4087-98c3-746010f1c228" containerName="console" containerID="cri-o://b6bfcef6736327a635dd4b3ec4fd793d6e31db5bba192b1d48ee7e39c58240b0" gracePeriod=15 Jul 05 13:20:43.759591 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:43.759563 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d9fbf8f76-bssr2" Jul 05 13:20:43.892402 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:43.892364 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd135cd6-3f42-4087-98c3-746010f1c228-console-serving-cert\") pod \"cd135cd6-3f42-4087-98c3-746010f1c228\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " Jul 05 13:20:43.892573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:43.892414 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd135cd6-3f42-4087-98c3-746010f1c228-oauth-serving-cert\") pod \"cd135cd6-3f42-4087-98c3-746010f1c228\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " Jul 05 13:20:43.892573 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:43.892450 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6b7s\" (UniqueName: \"kubernetes.io/projected/cd135cd6-3f42-4087-98c3-746010f1c228-kube-api-access-b6b7s\") pod \"cd135cd6-3f42-4087-98c3-746010f1c228\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " Jul 05 13:20:43.892658 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:43.892566 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd135cd6-3f42-4087-98c3-746010f1c228-console-config\") pod \"cd135cd6-3f42-4087-98c3-746010f1c228\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " Jul 05 13:20:43.892658 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:43.892636 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd135cd6-3f42-4087-98c3-746010f1c228-console-oauth-config\") pod \"cd135cd6-3f42-4087-98c3-746010f1c228\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " Jul 05 13:20:43.892745 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:43.892678 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd135cd6-3f42-4087-98c3-746010f1c228-trusted-ca-bundle\") pod \"cd135cd6-3f42-4087-98c3-746010f1c228\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " Jul 05 13:20:43.892745 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:43.892734 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd135cd6-3f42-4087-98c3-746010f1c228-service-ca\") pod \"cd135cd6-3f42-4087-98c3-746010f1c228\" (UID: \"cd135cd6-3f42-4087-98c3-746010f1c228\") " Jul 05 13:20:43.893120 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:43.892952 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd135cd6-3f42-4087-98c3-746010f1c228-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cd135cd6-3f42-4087-98c3-746010f1c228" (UID: "cd135cd6-3f42-4087-98c3-746010f1c228"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 13:20:43.893120 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:43.893087 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd135cd6-3f42-4087-98c3-746010f1c228-console-config" (OuterVolumeSpecName: "console-config") pod "cd135cd6-3f42-4087-98c3-746010f1c228" (UID: "cd135cd6-3f42-4087-98c3-746010f1c228"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 13:20:43.893283 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:43.893148 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd135cd6-3f42-4087-98c3-746010f1c228-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cd135cd6-3f42-4087-98c3-746010f1c228" (UID: "cd135cd6-3f42-4087-98c3-746010f1c228"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 13:20:43.893283 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:43.893186 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd135cd6-3f42-4087-98c3-746010f1c228-service-ca" (OuterVolumeSpecName: "service-ca") pod "cd135cd6-3f42-4087-98c3-746010f1c228" (UID: "cd135cd6-3f42-4087-98c3-746010f1c228"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 13:20:43.894862 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:43.894830 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd135cd6-3f42-4087-98c3-746010f1c228-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cd135cd6-3f42-4087-98c3-746010f1c228" (UID: "cd135cd6-3f42-4087-98c3-746010f1c228"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:20:43.895065 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:43.895048 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd135cd6-3f42-4087-98c3-746010f1c228-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cd135cd6-3f42-4087-98c3-746010f1c228" (UID: "cd135cd6-3f42-4087-98c3-746010f1c228"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:20:43.895113 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:43.895061 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd135cd6-3f42-4087-98c3-746010f1c228-kube-api-access-b6b7s" (OuterVolumeSpecName: "kube-api-access-b6b7s") pod "cd135cd6-3f42-4087-98c3-746010f1c228" (UID: "cd135cd6-3f42-4087-98c3-746010f1c228"). InnerVolumeSpecName "kube-api-access-b6b7s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:20:43.994017 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:43.993933 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd135cd6-3f42-4087-98c3-746010f1c228-console-oauth-config\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Jul 05 13:20:43.994017 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:43.993963 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd135cd6-3f42-4087-98c3-746010f1c228-trusted-ca-bundle\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Jul 05 13:20:43.994017 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:43.993973 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd135cd6-3f42-4087-98c3-746010f1c228-service-ca\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Jul 05 13:20:43.994017 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:43.993981 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd135cd6-3f42-4087-98c3-746010f1c228-console-serving-cert\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Jul 05 13:20:43.994017 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:43.993991 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd135cd6-3f42-4087-98c3-746010f1c228-oauth-serving-cert\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Jul 05 13:20:43.994017 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:43.993999 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6b7s\" (UniqueName: \"kubernetes.io/projected/cd135cd6-3f42-4087-98c3-746010f1c228-kube-api-access-b6b7s\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Jul 05 13:20:43.994017 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:43.994008 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd135cd6-3f42-4087-98c3-746010f1c228-console-config\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Jul 05 13:20:44.563235 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:44.563207 2565 generic.go:356] "Generic (PLEG): container finished" podID="cd135cd6-3f42-4087-98c3-746010f1c228" containerID="b6bfcef6736327a635dd4b3ec4fd793d6e31db5bba192b1d48ee7e39c58240b0" exitCode=0 Jul 05 13:20:44.563661 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:44.563251 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d9fbf8f76-bssr2" Jul 05 13:20:44.563661 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:44.563300 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d9fbf8f76-bssr2" event={"ID":"cd135cd6-3f42-4087-98c3-746010f1c228","Type":"ContainerDied","Data":"b6bfcef6736327a635dd4b3ec4fd793d6e31db5bba192b1d48ee7e39c58240b0"} Jul 05 13:20:44.563661 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:44.563348 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d9fbf8f76-bssr2" event={"ID":"cd135cd6-3f42-4087-98c3-746010f1c228","Type":"ContainerDied","Data":"946a45fd1f475ffc8584c86138bd6f8591435c7d82162ce1c221f98345e71144"} Jul 05 13:20:44.563661 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:44.563371 2565 scope.go:117] "RemoveContainer" containerID="b6bfcef6736327a635dd4b3ec4fd793d6e31db5bba192b1d48ee7e39c58240b0" Jul 05 13:20:44.572234 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:44.572215 2565 scope.go:117] "RemoveContainer" containerID="b6bfcef6736327a635dd4b3ec4fd793d6e31db5bba192b1d48ee7e39c58240b0" Jul 05 13:20:44.572499 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:20:44.572480 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6bfcef6736327a635dd4b3ec4fd793d6e31db5bba192b1d48ee7e39c58240b0\": container with ID starting with b6bfcef6736327a635dd4b3ec4fd793d6e31db5bba192b1d48ee7e39c58240b0 not found: ID does not exist" containerID="b6bfcef6736327a635dd4b3ec4fd793d6e31db5bba192b1d48ee7e39c58240b0" Jul 05 13:20:44.572545 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:44.572509 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6bfcef6736327a635dd4b3ec4fd793d6e31db5bba192b1d48ee7e39c58240b0"} err="failed to get container status \"b6bfcef6736327a635dd4b3ec4fd793d6e31db5bba192b1d48ee7e39c58240b0\": rpc error: code = NotFound desc = could not find container \"b6bfcef6736327a635dd4b3ec4fd793d6e31db5bba192b1d48ee7e39c58240b0\": container with ID starting with b6bfcef6736327a635dd4b3ec4fd793d6e31db5bba192b1d48ee7e39c58240b0 not found: ID does not exist" Jul 05 13:20:44.584221 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:44.584198 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d9fbf8f76-bssr2"] Jul 05 13:20:44.587920 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:44.587900 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d9fbf8f76-bssr2"] Jul 05 13:20:44.816951 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:20:44.816878 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd135cd6-3f42-4087-98c3-746010f1c228" path="/var/lib/kubelet/pods/cd135cd6-3f42-4087-98c3-746010f1c228/volumes" Jul 05 13:23:03.476052 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:03.476016 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p7zpn"] Jul 05 13:23:03.476521 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:03.476319 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd135cd6-3f42-4087-98c3-746010f1c228" containerName="console" Jul 05 13:23:03.476521 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:03.476330 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd135cd6-3f42-4087-98c3-746010f1c228" containerName="console" Jul 05 13:23:03.476521 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:03.476390 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd135cd6-3f42-4087-98c3-746010f1c228" containerName="console" Jul 05 13:23:03.479212 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:03.479196 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p7zpn" Jul 05 13:23:03.481793 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:03.481771 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-kndjs\"" Jul 05 13:23:03.482020 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:03.482003 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 05 13:23:03.482891 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:03.482876 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 05 13:23:03.492951 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:03.492932 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p7zpn"] Jul 05 13:23:03.568233 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:03.568194 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf49r\" (UniqueName: \"kubernetes.io/projected/049544b9-d2ad-4f65-97f5-56b46c0aba32-kube-api-access-pf49r\") pod \"openshift-lws-operator-fd8ccff4c-p7zpn\" (UID: \"049544b9-d2ad-4f65-97f5-56b46c0aba32\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p7zpn" Jul 05 13:23:03.568401 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:03.568245 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/049544b9-d2ad-4f65-97f5-56b46c0aba32-tmp\") pod \"openshift-lws-operator-fd8ccff4c-p7zpn\" (UID: \"049544b9-d2ad-4f65-97f5-56b46c0aba32\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p7zpn" Jul 05 13:23:03.669292 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:03.669241 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf49r\" (UniqueName: \"kubernetes.io/projected/049544b9-d2ad-4f65-97f5-56b46c0aba32-kube-api-access-pf49r\") pod \"openshift-lws-operator-fd8ccff4c-p7zpn\" (UID: \"049544b9-d2ad-4f65-97f5-56b46c0aba32\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p7zpn" Jul 05 13:23:03.669466 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:03.669320 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/049544b9-d2ad-4f65-97f5-56b46c0aba32-tmp\") pod \"openshift-lws-operator-fd8ccff4c-p7zpn\" (UID: \"049544b9-d2ad-4f65-97f5-56b46c0aba32\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p7zpn" Jul 05 13:23:03.669728 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:03.669709 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/049544b9-d2ad-4f65-97f5-56b46c0aba32-tmp\") pod \"openshift-lws-operator-fd8ccff4c-p7zpn\" (UID: \"049544b9-d2ad-4f65-97f5-56b46c0aba32\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p7zpn" Jul 05 13:23:03.678054 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:03.678033 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf49r\" (UniqueName: \"kubernetes.io/projected/049544b9-d2ad-4f65-97f5-56b46c0aba32-kube-api-access-pf49r\") pod \"openshift-lws-operator-fd8ccff4c-p7zpn\" (UID: \"049544b9-d2ad-4f65-97f5-56b46c0aba32\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p7zpn" Jul 05 13:23:03.800345 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:03.800247 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p7zpn" Jul 05 13:23:03.926348 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:03.926322 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p7zpn"] Jul 05 13:23:03.928421 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:23:03.928387 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod049544b9_d2ad_4f65_97f5_56b46c0aba32.slice/crio-3b75754ef1cf0540dfb768e14e045d2f4046bad8dc68959a5b42314d94055241 WatchSource:0}: Error finding container 3b75754ef1cf0540dfb768e14e045d2f4046bad8dc68959a5b42314d94055241: Status 404 returned error can't find the container with id 3b75754ef1cf0540dfb768e14e045d2f4046bad8dc68959a5b42314d94055241 Jul 05 13:23:04.064782 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:04.064699 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p7zpn" event={"ID":"049544b9-d2ad-4f65-97f5-56b46c0aba32","Type":"ContainerStarted","Data":"3b75754ef1cf0540dfb768e14e045d2f4046bad8dc68959a5b42314d94055241"} Jul 05 13:23:07.079036 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:07.078992 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p7zpn" event={"ID":"049544b9-d2ad-4f65-97f5-56b46c0aba32","Type":"ContainerStarted","Data":"650471ddcbdf7591d1d003b15ecc11a41f2e616d57273b3f25e61a799ce6b519"} Jul 05 13:23:07.099262 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:07.099214 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-p7zpn" podStartSLOduration=1.538628267 podStartE2EDuration="4.099197413s" totalImagesPullingTime="2.560569146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:23:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:23:07.098949167 +0000 UTC m=+280.744259631" watchObservedRunningTime="2026-07-05 13:23:07.099197413 +0000 UTC m=+280.744507876" Jul 05 13:23:26.686861 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:26.686830 2565 kubelet.go:1648] "Image garbage collection succeeded" Jul 05 13:23:27.315644 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:27.315614 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7"] Jul 05 13:23:27.319681 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:27.319654 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7" Jul 05 13:23:27.325840 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:27.325792 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-b5vh9\"" Jul 05 13:23:27.325988 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:27.325901 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 05 13:23:27.325988 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:27.325902 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 05 13:23:27.327457 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:27.327440 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 05 13:23:27.330052 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:27.330033 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 05 13:23:27.352575 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:27.352552 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7"] Jul 05 13:23:27.472825 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:27.472764 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8-manifests\") pod \"opendatahub-operator-controller-manager-678684cb77-z9gm7\" (UID: \"6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8\") " pod="opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7" Jul 05 13:23:27.472989 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:27.472834 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x5gz\" (UniqueName: \"kubernetes.io/projected/6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8-kube-api-access-4x5gz\") pod \"opendatahub-operator-controller-manager-678684cb77-z9gm7\" (UID: \"6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8\") " pod="opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7" Jul 05 13:23:27.472989 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:27.472896 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8-tmp\") pod \"opendatahub-operator-controller-manager-678684cb77-z9gm7\" (UID: \"6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8\") " pod="opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7" Jul 05 13:23:27.472989 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:27.472949 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8-webhook-cert\") pod \"opendatahub-operator-controller-manager-678684cb77-z9gm7\" (UID: \"6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8\") " pod="opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7" Jul 05 13:23:27.473094 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:27.473001 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-678684cb77-z9gm7\" (UID: \"6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8\") " pod="opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7" Jul 05 13:23:27.574243 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:27.574164 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-678684cb77-z9gm7\" (UID: \"6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8\") " pod="opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7" Jul 05 13:23:27.574243 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:27.574211 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8-manifests\") pod \"opendatahub-operator-controller-manager-678684cb77-z9gm7\" (UID: \"6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8\") " pod="opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7" Jul 05 13:23:27.574243 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:27.574236 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x5gz\" (UniqueName: \"kubernetes.io/projected/6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8-kube-api-access-4x5gz\") pod \"opendatahub-operator-controller-manager-678684cb77-z9gm7\" (UID: \"6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8\") " pod="opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7" Jul 05 13:23:27.574498 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:27.574431 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8-tmp\") pod \"opendatahub-operator-controller-manager-678684cb77-z9gm7\" (UID: \"6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8\") " pod="opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7" Jul 05 13:23:27.574551 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:27.574528 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8-webhook-cert\") pod \"opendatahub-operator-controller-manager-678684cb77-z9gm7\" (UID: \"6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8\") " pod="opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7" Jul 05 13:23:27.574631 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:27.574612 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8-manifests\") pod \"opendatahub-operator-controller-manager-678684cb77-z9gm7\" (UID: \"6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8\") " pod="opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7" Jul 05 13:23:27.576566 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:27.576534 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8-tmp\") pod \"opendatahub-operator-controller-manager-678684cb77-z9gm7\" (UID: \"6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8\") " pod="opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7" Jul 05 13:23:27.576724 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:27.576709 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-678684cb77-z9gm7\" (UID: \"6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8\") " pod="opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7" Jul 05 13:23:27.576783 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:27.576765 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8-webhook-cert\") pod \"opendatahub-operator-controller-manager-678684cb77-z9gm7\" (UID: \"6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8\") " pod="opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7" Jul 05 13:23:27.585792 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:27.585770 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x5gz\" (UniqueName: \"kubernetes.io/projected/6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8-kube-api-access-4x5gz\") pod \"opendatahub-operator-controller-manager-678684cb77-z9gm7\" (UID: \"6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8\") " pod="opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7" Jul 05 13:23:27.630838 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:27.630784 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7" Jul 05 13:23:27.775529 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:27.775495 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7"] Jul 05 13:23:27.779780 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:23:27.779753 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cef2a8c_ff9c_4bef_b72c_fb37c06e44b8.slice/crio-5800341a37ca4ff57aa2e6b0157a8ca4c57452212899fceff83c037803d5e747 WatchSource:0}: Error finding container 5800341a37ca4ff57aa2e6b0157a8ca4c57452212899fceff83c037803d5e747: Status 404 returned error can't find the container with id 5800341a37ca4ff57aa2e6b0157a8ca4c57452212899fceff83c037803d5e747 Jul 05 13:23:28.158085 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:28.158048 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7" event={"ID":"6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8","Type":"ContainerStarted","Data":"5800341a37ca4ff57aa2e6b0157a8ca4c57452212899fceff83c037803d5e747"} Jul 05 13:23:31.172417 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:31.172385 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7" event={"ID":"6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8","Type":"ContainerStarted","Data":"75cbc6af2017aa1c1a7f79e53c45574a64fa0a00fa1c01e984be24323fd32b81"} Jul 05 13:23:32.177454 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:32.177419 2565 generic.go:356] "Generic (PLEG): container finished" podID="6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8" containerID="75cbc6af2017aa1c1a7f79e53c45574a64fa0a00fa1c01e984be24323fd32b81" exitCode=0 Jul 05 13:23:32.178000 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:32.177504 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7" event={"ID":"6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8","Type":"ContainerDied","Data":"75cbc6af2017aa1c1a7f79e53c45574a64fa0a00fa1c01e984be24323fd32b81"} Jul 05 13:23:32.178050 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:32.178031 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 13:23:33.183339 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:33.183300 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7" event={"ID":"6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8","Type":"ContainerStarted","Data":"416a51ae966cb3a6613abb29b8c268cbadc93e278c6f169defebf18aa5ff9310"} Jul 05 13:23:33.183840 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:33.183405 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7" Jul 05 13:23:33.231089 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:33.231040 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7" podStartSLOduration=2.022964009 podStartE2EDuration="6.231024459s" totalImagesPullingTime="3.188221737s" totalInitContainerRuntime="1.019838713s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:23:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:23:33.230229893 +0000 UTC m=+306.875540376" watchObservedRunningTime="2026-07-05 13:23:33.231024459 +0000 UTC m=+306.876334923" Jul 05 13:23:44.189697 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:44.189672 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-678684cb77-z9gm7" Jul 05 13:23:47.488706 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:47.488667 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-44ssq"] Jul 05 13:23:47.497527 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:47.497510 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-44ssq" Jul 05 13:23:47.505105 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:47.505082 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 05 13:23:47.505348 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:47.505332 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-jf46m\"" Jul 05 13:23:47.533326 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:47.533291 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67vjg\" (UniqueName: \"kubernetes.io/projected/1ca4c5da-e508-401d-8372-943b0aa79318-kube-api-access-67vjg\") pod \"odh-model-controller-7998c67dc4-44ssq\" (UID: \"1ca4c5da-e508-401d-8372-943b0aa79318\") " pod="opendatahub/odh-model-controller-7998c67dc4-44ssq" Jul 05 13:23:47.533493 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:47.533347 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ca4c5da-e508-401d-8372-943b0aa79318-cert\") pod \"odh-model-controller-7998c67dc4-44ssq\" (UID: \"1ca4c5da-e508-401d-8372-943b0aa79318\") " pod="opendatahub/odh-model-controller-7998c67dc4-44ssq" Jul 05 13:23:47.534303 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:47.534278 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-44ssq"] Jul 05 13:23:47.634454 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:47.634411 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67vjg\" (UniqueName: \"kubernetes.io/projected/1ca4c5da-e508-401d-8372-943b0aa79318-kube-api-access-67vjg\") pod \"odh-model-controller-7998c67dc4-44ssq\" (UID: \"1ca4c5da-e508-401d-8372-943b0aa79318\") " pod="opendatahub/odh-model-controller-7998c67dc4-44ssq" Jul 05 13:23:47.634621 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:47.634465 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ca4c5da-e508-401d-8372-943b0aa79318-cert\") pod \"odh-model-controller-7998c67dc4-44ssq\" (UID: \"1ca4c5da-e508-401d-8372-943b0aa79318\") " pod="opendatahub/odh-model-controller-7998c67dc4-44ssq" Jul 05 13:23:47.634621 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:23:47.634572 2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 05 13:23:47.634711 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:23:47.634625 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ca4c5da-e508-401d-8372-943b0aa79318-cert podName:1ca4c5da-e508-401d-8372-943b0aa79318 nodeName:}" failed. No retries permitted until 2026-07-05 13:23:48.13460694 +0000 UTC m=+321.779917382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1ca4c5da-e508-401d-8372-943b0aa79318-cert") pod "odh-model-controller-7998c67dc4-44ssq" (UID: "1ca4c5da-e508-401d-8372-943b0aa79318") : secret "odh-model-controller-webhook-cert" not found Jul 05 13:23:47.684249 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:47.684216 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67vjg\" (UniqueName: \"kubernetes.io/projected/1ca4c5da-e508-401d-8372-943b0aa79318-kube-api-access-67vjg\") pod \"odh-model-controller-7998c67dc4-44ssq\" (UID: \"1ca4c5da-e508-401d-8372-943b0aa79318\") " pod="opendatahub/odh-model-controller-7998c67dc4-44ssq" Jul 05 13:23:48.139244 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:48.139206 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ca4c5da-e508-401d-8372-943b0aa79318-cert\") pod \"odh-model-controller-7998c67dc4-44ssq\" (UID: \"1ca4c5da-e508-401d-8372-943b0aa79318\") " pod="opendatahub/odh-model-controller-7998c67dc4-44ssq" Jul 05 13:23:48.141600 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:48.141574 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ca4c5da-e508-401d-8372-943b0aa79318-cert\") pod \"odh-model-controller-7998c67dc4-44ssq\" (UID: \"1ca4c5da-e508-401d-8372-943b0aa79318\") " pod="opendatahub/odh-model-controller-7998c67dc4-44ssq" Jul 05 13:23:48.406997 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:48.406903 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-44ssq" Jul 05 13:23:48.551768 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:48.551738 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-44ssq"] Jul 05 13:23:48.553578 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:23:48.553555 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ca4c5da_e508_401d_8372_943b0aa79318.slice/crio-68c4144c675b092b400a4762ea85e862ac36566b8b6a955e45523b17fa5d877e WatchSource:0}: Error finding container 68c4144c675b092b400a4762ea85e862ac36566b8b6a955e45523b17fa5d877e: Status 404 returned error can't find the container with id 68c4144c675b092b400a4762ea85e862ac36566b8b6a955e45523b17fa5d877e Jul 05 13:23:48.691672 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:48.691596 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nwxjc"] Jul 05 13:23:48.694708 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:48.694693 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-nwxjc" Jul 05 13:23:48.704978 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:48.704958 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 05 13:23:48.705092 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:48.705050 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-htlqq\"" Jul 05 13:23:48.719922 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:48.719903 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nwxjc"] Jul 05 13:23:48.744437 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:48.744413 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q94d2\" (UniqueName: \"kubernetes.io/projected/e78b333d-7036-44f0-93c8-ece5ac128a3f-kube-api-access-q94d2\") pod \"model-serving-api-54d89bd5fc-nwxjc\" (UID: \"e78b333d-7036-44f0-93c8-ece5ac128a3f\") " pod="opendatahub/model-serving-api-54d89bd5fc-nwxjc" Jul 05 13:23:48.744523 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:48.744445 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e78b333d-7036-44f0-93c8-ece5ac128a3f-tls-certs\") pod \"model-serving-api-54d89bd5fc-nwxjc\" (UID: \"e78b333d-7036-44f0-93c8-ece5ac128a3f\") " pod="opendatahub/model-serving-api-54d89bd5fc-nwxjc" Jul 05 13:23:48.845042 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:48.845016 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q94d2\" (UniqueName: \"kubernetes.io/projected/e78b333d-7036-44f0-93c8-ece5ac128a3f-kube-api-access-q94d2\") pod \"model-serving-api-54d89bd5fc-nwxjc\" (UID: \"e78b333d-7036-44f0-93c8-ece5ac128a3f\") " pod="opendatahub/model-serving-api-54d89bd5fc-nwxjc" Jul 05 13:23:48.845192 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:48.845052 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e78b333d-7036-44f0-93c8-ece5ac128a3f-tls-certs\") pod \"model-serving-api-54d89bd5fc-nwxjc\" (UID: \"e78b333d-7036-44f0-93c8-ece5ac128a3f\") " pod="opendatahub/model-serving-api-54d89bd5fc-nwxjc" Jul 05 13:23:48.845192 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:23:48.845129 2565 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 05 13:23:48.845192 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:23:48.845179 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e78b333d-7036-44f0-93c8-ece5ac128a3f-tls-certs podName:e78b333d-7036-44f0-93c8-ece5ac128a3f nodeName:}" failed. No retries permitted until 2026-07-05 13:23:49.345161229 +0000 UTC m=+322.990471669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/e78b333d-7036-44f0-93c8-ece5ac128a3f-tls-certs") pod "model-serving-api-54d89bd5fc-nwxjc" (UID: "e78b333d-7036-44f0-93c8-ece5ac128a3f") : secret "model-serving-api-tls" not found Jul 05 13:23:48.855680 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:48.855656 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q94d2\" (UniqueName: \"kubernetes.io/projected/e78b333d-7036-44f0-93c8-ece5ac128a3f-kube-api-access-q94d2\") pod \"model-serving-api-54d89bd5fc-nwxjc\" (UID: \"e78b333d-7036-44f0-93c8-ece5ac128a3f\") " pod="opendatahub/model-serving-api-54d89bd5fc-nwxjc" Jul 05 13:23:49.250301 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:49.250266 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-44ssq" event={"ID":"1ca4c5da-e508-401d-8372-943b0aa79318","Type":"ContainerStarted","Data":"68c4144c675b092b400a4762ea85e862ac36566b8b6a955e45523b17fa5d877e"} Jul 05 13:23:49.349998 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:49.349963 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e78b333d-7036-44f0-93c8-ece5ac128a3f-tls-certs\") pod \"model-serving-api-54d89bd5fc-nwxjc\" (UID: \"e78b333d-7036-44f0-93c8-ece5ac128a3f\") " pod="opendatahub/model-serving-api-54d89bd5fc-nwxjc" Jul 05 13:23:49.353630 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:49.353601 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e78b333d-7036-44f0-93c8-ece5ac128a3f-tls-certs\") pod \"model-serving-api-54d89bd5fc-nwxjc\" (UID: \"e78b333d-7036-44f0-93c8-ece5ac128a3f\") " pod="opendatahub/model-serving-api-54d89bd5fc-nwxjc" Jul 05 13:23:49.607095 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:49.607007 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-nwxjc" Jul 05 13:23:49.793707 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:49.793622 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-nwxjc"] Jul 05 13:23:49.798572 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:23:49.798504 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode78b333d_7036_44f0_93c8_ece5ac128a3f.slice/crio-dee87f26609fdcbd98bd3c20eeb1a2f15d0c57b0f567cc4d17c80f4d4fd35969 WatchSource:0}: Error finding container dee87f26609fdcbd98bd3c20eeb1a2f15d0c57b0f567cc4d17c80f4d4fd35969: Status 404 returned error can't find the container with id dee87f26609fdcbd98bd3c20eeb1a2f15d0c57b0f567cc4d17c80f4d4fd35969 Jul 05 13:23:50.263061 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:50.263016 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-nwxjc" event={"ID":"e78b333d-7036-44f0-93c8-ece5ac128a3f","Type":"ContainerStarted","Data":"dee87f26609fdcbd98bd3c20eeb1a2f15d0c57b0f567cc4d17c80f4d4fd35969"} Jul 05 13:23:52.274257 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:52.274224 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-44ssq" event={"ID":"1ca4c5da-e508-401d-8372-943b0aa79318","Type":"ContainerStarted","Data":"55af795f342c1575708655d0ede8f0a4598b37ccc1d995f2e916d1fee1830766"} Jul 05 13:23:52.274719 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:52.274373 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-44ssq" Jul 05 13:23:53.280860 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:53.280796 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-nwxjc" event={"ID":"e78b333d-7036-44f0-93c8-ece5ac128a3f","Type":"ContainerStarted","Data":"06cac9dfc54052bbccafd780f12a9c8f18b7a5fccf84d5474448f53ab009ac93"} Jul 05 13:23:53.281254 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:53.280983 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-nwxjc" Jul 05 13:23:53.347671 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:53.347618 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-44ssq" podStartSLOduration=3.555590379 podStartE2EDuration="6.347599247s" totalImagesPullingTime="2.792008868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:23:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:23:52.309118914 +0000 UTC m=+325.954429399" watchObservedRunningTime="2026-07-05 13:23:53.347599247 +0000 UTC m=+326.992909709" Jul 05 13:23:53.347903 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:53.347702 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-nwxjc" podStartSLOduration=2.577938062 podStartE2EDuration="5.347697015s" totalImagesPullingTime="2.769758953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:23:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:23:53.347499385 +0000 UTC m=+326.992809865" watchObservedRunningTime="2026-07-05 13:23:53.347697015 +0000 UTC m=+326.993007533" Jul 05 13:23:53.916658 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:53.916625 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5886f89bdd-4dlbj"] Jul 05 13:23:53.920000 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:53.919985 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5886f89bdd-4dlbj" Jul 05 13:23:53.926578 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:53.926412 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 05 13:23:53.929624 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:53.929605 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 05 13:23:53.929744 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:53.929729 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-nts2f\"" Jul 05 13:23:53.966071 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:53.966037 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5886f89bdd-4dlbj"] Jul 05 13:23:53.994935 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:53.994911 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa52ceb9-ed96-4729-8e90-5782089a4fca-tls-certs\") pod \"kube-auth-proxy-5886f89bdd-4dlbj\" (UID: \"aa52ceb9-ed96-4729-8e90-5782089a4fca\") " pod="openshift-ingress/kube-auth-proxy-5886f89bdd-4dlbj" Jul 05 13:23:53.995092 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:53.994940 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa52ceb9-ed96-4729-8e90-5782089a4fca-tmp\") pod \"kube-auth-proxy-5886f89bdd-4dlbj\" (UID: \"aa52ceb9-ed96-4729-8e90-5782089a4fca\") " pod="openshift-ingress/kube-auth-proxy-5886f89bdd-4dlbj" Jul 05 13:23:53.995092 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:53.994964 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lllxr\" (UniqueName: \"kubernetes.io/projected/aa52ceb9-ed96-4729-8e90-5782089a4fca-kube-api-access-lllxr\") pod \"kube-auth-proxy-5886f89bdd-4dlbj\" (UID: \"aa52ceb9-ed96-4729-8e90-5782089a4fca\") " pod="openshift-ingress/kube-auth-proxy-5886f89bdd-4dlbj" Jul 05 13:23:54.095995 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:54.095968 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lllxr\" (UniqueName: \"kubernetes.io/projected/aa52ceb9-ed96-4729-8e90-5782089a4fca-kube-api-access-lllxr\") pod \"kube-auth-proxy-5886f89bdd-4dlbj\" (UID: \"aa52ceb9-ed96-4729-8e90-5782089a4fca\") " pod="openshift-ingress/kube-auth-proxy-5886f89bdd-4dlbj" Jul 05 13:23:54.096161 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:54.096053 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa52ceb9-ed96-4729-8e90-5782089a4fca-tls-certs\") pod \"kube-auth-proxy-5886f89bdd-4dlbj\" (UID: \"aa52ceb9-ed96-4729-8e90-5782089a4fca\") " pod="openshift-ingress/kube-auth-proxy-5886f89bdd-4dlbj" Jul 05 13:23:54.096161 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:54.096073 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa52ceb9-ed96-4729-8e90-5782089a4fca-tmp\") pod \"kube-auth-proxy-5886f89bdd-4dlbj\" (UID: \"aa52ceb9-ed96-4729-8e90-5782089a4fca\") " pod="openshift-ingress/kube-auth-proxy-5886f89bdd-4dlbj" Jul 05 13:23:54.098051 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:54.098027 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa52ceb9-ed96-4729-8e90-5782089a4fca-tmp\") pod \"kube-auth-proxy-5886f89bdd-4dlbj\" (UID: \"aa52ceb9-ed96-4729-8e90-5782089a4fca\") " pod="openshift-ingress/kube-auth-proxy-5886f89bdd-4dlbj" Jul 05 13:23:54.098705 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:54.098684 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa52ceb9-ed96-4729-8e90-5782089a4fca-tls-certs\") pod \"kube-auth-proxy-5886f89bdd-4dlbj\" (UID: \"aa52ceb9-ed96-4729-8e90-5782089a4fca\") " pod="openshift-ingress/kube-auth-proxy-5886f89bdd-4dlbj" Jul 05 13:23:54.167583 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:54.167507 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lllxr\" (UniqueName: \"kubernetes.io/projected/aa52ceb9-ed96-4729-8e90-5782089a4fca-kube-api-access-lllxr\") pod \"kube-auth-proxy-5886f89bdd-4dlbj\" (UID: \"aa52ceb9-ed96-4729-8e90-5782089a4fca\") " pod="openshift-ingress/kube-auth-proxy-5886f89bdd-4dlbj" Jul 05 13:23:54.229634 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:54.229604 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5886f89bdd-4dlbj" Jul 05 13:23:54.447745 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:54.447722 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5886f89bdd-4dlbj"] Jul 05 13:23:54.449286 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:23:54.449260 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa52ceb9_ed96_4729_8e90_5782089a4fca.slice/crio-42fecd007093b5eec98f0cbf2e0aebf5d4a771605b0e8fc6c16c8df4c42080f2 WatchSource:0}: Error finding container 42fecd007093b5eec98f0cbf2e0aebf5d4a771605b0e8fc6c16c8df4c42080f2: Status 404 returned error can't find the container with id 42fecd007093b5eec98f0cbf2e0aebf5d4a771605b0e8fc6c16c8df4c42080f2 Jul 05 13:23:55.295443 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:55.295399 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5886f89bdd-4dlbj" event={"ID":"aa52ceb9-ed96-4729-8e90-5782089a4fca","Type":"ContainerStarted","Data":"42fecd007093b5eec98f0cbf2e0aebf5d4a771605b0e8fc6c16c8df4c42080f2"} Jul 05 13:23:57.305660 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:57.305621 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5886f89bdd-4dlbj" event={"ID":"aa52ceb9-ed96-4729-8e90-5782089a4fca","Type":"ContainerStarted","Data":"9a2e7080a8dc38a2fad30a0541224e1ac9cd24ae059a7fca1931f9d00d463541"} Jul 05 13:23:57.347923 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:57.347873 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5886f89bdd-4dlbj" podStartSLOduration=2.440728472 podStartE2EDuration="4.347858035s" totalImagesPullingTime="1.907129563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:23:57.347472078 +0000 UTC m=+330.992782540" watchObservedRunningTime="2026-07-05 13:23:57.347858035 +0000 UTC m=+330.993168531" Jul 05 13:23:59.102413 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.102383 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9"] Jul 05 13:23:59.109315 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.109288 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" Jul 05 13:23:59.114723 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.114699 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 05 13:23:59.114992 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.114976 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 05 13:23:59.114992 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.114983 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 05 13:23:59.115587 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.115570 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 05 13:23:59.139640 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.139605 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5954207d-93c1-4fa3-9c79-67073b23127c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-mdfq9\" (UID: \"5954207d-93c1-4fa3-9c79-67073b23127c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" Jul 05 13:23:59.139821 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.139650 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5954207d-93c1-4fa3-9c79-67073b23127c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-mdfq9\" (UID: \"5954207d-93c1-4fa3-9c79-67073b23127c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" Jul 05 13:23:59.139821 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.139677 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5954207d-93c1-4fa3-9c79-67073b23127c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-mdfq9\" (UID: \"5954207d-93c1-4fa3-9c79-67073b23127c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" Jul 05 13:23:59.139821 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.139706 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5954207d-93c1-4fa3-9c79-67073b23127c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-mdfq9\" (UID: \"5954207d-93c1-4fa3-9c79-67073b23127c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" Jul 05 13:23:59.139821 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.139734 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5954207d-93c1-4fa3-9c79-67073b23127c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-mdfq9\" (UID: \"5954207d-93c1-4fa3-9c79-67073b23127c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" Jul 05 13:23:59.139821 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.139763 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5954207d-93c1-4fa3-9c79-67073b23127c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-mdfq9\" (UID: \"5954207d-93c1-4fa3-9c79-67073b23127c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" Jul 05 13:23:59.139821 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.139800 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5dxn\" (UniqueName: \"kubernetes.io/projected/5954207d-93c1-4fa3-9c79-67073b23127c-kube-api-access-b5dxn\") pod \"istiod-openshift-gateway-94bb8fbfd-mdfq9\" (UID: \"5954207d-93c1-4fa3-9c79-67073b23127c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" Jul 05 13:23:59.141231 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.141207 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9"] Jul 05 13:23:59.189496 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.189465 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-lp6x2\"" Jul 05 13:23:59.240650 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.240619 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5954207d-93c1-4fa3-9c79-67073b23127c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-mdfq9\" (UID: \"5954207d-93c1-4fa3-9c79-67073b23127c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" Jul 05 13:23:59.240650 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.240651 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5954207d-93c1-4fa3-9c79-67073b23127c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-mdfq9\" (UID: \"5954207d-93c1-4fa3-9c79-67073b23127c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" Jul 05 13:23:59.240904 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.240670 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5954207d-93c1-4fa3-9c79-67073b23127c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-mdfq9\" (UID: \"5954207d-93c1-4fa3-9c79-67073b23127c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" Jul 05 13:23:59.240904 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.240690 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5954207d-93c1-4fa3-9c79-67073b23127c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-mdfq9\" (UID: \"5954207d-93c1-4fa3-9c79-67073b23127c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" Jul 05 13:23:59.240904 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.240712 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5954207d-93c1-4fa3-9c79-67073b23127c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-mdfq9\" (UID: \"5954207d-93c1-4fa3-9c79-67073b23127c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" Jul 05 13:23:59.240904 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.240737 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5954207d-93c1-4fa3-9c79-67073b23127c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-mdfq9\" (UID: \"5954207d-93c1-4fa3-9c79-67073b23127c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" Jul 05 13:23:59.240904 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.240763 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5dxn\" (UniqueName: \"kubernetes.io/projected/5954207d-93c1-4fa3-9c79-67073b23127c-kube-api-access-b5dxn\") pod \"istiod-openshift-gateway-94bb8fbfd-mdfq9\" (UID: \"5954207d-93c1-4fa3-9c79-67073b23127c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" Jul 05 13:23:59.241454 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.241427 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5954207d-93c1-4fa3-9c79-67073b23127c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-mdfq9\" (UID: \"5954207d-93c1-4fa3-9c79-67073b23127c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" Jul 05 13:23:59.243139 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.243118 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5954207d-93c1-4fa3-9c79-67073b23127c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-mdfq9\" (UID: \"5954207d-93c1-4fa3-9c79-67073b23127c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" Jul 05 13:23:59.243224 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.243172 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5954207d-93c1-4fa3-9c79-67073b23127c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-mdfq9\" (UID: \"5954207d-93c1-4fa3-9c79-67073b23127c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" Jul 05 13:23:59.243280 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.243262 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5954207d-93c1-4fa3-9c79-67073b23127c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-mdfq9\" (UID: \"5954207d-93c1-4fa3-9c79-67073b23127c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" Jul 05 13:23:59.243476 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.243459 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5954207d-93c1-4fa3-9c79-67073b23127c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-mdfq9\" (UID: \"5954207d-93c1-4fa3-9c79-67073b23127c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" Jul 05 13:23:59.262413 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.262391 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5954207d-93c1-4fa3-9c79-67073b23127c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-mdfq9\" (UID: \"5954207d-93c1-4fa3-9c79-67073b23127c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" Jul 05 13:23:59.263143 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.263122 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5dxn\" (UniqueName: \"kubernetes.io/projected/5954207d-93c1-4fa3-9c79-67073b23127c-kube-api-access-b5dxn\") pod \"istiod-openshift-gateway-94bb8fbfd-mdfq9\" (UID: \"5954207d-93c1-4fa3-9c79-67073b23127c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" Jul 05 13:23:59.419733 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.419703 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" Jul 05 13:23:59.600485 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:23:59.600459 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9"] Jul 05 13:23:59.601796 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:23:59.601774 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5954207d_93c1_4fa3_9c79_67073b23127c.slice/crio-cb285f7ce4243a1ee8971e7eabc99f03629a9d0df9e553f1c766c051742f0c3a WatchSource:0}: Error finding container cb285f7ce4243a1ee8971e7eabc99f03629a9d0df9e553f1c766c051742f0c3a: Status 404 returned error can't find the container with id cb285f7ce4243a1ee8971e7eabc99f03629a9d0df9e553f1c766c051742f0c3a Jul 05 13:24:00.320759 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:00.320714 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" event={"ID":"5954207d-93c1-4fa3-9c79-67073b23127c","Type":"ContainerStarted","Data":"cb285f7ce4243a1ee8971e7eabc99f03629a9d0df9e553f1c766c051742f0c3a"} Jul 05 13:24:01.785197 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:01.785155 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 05 13:24:01.785487 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:01.785223 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 05 13:24:02.331292 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:02.331255 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" event={"ID":"5954207d-93c1-4fa3-9c79-67073b23127c","Type":"ContainerStarted","Data":"e679ab12229c3642ff28b35fa2146fa3f97f401ba6a44a6b0049b2d4fd88b7b8"} Jul 05 13:24:02.331590 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:02.331568 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" Jul 05 13:24:02.333133 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:02.333111 2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-mdfq9 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 05 13:24:02.333246 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:02.333150 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" podUID="5954207d-93c1-4fa3-9c79-67073b23127c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 05 13:24:03.284077 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:03.284041 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-44ssq" Jul 05 13:24:03.336140 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:03.336100 2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-mdfq9 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 05 13:24:03.336295 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:03.336177 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" podUID="5954207d-93c1-4fa3-9c79-67073b23127c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 05 13:24:03.471885 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:03.471830 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" podStartSLOduration=2.29077063 podStartE2EDuration="4.471797533s" totalImagesPullingTime="2.181026903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:24:02.523204146 +0000 UTC m=+336.168514634" watchObservedRunningTime="2026-07-05 13:24:03.471797533 +0000 UTC m=+337.117107995" Jul 05 13:24:04.290565 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:04.290540 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-nwxjc" Jul 05 13:24:06.078759 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:06.078728 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fxbrs"] Jul 05 13:24:06.082433 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:06.082407 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fxbrs" Jul 05 13:24:06.124354 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:06.124300 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-b48xm\"" Jul 05 13:24:06.131847 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:06.131798 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 05 13:24:06.155152 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:06.155116 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fxbrs"] Jul 05 13:24:06.203285 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:06.203252 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68ndc\" (UniqueName: \"kubernetes.io/projected/93e19444-8869-4303-9e9c-8dca5f8bdaaf-kube-api-access-68ndc\") pod \"llmisvc-controller-manager-777c6bd7d5-fxbrs\" (UID: \"93e19444-8869-4303-9e9c-8dca5f8bdaaf\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fxbrs" Jul 05 13:24:06.203466 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:06.203312 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93e19444-8869-4303-9e9c-8dca5f8bdaaf-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fxbrs\" (UID: \"93e19444-8869-4303-9e9c-8dca5f8bdaaf\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fxbrs" Jul 05 13:24:06.304244 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:06.304206 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68ndc\" (UniqueName: \"kubernetes.io/projected/93e19444-8869-4303-9e9c-8dca5f8bdaaf-kube-api-access-68ndc\") pod \"llmisvc-controller-manager-777c6bd7d5-fxbrs\" (UID: \"93e19444-8869-4303-9e9c-8dca5f8bdaaf\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fxbrs" Jul 05 13:24:06.304445 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:06.304261 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93e19444-8869-4303-9e9c-8dca5f8bdaaf-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fxbrs\" (UID: \"93e19444-8869-4303-9e9c-8dca5f8bdaaf\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fxbrs" Jul 05 13:24:06.306864 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:06.306840 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93e19444-8869-4303-9e9c-8dca5f8bdaaf-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fxbrs\" (UID: \"93e19444-8869-4303-9e9c-8dca5f8bdaaf\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fxbrs" Jul 05 13:24:06.337116 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:06.337037 2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-mdfq9 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 05 13:24:06.337116 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:06.337089 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" podUID="5954207d-93c1-4fa3-9c79-67073b23127c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 05 13:24:06.346426 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:06.346391 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68ndc\" (UniqueName: \"kubernetes.io/projected/93e19444-8869-4303-9e9c-8dca5f8bdaaf-kube-api-access-68ndc\") pod \"llmisvc-controller-manager-777c6bd7d5-fxbrs\" (UID: \"93e19444-8869-4303-9e9c-8dca5f8bdaaf\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fxbrs" Jul 05 13:24:06.392579 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:06.392543 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fxbrs" Jul 05 13:24:06.606613 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:24:06.606571 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod93e19444_8869_4303_9e9c_8dca5f8bdaaf.slice/crio-8bb37465c8ff3330732a4df4adc6ce4970224d46e678fb3974ecde9b3bd87ce3 WatchSource:0}: Error finding container 8bb37465c8ff3330732a4df4adc6ce4970224d46e678fb3974ecde9b3bd87ce3: Status 404 returned error can't find the container with id 8bb37465c8ff3330732a4df4adc6ce4970224d46e678fb3974ecde9b3bd87ce3 Jul 05 13:24:06.607187 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:06.607161 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fxbrs"] Jul 05 13:24:07.354547 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:07.354507 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fxbrs" event={"ID":"93e19444-8869-4303-9e9c-8dca5f8bdaaf","Type":"ContainerStarted","Data":"8bb37465c8ff3330732a4df4adc6ce4970224d46e678fb3974ecde9b3bd87ce3"} Jul 05 13:24:09.337239 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:09.337163 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mdfq9" Jul 05 13:24:09.364788 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:09.364747 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fxbrs" event={"ID":"93e19444-8869-4303-9e9c-8dca5f8bdaaf","Type":"ContainerStarted","Data":"f9da160137d5adce7a5b8c4a4fc8df57c389876fdb036abb3fbf37cf59ff4452"} Jul 05 13:24:09.364976 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:09.364835 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fxbrs" Jul 05 13:24:40.372152 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:40.372074 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fxbrs" Jul 05 13:24:40.392787 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:40.392736 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fxbrs" podStartSLOduration=32.952064727 podStartE2EDuration="35.392719106s" totalImagesPullingTime="2.440654379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:24:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:24:09.464679797 +0000 UTC m=+343.109990281" watchObservedRunningTime="2026-07-05 13:24:40.392719106 +0000 UTC m=+374.038029569" Jul 05 13:24:48.163738 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:48.163700 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ppzgz"] Jul 05 13:24:48.179006 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:48.178984 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ppzgz" Jul 05 13:24:48.186772 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:48.186745 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 05 13:24:48.186975 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:48.186952 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 05 13:24:48.187826 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:48.187785 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-d726k\"" Jul 05 13:24:48.193414 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:48.193392 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ppzgz"] Jul 05 13:24:48.263216 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:48.263184 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbqxz\" (UniqueName: \"kubernetes.io/projected/5bed4941-6933-4084-bc09-d94c72cb233e-kube-api-access-lbqxz\") pod \"kuadrant-operator-catalog-ppzgz\" (UID: \"5bed4941-6933-4084-bc09-d94c72cb233e\") " pod="kuadrant-system/kuadrant-operator-catalog-ppzgz" Jul 05 13:24:48.363875 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:48.363839 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbqxz\" (UniqueName: \"kubernetes.io/projected/5bed4941-6933-4084-bc09-d94c72cb233e-kube-api-access-lbqxz\") pod \"kuadrant-operator-catalog-ppzgz\" (UID: \"5bed4941-6933-4084-bc09-d94c72cb233e\") " pod="kuadrant-system/kuadrant-operator-catalog-ppzgz" Jul 05 13:24:48.387417 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:48.387391 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbqxz\" (UniqueName: \"kubernetes.io/projected/5bed4941-6933-4084-bc09-d94c72cb233e-kube-api-access-lbqxz\") pod \"kuadrant-operator-catalog-ppzgz\" (UID: \"5bed4941-6933-4084-bc09-d94c72cb233e\") " pod="kuadrant-system/kuadrant-operator-catalog-ppzgz" Jul 05 13:24:48.489511 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:48.489430 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ppzgz" Jul 05 13:24:48.641012 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:48.640988 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ppzgz"] Jul 05 13:24:48.642861 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:24:48.642832 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bed4941_6933_4084_bc09_d94c72cb233e.slice/crio-9e919c37b6e6cb9147f5b80c98f35e26bb5adb2e7489dedb3f6827fde23d7a0b WatchSource:0}: Error finding container 9e919c37b6e6cb9147f5b80c98f35e26bb5adb2e7489dedb3f6827fde23d7a0b: Status 404 returned error can't find the container with id 9e919c37b6e6cb9147f5b80c98f35e26bb5adb2e7489dedb3f6827fde23d7a0b Jul 05 13:24:49.546060 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:49.546017 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ppzgz" event={"ID":"5bed4941-6933-4084-bc09-d94c72cb233e","Type":"ContainerStarted","Data":"9e919c37b6e6cb9147f5b80c98f35e26bb5adb2e7489dedb3f6827fde23d7a0b"} Jul 05 13:24:51.556053 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:51.556018 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ppzgz" event={"ID":"5bed4941-6933-4084-bc09-d94c72cb233e","Type":"ContainerStarted","Data":"eaf21cbaed084b666cc6ac2868df7c3cf930703665b09be02a9a58dfba2c3716"} Jul 05 13:24:51.575102 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:51.575056 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ppzgz" podStartSLOduration=1.670687474 podStartE2EDuration="3.575041122s" totalImagesPullingTime="1.904353648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:24:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:24:51.573472937 +0000 UTC m=+385.218783400" watchObservedRunningTime="2026-07-05 13:24:51.575041122 +0000 UTC m=+385.220351585" Jul 05 13:24:58.490191 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:58.490132 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-ppzgz" Jul 05 13:24:58.490619 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:58.490220 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-ppzgz" Jul 05 13:24:58.512820 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:58.512781 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-ppzgz" Jul 05 13:24:58.607847 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:24:58.607816 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-ppzgz" Jul 05 13:25:19.407036 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:19.407003 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8krbq"] Jul 05 13:25:19.410297 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:19.410280 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8krbq" Jul 05 13:25:19.413386 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:19.413365 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-42v4s\"" Jul 05 13:25:19.442284 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:19.442260 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8krbq"] Jul 05 13:25:19.531469 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:19.531439 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxx49\" (UniqueName: \"kubernetes.io/projected/bd1bec47-fbe3-43b8-b455-2d38be74fd02-kube-api-access-bxx49\") pod \"authorino-operator-75cc8d5cb7-8krbq\" (UID: \"bd1bec47-fbe3-43b8-b455-2d38be74fd02\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8krbq" Jul 05 13:25:19.632418 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:19.632382 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxx49\" (UniqueName: \"kubernetes.io/projected/bd1bec47-fbe3-43b8-b455-2d38be74fd02-kube-api-access-bxx49\") pod \"authorino-operator-75cc8d5cb7-8krbq\" (UID: \"bd1bec47-fbe3-43b8-b455-2d38be74fd02\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8krbq" Jul 05 13:25:19.654715 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:19.654687 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxx49\" (UniqueName: \"kubernetes.io/projected/bd1bec47-fbe3-43b8-b455-2d38be74fd02-kube-api-access-bxx49\") pod \"authorino-operator-75cc8d5cb7-8krbq\" (UID: \"bd1bec47-fbe3-43b8-b455-2d38be74fd02\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8krbq" Jul 05 13:25:19.719963 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:19.719888 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8krbq" Jul 05 13:25:19.875503 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:19.875476 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8krbq"] Jul 05 13:25:19.876922 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:25:19.876894 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd1bec47_fbe3_43b8_b455_2d38be74fd02.slice/crio-8b2991136841e47f6e0c3acd3a400aa46f1cd5664e0f76c2f7e050f0aba6d9bc WatchSource:0}: Error finding container 8b2991136841e47f6e0c3acd3a400aa46f1cd5664e0f76c2f7e050f0aba6d9bc: Status 404 returned error can't find the container with id 8b2991136841e47f6e0c3acd3a400aa46f1cd5664e0f76c2f7e050f0aba6d9bc Jul 05 13:25:20.684676 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:20.684639 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8krbq" event={"ID":"bd1bec47-fbe3-43b8-b455-2d38be74fd02","Type":"ContainerStarted","Data":"8b2991136841e47f6e0c3acd3a400aa46f1cd5664e0f76c2f7e050f0aba6d9bc"} Jul 05 13:25:22.695152 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:22.695121 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8krbq" event={"ID":"bd1bec47-fbe3-43b8-b455-2d38be74fd02","Type":"ContainerStarted","Data":"4c9043b63501dbe3bd39909db2c2498e4ece6fb46f4360ede67fef0d0bbb97f5"} Jul 05 13:25:22.695545 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:22.695214 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8krbq" Jul 05 13:25:22.727277 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:22.727234 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8krbq" podStartSLOduration=1.532476837 podStartE2EDuration="3.727219s" totalImagesPullingTime="2.194742163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:25:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:25:22.726737923 +0000 UTC m=+416.372048386" watchObservedRunningTime="2026-07-05 13:25:22.727219 +0000 UTC m=+416.372529463" Jul 05 13:25:22.944653 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:22.944623 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5665bfd6df-gmxrd"] Jul 05 13:25:22.948093 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:22.948040 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:22.955058 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:22.955033 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 05 13:25:22.955058 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:22.955048 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 05 13:25:22.955595 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:22.955578 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mnslj\"" Jul 05 13:25:22.957373 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:22.957358 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 05 13:25:22.957580 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:22.957566 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 05 13:25:22.961122 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:22.961108 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 05 13:25:22.987917 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:22.987895 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 05 13:25:22.988729 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:22.988711 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5665bfd6df-gmxrd"] Jul 05 13:25:23.063327 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:23.063306 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3cb06d2f-b20b-4731-98a5-5c250992b711-console-serving-cert\") pod \"console-5665bfd6df-gmxrd\" (UID: \"3cb06d2f-b20b-4731-98a5-5c250992b711\") " pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:23.063466 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:23.063346 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3cb06d2f-b20b-4731-98a5-5c250992b711-console-oauth-config\") pod \"console-5665bfd6df-gmxrd\" (UID: \"3cb06d2f-b20b-4731-98a5-5c250992b711\") " pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:23.063466 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:23.063381 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3cb06d2f-b20b-4731-98a5-5c250992b711-service-ca\") pod \"console-5665bfd6df-gmxrd\" (UID: \"3cb06d2f-b20b-4731-98a5-5c250992b711\") " pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:23.063466 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:23.063416 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cb06d2f-b20b-4731-98a5-5c250992b711-trusted-ca-bundle\") pod \"console-5665bfd6df-gmxrd\" (UID: \"3cb06d2f-b20b-4731-98a5-5c250992b711\") " pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:23.063466 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:23.063444 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3cb06d2f-b20b-4731-98a5-5c250992b711-console-config\") pod \"console-5665bfd6df-gmxrd\" (UID: \"3cb06d2f-b20b-4731-98a5-5c250992b711\") " pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:23.063466 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:23.063466 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hph2\" (UniqueName: \"kubernetes.io/projected/3cb06d2f-b20b-4731-98a5-5c250992b711-kube-api-access-7hph2\") pod \"console-5665bfd6df-gmxrd\" (UID: \"3cb06d2f-b20b-4731-98a5-5c250992b711\") " pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:23.063622 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:23.063523 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3cb06d2f-b20b-4731-98a5-5c250992b711-oauth-serving-cert\") pod \"console-5665bfd6df-gmxrd\" (UID: \"3cb06d2f-b20b-4731-98a5-5c250992b711\") " pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:23.164352 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:23.164325 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3cb06d2f-b20b-4731-98a5-5c250992b711-service-ca\") pod \"console-5665bfd6df-gmxrd\" (UID: \"3cb06d2f-b20b-4731-98a5-5c250992b711\") " pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:23.164352 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:23.164355 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cb06d2f-b20b-4731-98a5-5c250992b711-trusted-ca-bundle\") pod \"console-5665bfd6df-gmxrd\" (UID: \"3cb06d2f-b20b-4731-98a5-5c250992b711\") " pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:23.164561 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:23.164384 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3cb06d2f-b20b-4731-98a5-5c250992b711-console-config\") pod \"console-5665bfd6df-gmxrd\" (UID: \"3cb06d2f-b20b-4731-98a5-5c250992b711\") " pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:23.164561 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:23.164497 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hph2\" (UniqueName: \"kubernetes.io/projected/3cb06d2f-b20b-4731-98a5-5c250992b711-kube-api-access-7hph2\") pod \"console-5665bfd6df-gmxrd\" (UID: \"3cb06d2f-b20b-4731-98a5-5c250992b711\") " pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:23.164561 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:23.164534 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3cb06d2f-b20b-4731-98a5-5c250992b711-oauth-serving-cert\") pod \"console-5665bfd6df-gmxrd\" (UID: \"3cb06d2f-b20b-4731-98a5-5c250992b711\") " pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:23.164704 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:23.164579 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3cb06d2f-b20b-4731-98a5-5c250992b711-console-serving-cert\") pod \"console-5665bfd6df-gmxrd\" (UID: \"3cb06d2f-b20b-4731-98a5-5c250992b711\") " pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:23.164704 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:23.164622 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3cb06d2f-b20b-4731-98a5-5c250992b711-console-oauth-config\") pod \"console-5665bfd6df-gmxrd\" (UID: \"3cb06d2f-b20b-4731-98a5-5c250992b711\") " pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:23.165107 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:23.165078 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3cb06d2f-b20b-4731-98a5-5c250992b711-console-config\") pod \"console-5665bfd6df-gmxrd\" (UID: \"3cb06d2f-b20b-4731-98a5-5c250992b711\") " pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:23.165229 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:23.165178 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3cb06d2f-b20b-4731-98a5-5c250992b711-service-ca\") pod \"console-5665bfd6df-gmxrd\" (UID: \"3cb06d2f-b20b-4731-98a5-5c250992b711\") " pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:23.165291 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:23.165258 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3cb06d2f-b20b-4731-98a5-5c250992b711-oauth-serving-cert\") pod \"console-5665bfd6df-gmxrd\" (UID: \"3cb06d2f-b20b-4731-98a5-5c250992b711\") " pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:23.165565 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:23.165543 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cb06d2f-b20b-4731-98a5-5c250992b711-trusted-ca-bundle\") pod \"console-5665bfd6df-gmxrd\" (UID: \"3cb06d2f-b20b-4731-98a5-5c250992b711\") " pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:23.167045 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:23.167029 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3cb06d2f-b20b-4731-98a5-5c250992b711-console-oauth-config\") pod \"console-5665bfd6df-gmxrd\" (UID: \"3cb06d2f-b20b-4731-98a5-5c250992b711\") " pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:23.167132 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:23.167114 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3cb06d2f-b20b-4731-98a5-5c250992b711-console-serving-cert\") pod \"console-5665bfd6df-gmxrd\" (UID: \"3cb06d2f-b20b-4731-98a5-5c250992b711\") " pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:23.174544 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:23.174519 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hph2\" (UniqueName: \"kubernetes.io/projected/3cb06d2f-b20b-4731-98a5-5c250992b711-kube-api-access-7hph2\") pod \"console-5665bfd6df-gmxrd\" (UID: \"3cb06d2f-b20b-4731-98a5-5c250992b711\") " pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:23.257083 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:23.257014 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:23.395919 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:23.395893 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5665bfd6df-gmxrd"] Jul 05 13:25:23.397774 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:25:23.397751 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cb06d2f_b20b_4731_98a5_5c250992b711.slice/crio-8f8fc698cc5e24bf786ced2599903c477b87e7e46fbc90f16e7be7347b184723 WatchSource:0}: Error finding container 8f8fc698cc5e24bf786ced2599903c477b87e7e46fbc90f16e7be7347b184723: Status 404 returned error can't find the container with id 8f8fc698cc5e24bf786ced2599903c477b87e7e46fbc90f16e7be7347b184723 Jul 05 13:25:23.701592 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:23.701553 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5665bfd6df-gmxrd" event={"ID":"3cb06d2f-b20b-4731-98a5-5c250992b711","Type":"ContainerStarted","Data":"25c235d13bb9e2afad9e25f3a07d262cac451e1e4e6269eb0e1af60fa4bb943a"} Jul 05 13:25:23.702001 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:23.701615 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5665bfd6df-gmxrd" event={"ID":"3cb06d2f-b20b-4731-98a5-5c250992b711","Type":"ContainerStarted","Data":"8f8fc698cc5e24bf786ced2599903c477b87e7e46fbc90f16e7be7347b184723"} Jul 05 13:25:23.732996 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:23.732949 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5665bfd6df-gmxrd" podStartSLOduration=1.732932671 podStartE2EDuration="1.732932671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:25:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:25:23.731376054 +0000 UTC m=+417.376686514" watchObservedRunningTime="2026-07-05 13:25:23.732932671 +0000 UTC m=+417.378243136" Jul 05 13:25:33.258115 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:33.258074 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:33.258600 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:33.258140 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:33.262842 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:33.262803 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:33.704467 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:33.704443 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8krbq" Jul 05 13:25:33.752042 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:33.752015 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5665bfd6df-gmxrd" Jul 05 13:25:37.655865 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:37.655834 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz5t"] Jul 05 13:25:37.667063 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:37.667038 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz5t" Jul 05 13:25:37.671326 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:37.671304 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qljl9\"" Jul 05 13:25:37.682488 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:37.682462 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bbae7be-85b3-424d-be04-b55272611fa2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-whz5t\" (UID: \"9bbae7be-85b3-424d-be04-b55272611fa2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz5t" Jul 05 13:25:37.682633 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:37.682497 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjv4c\" (UniqueName: \"kubernetes.io/projected/9bbae7be-85b3-424d-be04-b55272611fa2-kube-api-access-rjv4c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-whz5t\" (UID: \"9bbae7be-85b3-424d-be04-b55272611fa2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz5t" Jul 05 13:25:37.689275 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:37.689251 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz5t"] Jul 05 13:25:37.783025 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:37.782991 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bbae7be-85b3-424d-be04-b55272611fa2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-whz5t\" (UID: \"9bbae7be-85b3-424d-be04-b55272611fa2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz5t" Jul 05 13:25:37.783025 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:37.783025 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjv4c\" (UniqueName: \"kubernetes.io/projected/9bbae7be-85b3-424d-be04-b55272611fa2-kube-api-access-rjv4c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-whz5t\" (UID: \"9bbae7be-85b3-424d-be04-b55272611fa2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz5t" Jul 05 13:25:37.783387 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:37.783367 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bbae7be-85b3-424d-be04-b55272611fa2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-whz5t\" (UID: \"9bbae7be-85b3-424d-be04-b55272611fa2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz5t" Jul 05 13:25:37.829697 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:37.829661 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjv4c\" (UniqueName: \"kubernetes.io/projected/9bbae7be-85b3-424d-be04-b55272611fa2-kube-api-access-rjv4c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-whz5t\" (UID: \"9bbae7be-85b3-424d-be04-b55272611fa2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz5t" Jul 05 13:25:37.979240 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:37.979146 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz5t" Jul 05 13:25:38.199437 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:38.199404 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz5t"] Jul 05 13:25:38.203493 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:25:38.203458 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bbae7be_85b3_424d_be04_b55272611fa2.slice/crio-3ad194ee1ddf1961d0a2c5ff14e4ce180287ffeee1137ab9acb500d18ccb2755 WatchSource:0}: Error finding container 3ad194ee1ddf1961d0a2c5ff14e4ce180287ffeee1137ab9acb500d18ccb2755: Status 404 returned error can't find the container with id 3ad194ee1ddf1961d0a2c5ff14e4ce180287ffeee1137ab9acb500d18ccb2755 Jul 05 13:25:38.771910 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:38.771872 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz5t" event={"ID":"9bbae7be-85b3-424d-be04-b55272611fa2","Type":"ContainerStarted","Data":"3ad194ee1ddf1961d0a2c5ff14e4ce180287ffeee1137ab9acb500d18ccb2755"} Jul 05 13:25:43.796969 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:43.796930 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz5t" event={"ID":"9bbae7be-85b3-424d-be04-b55272611fa2","Type":"ContainerStarted","Data":"a2a9387f942b9173c7f66cf9670d85f6bfac0dddd7a95aabae04c30d998f2a09"} Jul 05 13:25:43.797427 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:43.797079 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz5t" Jul 05 13:25:43.979818 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:43.979764 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz5t" podStartSLOduration=2.120225078 podStartE2EDuration="6.979744444s" totalImagesPullingTime="4.859519366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:25:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:25:43.976610313 +0000 UTC m=+437.621920776" watchObservedRunningTime="2026-07-05 13:25:43.979744444 +0000 UTC m=+437.625054966" Jul 05 13:25:54.803833 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:54.803740 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz5t" Jul 05 13:25:57.896412 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:57.896374 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz5t"] Jul 05 13:25:57.896878 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:57.896565 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz5t" podUID="9bbae7be-85b3-424d-be04-b55272611fa2" containerName="manager" containerID="cri-o://a2a9387f942b9173c7f66cf9670d85f6bfac0dddd7a95aabae04c30d998f2a09" gracePeriod=10 Jul 05 13:25:58.166118 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:58.166094 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz5t" Jul 05 13:25:58.263090 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:58.263064 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjv4c\" (UniqueName: \"kubernetes.io/projected/9bbae7be-85b3-424d-be04-b55272611fa2-kube-api-access-rjv4c\") pod \"9bbae7be-85b3-424d-be04-b55272611fa2\" (UID: \"9bbae7be-85b3-424d-be04-b55272611fa2\") " Jul 05 13:25:58.263090 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:58.263099 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bbae7be-85b3-424d-be04-b55272611fa2-extensions-socket-volume\") pod \"9bbae7be-85b3-424d-be04-b55272611fa2\" (UID: \"9bbae7be-85b3-424d-be04-b55272611fa2\") " Jul 05 13:25:58.263718 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:58.263683 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bbae7be-85b3-424d-be04-b55272611fa2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9bbae7be-85b3-424d-be04-b55272611fa2" (UID: "9bbae7be-85b3-424d-be04-b55272611fa2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 13:25:58.265209 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:58.265178 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bbae7be-85b3-424d-be04-b55272611fa2-kube-api-access-rjv4c" (OuterVolumeSpecName: "kube-api-access-rjv4c") pod "9bbae7be-85b3-424d-be04-b55272611fa2" (UID: "9bbae7be-85b3-424d-be04-b55272611fa2"). InnerVolumeSpecName "kube-api-access-rjv4c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:25:58.364342 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:58.364307 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjv4c\" (UniqueName: \"kubernetes.io/projected/9bbae7be-85b3-424d-be04-b55272611fa2-kube-api-access-rjv4c\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Jul 05 13:25:58.364342 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:58.364337 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9bbae7be-85b3-424d-be04-b55272611fa2-extensions-socket-volume\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Jul 05 13:25:58.864774 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:58.864743 2565 generic.go:356] "Generic (PLEG): container finished" podID="9bbae7be-85b3-424d-be04-b55272611fa2" containerID="a2a9387f942b9173c7f66cf9670d85f6bfac0dddd7a95aabae04c30d998f2a09" exitCode=0 Jul 05 13:25:58.864960 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:58.864802 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz5t" Jul 05 13:25:58.864960 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:58.864837 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz5t" event={"ID":"9bbae7be-85b3-424d-be04-b55272611fa2","Type":"ContainerDied","Data":"a2a9387f942b9173c7f66cf9670d85f6bfac0dddd7a95aabae04c30d998f2a09"} Jul 05 13:25:58.864960 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:58.864891 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz5t" event={"ID":"9bbae7be-85b3-424d-be04-b55272611fa2","Type":"ContainerDied","Data":"3ad194ee1ddf1961d0a2c5ff14e4ce180287ffeee1137ab9acb500d18ccb2755"} Jul 05 13:25:58.864960 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:58.864912 2565 scope.go:117] "RemoveContainer" containerID="a2a9387f942b9173c7f66cf9670d85f6bfac0dddd7a95aabae04c30d998f2a09" Jul 05 13:25:58.873354 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:58.873336 2565 scope.go:117] "RemoveContainer" containerID="a2a9387f942b9173c7f66cf9670d85f6bfac0dddd7a95aabae04c30d998f2a09" Jul 05 13:25:58.873611 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:25:58.873593 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2a9387f942b9173c7f66cf9670d85f6bfac0dddd7a95aabae04c30d998f2a09\": container with ID starting with a2a9387f942b9173c7f66cf9670d85f6bfac0dddd7a95aabae04c30d998f2a09 not found: ID does not exist" containerID="a2a9387f942b9173c7f66cf9670d85f6bfac0dddd7a95aabae04c30d998f2a09" Jul 05 13:25:58.873673 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:58.873618 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2a9387f942b9173c7f66cf9670d85f6bfac0dddd7a95aabae04c30d998f2a09"} err="failed to get container status \"a2a9387f942b9173c7f66cf9670d85f6bfac0dddd7a95aabae04c30d998f2a09\": rpc error: code = NotFound desc = could not find container \"a2a9387f942b9173c7f66cf9670d85f6bfac0dddd7a95aabae04c30d998f2a09\": container with ID starting with a2a9387f942b9173c7f66cf9670d85f6bfac0dddd7a95aabae04c30d998f2a09 not found: ID does not exist" Jul 05 13:25:58.924033 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:58.924007 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz5t"] Jul 05 13:25:58.929796 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:25:58.929774 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-whz5t"] Jul 05 13:26:00.819139 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:00.819100 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bbae7be-85b3-424d-be04-b55272611fa2" path="/var/lib/kubelet/pods/9bbae7be-85b3-424d-be04-b55272611fa2/volumes" Jul 05 13:26:17.231194 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:17.231158 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mp6sc"] Jul 05 13:26:17.231611 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:17.231569 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bbae7be-85b3-424d-be04-b55272611fa2" containerName="manager" Jul 05 13:26:17.231611 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:17.231584 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bbae7be-85b3-424d-be04-b55272611fa2" containerName="manager" Jul 05 13:26:17.231680 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:17.231650 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bbae7be-85b3-424d-be04-b55272611fa2" containerName="manager" Jul 05 13:26:17.263082 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:17.263056 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mp6sc" Jul 05 13:26:17.267008 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:17.266980 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 05 13:26:17.273030 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:17.273005 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rxqw6\"" Jul 05 13:26:17.308200 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:17.308170 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mp6sc"] Jul 05 13:26:17.347135 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:17.347102 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mp6sc"] Jul 05 13:26:17.433304 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:17.433262 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qgrl\" (UniqueName: \"kubernetes.io/projected/00a2fb67-8356-464d-b592-2097003b4787-kube-api-access-5qgrl\") pod \"limitador-limitador-64c94fd64f-mp6sc\" (UID: \"00a2fb67-8356-464d-b592-2097003b4787\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mp6sc" Jul 05 13:26:17.433479 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:17.433337 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/00a2fb67-8356-464d-b592-2097003b4787-config-file\") pod \"limitador-limitador-64c94fd64f-mp6sc\" (UID: \"00a2fb67-8356-464d-b592-2097003b4787\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mp6sc" Jul 05 13:26:17.534888 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:17.534771 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/00a2fb67-8356-464d-b592-2097003b4787-config-file\") pod \"limitador-limitador-64c94fd64f-mp6sc\" (UID: \"00a2fb67-8356-464d-b592-2097003b4787\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mp6sc" Jul 05 13:26:17.535062 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:17.534931 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qgrl\" (UniqueName: \"kubernetes.io/projected/00a2fb67-8356-464d-b592-2097003b4787-kube-api-access-5qgrl\") pod \"limitador-limitador-64c94fd64f-mp6sc\" (UID: \"00a2fb67-8356-464d-b592-2097003b4787\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mp6sc" Jul 05 13:26:17.535455 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:17.535433 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/00a2fb67-8356-464d-b592-2097003b4787-config-file\") pod \"limitador-limitador-64c94fd64f-mp6sc\" (UID: \"00a2fb67-8356-464d-b592-2097003b4787\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mp6sc" Jul 05 13:26:17.557625 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:17.557594 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qgrl\" (UniqueName: \"kubernetes.io/projected/00a2fb67-8356-464d-b592-2097003b4787-kube-api-access-5qgrl\") pod \"limitador-limitador-64c94fd64f-mp6sc\" (UID: \"00a2fb67-8356-464d-b592-2097003b4787\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mp6sc" Jul 05 13:26:17.575265 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:17.575235 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mp6sc" Jul 05 13:26:17.735609 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:17.735575 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mp6sc"] Jul 05 13:26:17.738622 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:26:17.738598 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00a2fb67_8356_464d_b592_2097003b4787.slice/crio-a37e1115ef3f287411c4abc4b1e831261256faaf94e97e86b80289d6c9e69783 WatchSource:0}: Error finding container a37e1115ef3f287411c4abc4b1e831261256faaf94e97e86b80289d6c9e69783: Status 404 returned error can't find the container with id a37e1115ef3f287411c4abc4b1e831261256faaf94e97e86b80289d6c9e69783 Jul 05 13:26:17.950290 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:17.950257 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mp6sc" event={"ID":"00a2fb67-8356-464d-b592-2097003b4787","Type":"ContainerStarted","Data":"a37e1115ef3f287411c4abc4b1e831261256faaf94e97e86b80289d6c9e69783"} Jul 05 13:26:20.966148 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:20.966111 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mp6sc" event={"ID":"00a2fb67-8356-464d-b592-2097003b4787","Type":"ContainerStarted","Data":"d26159fd77b67af5b9daa9ea6bb933e366dd0c1fef79920d0b966d135add88b2"} Jul 05 13:26:20.966558 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:20.966261 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-mp6sc" Jul 05 13:26:21.000168 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:20.999961 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-mp6sc" podStartSLOduration=1.332402284 podStartE2EDuration="3.999941889s" totalImagesPullingTime="2.667539605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:26:20.999225757 +0000 UTC m=+474.644536219" watchObservedRunningTime="2026-07-05 13:26:20.999941889 +0000 UTC m=+474.645252352" Jul 05 13:26:31.971738 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:31.971706 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-mp6sc" Jul 05 13:26:32.112638 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:32.112604 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mp6sc"] Jul 05 13:26:32.112907 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:32.112874 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-mp6sc" podUID="00a2fb67-8356-464d-b592-2097003b4787" containerName="limitador" containerID="cri-o://d26159fd77b67af5b9daa9ea6bb933e366dd0c1fef79920d0b966d135add88b2" gracePeriod=30 Jul 05 13:26:33.026220 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:33.026187 2565 generic.go:356] "Generic (PLEG): container finished" podID="00a2fb67-8356-464d-b592-2097003b4787" containerID="d26159fd77b67af5b9daa9ea6bb933e366dd0c1fef79920d0b966d135add88b2" exitCode=0 Jul 05 13:26:33.026564 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:33.026248 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mp6sc" event={"ID":"00a2fb67-8356-464d-b592-2097003b4787","Type":"ContainerDied","Data":"d26159fd77b67af5b9daa9ea6bb933e366dd0c1fef79920d0b966d135add88b2"} Jul 05 13:26:33.065131 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:33.065106 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mp6sc" Jul 05 13:26:33.164582 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:33.164545 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qgrl\" (UniqueName: \"kubernetes.io/projected/00a2fb67-8356-464d-b592-2097003b4787-kube-api-access-5qgrl\") pod \"00a2fb67-8356-464d-b592-2097003b4787\" (UID: \"00a2fb67-8356-464d-b592-2097003b4787\") " Jul 05 13:26:33.164719 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:33.164593 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/00a2fb67-8356-464d-b592-2097003b4787-config-file\") pod \"00a2fb67-8356-464d-b592-2097003b4787\" (UID: \"00a2fb67-8356-464d-b592-2097003b4787\") " Jul 05 13:26:33.164991 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:33.164970 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00a2fb67-8356-464d-b592-2097003b4787-config-file" (OuterVolumeSpecName: "config-file") pod "00a2fb67-8356-464d-b592-2097003b4787" (UID: "00a2fb67-8356-464d-b592-2097003b4787"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 13:26:33.166538 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:33.166520 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00a2fb67-8356-464d-b592-2097003b4787-kube-api-access-5qgrl" (OuterVolumeSpecName: "kube-api-access-5qgrl") pod "00a2fb67-8356-464d-b592-2097003b4787" (UID: "00a2fb67-8356-464d-b592-2097003b4787"). InnerVolumeSpecName "kube-api-access-5qgrl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:26:33.265603 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:33.265530 2565 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/00a2fb67-8356-464d-b592-2097003b4787-config-file\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Jul 05 13:26:33.265603 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:33.265555 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qgrl\" (UniqueName: \"kubernetes.io/projected/00a2fb67-8356-464d-b592-2097003b4787-kube-api-access-5qgrl\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Jul 05 13:26:34.032688 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:34.032658 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mp6sc" event={"ID":"00a2fb67-8356-464d-b592-2097003b4787","Type":"ContainerDied","Data":"a37e1115ef3f287411c4abc4b1e831261256faaf94e97e86b80289d6c9e69783"} Jul 05 13:26:34.032688 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:34.032680 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mp6sc" Jul 05 13:26:34.033207 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:34.032715 2565 scope.go:117] "RemoveContainer" containerID="d26159fd77b67af5b9daa9ea6bb933e366dd0c1fef79920d0b966d135add88b2" Jul 05 13:26:34.060389 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:34.060364 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mp6sc"] Jul 05 13:26:34.062756 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:34.062736 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mp6sc"] Jul 05 13:26:34.818043 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:34.818012 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00a2fb67-8356-464d-b592-2097003b4787" path="/var/lib/kubelet/pods/00a2fb67-8356-464d-b592-2097003b4787/volumes" Jul 05 13:26:38.581519 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:38.581478 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-s9l7d"] Jul 05 13:26:38.582070 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:38.581894 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00a2fb67-8356-464d-b592-2097003b4787" containerName="limitador" Jul 05 13:26:38.582070 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:38.581908 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="00a2fb67-8356-464d-b592-2097003b4787" containerName="limitador" Jul 05 13:26:38.582070 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:38.581977 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="00a2fb67-8356-464d-b592-2097003b4787" containerName="limitador" Jul 05 13:26:38.586308 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:38.586290 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-s9l7d" Jul 05 13:26:38.593989 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:38.593973 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mc2z8\"" Jul 05 13:26:38.594316 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:38.594301 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 05 13:26:38.609712 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:38.609682 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbqd2\" (UniqueName: \"kubernetes.io/projected/a8aa53c7-0996-411f-b882-73c5d4c17ace-kube-api-access-rbqd2\") pod \"postgres-69fb4594cf-s9l7d\" (UID: \"a8aa53c7-0996-411f-b882-73c5d4c17ace\") " pod="opendatahub/postgres-69fb4594cf-s9l7d" Jul 05 13:26:38.609875 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:38.609855 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a8aa53c7-0996-411f-b882-73c5d4c17ace-data\") pod \"postgres-69fb4594cf-s9l7d\" (UID: \"a8aa53c7-0996-411f-b882-73c5d4c17ace\") " pod="opendatahub/postgres-69fb4594cf-s9l7d" Jul 05 13:26:38.610383 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:38.610363 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-s9l7d"] Jul 05 13:26:38.710347 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:38.710313 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbqd2\" (UniqueName: \"kubernetes.io/projected/a8aa53c7-0996-411f-b882-73c5d4c17ace-kube-api-access-rbqd2\") pod \"postgres-69fb4594cf-s9l7d\" (UID: \"a8aa53c7-0996-411f-b882-73c5d4c17ace\") " pod="opendatahub/postgres-69fb4594cf-s9l7d" Jul 05 13:26:38.710508 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:38.710397 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a8aa53c7-0996-411f-b882-73c5d4c17ace-data\") pod \"postgres-69fb4594cf-s9l7d\" (UID: \"a8aa53c7-0996-411f-b882-73c5d4c17ace\") " pod="opendatahub/postgres-69fb4594cf-s9l7d" Jul 05 13:26:38.710718 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:38.710704 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a8aa53c7-0996-411f-b882-73c5d4c17ace-data\") pod \"postgres-69fb4594cf-s9l7d\" (UID: \"a8aa53c7-0996-411f-b882-73c5d4c17ace\") " pod="opendatahub/postgres-69fb4594cf-s9l7d" Jul 05 13:26:38.724609 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:38.724583 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbqd2\" (UniqueName: \"kubernetes.io/projected/a8aa53c7-0996-411f-b882-73c5d4c17ace-kube-api-access-rbqd2\") pod \"postgres-69fb4594cf-s9l7d\" (UID: \"a8aa53c7-0996-411f-b882-73c5d4c17ace\") " pod="opendatahub/postgres-69fb4594cf-s9l7d" Jul 05 13:26:38.897225 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:38.897200 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-s9l7d" Jul 05 13:26:39.048996 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:39.048967 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-s9l7d"] Jul 05 13:26:39.053069 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:26:39.053045 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8aa53c7_0996_411f_b882_73c5d4c17ace.slice/crio-cc23049425f1a315d35e40733470b7b7bd462a90e0a43e6e7f1e36ca6a633f5f WatchSource:0}: Error finding container cc23049425f1a315d35e40733470b7b7bd462a90e0a43e6e7f1e36ca6a633f5f: Status 404 returned error can't find the container with id cc23049425f1a315d35e40733470b7b7bd462a90e0a43e6e7f1e36ca6a633f5f Jul 05 13:26:40.062996 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:40.062961 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-s9l7d" event={"ID":"a8aa53c7-0996-411f-b882-73c5d4c17ace","Type":"ContainerStarted","Data":"cc23049425f1a315d35e40733470b7b7bd462a90e0a43e6e7f1e36ca6a633f5f"} Jul 05 13:26:44.085637 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:44.085540 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-s9l7d" event={"ID":"a8aa53c7-0996-411f-b882-73c5d4c17ace","Type":"ContainerStarted","Data":"cf29c46ace447d968c730ad871d1a79f5e3959464326df462c7e4ad1b2bd6710"} Jul 05 13:26:44.086040 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:44.085669 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-s9l7d" Jul 05 13:26:50.119123 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:50.119095 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-s9l7d" Jul 05 13:26:50.165431 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:50.165383 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-s9l7d" podStartSLOduration=7.575380388 podStartE2EDuration="12.165364228s" totalImagesPullingTime="4.58998384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:26:44.119856497 +0000 UTC m=+497.765166981" watchObservedRunningTime="2026-07-05 13:26:50.165364228 +0000 UTC m=+503.810674692" Jul 05 13:26:58.129252 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:58.129218 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68747c6dd4-xkdkj"] Jul 05 13:26:58.153251 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:58.153223 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68747c6dd4-xkdkj" Jul 05 13:26:58.156205 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:58.156179 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68747c6dd4-xkdkj"] Jul 05 13:26:58.158314 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:58.158291 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 05 13:26:58.158994 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:58.158973 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7rg2d\"" Jul 05 13:26:58.159224 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:58.159209 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 05 13:26:58.279535 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:58.279505 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tpf6\" (UniqueName: \"kubernetes.io/projected/8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3-kube-api-access-5tpf6\") pod \"maas-controller-68747c6dd4-xkdkj\" (UID: \"8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3\") " pod="opendatahub/maas-controller-68747c6dd4-xkdkj" Jul 05 13:26:58.279718 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:58.279634 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3-webhook-cert\") pod \"maas-controller-68747c6dd4-xkdkj\" (UID: \"8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3\") " pod="opendatahub/maas-controller-68747c6dd4-xkdkj" Jul 05 13:26:58.380825 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:58.380774 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3-webhook-cert\") pod \"maas-controller-68747c6dd4-xkdkj\" (UID: \"8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3\") " pod="opendatahub/maas-controller-68747c6dd4-xkdkj" Jul 05 13:26:58.381028 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:58.380899 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tpf6\" (UniqueName: \"kubernetes.io/projected/8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3-kube-api-access-5tpf6\") pod \"maas-controller-68747c6dd4-xkdkj\" (UID: \"8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3\") " pod="opendatahub/maas-controller-68747c6dd4-xkdkj" Jul 05 13:26:58.381028 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:26:58.380916 2565 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 05 13:26:58.381028 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:26:58.380994 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3-webhook-cert podName:8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3 nodeName:}" failed. No retries permitted until 2026-07-05 13:26:58.880971677 +0000 UTC m=+512.526282119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3-webhook-cert") pod "maas-controller-68747c6dd4-xkdkj" (UID: "8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3") : secret "maas-controller-webhook-cert" not found Jul 05 13:26:58.411677 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:58.411649 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bf4fc7478-wbl64"] Jul 05 13:26:58.412878 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:58.412851 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tpf6\" (UniqueName: \"kubernetes.io/projected/8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3-kube-api-access-5tpf6\") pod \"maas-controller-68747c6dd4-xkdkj\" (UID: \"8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3\") " pod="opendatahub/maas-controller-68747c6dd4-xkdkj" Jul 05 13:26:58.415227 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:58.415211 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf4fc7478-wbl64" Jul 05 13:26:58.434565 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:58.434540 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bf4fc7478-wbl64"] Jul 05 13:26:58.481728 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:58.481697 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx6dr\" (UniqueName: \"kubernetes.io/projected/e36a6eb5-8849-4d3a-8e41-dbb3887ceb8f-kube-api-access-nx6dr\") pod \"maas-controller-7bf4fc7478-wbl64\" (UID: \"e36a6eb5-8849-4d3a-8e41-dbb3887ceb8f\") " pod="opendatahub/maas-controller-7bf4fc7478-wbl64" Jul 05 13:26:58.481876 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:58.481797 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e36a6eb5-8849-4d3a-8e41-dbb3887ceb8f-webhook-cert\") pod \"maas-controller-7bf4fc7478-wbl64\" (UID: \"e36a6eb5-8849-4d3a-8e41-dbb3887ceb8f\") " pod="opendatahub/maas-controller-7bf4fc7478-wbl64" Jul 05 13:26:58.583080 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:58.583046 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx6dr\" (UniqueName: \"kubernetes.io/projected/e36a6eb5-8849-4d3a-8e41-dbb3887ceb8f-kube-api-access-nx6dr\") pod \"maas-controller-7bf4fc7478-wbl64\" (UID: \"e36a6eb5-8849-4d3a-8e41-dbb3887ceb8f\") " pod="opendatahub/maas-controller-7bf4fc7478-wbl64" Jul 05 13:26:58.583247 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:58.583113 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e36a6eb5-8849-4d3a-8e41-dbb3887ceb8f-webhook-cert\") pod \"maas-controller-7bf4fc7478-wbl64\" (UID: \"e36a6eb5-8849-4d3a-8e41-dbb3887ceb8f\") " pod="opendatahub/maas-controller-7bf4fc7478-wbl64" Jul 05 13:26:58.585605 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:58.585581 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e36a6eb5-8849-4d3a-8e41-dbb3887ceb8f-webhook-cert\") pod \"maas-controller-7bf4fc7478-wbl64\" (UID: \"e36a6eb5-8849-4d3a-8e41-dbb3887ceb8f\") " pod="opendatahub/maas-controller-7bf4fc7478-wbl64" Jul 05 13:26:58.596530 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:58.596506 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx6dr\" (UniqueName: \"kubernetes.io/projected/e36a6eb5-8849-4d3a-8e41-dbb3887ceb8f-kube-api-access-nx6dr\") pod \"maas-controller-7bf4fc7478-wbl64\" (UID: \"e36a6eb5-8849-4d3a-8e41-dbb3887ceb8f\") " pod="opendatahub/maas-controller-7bf4fc7478-wbl64" Jul 05 13:26:58.729555 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:58.729463 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf4fc7478-wbl64" Jul 05 13:26:58.870271 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:58.870248 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bf4fc7478-wbl64"] Jul 05 13:26:58.872638 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:26:58.872611 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode36a6eb5_8849_4d3a_8e41_dbb3887ceb8f.slice/crio-8aa2d91213481761b3d09c181ce504bd3ded2eff89dc7b634dbe2160260f659f WatchSource:0}: Error finding container 8aa2d91213481761b3d09c181ce504bd3ded2eff89dc7b634dbe2160260f659f: Status 404 returned error can't find the container with id 8aa2d91213481761b3d09c181ce504bd3ded2eff89dc7b634dbe2160260f659f Jul 05 13:26:58.884771 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:58.884746 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3-webhook-cert\") pod \"maas-controller-68747c6dd4-xkdkj\" (UID: \"8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3\") " pod="opendatahub/maas-controller-68747c6dd4-xkdkj" Jul 05 13:26:58.887017 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:58.886997 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3-webhook-cert\") pod \"maas-controller-68747c6dd4-xkdkj\" (UID: \"8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3\") " pod="opendatahub/maas-controller-68747c6dd4-xkdkj" Jul 05 13:26:59.068254 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:59.068174 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68747c6dd4-xkdkj" Jul 05 13:26:59.158007 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:59.157963 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf4fc7478-wbl64" event={"ID":"e36a6eb5-8849-4d3a-8e41-dbb3887ceb8f","Type":"ContainerStarted","Data":"8aa2d91213481761b3d09c181ce504bd3ded2eff89dc7b634dbe2160260f659f"} Jul 05 13:26:59.206328 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:26:59.206305 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68747c6dd4-xkdkj"] Jul 05 13:26:59.207975 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:26:59.207945 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d0ed4c3_6b9b_4c0b_af05_b6e8222bb8d3.slice/crio-0072ccc74ba8c973ba57a05cad5ceb3089b206707ce2889a73929ba0169fe15c WatchSource:0}: Error finding container 0072ccc74ba8c973ba57a05cad5ceb3089b206707ce2889a73929ba0169fe15c: Status 404 returned error can't find the container with id 0072ccc74ba8c973ba57a05cad5ceb3089b206707ce2889a73929ba0169fe15c Jul 05 13:27:00.167005 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:00.166872 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68747c6dd4-xkdkj" event={"ID":"8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3","Type":"ContainerStarted","Data":"0072ccc74ba8c973ba57a05cad5ceb3089b206707ce2889a73929ba0169fe15c"} Jul 05 13:27:02.178880 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:02.178845 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68747c6dd4-xkdkj" event={"ID":"8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3","Type":"ContainerStarted","Data":"63fc1eb8ec45e76326120e70a2823c1f1506c58d019c490c3ab22dd7717cc963"} Jul 05 13:27:02.179323 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:02.178932 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68747c6dd4-xkdkj" Jul 05 13:27:02.180424 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:02.180403 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf4fc7478-wbl64" event={"ID":"e36a6eb5-8849-4d3a-8e41-dbb3887ceb8f","Type":"ContainerStarted","Data":"6f2724cab7316d0cfd136b08865994e2ca8fcc5ea35823d575f3a01a4badb211"} Jul 05 13:27:02.180539 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:02.180527 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bf4fc7478-wbl64" Jul 05 13:27:02.215933 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:02.215884 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-68747c6dd4-xkdkj" podStartSLOduration=1.854660887 podStartE2EDuration="4.215869172s" totalImagesPullingTime="2.361208285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:26:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:27:02.213461337 +0000 UTC m=+515.858771809" watchObservedRunningTime="2026-07-05 13:27:02.215869172 +0000 UTC m=+515.861179634" Jul 05 13:27:02.258422 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:02.258369 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bf4fc7478-wbl64" podStartSLOduration=1.5692283649999998 podStartE2EDuration="4.258349646s" totalImagesPullingTime="2.689121281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:26:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:27:02.253220834 +0000 UTC m=+515.898531315" watchObservedRunningTime="2026-07-05 13:27:02.258349646 +0000 UTC m=+515.903660142" Jul 05 13:27:13.192891 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:13.192859 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68747c6dd4-xkdkj" Jul 05 13:27:13.193341 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:13.193001 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bf4fc7478-wbl64" Jul 05 13:27:13.280480 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:13.280445 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68747c6dd4-xkdkj"] Jul 05 13:27:13.280707 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:13.280665 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-68747c6dd4-xkdkj" podUID="8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3" containerName="manager" containerID="cri-o://63fc1eb8ec45e76326120e70a2823c1f1506c58d019c490c3ab22dd7717cc963" gracePeriod=30 Jul 05 13:27:13.532061 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:13.532035 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68747c6dd4-xkdkj" Jul 05 13:27:13.625651 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:13.625614 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tpf6\" (UniqueName: \"kubernetes.io/projected/8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3-kube-api-access-5tpf6\") pod \"8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3\" (UID: \"8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3\") " Jul 05 13:27:13.625874 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:13.625676 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3-webhook-cert\") pod \"8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3\" (UID: \"8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3\") " Jul 05 13:27:13.627844 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:13.627795 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3" (UID: "8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:27:13.627942 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:13.627848 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3-kube-api-access-5tpf6" (OuterVolumeSpecName: "kube-api-access-5tpf6") pod "8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3" (UID: "8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3"). InnerVolumeSpecName "kube-api-access-5tpf6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:27:13.727371 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:13.727283 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tpf6\" (UniqueName: \"kubernetes.io/projected/8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3-kube-api-access-5tpf6\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Jul 05 13:27:13.727371 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:13.727312 2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3-webhook-cert\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Jul 05 13:27:14.236144 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:14.236114 2565 generic.go:356] "Generic (PLEG): container finished" podID="8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3" containerID="63fc1eb8ec45e76326120e70a2823c1f1506c58d019c490c3ab22dd7717cc963" exitCode=0 Jul 05 13:27:14.236530 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:14.236154 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68747c6dd4-xkdkj" Jul 05 13:27:14.236530 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:14.236156 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68747c6dd4-xkdkj" event={"ID":"8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3","Type":"ContainerDied","Data":"63fc1eb8ec45e76326120e70a2823c1f1506c58d019c490c3ab22dd7717cc963"} Jul 05 13:27:14.236530 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:14.236297 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68747c6dd4-xkdkj" event={"ID":"8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3","Type":"ContainerDied","Data":"0072ccc74ba8c973ba57a05cad5ceb3089b206707ce2889a73929ba0169fe15c"} Jul 05 13:27:14.236530 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:14.236333 2565 scope.go:117] "RemoveContainer" containerID="63fc1eb8ec45e76326120e70a2823c1f1506c58d019c490c3ab22dd7717cc963" Jul 05 13:27:14.245040 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:14.245025 2565 scope.go:117] "RemoveContainer" containerID="63fc1eb8ec45e76326120e70a2823c1f1506c58d019c490c3ab22dd7717cc963" Jul 05 13:27:14.245307 ip-10-0-135-121 kubenswrapper[2565]: E0705 13:27:14.245291 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63fc1eb8ec45e76326120e70a2823c1f1506c58d019c490c3ab22dd7717cc963\": container with ID starting with 63fc1eb8ec45e76326120e70a2823c1f1506c58d019c490c3ab22dd7717cc963 not found: ID does not exist" containerID="63fc1eb8ec45e76326120e70a2823c1f1506c58d019c490c3ab22dd7717cc963" Jul 05 13:27:14.245344 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:14.245316 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63fc1eb8ec45e76326120e70a2823c1f1506c58d019c490c3ab22dd7717cc963"} err="failed to get container status \"63fc1eb8ec45e76326120e70a2823c1f1506c58d019c490c3ab22dd7717cc963\": rpc error: code = NotFound desc = could not find container \"63fc1eb8ec45e76326120e70a2823c1f1506c58d019c490c3ab22dd7717cc963\": container with ID starting with 63fc1eb8ec45e76326120e70a2823c1f1506c58d019c490c3ab22dd7717cc963 not found: ID does not exist" Jul 05 13:27:14.261839 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:14.261801 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68747c6dd4-xkdkj"] Jul 05 13:27:14.269965 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:14.269942 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68747c6dd4-xkdkj"] Jul 05 13:27:14.818372 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:27:14.818342 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3" path="/var/lib/kubelet/pods/8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3/volumes" Jul 05 13:37:24.785226 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:24.785184 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fxbrs_93e19444-8869-4303-9e9c-8dca5f8bdaaf/manager/0.log" Jul 05 13:37:24.898093 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:24.898065 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bf4fc7478-wbl64_e36a6eb5-8849-4d3a-8e41-dbb3887ceb8f/manager/0.log" Jul 05 13:37:25.006336 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:25.006302 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-nwxjc_e78b333d-7036-44f0-93c8-ece5ac128a3f/server/0.log" Jul 05 13:37:25.120826 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:25.120717 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-44ssq_1ca4c5da-e508-401d-8372-943b0aa79318/manager/0.log" Jul 05 13:37:25.484225 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:25.484199 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-678684cb77-z9gm7_6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8/manager/0.log" Jul 05 13:37:25.490126 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:25.490106 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-678684cb77-z9gm7_6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8/copy-manifests/0.log" Jul 05 13:37:25.601167 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:25.601142 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-s9l7d_a8aa53c7-0996-411f-b882-73c5d4c17ace/postgres/0.log" Jul 05 13:37:26.983553 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:26.983522 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-8krbq_bd1bec47-fbe3-43b8-b455-2d38be74fd02/manager/0.log" Jul 05 13:37:27.320063 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:27.319984 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ppzgz_5bed4941-6933-4084-bc09-d94c72cb233e/registry-server/0.log" Jul 05 13:37:28.112669 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:28.112639 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mdfq9_5954207d-93c1-4fa3-9c79-67073b23127c/discovery/0.log" Jul 05 13:37:28.214598 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:28.214565 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5886f89bdd-4dlbj_aa52ceb9-ed96-4729-8e90-5782089a4fca/kube-auth-proxy/0.log" Jul 05 13:37:28.539481 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:28.539457 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54c57459b5-lt6zp_6665a837-1cd2-41d9-86ef-7d3cfcba4dc3/router/0.log" Jul 05 13:37:35.551192 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:35.551153 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xms2g_4ce057ad-491a-4f76-b9df-0a4da94dd152/global-pull-secret-syncer/0.log" Jul 05 13:37:35.642373 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:35.642333 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-d7sjf_63bc4840-4a3a-4d25-84c8-97c63b44aca3/konnectivity-agent/0.log" Jul 05 13:37:35.734254 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:35.734224 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-121.ec2.internal_e5efd728fef4d484917909757bf24398/haproxy/0.log" Jul 05 13:37:40.794505 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:40.794471 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-8krbq_bd1bec47-fbe3-43b8-b455-2d38be74fd02/manager/0.log" Jul 05 13:37:40.890155 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:40.890105 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ppzgz_5bed4941-6933-4084-bc09-d94c72cb233e/registry-server/0.log" Jul 05 13:37:43.100359 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:43.100335 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t7b2m_0c6e15d8-a41b-456e-941b-e946fe1fe519/node-exporter/0.log" Jul 05 13:37:43.123054 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:43.123030 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t7b2m_0c6e15d8-a41b-456e-941b-e946fe1fe519/kube-rbac-proxy/0.log" Jul 05 13:37:43.146267 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:43.146247 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t7b2m_0c6e15d8-a41b-456e-941b-e946fe1fe519/init-textfile/0.log" Jul 05 13:37:43.257919 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:43.257875 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-x4c49_56f3c6e2-24e9-4ecf-a08c-4805372e3da0/kube-rbac-proxy-main/0.log" Jul 05 13:37:43.282041 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:43.282016 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-x4c49_56f3c6e2-24e9-4ecf-a08c-4805372e3da0/kube-rbac-proxy-self/0.log" Jul 05 13:37:43.314003 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:43.313982 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-x4c49_56f3c6e2-24e9-4ecf-a08c-4805372e3da0/openshift-state-metrics/0.log" Jul 05 13:37:43.537922 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:43.537898 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-fpz8d_e7cb206a-0dfc-4638-ac42-855d4ac363ad/prometheus-operator/0.log" Jul 05 13:37:43.559718 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:43.559695 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-fpz8d_e7cb206a-0dfc-4638-ac42-855d4ac363ad/kube-rbac-proxy/0.log" Jul 05 13:37:43.703718 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:43.703696 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66589bf544-trlq9_3db82445-c6d6-4705-92ec-340d40fac6c6/thanos-query/0.log" Jul 05 13:37:43.725893 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:43.725873 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66589bf544-trlq9_3db82445-c6d6-4705-92ec-340d40fac6c6/kube-rbac-proxy-web/0.log" Jul 05 13:37:43.752003 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:43.751979 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66589bf544-trlq9_3db82445-c6d6-4705-92ec-340d40fac6c6/kube-rbac-proxy/0.log" Jul 05 13:37:43.773510 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:43.773489 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66589bf544-trlq9_3db82445-c6d6-4705-92ec-340d40fac6c6/prom-label-proxy/0.log" Jul 05 13:37:43.795367 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:43.795311 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66589bf544-trlq9_3db82445-c6d6-4705-92ec-340d40fac6c6/kube-rbac-proxy-rules/0.log" Jul 05 13:37:43.816899 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:43.816877 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66589bf544-trlq9_3db82445-c6d6-4705-92ec-340d40fac6c6/kube-rbac-proxy-metrics/0.log" Jul 05 13:37:44.860157 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:44.860124 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hdrx7/perf-node-gather-daemonset-57z8h"] Jul 05 13:37:44.860512 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:44.860478 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3" containerName="manager" Jul 05 13:37:44.860512 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:44.860489 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3" containerName="manager" Jul 05 13:37:44.860580 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:44.860567 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d0ed4c3-6b9b-4c0b-af05-b6e8222bb8d3" containerName="manager" Jul 05 13:37:44.863822 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:44.863788 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hdrx7/perf-node-gather-daemonset-57z8h" Jul 05 13:37:44.867585 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:44.867561 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kqgj\" (UniqueName: \"kubernetes.io/projected/b9524c7e-c1c2-44f8-925f-33994a1f13f2-kube-api-access-8kqgj\") pod \"perf-node-gather-daemonset-57z8h\" (UID: \"b9524c7e-c1c2-44f8-925f-33994a1f13f2\") " pod="openshift-must-gather-hdrx7/perf-node-gather-daemonset-57z8h" Jul 05 13:37:44.867732 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:44.867596 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9524c7e-c1c2-44f8-925f-33994a1f13f2-sys\") pod \"perf-node-gather-daemonset-57z8h\" (UID: \"b9524c7e-c1c2-44f8-925f-33994a1f13f2\") " pod="openshift-must-gather-hdrx7/perf-node-gather-daemonset-57z8h" Jul 05 13:37:44.867732 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:44.867620 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b9524c7e-c1c2-44f8-925f-33994a1f13f2-proc\") pod \"perf-node-gather-daemonset-57z8h\" (UID: \"b9524c7e-c1c2-44f8-925f-33994a1f13f2\") " pod="openshift-must-gather-hdrx7/perf-node-gather-daemonset-57z8h" Jul 05 13:37:44.867871 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:44.867767 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9524c7e-c1c2-44f8-925f-33994a1f13f2-lib-modules\") pod \"perf-node-gather-daemonset-57z8h\" (UID: \"b9524c7e-c1c2-44f8-925f-33994a1f13f2\") " pod="openshift-must-gather-hdrx7/perf-node-gather-daemonset-57z8h" Jul 05 13:37:44.867871 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:44.867795 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b9524c7e-c1c2-44f8-925f-33994a1f13f2-podres\") pod \"perf-node-gather-daemonset-57z8h\" (UID: \"b9524c7e-c1c2-44f8-925f-33994a1f13f2\") " pod="openshift-must-gather-hdrx7/perf-node-gather-daemonset-57z8h" Jul 05 13:37:44.869186 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:44.869165 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hdrx7\"/\"default-dockercfg-lr9jf\"" Jul 05 13:37:44.870495 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:44.870187 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hdrx7\"/\"kube-root-ca.crt\"" Jul 05 13:37:44.871931 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:44.871916 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hdrx7\"/\"openshift-service-ca.crt\"" Jul 05 13:37:44.880617 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:44.880597 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hdrx7/perf-node-gather-daemonset-57z8h"] Jul 05 13:37:44.968524 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:44.968492 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9524c7e-c1c2-44f8-925f-33994a1f13f2-lib-modules\") pod \"perf-node-gather-daemonset-57z8h\" (UID: \"b9524c7e-c1c2-44f8-925f-33994a1f13f2\") " pod="openshift-must-gather-hdrx7/perf-node-gather-daemonset-57z8h" Jul 05 13:37:44.968524 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:44.968523 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b9524c7e-c1c2-44f8-925f-33994a1f13f2-podres\") pod \"perf-node-gather-daemonset-57z8h\" (UID: \"b9524c7e-c1c2-44f8-925f-33994a1f13f2\") " pod="openshift-must-gather-hdrx7/perf-node-gather-daemonset-57z8h" Jul 05 13:37:44.968756 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:44.968560 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kqgj\" (UniqueName: \"kubernetes.io/projected/b9524c7e-c1c2-44f8-925f-33994a1f13f2-kube-api-access-8kqgj\") pod \"perf-node-gather-daemonset-57z8h\" (UID: \"b9524c7e-c1c2-44f8-925f-33994a1f13f2\") " pod="openshift-must-gather-hdrx7/perf-node-gather-daemonset-57z8h" Jul 05 13:37:44.968756 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:44.968583 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9524c7e-c1c2-44f8-925f-33994a1f13f2-sys\") pod \"perf-node-gather-daemonset-57z8h\" (UID: \"b9524c7e-c1c2-44f8-925f-33994a1f13f2\") " pod="openshift-must-gather-hdrx7/perf-node-gather-daemonset-57z8h" Jul 05 13:37:44.968756 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:44.968602 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b9524c7e-c1c2-44f8-925f-33994a1f13f2-proc\") pod \"perf-node-gather-daemonset-57z8h\" (UID: \"b9524c7e-c1c2-44f8-925f-33994a1f13f2\") " pod="openshift-must-gather-hdrx7/perf-node-gather-daemonset-57z8h" Jul 05 13:37:44.968756 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:44.968670 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b9524c7e-c1c2-44f8-925f-33994a1f13f2-proc\") pod \"perf-node-gather-daemonset-57z8h\" (UID: \"b9524c7e-c1c2-44f8-925f-33994a1f13f2\") " pod="openshift-must-gather-hdrx7/perf-node-gather-daemonset-57z8h" Jul 05 13:37:44.968756 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:44.968669 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b9524c7e-c1c2-44f8-925f-33994a1f13f2-podres\") pod \"perf-node-gather-daemonset-57z8h\" (UID: \"b9524c7e-c1c2-44f8-925f-33994a1f13f2\") " pod="openshift-must-gather-hdrx7/perf-node-gather-daemonset-57z8h" Jul 05 13:37:44.968756 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:44.968670 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9524c7e-c1c2-44f8-925f-33994a1f13f2-lib-modules\") pod \"perf-node-gather-daemonset-57z8h\" (UID: \"b9524c7e-c1c2-44f8-925f-33994a1f13f2\") " pod="openshift-must-gather-hdrx7/perf-node-gather-daemonset-57z8h" Jul 05 13:37:44.968756 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:44.968699 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9524c7e-c1c2-44f8-925f-33994a1f13f2-sys\") pod \"perf-node-gather-daemonset-57z8h\" (UID: \"b9524c7e-c1c2-44f8-925f-33994a1f13f2\") " pod="openshift-must-gather-hdrx7/perf-node-gather-daemonset-57z8h" Jul 05 13:37:44.976636 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:44.976609 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kqgj\" (UniqueName: \"kubernetes.io/projected/b9524c7e-c1c2-44f8-925f-33994a1f13f2-kube-api-access-8kqgj\") pod \"perf-node-gather-daemonset-57z8h\" (UID: \"b9524c7e-c1c2-44f8-925f-33994a1f13f2\") " pod="openshift-must-gather-hdrx7/perf-node-gather-daemonset-57z8h" Jul 05 13:37:44.979009 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:44.978989 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-tgc6s_b6d8d93d-a638-4dc3-a52d-f07c013e7031/networking-console-plugin/0.log" Jul 05 13:37:45.173421 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:45.173383 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hdrx7/perf-node-gather-daemonset-57z8h" Jul 05 13:37:45.300123 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:45.300099 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hdrx7/perf-node-gather-daemonset-57z8h"] Jul 05 13:37:45.301990 ip-10-0-135-121 kubenswrapper[2565]: W0705 13:37:45.301960 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb9524c7e_c1c2_44f8_925f_33994a1f13f2.slice/crio-b3820c19a98631fda17d82c05dfd608a77c6b1ec4234c9f4b33eaa63f31513fa WatchSource:0}: Error finding container b3820c19a98631fda17d82c05dfd608a77c6b1ec4234c9f4b33eaa63f31513fa: Status 404 returned error can't find the container with id b3820c19a98631fda17d82c05dfd608a77c6b1ec4234c9f4b33eaa63f31513fa Jul 05 13:37:45.976265 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:45.976236 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5665bfd6df-gmxrd_3cb06d2f-b20b-4731-98a5-5c250992b711/console/0.log" Jul 05 13:37:46.005471 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:46.005445 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-2k7bm_13d301ec-70ea-4c9f-b007-bcfb611ef3ec/download-server/0.log" Jul 05 13:37:46.136462 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:46.136431 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hdrx7/perf-node-gather-daemonset-57z8h" event={"ID":"b9524c7e-c1c2-44f8-925f-33994a1f13f2","Type":"ContainerStarted","Data":"80024dfe003f4b1fc2d97f5583136092fc7867e370fc9f9920ea82a77ddbb901"} Jul 05 13:37:46.136634 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:46.136480 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hdrx7/perf-node-gather-daemonset-57z8h" event={"ID":"b9524c7e-c1c2-44f8-925f-33994a1f13f2","Type":"ContainerStarted","Data":"b3820c19a98631fda17d82c05dfd608a77c6b1ec4234c9f4b33eaa63f31513fa"} Jul 05 13:37:46.136634 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:46.136524 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hdrx7/perf-node-gather-daemonset-57z8h" Jul 05 13:37:46.153167 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:46.153124 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hdrx7/perf-node-gather-daemonset-57z8h" podStartSLOduration=2.153108613 podStartE2EDuration="2.153108613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:37:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:37:46.152320707 +0000 UTC m=+1159.797631182" watchObservedRunningTime="2026-07-05 13:37:46.153108613 +0000 UTC m=+1159.798419077" Jul 05 13:37:46.573109 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:46.573060 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-cdk6v_3dcf2538-156f-41ad-b79f-1e91f6b65902/volume-data-source-validator/0.log" Jul 05 13:37:47.755265 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:47.755223 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-smvf9_e0ec710f-20ca-463a-9cf3-bc60137f4f9f/dns/0.log" Jul 05 13:37:47.782743 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:47.782724 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-smvf9_e0ec710f-20ca-463a-9cf3-bc60137f4f9f/kube-rbac-proxy/0.log" Jul 05 13:37:47.867641 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:47.867617 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fd7rj_1044be9c-adcd-4685-845f-4ab24fe04c00/dns-node-resolver/0.log" Jul 05 13:37:48.495306 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:48.495281 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-844d586685-58vjx_230f66ad-0649-4bdd-95ff-727814d3c024/registry/0.log" Jul 05 13:37:48.578133 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:48.578060 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tss2s_eb3e727d-7877-482d-bd5f-a2cbcbd9dae4/node-ca/0.log" Jul 05 13:37:49.556878 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:49.556850 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mdfq9_5954207d-93c1-4fa3-9c79-67073b23127c/discovery/0.log" Jul 05 13:37:49.576428 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:49.576402 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5886f89bdd-4dlbj_aa52ceb9-ed96-4729-8e90-5782089a4fca/kube-auth-proxy/0.log" Jul 05 13:37:49.657219 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:49.657191 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54c57459b5-lt6zp_6665a837-1cd2-41d9-86ef-7d3cfcba4dc3/router/0.log" Jul 05 13:37:50.186128 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:50.186103 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bx4kp_5f3f69bc-f69d-4851-9857-ab68864da3de/serve-healthcheck-canary/0.log" Jul 05 13:37:50.705533 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:50.705512 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9shv4_a87beecc-8c6a-466a-9fec-8fe341bd19db/kube-rbac-proxy/0.log" Jul 05 13:37:50.725387 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:50.725357 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9shv4_a87beecc-8c6a-466a-9fec-8fe341bd19db/exporter/0.log" Jul 05 13:37:50.747359 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:50.747328 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9shv4_a87beecc-8c6a-466a-9fec-8fe341bd19db/extractor/0.log" Jul 05 13:37:52.151346 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:52.151321 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hdrx7/perf-node-gather-daemonset-57z8h" Jul 05 13:37:52.980788 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:52.980759 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fxbrs_93e19444-8869-4303-9e9c-8dca5f8bdaaf/manager/0.log" Jul 05 13:37:53.012999 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:53.012968 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bf4fc7478-wbl64_e36a6eb5-8849-4d3a-8e41-dbb3887ceb8f/manager/0.log" Jul 05 13:37:53.038447 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:53.038425 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-nwxjc_e78b333d-7036-44f0-93c8-ece5ac128a3f/server/0.log" Jul 05 13:37:53.113441 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:53.113393 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-44ssq_1ca4c5da-e508-401d-8372-943b0aa79318/manager/0.log" Jul 05 13:37:53.376910 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:53.376829 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-678684cb77-z9gm7_6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8/manager/0.log" Jul 05 13:37:53.417220 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:53.417196 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-678684cb77-z9gm7_6cef2a8c-ff9c-4bef-b72c-fb37c06e44b8/copy-manifests/0.log" Jul 05 13:37:53.455276 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:53.455250 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-s9l7d_a8aa53c7-0996-411f-b882-73c5d4c17ace/postgres/0.log" Jul 05 13:37:54.889922 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:54.889899 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-p7zpn_049544b9-d2ad-4f65-97f5-56b46c0aba32/openshift-lws-operator/0.log" Jul 05 13:37:54.979268 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:54.979240 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mdfq9_5954207d-93c1-4fa3-9c79-67073b23127c/discovery/0.log" Jul 05 13:37:54.994833 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:54.994795 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5886f89bdd-4dlbj_aa52ceb9-ed96-4729-8e90-5782089a4fca/kube-auth-proxy/0.log" Jul 05 13:37:55.063129 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:55.063094 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54c57459b5-lt6zp_6665a837-1cd2-41d9-86ef-7d3cfcba4dc3/router/0.log" Jul 05 13:37:56.039363 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:56.039336 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mdfq9_5954207d-93c1-4fa3-9c79-67073b23127c/discovery/0.log" Jul 05 13:37:56.049841 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:56.049824 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5886f89bdd-4dlbj_aa52ceb9-ed96-4729-8e90-5782089a4fca/kube-auth-proxy/0.log" Jul 05 13:37:56.108957 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:37:56.108931 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54c57459b5-lt6zp_6665a837-1cd2-41d9-86ef-7d3cfcba4dc3/router/0.log" Jul 05 13:38:01.218888 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:38:01.218863 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-92dw2_fc48db1b-17f3-442b-b816-20457c2f17ca/kube-multus-additional-cni-plugins/0.log" Jul 05 13:38:01.242633 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:38:01.242603 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-92dw2_fc48db1b-17f3-442b-b816-20457c2f17ca/egress-router-binary-copy/0.log" Jul 05 13:38:01.265984 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:38:01.265960 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-92dw2_fc48db1b-17f3-442b-b816-20457c2f17ca/cni-plugins/0.log" Jul 05 13:38:01.288473 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:38:01.288454 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-92dw2_fc48db1b-17f3-442b-b816-20457c2f17ca/bond-cni-plugin/0.log" Jul 05 13:38:01.311092 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:38:01.311068 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-92dw2_fc48db1b-17f3-442b-b816-20457c2f17ca/routeoverride-cni/0.log" Jul 05 13:38:01.333509 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:38:01.333488 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-92dw2_fc48db1b-17f3-442b-b816-20457c2f17ca/whereabouts-cni-bincopy/0.log" Jul 05 13:38:01.356554 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:38:01.356533 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-92dw2_fc48db1b-17f3-442b-b816-20457c2f17ca/whereabouts-cni/0.log" Jul 05 13:38:01.557398 ip-10-0-135-121 kubenswrapper[2565]: I0705 13:38:01.557324 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vjtd2_15bf4c96-57a0-4f71-af70-f0fbe98e4495/kube-multus/0.log"