Jul 10 22:05:51.081259 ip-10-0-142-236 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 10 22:05:51.081268 ip-10-0-142-236 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 10 22:05:51.081275 ip-10-0-142-236 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 10 22:05:51.081493 ip-10-0-142-236 systemd[1]: Failed to start Kubernetes Kubelet. Jul 10 22:06:00.541284 ip-10-0-142-236 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 10 22:06:00.541300 ip-10-0-142-236 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ed1719c20c4b4202bd7dd1857a892fa4 -- Jul 10 22:07:50.965409 ip-10-0-142-236 systemd[1]: Starting Kubernetes Kubelet... Jul 10 22:07:51.422924 ip-10-0-142-236 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 22:07:51.422924 ip-10-0-142-236 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 10 22:07:51.422924 ip-10-0-142-236 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 22:07:51.422924 ip-10-0-142-236 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 10 22:07:51.422924 ip-10-0-142-236 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 22:07:51.422924 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.377166 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 10 22:07:51.422924 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383234 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 22:07:51.422924 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383250 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 22:07:51.422924 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383253 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 22:07:51.422924 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383257 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 22:07:51.422924 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383260 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 22:07:51.422924 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383263 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 22:07:51.422924 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383266 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 22:07:51.422924 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383269 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 22:07:51.424447 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383272 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 22:07:51.424447 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383274 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 22:07:51.424447 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383277 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 22:07:51.424447 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383279 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 22:07:51.424447 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383282 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 22:07:51.424447 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383284 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 22:07:51.424447 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383287 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 22:07:51.424447 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383289 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 22:07:51.424447 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383292 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 22:07:51.424447 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383294 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 22:07:51.424447 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383297 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 22:07:51.424447 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383300 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 22:07:51.424447 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383302 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 22:07:51.424447 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383304 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 22:07:51.424447 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383310 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 22:07:51.424447 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383313 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 22:07:51.424447 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383316 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 22:07:51.424447 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383318 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 22:07:51.424447 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383322 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 22:07:51.629736 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383325 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 22:07:51.629736 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383328 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 22:07:51.629736 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383331 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 22:07:51.629736 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383333 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 22:07:51.629736 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383336 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 22:07:51.629736 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383340 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 22:07:51.629736 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383342 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 22:07:51.629736 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383345 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 22:07:51.629736 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383347 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 22:07:51.629736 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383350 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 22:07:51.629736 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383352 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 22:07:51.629736 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383355 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 22:07:51.629736 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383357 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 22:07:51.629736 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383360 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 22:07:51.629736 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383362 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 22:07:51.629736 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383365 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 22:07:51.629736 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383368 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 22:07:51.629736 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383370 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 22:07:51.629736 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383373 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 22:07:51.629736 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383375 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 22:07:51.457494 ip-10-0-142-236 systemd[1]: Started Kubernetes Kubelet. Jul 10 22:07:51.641283 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383378 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 22:07:51.641283 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383381 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 22:07:51.641283 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383383 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 22:07:51.641283 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383386 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 22:07:51.641283 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383389 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 22:07:51.641283 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383392 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 22:07:51.641283 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383395 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 22:07:51.641283 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383397 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 22:07:51.641283 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383400 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 22:07:51.641283 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383402 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 22:07:51.641283 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383405 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 22:07:51.641283 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383408 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 22:07:51.641283 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383411 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 22:07:51.641283 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383413 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 22:07:51.641283 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383416 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 22:07:51.641283 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383419 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 22:07:51.641283 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383421 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 22:07:51.641283 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383424 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 22:07:51.641283 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383426 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 22:07:51.641283 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383429 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 22:07:51.642123 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383431 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 22:07:51.642123 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383434 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 22:07:51.642123 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383437 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 22:07:51.642123 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383439 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 22:07:51.642123 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383442 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 22:07:51.642123 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383444 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 22:07:51.642123 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383447 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 22:07:51.642123 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383449 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 22:07:51.642123 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383452 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 22:07:51.642123 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383454 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 22:07:51.642123 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383457 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 22:07:51.642123 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383459 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 22:07:51.642123 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383465 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 22:07:51.642123 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383470 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 22:07:51.642123 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383472 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 22:07:51.642123 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383475 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 22:07:51.642123 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383479 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 22:07:51.642123 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383481 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 22:07:51.642123 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383485 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 22:07:51.642798 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383490 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 22:07:51.642798 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383493 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 22:07:51.642798 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383496 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 22:07:51.642798 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383499 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 22:07:51.642798 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383501 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 10 22:07:51.642798 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383504 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 22:07:51.642798 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383507 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 22:07:51.642798 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383509 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 22:07:51.642798 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383513 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 22:07:51.642798 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383517 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 22:07:51.642798 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383520 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 22:07:51.642798 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383523 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 22:07:51.642798 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.383525 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 22:07:51.642798 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384266 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 22:07:51.642798 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384275 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 22:07:51.642798 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384278 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 22:07:51.642798 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384281 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 22:07:51.642798 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384285 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 22:07:51.642798 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384288 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 22:07:51.643484 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384290 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 22:07:51.643484 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384294 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 22:07:51.643484 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384297 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 22:07:51.643484 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384300 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 22:07:51.643484 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384303 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 22:07:51.643484 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384306 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 22:07:51.643484 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384309 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 22:07:51.643484 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384311 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 22:07:51.643484 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384314 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 22:07:51.643484 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384317 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 22:07:51.643484 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384320 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 10 22:07:51.643484 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384323 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 22:07:51.643484 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384326 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 22:07:51.643484 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384329 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 22:07:51.643484 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384332 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 22:07:51.643484 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384334 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 22:07:51.643484 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384337 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 22:07:51.643484 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384339 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 22:07:51.643484 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384342 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 22:07:51.643484 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384344 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 22:07:51.644221 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384347 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 22:07:51.644221 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384350 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 22:07:51.644221 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384353 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 22:07:51.644221 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384355 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 22:07:51.644221 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384358 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 22:07:51.644221 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384360 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 22:07:51.644221 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384363 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 22:07:51.644221 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384366 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 22:07:51.644221 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384368 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 22:07:51.644221 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384371 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 22:07:51.644221 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384373 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 22:07:51.644221 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384376 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 22:07:51.644221 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384379 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 22:07:51.644221 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384383 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 22:07:51.644221 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384386 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 22:07:51.644221 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384388 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 22:07:51.644221 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384391 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 22:07:51.644221 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384394 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 22:07:51.644221 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384396 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 22:07:51.644221 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384398 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 22:07:51.644949 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384401 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 22:07:51.644949 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384403 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 22:07:51.644949 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384406 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 22:07:51.644949 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384409 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 22:07:51.644949 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384412 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 22:07:51.644949 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384415 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 22:07:51.644949 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384417 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 22:07:51.644949 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384420 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 22:07:51.644949 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384423 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 22:07:51.644949 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384425 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 22:07:51.644949 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384428 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 22:07:51.644949 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384430 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 22:07:51.644949 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384434 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 22:07:51.644949 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384439 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 22:07:51.644949 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384442 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 22:07:51.644949 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384445 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 22:07:51.644949 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384448 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 22:07:51.644949 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384451 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 22:07:51.644949 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384453 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 22:07:51.645683 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384455 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 22:07:51.645683 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384458 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 22:07:51.645683 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384462 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 22:07:51.645683 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384465 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 22:07:51.645683 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384468 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 22:07:51.645683 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384470 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 22:07:51.645683 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384474 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 22:07:51.645683 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384476 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 22:07:51.645683 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384479 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 22:07:51.645683 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384481 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 22:07:51.645683 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384484 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 22:07:51.645683 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384486 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 22:07:51.645683 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384489 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 22:07:51.645683 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384491 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 22:07:51.645683 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384494 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 22:07:51.645683 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384496 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 22:07:51.645683 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384499 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 22:07:51.645683 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384501 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 22:07:51.645683 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384504 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 22:07:51.646391 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384507 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 22:07:51.646391 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384510 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 22:07:51.646391 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384513 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 22:07:51.646391 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384516 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 22:07:51.646391 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384519 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 22:07:51.646391 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384521 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 22:07:51.646391 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384524 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 22:07:51.646391 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384528 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 22:07:51.646391 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384531 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 22:07:51.646391 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384533 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 22:07:51.646391 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384536 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 22:07:51.646391 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384538 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 22:07:51.646391 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384541 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 22:07:51.646391 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384543 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 22:07:51.646391 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384546 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 22:07:51.646391 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384903 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 22:07:51.646391 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384908 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 22:07:51.646391 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384911 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 22:07:51.646391 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384913 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 22:07:51.646391 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384918 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 22:07:51.647129 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384921 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 22:07:51.647129 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384923 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 22:07:51.647129 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384926 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 22:07:51.647129 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384928 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 22:07:51.647129 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384931 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 22:07:51.647129 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384933 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 22:07:51.647129 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384936 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 22:07:51.647129 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384939 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 22:07:51.647129 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384941 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 22:07:51.647129 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384944 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 22:07:51.647129 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384946 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 22:07:51.647129 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384950 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 22:07:51.647129 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384952 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 22:07:51.647129 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384955 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 22:07:51.647129 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384957 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 22:07:51.647129 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384961 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 22:07:51.647129 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384965 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 22:07:51.647129 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384968 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 10 22:07:51.647129 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384971 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 22:07:51.647935 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384975 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 22:07:51.647935 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384978 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 22:07:51.647935 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384980 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 22:07:51.647935 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384983 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 22:07:51.647935 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384985 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 22:07:51.647935 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384988 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 22:07:51.647935 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384990 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 22:07:51.647935 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384993 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 22:07:51.647935 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384995 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 22:07:51.647935 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.384998 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 22:07:51.647935 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385000 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 22:07:51.647935 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385003 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 22:07:51.647935 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385006 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 22:07:51.647935 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385009 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 22:07:51.647935 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385012 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 22:07:51.647935 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385014 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 22:07:51.647935 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385017 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 22:07:51.647935 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385019 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 22:07:51.647935 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385022 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 22:07:51.647935 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385024 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 22:07:51.648765 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385027 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 22:07:51.648765 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385029 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 22:07:51.648765 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385032 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 22:07:51.648765 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385034 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 22:07:51.648765 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385037 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 22:07:51.648765 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385040 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 22:07:51.648765 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385042 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 22:07:51.648765 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385050 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 22:07:51.648765 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385053 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 22:07:51.648765 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385056 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 22:07:51.648765 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385060 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 22:07:51.648765 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385063 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 22:07:51.648765 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385067 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 22:07:51.648765 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385069 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 22:07:51.648765 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385072 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 22:07:51.648765 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385075 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 22:07:51.648765 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385077 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 22:07:51.648765 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385080 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 22:07:51.648765 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385082 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 22:07:51.649438 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385085 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 22:07:51.649438 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385087 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 22:07:51.649438 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385090 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 22:07:51.649438 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385093 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 22:07:51.649438 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385095 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 22:07:51.649438 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385099 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 22:07:51.649438 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385101 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 22:07:51.649438 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385104 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 22:07:51.649438 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385106 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 22:07:51.649438 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385109 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 22:07:51.649438 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385112 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 22:07:51.649438 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385114 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 22:07:51.649438 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385117 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 22:07:51.649438 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385119 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 22:07:51.649438 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385136 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 22:07:51.649438 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385138 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 22:07:51.649438 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385141 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 22:07:51.649438 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385146 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 22:07:51.649438 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385150 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 22:07:51.650003 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385153 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 22:07:51.650003 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385156 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 22:07:51.650003 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385159 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 22:07:51.650003 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385162 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 22:07:51.650003 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385164 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 22:07:51.650003 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385167 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 22:07:51.650003 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385171 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 22:07:51.650003 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385173 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 22:07:51.650003 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385176 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 22:07:51.650003 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385178 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 22:07:51.650003 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385181 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 22:07:51.650003 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385183 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 22:07:51.650003 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385186 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 22:07:51.650003 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385189 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 22:07:51.650003 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385192 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 22:07:51.650003 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385194 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 22:07:51.650003 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385197 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 22:07:51.650003 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385279 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 10 22:07:51.650003 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385292 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 10 22:07:51.650003 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385302 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 10 22:07:51.650003 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385308 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 10 22:07:51.650668 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385315 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 10 22:07:51.650668 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385319 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 10 22:07:51.650668 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385324 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 10 22:07:51.650668 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385328 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 10 22:07:51.650668 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385331 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 10 22:07:51.650668 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385334 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 10 22:07:51.650668 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385337 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 10 22:07:51.650668 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385340 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 10 22:07:51.650668 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385343 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 10 22:07:51.650668 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385347 2578 flags.go:64] FLAG: --cgroup-root="" Jul 10 22:07:51.650668 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385349 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 10 22:07:51.650668 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385352 2578 flags.go:64] FLAG: --client-ca-file="" Jul 10 22:07:51.650668 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385356 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 10 22:07:51.650668 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385359 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 10 22:07:51.650668 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385363 2578 flags.go:64] FLAG: --cluster-domain="" Jul 10 22:07:51.650668 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385366 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 10 22:07:51.650668 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385369 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 10 22:07:51.650668 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385374 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 10 22:07:51.650668 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385377 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 10 22:07:51.650668 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385381 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 10 22:07:51.650668 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385384 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 10 22:07:51.650668 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385387 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 10 22:07:51.650668 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385390 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 10 22:07:51.651312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385393 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 10 22:07:51.651312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385396 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 10 22:07:51.651312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385399 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 10 22:07:51.651312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385402 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 10 22:07:51.651312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385405 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 10 22:07:51.651312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385409 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 10 22:07:51.651312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385414 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 10 22:07:51.651312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385417 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 10 22:07:51.651312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385419 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 10 22:07:51.651312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385422 2578 flags.go:64] FLAG: --enable-server="true" Jul 10 22:07:51.651312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385425 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 10 22:07:51.651312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385430 2578 flags.go:64] FLAG: --event-burst="100" Jul 10 22:07:51.651312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385433 2578 flags.go:64] FLAG: --event-qps="50" Jul 10 22:07:51.651312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385435 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 10 22:07:51.651312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385438 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 10 22:07:51.651312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385441 2578 flags.go:64] FLAG: --eviction-hard="" Jul 10 22:07:51.651312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385445 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 10 22:07:51.651312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385448 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 10 22:07:51.651312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385451 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 10 22:07:51.651312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385454 2578 flags.go:64] FLAG: --eviction-soft="" Jul 10 22:07:51.651312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385456 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 10 22:07:51.651312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385459 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 10 22:07:51.651312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385463 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 10 22:07:51.651312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385466 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 10 22:07:51.651312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385469 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 10 22:07:51.652063 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385471 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 10 22:07:51.652063 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385475 2578 flags.go:64] FLAG: --feature-gates="" Jul 10 22:07:51.652063 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385479 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 10 22:07:51.652063 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385482 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 10 22:07:51.652063 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385485 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 10 22:07:51.652063 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385488 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 10 22:07:51.652063 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385491 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 10 22:07:51.652063 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385494 2578 flags.go:64] FLAG: --help="false" Jul 10 22:07:51.652063 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385497 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-142-236.ec2.internal" Jul 10 22:07:51.652063 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385500 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 10 22:07:51.652063 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385503 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 10 22:07:51.652063 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385505 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 10 22:07:51.652063 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385509 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 10 22:07:51.652063 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385514 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 10 22:07:51.652063 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385517 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 10 22:07:51.652063 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385520 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 10 22:07:51.652063 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385523 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 10 22:07:51.652063 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385526 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 10 22:07:51.652063 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385529 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 10 22:07:51.652063 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385532 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 10 22:07:51.652063 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385535 2578 flags.go:64] FLAG: --kube-reserved="" Jul 10 22:07:51.652063 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385537 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 10 22:07:51.652063 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385540 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 10 22:07:51.652063 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385543 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 10 22:07:51.652766 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385546 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 10 22:07:51.652766 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385549 2578 flags.go:64] FLAG: --lock-file="" Jul 10 22:07:51.652766 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385551 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 10 22:07:51.652766 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385554 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 10 22:07:51.652766 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385557 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 10 22:07:51.652766 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385562 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 10 22:07:51.652766 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385565 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 10 22:07:51.652766 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385568 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 10 22:07:51.652766 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385571 2578 flags.go:64] FLAG: --logging-format="text" Jul 10 22:07:51.652766 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385575 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 10 22:07:51.652766 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385579 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 10 22:07:51.652766 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385581 2578 flags.go:64] FLAG: --manifest-url="" Jul 10 22:07:51.652766 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385585 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 10 22:07:51.652766 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385589 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 10 22:07:51.652766 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385592 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 10 22:07:51.652766 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385595 2578 flags.go:64] FLAG: --max-pods="110" Jul 10 22:07:51.652766 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385598 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 10 22:07:51.652766 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385601 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 10 22:07:51.652766 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385604 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 10 22:07:51.652766 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385607 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 10 22:07:51.652766 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385610 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 10 22:07:51.652766 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385614 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 10 22:07:51.652766 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385617 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 10 22:07:51.652766 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385624 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 10 22:07:51.652766 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385627 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 10 22:07:51.653533 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385630 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 10 22:07:51.653533 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385633 2578 flags.go:64] FLAG: --pod-cidr="" Jul 10 22:07:51.653533 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385636 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 10 22:07:51.653533 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385641 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 10 22:07:51.653533 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385644 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 10 22:07:51.653533 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385646 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 10 22:07:51.653533 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385649 2578 flags.go:64] FLAG: --port="10250" Jul 10 22:07:51.653533 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385652 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 10 22:07:51.653533 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385655 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a73dc7d007e0137c" Jul 10 22:07:51.653533 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385658 2578 flags.go:64] FLAG: --qos-reserved="" Jul 10 22:07:51.653533 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385661 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 10 22:07:51.653533 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385664 2578 flags.go:64] FLAG: --register-node="true" Jul 10 22:07:51.653533 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385667 2578 flags.go:64] FLAG: --register-with-taints="" Jul 10 22:07:51.653533 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385671 2578 flags.go:64] FLAG: --registry-burst="10" Jul 10 22:07:51.653533 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385674 2578 flags.go:64] FLAG: --registry-qps="5" Jul 10 22:07:51.653533 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385677 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 10 22:07:51.653533 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385680 2578 flags.go:64] FLAG: --reserved-memory="" Jul 10 22:07:51.653533 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385694 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 10 22:07:51.653533 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385698 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 10 22:07:51.653533 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385701 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 10 22:07:51.653533 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385704 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 10 22:07:51.653533 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385707 2578 flags.go:64] FLAG: --runonce="false" Jul 10 22:07:51.653533 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385710 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 10 22:07:51.653533 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385713 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 10 22:07:51.653533 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385716 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 10 22:07:51.654681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385719 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 10 22:07:51.654681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385722 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 10 22:07:51.654681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385725 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 10 22:07:51.654681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385729 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 10 22:07:51.654681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385732 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 10 22:07:51.654681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385735 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 10 22:07:51.654681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385738 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 10 22:07:51.654681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385741 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 10 22:07:51.654681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385743 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 10 22:07:51.654681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385746 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 10 22:07:51.654681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385749 2578 flags.go:64] FLAG: --system-cgroups="" Jul 10 22:07:51.654681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385752 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 10 22:07:51.654681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385757 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 10 22:07:51.654681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385760 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 10 22:07:51.654681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385762 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 10 22:07:51.654681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385766 2578 flags.go:64] FLAG: --tls-min-version="" Jul 10 22:07:51.654681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385769 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 10 22:07:51.654681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385772 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 10 22:07:51.654681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385775 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 10 22:07:51.654681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385778 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 10 22:07:51.654681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385780 2578 flags.go:64] FLAG: --v="2" Jul 10 22:07:51.654681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385784 2578 flags.go:64] FLAG: --version="false" Jul 10 22:07:51.654681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385789 2578 flags.go:64] FLAG: --vmodule="" Jul 10 22:07:51.654681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385793 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 10 22:07:51.654681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.385797 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 10 22:07:51.655469 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385927 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 22:07:51.655469 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385931 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 22:07:51.655469 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385935 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 22:07:51.655469 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385938 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 22:07:51.655469 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385941 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 22:07:51.655469 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385943 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 22:07:51.655469 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385948 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 22:07:51.655469 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385951 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 22:07:51.655469 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385955 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 22:07:51.655469 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385957 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 22:07:51.655469 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385962 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 22:07:51.655469 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385965 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 22:07:51.655469 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385968 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 22:07:51.655469 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385970 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 22:07:51.655469 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385973 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 22:07:51.655469 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385976 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 22:07:51.655469 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385978 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 22:07:51.655469 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385981 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 22:07:51.655469 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385985 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 22:07:51.857819 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385988 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 22:07:51.857819 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385992 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 22:07:51.857819 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385994 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 22:07:51.857819 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.385997 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 22:07:51.857819 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386000 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 22:07:51.857819 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386002 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 22:07:51.857819 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386005 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 22:07:51.857819 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386007 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 22:07:51.857819 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386010 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 22:07:51.857819 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386012 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 22:07:51.857819 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386015 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 22:07:51.857819 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386018 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 22:07:51.857819 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386022 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 22:07:51.857819 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386025 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 22:07:51.857819 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386027 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 22:07:51.857819 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386030 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 22:07:51.857819 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386032 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 22:07:51.857819 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386035 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 22:07:51.857819 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386037 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 22:07:51.859157 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386040 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 22:07:51.859157 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386042 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 22:07:51.859157 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386045 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 22:07:51.859157 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386048 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 22:07:51.859157 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386053 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 22:07:51.859157 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386056 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 22:07:51.859157 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386059 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 22:07:51.859157 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386062 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 22:07:51.859157 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386064 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 22:07:51.859157 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386067 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 22:07:51.859157 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386070 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 10 22:07:51.859157 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386073 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 22:07:51.859157 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386075 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 22:07:51.859157 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386078 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 22:07:51.859157 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386080 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 22:07:51.859157 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386083 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 22:07:51.859157 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386085 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 22:07:51.859157 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386088 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 22:07:51.859157 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386090 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 22:07:51.860044 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386093 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 22:07:51.860044 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386095 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 22:07:51.860044 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386098 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 22:07:51.860044 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386100 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 22:07:51.860044 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386103 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 22:07:51.860044 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386106 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 22:07:51.860044 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386110 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 22:07:51.860044 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386112 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 22:07:51.860044 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386115 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 22:07:51.860044 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386117 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 22:07:51.860044 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386120 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 22:07:51.860044 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386137 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 22:07:51.860044 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386140 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 22:07:51.860044 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386143 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 22:07:51.860044 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386145 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 22:07:51.860044 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386148 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 22:07:51.860044 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386150 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 22:07:51.860044 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386154 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 22:07:51.860044 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386157 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 22:07:51.860044 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386160 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 22:07:51.860920 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386162 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 22:07:51.860920 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386165 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 22:07:51.860920 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386168 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 22:07:51.860920 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386170 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 22:07:51.860920 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386173 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 22:07:51.860920 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386176 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 22:07:51.860920 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386178 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 22:07:51.860920 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386181 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 22:07:51.860920 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386183 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 22:07:51.860920 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386186 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 22:07:51.860920 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386189 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 22:07:51.860920 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386191 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 22:07:51.860920 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386193 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 22:07:51.860920 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386196 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 22:07:51.860920 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386199 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 22:07:51.860920 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386201 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 22:07:51.860920 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386204 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 22:07:51.860920 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386206 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 22:07:51.860920 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386248 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 22:07:51.860920 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386252 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 22:07:51.861804 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386254 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 22:07:51.861804 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.386257 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 22:07:51.861804 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.387550 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 22:07:51.861804 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.396001 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 10 22:07:51.861804 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.396017 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 10 22:07:51.861804 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.396037 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 10 22:07:51.861804 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.396042 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 10 22:07:51.861804 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396096 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 22:07:51.861804 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396102 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 22:07:51.861804 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396105 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 22:07:51.861804 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396108 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 22:07:51.861804 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396111 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 22:07:51.861804 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396114 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 22:07:51.861804 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396117 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 22:07:51.861804 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396119 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 22:07:51.862706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396141 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 22:07:51.862706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396144 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 22:07:51.862706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396147 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 22:07:51.862706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396150 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 22:07:51.862706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396152 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 22:07:51.862706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396155 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 10 22:07:51.862706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396160 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 22:07:51.862706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396163 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 22:07:51.862706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396166 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 22:07:51.862706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396169 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 22:07:51.862706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396172 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 22:07:51.862706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396174 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 22:07:51.862706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396177 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 22:07:51.862706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396180 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 22:07:51.862706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396182 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 22:07:51.862706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396185 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 22:07:51.862706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396188 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 22:07:51.862706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396190 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 22:07:51.862706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396193 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 22:07:51.863631 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396195 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 22:07:51.863631 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396198 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 22:07:51.863631 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396202 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 22:07:51.863631 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396204 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 22:07:51.863631 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396207 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 22:07:51.863631 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396211 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 22:07:51.863631 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396213 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 22:07:51.863631 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396216 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 22:07:51.863631 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396220 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 22:07:51.863631 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396224 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 22:07:51.863631 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396227 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 22:07:51.863631 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396229 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 22:07:51.863631 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396232 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 22:07:51.863631 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396235 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 22:07:51.863631 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396237 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 22:07:51.863631 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396240 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 22:07:51.863631 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396243 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 22:07:51.863631 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396246 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 22:07:51.863631 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396249 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 22:07:51.864518 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396254 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 22:07:51.864518 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396257 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 22:07:51.864518 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396259 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 22:07:51.864518 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396262 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 22:07:51.864518 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396265 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 22:07:51.864518 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396267 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 22:07:51.864518 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396270 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 22:07:51.864518 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396273 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 22:07:51.864518 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396276 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 22:07:51.864518 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396278 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 22:07:51.864518 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396281 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 22:07:51.864518 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396284 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 22:07:51.864518 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396287 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 22:07:51.864518 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396290 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 22:07:51.864518 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396292 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 22:07:51.864518 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396294 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 22:07:51.864518 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396298 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 22:07:51.864518 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396300 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 22:07:51.864518 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396303 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 22:07:51.864518 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396306 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 22:07:51.865408 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396309 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 22:07:51.865408 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396311 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 22:07:51.865408 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396314 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 22:07:51.865408 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396316 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 22:07:51.865408 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396319 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 22:07:51.865408 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396321 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 22:07:51.865408 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396324 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 22:07:51.865408 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396326 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 22:07:51.865408 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396329 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 22:07:51.865408 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396331 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 22:07:51.865408 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396334 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 22:07:51.865408 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396336 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 22:07:51.865408 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396340 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 22:07:51.865408 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396345 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 22:07:51.865408 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396347 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 22:07:51.865408 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396350 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 22:07:51.865408 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396353 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 22:07:51.865408 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396356 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 22:07:51.865408 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396358 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 22:07:51.865408 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396361 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 22:07:51.866308 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396364 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 22:07:51.866308 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396366 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 22:07:51.866308 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396369 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 22:07:51.866308 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396372 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 22:07:51.866308 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396374 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 22:07:51.866308 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396377 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 22:07:51.866308 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396379 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 22:07:51.866308 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396382 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 22:07:51.866308 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396385 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 22:07:51.866308 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396389 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 22:07:51.866308 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396392 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 22:07:51.866308 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396395 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 22:07:51.866308 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396399 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 22:07:51.866308 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.396404 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 22:07:51.866308 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396513 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 22:07:51.867169 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396517 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 22:07:51.867169 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396520 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 22:07:51.867169 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396523 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 22:07:51.867169 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396526 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 22:07:51.867169 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396529 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 22:07:51.867169 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396531 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 22:07:51.867169 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396534 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 22:07:51.867169 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396536 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 22:07:51.867169 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396539 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 22:07:51.867169 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396541 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 22:07:51.867169 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396547 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 22:07:51.867169 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396550 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 22:07:51.867169 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396552 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 22:07:51.867169 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396555 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 22:07:51.867169 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396557 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 22:07:51.867169 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396560 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 22:07:51.867169 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396562 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 22:07:51.867169 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396565 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 22:07:51.867169 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396567 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 22:07:51.868060 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396570 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 22:07:51.868060 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396573 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 22:07:51.868060 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396576 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 22:07:51.868060 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396578 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 22:07:51.868060 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396580 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 22:07:51.868060 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396583 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 22:07:51.868060 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396586 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 22:07:51.868060 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396588 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 22:07:51.868060 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396593 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 22:07:51.868060 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396596 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 22:07:51.868060 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396599 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 22:07:51.868060 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396602 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 22:07:51.868060 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396605 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 22:07:51.868060 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396608 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 22:07:51.868060 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396610 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 22:07:51.868060 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396613 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 22:07:51.868060 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396616 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 22:07:51.868060 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396618 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 22:07:51.868060 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396621 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 22:07:51.868060 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396623 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 22:07:51.868939 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396626 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 22:07:51.868939 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396628 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 22:07:51.868939 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396631 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 22:07:51.868939 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396636 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 22:07:51.868939 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396640 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 22:07:51.868939 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396643 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 22:07:51.868939 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396646 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 22:07:51.868939 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396649 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 22:07:51.868939 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396652 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 22:07:51.868939 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396655 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 22:07:51.868939 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396659 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 22:07:51.868939 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396662 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 22:07:51.868939 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396664 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 22:07:51.868939 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396667 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 22:07:51.868939 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396669 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 22:07:51.868939 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396672 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 22:07:51.868939 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396674 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 22:07:51.868939 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396677 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 22:07:51.868939 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396680 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 22:07:51.869826 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396682 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 22:07:51.869826 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396685 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 22:07:51.869826 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396688 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 22:07:51.869826 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396690 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 22:07:51.869826 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396693 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 22:07:51.869826 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396695 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 22:07:51.869826 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396698 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 22:07:51.869826 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396700 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 22:07:51.869826 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396703 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 22:07:51.869826 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396705 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 22:07:51.869826 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396707 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 22:07:51.869826 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396710 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 22:07:51.869826 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396712 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 22:07:51.869826 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396715 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 22:07:51.869826 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396717 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 22:07:51.869826 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396720 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 22:07:51.869826 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396724 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 22:07:51.869826 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396727 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 22:07:51.869826 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396729 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 22:07:51.869826 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396732 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 22:07:51.870706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396734 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 22:07:51.870706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396737 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 22:07:51.870706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396739 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 22:07:51.870706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396742 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 22:07:51.870706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396745 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 22:07:51.870706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396747 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 22:07:51.870706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396749 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 22:07:51.870706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396752 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 22:07:51.870706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396754 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 10 22:07:51.870706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396757 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 22:07:51.870706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396760 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 22:07:51.870706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396762 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 22:07:51.870706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396764 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 22:07:51.870706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396767 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 22:07:51.870706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396769 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 22:07:51.870706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396772 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 22:07:51.870706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396775 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 22:07:51.870706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396777 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 22:07:51.870706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396780 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 22:07:51.870706 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:51.396782 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 22:07:51.871581 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.396787 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 22:07:51.871581 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.396902 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 10 22:07:51.871581 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.398884 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 10 22:07:51.871581 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.400250 2578 server.go:1019] "Starting client certificate rotation" Jul 10 22:07:51.871581 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.400347 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 22:07:51.871581 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.400383 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 22:07:51.871581 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.402714 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 22:07:51.871581 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.403955 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 22:07:51.871581 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.416115 2578 log.go:25] "Validated CRI v1 runtime API" Jul 10 22:07:51.871581 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.424815 2578 log.go:25] "Validated CRI v1 image API" Jul 10 22:07:51.871581 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.426354 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 10 22:07:51.871581 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.429593 2578 fs.go:135] Filesystem UUIDs: map[44619a5d-6000-4b99-a078-3ce12523f76f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 894f65f5-937b-4733-935f-4d9132372c97:/dev/nvme0n1p4] Jul 10 22:07:51.872043 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.429609 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 10 22:07:51.872043 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.436979 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 22:07:51.872903 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.437310 2578 manager.go:216] Machine: {Timestamp:2026-07-10 22:07:51.433994903 +0000 UTC m=+0.347932163 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3037025 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a628a7284e40c143cbbe36cf89976 SystemUUID:ec2a628a-7284-e40c-143c-bbe36cf89976 BootID:ed1719c2-0c4b-4202-bd7d-d1857a892fa4 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:37:ab:1c:9f:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:37:ab:1c:9f:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:53:ea:9f:ce:fa Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 10 22:07:51.872903 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.437411 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 10 22:07:51.872903 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.437483 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 10 22:07:51.872903 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.440516 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 10 22:07:51.872903 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.440539 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-236.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 10 22:07:51.872903 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.441235 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 10 22:07:51.872903 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.441246 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 10 22:07:51.872903 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.441255 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 22:07:51.872903 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.441269 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 22:07:51.872903 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.442542 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 10 22:07:51.872903 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.445373 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 10 22:07:51.872903 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.445485 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 10 22:07:51.872903 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.445511 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 10 22:07:51.872903 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.445520 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 10 22:07:51.872903 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.445544 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 10 22:07:51.872903 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.445552 2578 kubelet.go:398] "Adding apiserver pod source" Jul 10 22:07:51.872903 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.445567 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 10 22:07:51.872903 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.445892 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.445907 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.449076 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.451028 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.451056 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.451267 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.451287 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.451303 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.451315 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.451325 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.451333 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.451682 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.451688 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.451694 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.451715 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.451727 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.451735 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.452400 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.452407 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.455538 2578 server.go:1268] "Started kubelet" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.455605 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.455763 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.455817 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.456370 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-236.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:51.456496 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:51.456570 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-236.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.457031 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.471657 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.471722 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:51.471866 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-236.ec2.internal\" not found" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.472393 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.472403 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.472469 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.472591 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.472601 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:51.472610 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.473636 2578 factory.go:153] Registering CRI-O factory Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.473651 2578 factory.go:223] Registration of the crio container factory successfully Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.473696 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.473703 2578 factory.go:55] Registering systemd factory Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.473711 2578 factory.go:223] Registration of the systemd container factory successfully Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.473745 2578 factory.go:103] Registering Raw factory Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.473755 2578 manager.go:1196] Started watching for new ooms in manager Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.474004 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.474263 2578 manager.go:349] Starting recovery of all containers Jul 10 22:07:51.873784 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:51.482090 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-236.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:51.482345 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:51.481660 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-236.ec2.internal.18c10d0bbb69e0db default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-236.ec2.internal,UID:ip-10-0-142-236.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-236.ec2.internal,},FirstTimestamp:2026-07-10 22:07:51.455506651 +0000 UTC m=+0.369443894,LastTimestamp:2026-07-10 22:07:51.455506651 +0000 UTC m=+0.369443894,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-236.ec2.internal,}" Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.484107 2578 manager.go:354] Recovery completed Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.488902 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rn6nt" Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.488990 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.490843 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientMemory" Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.490867 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.490877 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientPID" Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.491812 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.491826 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.491842 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.491817 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.492601 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientMemory" Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.492623 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.492638 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientPID" Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:51.492849 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-236.ec2.internal.18c10d0bbd854871 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-236.ec2.internal,UID:ip-10-0-142-236.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-236.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-236.ec2.internal,},FirstTimestamp:2026-07-10 22:07:51.490857073 +0000 UTC m=+0.404794314,LastTimestamp:2026-07-10 22:07:51.490857073 +0000 UTC m=+0.404794314,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-236.ec2.internal,}" Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.493150 2578 policy_none.go:49] "None policy: Start" Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.493162 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.493181 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.494112 2578 policy_none.go:47] "Start" Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.496631 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rn6nt" Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:51.501028 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-236.ec2.internal.18c10d0bbd8580f3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-236.ec2.internal,UID:ip-10-0-142-236.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-236.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-236.ec2.internal,},FirstTimestamp:2026-07-10 22:07:51.490871539 +0000 UTC m=+0.404808783,LastTimestamp:2026-07-10 22:07:51.490871539 +0000 UTC m=+0.404808783,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-236.ec2.internal,}" Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.526817 2578 manager.go:337] "Starting Device Plugin manager" Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:51.526855 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.526868 2578 server.go:87] "Starting device plugin registration server" Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.527141 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 10 22:07:51.879066 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.527154 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.527398 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.527484 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.527493 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:51.528275 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:51.528332 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-236.ec2.internal\" not found" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.623373 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.624683 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.624718 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.624743 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:51.624777 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.627416 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.627880 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.632177 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientMemory" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.632218 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.632237 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientPID" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.632260 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-236.ec2.internal" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.641827 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-236.ec2.internal" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:51.641847 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-236.ec2.internal\": node \"ip-10-0-142-236.ec2.internal\" not found" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:51.668631 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-236.ec2.internal\" not found" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.726417 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-236.ec2.internal"] Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.726506 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.727496 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientMemory" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.727525 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.727537 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientPID" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.729085 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.729251 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.729279 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.729887 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientMemory" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.729894 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientMemory" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.729915 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.729927 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientPID" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.729916 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.730065 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientPID" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.731194 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-236.ec2.internal" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.731233 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.731834 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientMemory" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.731858 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.731873 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientPID" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:51.760889 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-236.ec2.internal\" not found" node="ip-10-0-142-236.ec2.internal" Jul 10 22:07:51.879961 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:51.765723 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-236.ec2.internal\" not found" node="ip-10-0-142-236.ec2.internal" Jul 10 22:07:51.998747 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:51.768723 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-236.ec2.internal\" not found" Jul 10 22:07:51.998747 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.774764 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1a76ec413de110e8f73baffdec3c3161-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal\" (UID: \"1a76ec413de110e8f73baffdec3c3161\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal" Jul 10 22:07:51.998747 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.774793 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a76ec413de110e8f73baffdec3c3161-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal\" (UID: \"1a76ec413de110e8f73baffdec3c3161\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal" Jul 10 22:07:51.998747 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.774812 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6d92aa44007fbeeba58b77b0f3aaedc2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-236.ec2.internal\" (UID: \"6d92aa44007fbeeba58b77b0f3aaedc2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-236.ec2.internal" Jul 10 22:07:51.998747 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:51.869587 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-236.ec2.internal\" not found" Jul 10 22:07:51.998747 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.875220 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a76ec413de110e8f73baffdec3c3161-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal\" (UID: \"1a76ec413de110e8f73baffdec3c3161\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal" Jul 10 22:07:51.998747 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.875248 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6d92aa44007fbeeba58b77b0f3aaedc2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-236.ec2.internal\" (UID: \"6d92aa44007fbeeba58b77b0f3aaedc2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-236.ec2.internal" Jul 10 22:07:51.998747 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.875286 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1a76ec413de110e8f73baffdec3c3161-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal\" (UID: \"1a76ec413de110e8f73baffdec3c3161\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal" Jul 10 22:07:51.998747 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.875333 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6d92aa44007fbeeba58b77b0f3aaedc2-config\") pod \"kube-apiserver-proxy-ip-10-0-142-236.ec2.internal\" (UID: \"6d92aa44007fbeeba58b77b0f3aaedc2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-236.ec2.internal" Jul 10 22:07:51.998747 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.875338 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a76ec413de110e8f73baffdec3c3161-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal\" (UID: \"1a76ec413de110e8f73baffdec3c3161\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal" Jul 10 22:07:51.998747 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:51.875394 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1a76ec413de110e8f73baffdec3c3161-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal\" (UID: \"1a76ec413de110e8f73baffdec3c3161\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal" Jul 10 22:07:51.998747 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:51.970789 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-236.ec2.internal\" not found" Jul 10 22:07:52.119064 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:52.062759 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal" Jul 10 22:07:52.119064 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:52.069403 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-236.ec2.internal" Jul 10 22:07:52.119064 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:52.071641 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-236.ec2.internal\" not found" Jul 10 22:07:52.245403 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:52.172140 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-236.ec2.internal\" not found" Jul 10 22:07:52.370438 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:52.272640 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-236.ec2.internal\" not found" Jul 10 22:07:52.375362 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:52.373392 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-236.ec2.internal\" not found" Jul 10 22:07:52.383366 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:52.382712 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 22:07:52.501126 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:52.400251 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 10 22:07:52.501126 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:52.400379 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 22:07:52.501126 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:52.400403 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 22:07:52.501126 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:52.473741 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-236.ec2.internal\" not found" Jul 10 22:07:52.501126 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:52.499582 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 22:02:51 +0000 UTC" deadline="2028-02-10 03:14:31.572710468 +0000 UTC" Jul 10 22:07:52.501126 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:52.499607 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13901h6m39.073106743s" Jul 10 22:07:52.632349 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:52.574217 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-236.ec2.internal\" not found" Jul 10 22:07:52.632349 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:52.609548 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 22:07:52.632349 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:52.614959 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientMemory" Jul 10 22:07:52.632349 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:52.614989 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 22:07:52.632349 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:52.615001 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeHasSufficientPID" Jul 10 22:07:52.634989 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:52.633892 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 22:07:52.771169 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:52.672995 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal" Jul 10 22:07:52.771169 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:52.689037 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 22:07:52.771169 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:52.690890 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-236.ec2.internal" Jul 10 22:07:52.771169 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:52.700702 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 22:07:52.771169 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:52.731900 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 22:07:53.282223 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.215910 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 22:07:53.447271 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.447230 2578 apiserver.go:52] "Watching apiserver" Jul 10 22:07:53.458720 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.458689 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 10 22:07:53.459799 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.459777 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-b5fbv","kube-system/konnectivity-agent-j67dl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8","openshift-cluster-node-tuning-operator/tuned-tq4gb","openshift-dns/node-resolver-ctkbw","openshift-multus/multus-hrwzf","openshift-multus/network-metrics-daemon-rbtmx","openshift-network-operator/iptables-alerter-c6shj","openshift-ovn-kubernetes/ovnkube-node-q2w5j","kube-system/global-pull-secret-syncer-8qjtp","kube-system/kube-apiserver-proxy-ip-10-0-142-236.ec2.internal","openshift-image-registry/node-ca-bjbhb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal","openshift-multus/multus-additional-cni-plugins-gpgqm"] Jul 10 22:07:53.461693 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.461676 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:07:53.461781 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:53.461759 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5fbv" podUID="005d0536-3d14-4e5c-808b-9bb203a2aced" Jul 10 22:07:53.463339 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.463321 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j67dl" Jul 10 22:07:53.464564 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.464548 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" Jul 10 22:07:53.465985 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.465969 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.467270 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.467256 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ctkbw" Jul 10 22:07:53.467712 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.467694 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 10 22:07:53.467921 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.467883 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-62ghg\"" Jul 10 22:07:53.467972 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.467958 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 10 22:07:53.468546 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.468531 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 10 22:07:53.468747 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.468735 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.471906 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.471882 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:07:53.471990 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:53.471968 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbtmx" podUID="31e9f715-aeb8-4938-bc61-4bc61dd8c82a" Jul 10 22:07:53.472768 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.472746 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 10 22:07:53.473760 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.473547 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 10 22:07:53.473760 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.473593 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 10 22:07:53.473760 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.473624 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gn98z\"" Jul 10 22:07:53.473760 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.473625 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 10 22:07:53.473760 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.473701 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 10 22:07:53.474037 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.473765 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 10 22:07:53.474037 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.473896 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c6shj" Jul 10 22:07:53.474037 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.473965 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 10 22:07:53.474037 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.473982 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 10 22:07:53.474037 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.473982 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 10 22:07:53.474228 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.474209 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-546rx\"" Jul 10 22:07:53.474295 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.474243 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-glqt5\"" Jul 10 22:07:53.474295 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.474267 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 10 22:07:53.475236 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.475216 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.476642 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.476629 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:07:53.476711 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:53.476677 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qjtp" podUID="50d3b770-a6bb-4280-b6dc-6c1dfec697d1" Jul 10 22:07:53.478422 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.478407 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bjbhb" Jul 10 22:07:53.480138 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.480120 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gpgqm" Jul 10 22:07:53.482329 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.482313 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 10 22:07:53.482410 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.482364 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 10 22:07:53.482713 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.482698 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7drwn\"" Jul 10 22:07:53.483241 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483195 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-system-cni-dir\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.483295 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483254 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-host-run-k8s-cni-cncf-io\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.483295 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483282 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-host-var-lib-kubelet\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.483364 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483298 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-hostroot\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.483364 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483342 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h2vj8\" (UID: \"0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" Jul 10 22:07:53.483424 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483380 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/48d5aed0-5ea4-4534-9f46-59ac020c70af-etc-tuned\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.483424 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483404 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48d5aed0-5ea4-4534-9f46-59ac020c70af-tmp\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.483480 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483431 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-etc-kubernetes\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.483480 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483450 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz7mv\" (UniqueName: \"kubernetes.io/projected/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-kube-api-access-hz7mv\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.483538 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483482 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8-etc-selinux\") pod \"aws-ebs-csi-driver-node-h2vj8\" (UID: \"0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" Jul 10 22:07:53.483538 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483505 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/81543b68-820c-44cd-b221-c379b5c27e7d-hosts-file\") pod \"node-resolver-ctkbw\" (UID: \"81543b68-820c-44cd-b221-c379b5c27e7d\") " pod="openshift-dns/node-resolver-ctkbw" Jul 10 22:07:53.483538 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483521 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81543b68-820c-44cd-b221-c379b5c27e7d-tmp-dir\") pod \"node-resolver-ctkbw\" (UID: \"81543b68-820c-44cd-b221-c379b5c27e7d\") " pod="openshift-dns/node-resolver-ctkbw" Jul 10 22:07:53.483648 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483575 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs\") pod \"network-metrics-daemon-rbtmx\" (UID: \"31e9f715-aeb8-4938-bc61-4bc61dd8c82a\") " pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:07:53.483648 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483604 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqtx4\" (UniqueName: \"kubernetes.io/projected/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-kube-api-access-xqtx4\") pod \"network-metrics-daemon-rbtmx\" (UID: \"31e9f715-aeb8-4938-bc61-4bc61dd8c82a\") " pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:07:53.483648 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483624 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-host-var-lib-cni-bin\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.483796 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483664 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbc86\" (UniqueName: \"kubernetes.io/projected/758ed1f0-d6b0-47c5-9be1-a43dafefce32-kube-api-access-nbc86\") pod \"iptables-alerter-c6shj\" (UID: \"758ed1f0-d6b0-47c5-9be1-a43dafefce32\") " pod="openshift-network-operator/iptables-alerter-c6shj" Jul 10 22:07:53.483796 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483684 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8-registration-dir\") pod \"aws-ebs-csi-driver-node-h2vj8\" (UID: \"0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" Jul 10 22:07:53.483796 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483704 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-sys\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.483796 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483727 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-lib-modules\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.483796 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483745 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9xrv\" (UniqueName: \"kubernetes.io/projected/005d0536-3d14-4e5c-808b-9bb203a2aced-kube-api-access-x9xrv\") pod \"network-check-target-b5fbv\" (UID: \"005d0536-3d14-4e5c-808b-9bb203a2aced\") " pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:07:53.483796 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483760 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-os-release\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.483796 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483776 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-multus-socket-dir-parent\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.484044 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483818 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-host-run-netns\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.484044 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483837 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-host-run-multus-certs\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.484044 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483896 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-etc-sysconfig\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.484044 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483946 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-etc-sysctl-d\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.484044 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.483986 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/da2b4896-f7f4-43a2-a721-670b0c264462-konnectivity-ca\") pod \"konnectivity-agent-j67dl\" (UID: \"da2b4896-f7f4-43a2-a721-670b0c264462\") " pod="kube-system/konnectivity-agent-j67dl" Jul 10 22:07:53.484044 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.484038 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-host-var-lib-cni-multus\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.484282 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.484080 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8-device-dir\") pod \"aws-ebs-csi-driver-node-h2vj8\" (UID: \"0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" Jul 10 22:07:53.484282 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.484109 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-etc-kubernetes\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.484282 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.484159 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-etc-sysctl-conf\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.484282 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.484201 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-etc-systemd\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.484282 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.484245 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-run\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.484282 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.484273 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/da2b4896-f7f4-43a2-a721-670b0c264462-agent-certs\") pod \"konnectivity-agent-j67dl\" (UID: \"da2b4896-f7f4-43a2-a721-670b0c264462\") " pod="kube-system/konnectivity-agent-j67dl" Jul 10 22:07:53.484572 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.484298 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-multus-daemon-config\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.484572 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.484318 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/758ed1f0-d6b0-47c5-9be1-a43dafefce32-host-slash\") pod \"iptables-alerter-c6shj\" (UID: \"758ed1f0-d6b0-47c5-9be1-a43dafefce32\") " pod="openshift-network-operator/iptables-alerter-c6shj" Jul 10 22:07:53.484572 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.484365 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8-socket-dir\") pod \"aws-ebs-csi-driver-node-h2vj8\" (UID: \"0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" Jul 10 22:07:53.484572 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.484407 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8-sys-fs\") pod \"aws-ebs-csi-driver-node-h2vj8\" (UID: \"0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" Jul 10 22:07:53.484572 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.484435 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-host\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.484572 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.484470 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxz62\" (UniqueName: \"kubernetes.io/projected/81543b68-820c-44cd-b221-c379b5c27e7d-kube-api-access-kxz62\") pod \"node-resolver-ctkbw\" (UID: \"81543b68-820c-44cd-b221-c379b5c27e7d\") " pod="openshift-dns/node-resolver-ctkbw" Jul 10 22:07:53.484572 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.484514 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-multus-cni-dir\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.484572 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.484547 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-cni-binary-copy\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.484572 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.484570 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-multus-conf-dir\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.485230 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.484602 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/758ed1f0-d6b0-47c5-9be1-a43dafefce32-iptables-alerter-script\") pod \"iptables-alerter-c6shj\" (UID: \"758ed1f0-d6b0-47c5-9be1-a43dafefce32\") " pod="openshift-network-operator/iptables-alerter-c6shj" Jul 10 22:07:53.485230 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.484629 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-var-lib-kubelet\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.485230 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.484653 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kqrf\" (UniqueName: \"kubernetes.io/projected/48d5aed0-5ea4-4534-9f46-59ac020c70af-kube-api-access-5kqrf\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.485230 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.484679 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-cnibin\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.485230 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.484705 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v68sw\" (UniqueName: \"kubernetes.io/projected/0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8-kube-api-access-v68sw\") pod \"aws-ebs-csi-driver-node-h2vj8\" (UID: \"0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" Jul 10 22:07:53.485230 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.484748 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-etc-modprobe-d\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.485230 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.484991 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 10 22:07:53.485230 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.485151 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 10 22:07:53.485493 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.485272 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 10 22:07:53.489507 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.489490 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 10 22:07:53.494703 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.494685 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 10 22:07:53.494802 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.494739 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 10 22:07:53.494802 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.494693 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 10 22:07:53.494802 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.494796 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 10 22:07:53.495023 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.495008 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 10 22:07:53.495059 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.495030 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 10 22:07:53.495246 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.495230 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fp8wc\"" Jul 10 22:07:53.495354 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.495338 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 10 22:07:53.495404 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.495358 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-v4llq\"" Jul 10 22:07:53.495462 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.495447 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rhblt\"" Jul 10 22:07:53.495610 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.495593 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 10 22:07:53.498139 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.498122 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 10 22:07:53.499262 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.499249 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lkx9w\"" Jul 10 22:07:53.511477 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.511459 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 22:07:53.561265 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.561245 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mxgjb" Jul 10 22:07:53.573128 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.573107 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 10 22:07:53.584945 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.584917 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-cni-binary-copy\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.585032 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.584949 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-multus-conf-dir\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.585032 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.584978 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-host-cni-bin\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.585032 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585004 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb5wm\" (UniqueName: \"kubernetes.io/projected/6729845a-5a43-4a34-91c1-58f0bd7b45a6-kube-api-access-gb5wm\") pod \"node-ca-bjbhb\" (UID: \"6729845a-5a43-4a34-91c1-58f0bd7b45a6\") " pod="openshift-image-registry/node-ca-bjbhb" Jul 10 22:07:53.585245 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585031 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-cnibin\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.585245 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585052 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-multus-conf-dir\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.585245 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585057 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v68sw\" (UniqueName: \"kubernetes.io/projected/0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8-kube-api-access-v68sw\") pod \"aws-ebs-csi-driver-node-h2vj8\" (UID: \"0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" Jul 10 22:07:53.585245 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585108 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-etc-modprobe-d\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.585245 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585120 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-cnibin\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.585245 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585159 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-run-openvswitch\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.585245 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585190 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mxgjb" Jul 10 22:07:53.585245 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585191 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-run-ovn\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.585245 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585229 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-host-cni-netd\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.585781 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585254 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.585781 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585274 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-etc-modprobe-d\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.585781 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585301 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-original-pull-secret\") pod \"global-pull-secret-syncer-8qjtp\" (UID: \"50d3b770-a6bb-4280-b6dc-6c1dfec697d1\") " pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:07:53.585781 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585339 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-host-run-k8s-cni-cncf-io\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.585781 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585374 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d632308b-166b-4f72-b311-f3a3c20d206c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gpgqm\" (UID: \"d632308b-166b-4f72-b311-f3a3c20d206c\") " pod="openshift-multus/multus-additional-cni-plugins-gpgqm" Jul 10 22:07:53.585781 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585413 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d632308b-166b-4f72-b311-f3a3c20d206c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gpgqm\" (UID: \"d632308b-166b-4f72-b311-f3a3c20d206c\") " pod="openshift-multus/multus-additional-cni-plugins-gpgqm" Jul 10 22:07:53.585781 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585442 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-host-run-k8s-cni-cncf-io\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.585781 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585446 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz7mv\" (UniqueName: \"kubernetes.io/projected/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-kube-api-access-hz7mv\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.585781 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585575 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8-etc-selinux\") pod \"aws-ebs-csi-driver-node-h2vj8\" (UID: \"0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" Jul 10 22:07:53.585781 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585597 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81543b68-820c-44cd-b221-c379b5c27e7d-tmp-dir\") pod \"node-resolver-ctkbw\" (UID: \"81543b68-820c-44cd-b221-c379b5c27e7d\") " pod="openshift-dns/node-resolver-ctkbw" Jul 10 22:07:53.585781 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585612 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-host-kubelet\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.585781 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585628 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-dbus\") pod \"global-pull-secret-syncer-8qjtp\" (UID: \"50d3b770-a6bb-4280-b6dc-6c1dfec697d1\") " pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:07:53.585781 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585645 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-host-var-lib-cni-bin\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.585781 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585671 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8-registration-dir\") pod \"aws-ebs-csi-driver-node-h2vj8\" (UID: \"0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" Jul 10 22:07:53.585781 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585753 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-sys\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.585781 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585760 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8-registration-dir\") pod \"aws-ebs-csi-driver-node-h2vj8\" (UID: \"0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" Jul 10 22:07:53.585781 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585761 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-host-var-lib-cni-bin\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.586516 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585787 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8-etc-selinux\") pod \"aws-ebs-csi-driver-node-h2vj8\" (UID: \"0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" Jul 10 22:07:53.586516 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585815 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-ovn-node-metrics-cert\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.586516 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585848 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-sys\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.586516 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585877 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81543b68-820c-44cd-b221-c379b5c27e7d-tmp-dir\") pod \"node-resolver-ctkbw\" (UID: \"81543b68-820c-44cd-b221-c379b5c27e7d\") " pod="openshift-dns/node-resolver-ctkbw" Jul 10 22:07:53.586516 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.585882 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d632308b-166b-4f72-b311-f3a3c20d206c-cnibin\") pod \"multus-additional-cni-plugins-gpgqm\" (UID: \"d632308b-166b-4f72-b311-f3a3c20d206c\") " pod="openshift-multus/multus-additional-cni-plugins-gpgqm" Jul 10 22:07:53.586516 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.586268 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d632308b-166b-4f72-b311-f3a3c20d206c-cni-binary-copy\") pod \"multus-additional-cni-plugins-gpgqm\" (UID: \"d632308b-166b-4f72-b311-f3a3c20d206c\") " pod="openshift-multus/multus-additional-cni-plugins-gpgqm" Jul 10 22:07:53.586516 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.586306 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-cni-binary-copy\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.586516 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.586311 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-host-run-multus-certs\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.586516 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.586377 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-host-run-multus-certs\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.586516 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.586396 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-etc-sysctl-d\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.586516 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.586433 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kqrf\" (UniqueName: \"kubernetes.io/projected/48d5aed0-5ea4-4534-9f46-59ac020c70af-kube-api-access-5kqrf\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.586516 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.586474 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-host-run-netns\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.587101 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.586529 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-env-overrides\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.587101 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.586557 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-kubelet-config\") pod \"global-pull-secret-syncer-8qjtp\" (UID: \"50d3b770-a6bb-4280-b6dc-6c1dfec697d1\") " pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:07:53.587101 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.586586 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-etc-sysctl-d\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.587101 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.586778 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-host-var-lib-cni-multus\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.587101 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.586828 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8-device-dir\") pod \"aws-ebs-csi-driver-node-h2vj8\" (UID: \"0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" Jul 10 22:07:53.587101 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.586864 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-etc-kubernetes\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.587101 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.586896 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-run\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.587101 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.586909 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8-device-dir\") pod \"aws-ebs-csi-driver-node-h2vj8\" (UID: \"0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" Jul 10 22:07:53.587101 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.586928 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-host\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.587101 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.586970 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-multus-daemon-config\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.587101 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.587000 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-etc-kubernetes\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.587101 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.587027 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/758ed1f0-d6b0-47c5-9be1-a43dafefce32-host-slash\") pod \"iptables-alerter-c6shj\" (UID: \"758ed1f0-d6b0-47c5-9be1-a43dafefce32\") " pod="openshift-network-operator/iptables-alerter-c6shj" Jul 10 22:07:53.587101 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.587065 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-host\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.587101 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.587066 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8-socket-dir\") pod \"aws-ebs-csi-driver-node-h2vj8\" (UID: \"0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" Jul 10 22:07:53.587735 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.587116 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8-sys-fs\") pod \"aws-ebs-csi-driver-node-h2vj8\" (UID: \"0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" Jul 10 22:07:53.587735 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.587165 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-multus-cni-dir\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.587735 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.587200 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/758ed1f0-d6b0-47c5-9be1-a43dafefce32-iptables-alerter-script\") pod \"iptables-alerter-c6shj\" (UID: \"758ed1f0-d6b0-47c5-9be1-a43dafefce32\") " pod="openshift-network-operator/iptables-alerter-c6shj" Jul 10 22:07:53.587735 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.587199 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8-socket-dir\") pod \"aws-ebs-csi-driver-node-h2vj8\" (UID: \"0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" Jul 10 22:07:53.587735 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.587241 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-host-slash\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.587735 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.587277 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-host-run-ovn-kubernetes\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.587735 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.587308 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/758ed1f0-d6b0-47c5-9be1-a43dafefce32-host-slash\") pod \"iptables-alerter-c6shj\" (UID: \"758ed1f0-d6b0-47c5-9be1-a43dafefce32\") " pod="openshift-network-operator/iptables-alerter-c6shj" Jul 10 22:07:53.587735 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.587314 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-ovnkube-config\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.587735 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.587392 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8-sys-fs\") pod \"aws-ebs-csi-driver-node-h2vj8\" (UID: \"0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" Jul 10 22:07:53.587735 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.587430 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-system-cni-dir\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.587735 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.587467 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-multus-cni-dir\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.587735 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.587470 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-host-var-lib-kubelet\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.587735 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.587525 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-hostroot\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.587735 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.587540 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-host-var-lib-kubelet\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.587735 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.587567 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h2vj8\" (UID: \"0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" Jul 10 22:07:53.588404 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.587853 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/48d5aed0-5ea4-4534-9f46-59ac020c70af-etc-tuned\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.588404 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.587898 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48d5aed0-5ea4-4534-9f46-59ac020c70af-tmp\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.588404 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.587933 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-etc-kubernetes\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.588404 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.588013 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/81543b68-820c-44cd-b221-c379b5c27e7d-hosts-file\") pod \"node-resolver-ctkbw\" (UID: \"81543b68-820c-44cd-b221-c379b5c27e7d\") " pod="openshift-dns/node-resolver-ctkbw" Jul 10 22:07:53.588404 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.588048 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs\") pod \"network-metrics-daemon-rbtmx\" (UID: \"31e9f715-aeb8-4938-bc61-4bc61dd8c82a\") " pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:07:53.588404 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.588121 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqtx4\" (UniqueName: \"kubernetes.io/projected/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-kube-api-access-xqtx4\") pod \"network-metrics-daemon-rbtmx\" (UID: \"31e9f715-aeb8-4938-bc61-4bc61dd8c82a\") " pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:07:53.588404 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.588126 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/758ed1f0-d6b0-47c5-9be1-a43dafefce32-iptables-alerter-script\") pod \"iptables-alerter-c6shj\" (UID: \"758ed1f0-d6b0-47c5-9be1-a43dafefce32\") " pod="openshift-network-operator/iptables-alerter-c6shj" Jul 10 22:07:53.588404 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.588159 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-multus-daemon-config\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.588404 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.588254 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-log-socket\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.588404 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.588282 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w8lk\" (UniqueName: \"kubernetes.io/projected/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-kube-api-access-8w8lk\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.588404 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.588302 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6729845a-5a43-4a34-91c1-58f0bd7b45a6-serviceca\") pod \"node-ca-bjbhb\" (UID: \"6729845a-5a43-4a34-91c1-58f0bd7b45a6\") " pod="openshift-image-registry/node-ca-bjbhb" Jul 10 22:07:53.588404 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.588324 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d632308b-166b-4f72-b311-f3a3c20d206c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gpgqm\" (UID: \"d632308b-166b-4f72-b311-f3a3c20d206c\") " pod="openshift-multus/multus-additional-cni-plugins-gpgqm" Jul 10 22:07:53.588404 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.588349 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbc86\" (UniqueName: \"kubernetes.io/projected/758ed1f0-d6b0-47c5-9be1-a43dafefce32-kube-api-access-nbc86\") pod \"iptables-alerter-c6shj\" (UID: \"758ed1f0-d6b0-47c5-9be1-a43dafefce32\") " pod="openshift-network-operator/iptables-alerter-c6shj" Jul 10 22:07:53.588404 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.588381 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-lib-modules\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.588404 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.588402 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-run-systemd\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.589092 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.588423 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-var-lib-openvswitch\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.589092 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.588445 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d632308b-166b-4f72-b311-f3a3c20d206c-system-cni-dir\") pod \"multus-additional-cni-plugins-gpgqm\" (UID: \"d632308b-166b-4f72-b311-f3a3c20d206c\") " pod="openshift-multus/multus-additional-cni-plugins-gpgqm" Jul 10 22:07:53.589092 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.588465 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvxpl\" (UniqueName: \"kubernetes.io/projected/d632308b-166b-4f72-b311-f3a3c20d206c-kube-api-access-lvxpl\") pod \"multus-additional-cni-plugins-gpgqm\" (UID: \"d632308b-166b-4f72-b311-f3a3c20d206c\") " pod="openshift-multus/multus-additional-cni-plugins-gpgqm" Jul 10 22:07:53.589092 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.588508 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-run\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.589092 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.588543 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-system-cni-dir\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.589092 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:53.588544 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:07:53.589092 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.588570 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-hostroot\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.589092 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.588608 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/81543b68-820c-44cd-b221-c379b5c27e7d-hosts-file\") pod \"node-resolver-ctkbw\" (UID: \"81543b68-820c-44cd-b221-c379b5c27e7d\") " pod="openshift-dns/node-resolver-ctkbw" Jul 10 22:07:53.589092 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:53.588666 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs podName:31e9f715-aeb8-4938-bc61-4bc61dd8c82a nodeName:}" failed. No retries permitted until 2026-07-10 22:07:54.088615899 +0000 UTC m=+3.002553153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs") pod "network-metrics-daemon-rbtmx" (UID: "31e9f715-aeb8-4938-bc61-4bc61dd8c82a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:07:53.589092 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.588887 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 10 22:07:53.589696 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.589216 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-host-var-lib-cni-multus\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.589696 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.589291 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h2vj8\" (UID: \"0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" Jul 10 22:07:53.589696 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.589522 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-etc-kubernetes\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.590047 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.589971 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9xrv\" (UniqueName: \"kubernetes.io/projected/005d0536-3d14-4e5c-808b-9bb203a2aced-kube-api-access-x9xrv\") pod \"network-check-target-b5fbv\" (UID: \"005d0536-3d14-4e5c-808b-9bb203a2aced\") " pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:07:53.590124 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.590043 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-os-release\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.590124 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.590084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-multus-socket-dir-parent\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.590256 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.590135 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-host-run-netns\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.590256 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.590146 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-lib-modules\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.590355 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.590271 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-os-release\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.590355 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.590342 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-host-run-netns\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.590460 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.590347 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-multus-socket-dir-parent\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.590460 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.590430 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-etc-sysconfig\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.590557 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.590464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-etc-systemd\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.590557 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.590501 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-var-lib-kubelet\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.590557 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.590537 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/da2b4896-f7f4-43a2-a721-670b0c264462-konnectivity-ca\") pod \"konnectivity-agent-j67dl\" (UID: \"da2b4896-f7f4-43a2-a721-670b0c264462\") " pod="kube-system/konnectivity-agent-j67dl" Jul 10 22:07:53.590707 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.590571 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-etc-sysctl-conf\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.590707 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.590602 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-systemd-units\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.590707 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.590636 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-etc-openvswitch\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.590707 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.590669 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-node-log\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.590707 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.590702 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6729845a-5a43-4a34-91c1-58f0bd7b45a6-host\") pod \"node-ca-bjbhb\" (UID: \"6729845a-5a43-4a34-91c1-58f0bd7b45a6\") " pod="openshift-image-registry/node-ca-bjbhb" Jul 10 22:07:53.590941 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.590736 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d632308b-166b-4f72-b311-f3a3c20d206c-os-release\") pod \"multus-additional-cni-plugins-gpgqm\" (UID: \"d632308b-166b-4f72-b311-f3a3c20d206c\") " pod="openshift-multus/multus-additional-cni-plugins-gpgqm" Jul 10 22:07:53.590941 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.590767 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/da2b4896-f7f4-43a2-a721-670b0c264462-agent-certs\") pod \"konnectivity-agent-j67dl\" (UID: \"da2b4896-f7f4-43a2-a721-670b0c264462\") " pod="kube-system/konnectivity-agent-j67dl" Jul 10 22:07:53.590941 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.590802 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxz62\" (UniqueName: \"kubernetes.io/projected/81543b68-820c-44cd-b221-c379b5c27e7d-kube-api-access-kxz62\") pod \"node-resolver-ctkbw\" (UID: \"81543b68-820c-44cd-b221-c379b5c27e7d\") " pod="openshift-dns/node-resolver-ctkbw" Jul 10 22:07:53.590941 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.590837 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-ovnkube-script-lib\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.591128 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.590967 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-etc-sysconfig\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.591128 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.591077 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-etc-systemd\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.591291 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.591138 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-var-lib-kubelet\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.591949 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.591699 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/da2b4896-f7f4-43a2-a721-670b0c264462-konnectivity-ca\") pod \"konnectivity-agent-j67dl\" (UID: \"da2b4896-f7f4-43a2-a721-670b0c264462\") " pod="kube-system/konnectivity-agent-j67dl" Jul 10 22:07:53.591949 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.591862 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/48d5aed0-5ea4-4534-9f46-59ac020c70af-etc-sysctl-conf\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.592798 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.592775 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/48d5aed0-5ea4-4534-9f46-59ac020c70af-etc-tuned\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.593399 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.593382 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48d5aed0-5ea4-4534-9f46-59ac020c70af-tmp\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.594507 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.594490 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/da2b4896-f7f4-43a2-a721-670b0c264462-agent-certs\") pod \"konnectivity-agent-j67dl\" (UID: \"da2b4896-f7f4-43a2-a721-670b0c264462\") " pod="kube-system/konnectivity-agent-j67dl" Jul 10 22:07:53.602311 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.602290 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kqrf\" (UniqueName: \"kubernetes.io/projected/48d5aed0-5ea4-4534-9f46-59ac020c70af-kube-api-access-5kqrf\") pod \"tuned-tq4gb\" (UID: \"48d5aed0-5ea4-4534-9f46-59ac020c70af\") " pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.605858 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:53.605837 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 22:07:53.605858 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:53.605860 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 22:07:53.606006 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:53.605870 2578 projected.go:196] Error preparing data for projected volume kube-api-access-x9xrv for pod openshift-network-diagnostics/network-check-target-b5fbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:07:53.606006 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:53.605927 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/005d0536-3d14-4e5c-808b-9bb203a2aced-kube-api-access-x9xrv podName:005d0536-3d14-4e5c-808b-9bb203a2aced nodeName:}" failed. No retries permitted until 2026-07-10 22:07:54.105908905 +0000 UTC m=+3.019846139 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-x9xrv" (UniqueName: "kubernetes.io/projected/005d0536-3d14-4e5c-808b-9bb203a2aced-kube-api-access-x9xrv") pod "network-check-target-b5fbv" (UID: "005d0536-3d14-4e5c-808b-9bb203a2aced") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:07:53.606928 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.606902 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqtx4\" (UniqueName: \"kubernetes.io/projected/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-kube-api-access-xqtx4\") pod \"network-metrics-daemon-rbtmx\" (UID: \"31e9f715-aeb8-4938-bc61-4bc61dd8c82a\") " pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:07:53.608045 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.608023 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxz62\" (UniqueName: \"kubernetes.io/projected/81543b68-820c-44cd-b221-c379b5c27e7d-kube-api-access-kxz62\") pod \"node-resolver-ctkbw\" (UID: \"81543b68-820c-44cd-b221-c379b5c27e7d\") " pod="openshift-dns/node-resolver-ctkbw" Jul 10 22:07:53.608122 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.608084 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz7mv\" (UniqueName: \"kubernetes.io/projected/8b318bfc-cb4a-459a-9f6c-ed3246ec6334-kube-api-access-hz7mv\") pod \"multus-hrwzf\" (UID: \"8b318bfc-cb4a-459a-9f6c-ed3246ec6334\") " pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.608257 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.608236 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbc86\" (UniqueName: \"kubernetes.io/projected/758ed1f0-d6b0-47c5-9be1-a43dafefce32-kube-api-access-nbc86\") pod \"iptables-alerter-c6shj\" (UID: \"758ed1f0-d6b0-47c5-9be1-a43dafefce32\") " pod="openshift-network-operator/iptables-alerter-c6shj" Jul 10 22:07:53.608469 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.608454 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v68sw\" (UniqueName: \"kubernetes.io/projected/0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8-kube-api-access-v68sw\") pod \"aws-ebs-csi-driver-node-h2vj8\" (UID: \"0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" Jul 10 22:07:53.692007 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.691969 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-log-socket\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.692205 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692027 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w8lk\" (UniqueName: \"kubernetes.io/projected/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-kube-api-access-8w8lk\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.692205 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692049 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6729845a-5a43-4a34-91c1-58f0bd7b45a6-serviceca\") pod \"node-ca-bjbhb\" (UID: \"6729845a-5a43-4a34-91c1-58f0bd7b45a6\") " pod="openshift-image-registry/node-ca-bjbhb" Jul 10 22:07:53.692205 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692056 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-log-socket\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.692205 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692067 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d632308b-166b-4f72-b311-f3a3c20d206c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gpgqm\" (UID: \"d632308b-166b-4f72-b311-f3a3c20d206c\") " pod="openshift-multus/multus-additional-cni-plugins-gpgqm" Jul 10 22:07:53.692205 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-run-systemd\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.692465 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692230 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-var-lib-openvswitch\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.692465 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692249 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d632308b-166b-4f72-b311-f3a3c20d206c-system-cni-dir\") pod \"multus-additional-cni-plugins-gpgqm\" (UID: \"d632308b-166b-4f72-b311-f3a3c20d206c\") " pod="openshift-multus/multus-additional-cni-plugins-gpgqm" Jul 10 22:07:53.692465 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692277 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-run-systemd\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.692465 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692312 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvxpl\" (UniqueName: \"kubernetes.io/projected/d632308b-166b-4f72-b311-f3a3c20d206c-kube-api-access-lvxpl\") pod \"multus-additional-cni-plugins-gpgqm\" (UID: \"d632308b-166b-4f72-b311-f3a3c20d206c\") " pod="openshift-multus/multus-additional-cni-plugins-gpgqm" Jul 10 22:07:53.692465 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692318 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-var-lib-openvswitch\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.692465 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692332 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d632308b-166b-4f72-b311-f3a3c20d206c-system-cni-dir\") pod \"multus-additional-cni-plugins-gpgqm\" (UID: \"d632308b-166b-4f72-b311-f3a3c20d206c\") " pod="openshift-multus/multus-additional-cni-plugins-gpgqm" Jul 10 22:07:53.692465 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692369 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-systemd-units\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.692465 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692389 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-etc-openvswitch\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.692465 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692417 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-node-log\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.692465 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692434 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-systemd-units\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.692465 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692442 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6729845a-5a43-4a34-91c1-58f0bd7b45a6-host\") pod \"node-ca-bjbhb\" (UID: \"6729845a-5a43-4a34-91c1-58f0bd7b45a6\") " pod="openshift-image-registry/node-ca-bjbhb" Jul 10 22:07:53.693004 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692467 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-etc-openvswitch\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.693004 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692475 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d632308b-166b-4f72-b311-f3a3c20d206c-os-release\") pod \"multus-additional-cni-plugins-gpgqm\" (UID: \"d632308b-166b-4f72-b311-f3a3c20d206c\") " pod="openshift-multus/multus-additional-cni-plugins-gpgqm" Jul 10 22:07:53.693004 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692494 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-node-log\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.693004 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692517 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-ovnkube-script-lib\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.693004 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692546 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-host-cni-bin\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.693004 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692553 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d632308b-166b-4f72-b311-f3a3c20d206c-os-release\") pod \"multus-additional-cni-plugins-gpgqm\" (UID: \"d632308b-166b-4f72-b311-f3a3c20d206c\") " pod="openshift-multus/multus-additional-cni-plugins-gpgqm" Jul 10 22:07:53.693004 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692569 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb5wm\" (UniqueName: \"kubernetes.io/projected/6729845a-5a43-4a34-91c1-58f0bd7b45a6-kube-api-access-gb5wm\") pod \"node-ca-bjbhb\" (UID: \"6729845a-5a43-4a34-91c1-58f0bd7b45a6\") " pod="openshift-image-registry/node-ca-bjbhb" Jul 10 22:07:53.693004 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692597 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-run-openvswitch\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.693004 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692597 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6729845a-5a43-4a34-91c1-58f0bd7b45a6-serviceca\") pod \"node-ca-bjbhb\" (UID: \"6729845a-5a43-4a34-91c1-58f0bd7b45a6\") " pod="openshift-image-registry/node-ca-bjbhb" Jul 10 22:07:53.693004 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692602 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6729845a-5a43-4a34-91c1-58f0bd7b45a6-host\") pod \"node-ca-bjbhb\" (UID: \"6729845a-5a43-4a34-91c1-58f0bd7b45a6\") " pod="openshift-image-registry/node-ca-bjbhb" Jul 10 22:07:53.693004 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692644 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-host-cni-bin\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.693004 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692662 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-run-openvswitch\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.693004 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692678 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d632308b-166b-4f72-b311-f3a3c20d206c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gpgqm\" (UID: \"d632308b-166b-4f72-b311-f3a3c20d206c\") " pod="openshift-multus/multus-additional-cni-plugins-gpgqm" Jul 10 22:07:53.693004 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692684 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-run-ovn\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.693004 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692713 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-host-cni-netd\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.693004 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692741 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.693004 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692748 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-run-ovn\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.693730 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692781 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-original-pull-secret\") pod \"global-pull-secret-syncer-8qjtp\" (UID: \"50d3b770-a6bb-4280-b6dc-6c1dfec697d1\") " pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:07:53.693730 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692790 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.693730 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692813 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d632308b-166b-4f72-b311-f3a3c20d206c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gpgqm\" (UID: \"d632308b-166b-4f72-b311-f3a3c20d206c\") " pod="openshift-multus/multus-additional-cni-plugins-gpgqm" Jul 10 22:07:53.693730 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692822 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-host-cni-netd\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.693730 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692840 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d632308b-166b-4f72-b311-f3a3c20d206c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gpgqm\" (UID: \"d632308b-166b-4f72-b311-f3a3c20d206c\") " pod="openshift-multus/multus-additional-cni-plugins-gpgqm" Jul 10 22:07:53.693730 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692873 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-host-kubelet\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.693730 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:53.692900 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 22:07:53.693730 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692900 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-dbus\") pod \"global-pull-secret-syncer-8qjtp\" (UID: \"50d3b770-a6bb-4280-b6dc-6c1dfec697d1\") " pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:07:53.693730 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692948 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-ovn-node-metrics-cert\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.693730 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692965 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d632308b-166b-4f72-b311-f3a3c20d206c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gpgqm\" (UID: \"d632308b-166b-4f72-b311-f3a3c20d206c\") " pod="openshift-multus/multus-additional-cni-plugins-gpgqm" Jul 10 22:07:53.693730 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692971 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-host-kubelet\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.693730 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.692975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d632308b-166b-4f72-b311-f3a3c20d206c-cnibin\") pod \"multus-additional-cni-plugins-gpgqm\" (UID: \"d632308b-166b-4f72-b311-f3a3c20d206c\") " pod="openshift-multus/multus-additional-cni-plugins-gpgqm" Jul 10 22:07:53.693730 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:53.692993 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-original-pull-secret podName:50d3b770-a6bb-4280-b6dc-6c1dfec697d1 nodeName:}" failed. No retries permitted until 2026-07-10 22:07:54.19297391 +0000 UTC m=+3.106911155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-original-pull-secret") pod "global-pull-secret-syncer-8qjtp" (UID: "50d3b770-a6bb-4280-b6dc-6c1dfec697d1") : object "kube-system"/"original-pull-secret" not registered Jul 10 22:07:53.693730 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.693017 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d632308b-166b-4f72-b311-f3a3c20d206c-cnibin\") pod \"multus-additional-cni-plugins-gpgqm\" (UID: \"d632308b-166b-4f72-b311-f3a3c20d206c\") " pod="openshift-multus/multus-additional-cni-plugins-gpgqm" Jul 10 22:07:53.693730 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.693042 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-dbus\") pod \"global-pull-secret-syncer-8qjtp\" (UID: \"50d3b770-a6bb-4280-b6dc-6c1dfec697d1\") " pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:07:53.693730 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.693059 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d632308b-166b-4f72-b311-f3a3c20d206c-cni-binary-copy\") pod \"multus-additional-cni-plugins-gpgqm\" (UID: \"d632308b-166b-4f72-b311-f3a3c20d206c\") " pod="openshift-multus/multus-additional-cni-plugins-gpgqm" Jul 10 22:07:53.693730 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.693104 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-host-run-netns\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.694304 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.693151 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-env-overrides\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.694304 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.693179 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-kubelet-config\") pod \"global-pull-secret-syncer-8qjtp\" (UID: \"50d3b770-a6bb-4280-b6dc-6c1dfec697d1\") " pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:07:53.694304 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.693182 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-ovnkube-script-lib\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.694304 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.693219 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-host-slash\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.694304 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.693240 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-host-run-netns\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.694304 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.693245 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-host-run-ovn-kubernetes\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.694304 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.693276 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-kubelet-config\") pod \"global-pull-secret-syncer-8qjtp\" (UID: \"50d3b770-a6bb-4280-b6dc-6c1dfec697d1\") " pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:07:53.694304 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.693293 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-host-run-ovn-kubernetes\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.694304 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.693282 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-ovnkube-config\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.694304 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.693322 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d632308b-166b-4f72-b311-f3a3c20d206c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gpgqm\" (UID: \"d632308b-166b-4f72-b311-f3a3c20d206c\") " pod="openshift-multus/multus-additional-cni-plugins-gpgqm" Jul 10 22:07:53.694304 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.693370 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-host-slash\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.694304 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.693642 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d632308b-166b-4f72-b311-f3a3c20d206c-cni-binary-copy\") pod \"multus-additional-cni-plugins-gpgqm\" (UID: \"d632308b-166b-4f72-b311-f3a3c20d206c\") " pod="openshift-multus/multus-additional-cni-plugins-gpgqm" Jul 10 22:07:53.694304 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.693715 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-env-overrides\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.694304 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.693793 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-ovnkube-config\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.695406 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.695382 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-ovn-node-metrics-cert\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.706924 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.706872 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvxpl\" (UniqueName: \"kubernetes.io/projected/d632308b-166b-4f72-b311-f3a3c20d206c-kube-api-access-lvxpl\") pod \"multus-additional-cni-plugins-gpgqm\" (UID: \"d632308b-166b-4f72-b311-f3a3c20d206c\") " pod="openshift-multus/multus-additional-cni-plugins-gpgqm" Jul 10 22:07:53.707288 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.707262 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb5wm\" (UniqueName: \"kubernetes.io/projected/6729845a-5a43-4a34-91c1-58f0bd7b45a6-kube-api-access-gb5wm\") pod \"node-ca-bjbhb\" (UID: \"6729845a-5a43-4a34-91c1-58f0bd7b45a6\") " pod="openshift-image-registry/node-ca-bjbhb" Jul 10 22:07:53.709033 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.709016 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w8lk\" (UniqueName: \"kubernetes.io/projected/723bd115-a9a8-4ca9-b4d1-dd76b54b802a-kube-api-access-8w8lk\") pod \"ovnkube-node-q2w5j\" (UID: \"723bd115-a9a8-4ca9-b4d1-dd76b54b802a\") " pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.790100 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.790071 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j67dl" Jul 10 22:07:53.802536 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.802512 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" Jul 10 22:07:53.819945 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.819923 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" Jul 10 22:07:53.835216 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.835181 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ctkbw" Jul 10 22:07:53.851318 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.851295 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hrwzf" Jul 10 22:07:53.867563 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.867539 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c6shj" Jul 10 22:07:53.870401 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.870381 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:07:53.885357 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.885339 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bjbhb" Jul 10 22:07:53.893109 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.893086 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gpgqm" Jul 10 22:07:53.914743 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:53.914717 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6729845a_5a43_4a34_91c1_58f0bd7b45a6.slice/crio-be5db26579363c664ca20b3ff29dff744a97151871c3bd0d54eb396e985a9aa3 WatchSource:0}: Error finding container be5db26579363c664ca20b3ff29dff744a97151871c3bd0d54eb396e985a9aa3: Status 404 returned error can't find the container with id be5db26579363c664ca20b3ff29dff744a97151871c3bd0d54eb396e985a9aa3 Jul 10 22:07:53.915336 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:53.915313 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d92aa44007fbeeba58b77b0f3aaedc2.slice/crio-de8c4ff47ada809f2ae045ad19fa5429f14bdc6edf848b3140d8e52cf2a1df5e WatchSource:0}: Error finding container de8c4ff47ada809f2ae045ad19fa5429f14bdc6edf848b3140d8e52cf2a1df5e: Status 404 returned error can't find the container with id de8c4ff47ada809f2ae045ad19fa5429f14bdc6edf848b3140d8e52cf2a1df5e Jul 10 22:07:53.915870 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:53.915846 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd632308b_166b_4f72_b311_f3a3c20d206c.slice/crio-7e6e7db93124a099141cb246df2d3e671c75e7093db8e3d8e8271cd3fd6cbb33 WatchSource:0}: Error finding container 7e6e7db93124a099141cb246df2d3e671c75e7093db8e3d8e8271cd3fd6cbb33: Status 404 returned error can't find the container with id 7e6e7db93124a099141cb246df2d3e671c75e7093db8e3d8e8271cd3fd6cbb33 Jul 10 22:07:53.920312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:53.920291 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 22:07:54.007256 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:54.007222 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a76ec413de110e8f73baffdec3c3161.slice/crio-c61fa0e24b799b360cd0d3725cd599365c90b35f14266e99064a01c4a6b436c6 WatchSource:0}: Error finding container c61fa0e24b799b360cd0d3725cd599365c90b35f14266e99064a01c4a6b436c6: Status 404 returned error can't find the container with id c61fa0e24b799b360cd0d3725cd599365c90b35f14266e99064a01c4a6b436c6 Jul 10 22:07:54.095650 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:54.095616 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs\") pod \"network-metrics-daemon-rbtmx\" (UID: \"31e9f715-aeb8-4938-bc61-4bc61dd8c82a\") " pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:07:54.095808 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:54.095777 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:07:54.095883 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:54.095841 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs podName:31e9f715-aeb8-4938-bc61-4bc61dd8c82a nodeName:}" failed. No retries permitted until 2026-07-10 22:07:55.095823987 +0000 UTC m=+4.009761218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs") pod "network-metrics-daemon-rbtmx" (UID: "31e9f715-aeb8-4938-bc61-4bc61dd8c82a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:07:54.126793 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:54.126769 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48d5aed0_5ea4_4534_9f46_59ac020c70af.slice/crio-90194355208e46839feacffba6101e9c856dd44625ce2a2ebf3368e1f94909a7 WatchSource:0}: Error finding container 90194355208e46839feacffba6101e9c856dd44625ce2a2ebf3368e1f94909a7: Status 404 returned error can't find the container with id 90194355208e46839feacffba6101e9c856dd44625ce2a2ebf3368e1f94909a7 Jul 10 22:07:54.194997 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:54.194970 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81543b68_820c_44cd_b221_c379b5c27e7d.slice/crio-43c62675e3a8c8c5f8aeef988dc5af74acbe413e4eade6fc0a8634d8b886ac16 WatchSource:0}: Error finding container 43c62675e3a8c8c5f8aeef988dc5af74acbe413e4eade6fc0a8634d8b886ac16: Status 404 returned error can't find the container with id 43c62675e3a8c8c5f8aeef988dc5af74acbe413e4eade6fc0a8634d8b886ac16 Jul 10 22:07:54.195933 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:54.195914 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9xrv\" (UniqueName: \"kubernetes.io/projected/005d0536-3d14-4e5c-808b-9bb203a2aced-kube-api-access-x9xrv\") pod \"network-check-target-b5fbv\" (UID: \"005d0536-3d14-4e5c-808b-9bb203a2aced\") " pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:07:54.195992 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:54.195953 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-original-pull-secret\") pod \"global-pull-secret-syncer-8qjtp\" (UID: \"50d3b770-a6bb-4280-b6dc-6c1dfec697d1\") " pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:07:54.196057 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:54.196046 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 22:07:54.196102 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:54.196064 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 22:07:54.196102 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:54.196079 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 22:07:54.196102 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:54.196089 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-original-pull-secret podName:50d3b770-a6bb-4280-b6dc-6c1dfec697d1 nodeName:}" failed. No retries permitted until 2026-07-10 22:07:55.196076543 +0000 UTC m=+4.110013773 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-original-pull-secret") pod "global-pull-secret-syncer-8qjtp" (UID: "50d3b770-a6bb-4280-b6dc-6c1dfec697d1") : object "kube-system"/"original-pull-secret" not registered Jul 10 22:07:54.196102 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:54.196089 2578 projected.go:196] Error preparing data for projected volume kube-api-access-x9xrv for pod openshift-network-diagnostics/network-check-target-b5fbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:07:54.196273 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:54.196118 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/005d0536-3d14-4e5c-808b-9bb203a2aced-kube-api-access-x9xrv podName:005d0536-3d14-4e5c-808b-9bb203a2aced nodeName:}" failed. No retries permitted until 2026-07-10 22:07:55.196111397 +0000 UTC m=+4.110048627 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9xrv" (UniqueName: "kubernetes.io/projected/005d0536-3d14-4e5c-808b-9bb203a2aced-kube-api-access-x9xrv") pod "network-check-target-b5fbv" (UID: "005d0536-3d14-4e5c-808b-9bb203a2aced") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:07:54.258679 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:54.258652 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda2b4896_f7f4_43a2_a721_670b0c264462.slice/crio-453b3d3cbb9142fb018f3db163f33131657dcc3a3c7651bde5e39cd8e365d56d WatchSource:0}: Error finding container 453b3d3cbb9142fb018f3db163f33131657dcc3a3c7651bde5e39cd8e365d56d: Status 404 returned error can't find the container with id 453b3d3cbb9142fb018f3db163f33131657dcc3a3c7651bde5e39cd8e365d56d Jul 10 22:07:54.291461 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:54.291435 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ceaaf7e_ad4d_4589_9ba9_85f8e39887b8.slice/crio-1b41eff157a74969d9ca67970f78460810e99d0f7337592f6c08f75d284269b5 WatchSource:0}: Error finding container 1b41eff157a74969d9ca67970f78460810e99d0f7337592f6c08f75d284269b5: Status 404 returned error can't find the container with id 1b41eff157a74969d9ca67970f78460810e99d0f7337592f6c08f75d284269b5 Jul 10 22:07:54.336585 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:54.336559 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod758ed1f0_d6b0_47c5_9be1_a43dafefce32.slice/crio-aa3a571ac10573fd4391f2261a65a526fd896c616cd727fdb732efcf1570e0b4 WatchSource:0}: Error finding container aa3a571ac10573fd4391f2261a65a526fd896c616cd727fdb732efcf1570e0b4: Status 404 returned error can't find the container with id aa3a571ac10573fd4391f2261a65a526fd896c616cd727fdb732efcf1570e0b4 Jul 10 22:07:54.364219 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:54.364181 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod723bd115_a9a8_4ca9_b4d1_dd76b54b802a.slice/crio-e99a7dad5925bed5a1c8d9024f373a2c290a395bda752a0310b402489330cb1e WatchSource:0}: Error finding container e99a7dad5925bed5a1c8d9024f373a2c290a395bda752a0310b402489330cb1e: Status 404 returned error can't find the container with id e99a7dad5925bed5a1c8d9024f373a2c290a395bda752a0310b402489330cb1e Jul 10 22:07:54.593081 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:54.592993 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 22:02:53 +0000 UTC" deadline="2028-02-08 02:59:37.79678789 +0000 UTC" Jul 10 22:07:54.593081 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:54.593045 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13852h51m43.203748316s" Jul 10 22:07:54.593903 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:54.593198 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 22:07:54.632996 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:54.632928 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" event={"ID":"0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8","Type":"ContainerStarted","Data":"1b41eff157a74969d9ca67970f78460810e99d0f7337592f6c08f75d284269b5"} Jul 10 22:07:54.637179 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:54.637110 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j67dl" event={"ID":"da2b4896-f7f4-43a2-a721-670b0c264462","Type":"ContainerStarted","Data":"453b3d3cbb9142fb018f3db163f33131657dcc3a3c7651bde5e39cd8e365d56d"} Jul 10 22:07:54.643451 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:54.643420 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ctkbw" event={"ID":"81543b68-820c-44cd-b221-c379b5c27e7d","Type":"ContainerStarted","Data":"43c62675e3a8c8c5f8aeef988dc5af74acbe413e4eade6fc0a8634d8b886ac16"} Jul 10 22:07:54.646270 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:54.646240 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" event={"ID":"48d5aed0-5ea4-4534-9f46-59ac020c70af","Type":"ContainerStarted","Data":"90194355208e46839feacffba6101e9c856dd44625ce2a2ebf3368e1f94909a7"} Jul 10 22:07:54.649009 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:54.648985 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bjbhb" event={"ID":"6729845a-5a43-4a34-91c1-58f0bd7b45a6","Type":"ContainerStarted","Data":"be5db26579363c664ca20b3ff29dff744a97151871c3bd0d54eb396e985a9aa3"} Jul 10 22:07:54.658919 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:54.658891 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c6shj" event={"ID":"758ed1f0-d6b0-47c5-9be1-a43dafefce32","Type":"ContainerStarted","Data":"aa3a571ac10573fd4391f2261a65a526fd896c616cd727fdb732efcf1570e0b4"} Jul 10 22:07:54.661293 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:54.661266 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal" event={"ID":"1a76ec413de110e8f73baffdec3c3161","Type":"ContainerStarted","Data":"c61fa0e24b799b360cd0d3725cd599365c90b35f14266e99064a01c4a6b436c6"} Jul 10 22:07:54.676074 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:54.676042 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gpgqm" event={"ID":"d632308b-166b-4f72-b311-f3a3c20d206c","Type":"ContainerStarted","Data":"7e6e7db93124a099141cb246df2d3e671c75e7093db8e3d8e8271cd3fd6cbb33"} Jul 10 22:07:54.680777 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:54.680753 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-236.ec2.internal" event={"ID":"6d92aa44007fbeeba58b77b0f3aaedc2","Type":"ContainerStarted","Data":"de8c4ff47ada809f2ae045ad19fa5429f14bdc6edf848b3140d8e52cf2a1df5e"} Jul 10 22:07:54.681182 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:07:54.681153 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b318bfc_cb4a_459a_9f6c_ed3246ec6334.slice/crio-0c3f62fbd922a6749949889fe6d1a7e7d0b0337161a8cd9816553d9cb1f674e3 WatchSource:0}: Error finding container 0c3f62fbd922a6749949889fe6d1a7e7d0b0337161a8cd9816553d9cb1f674e3: Status 404 returned error can't find the container with id 0c3f62fbd922a6749949889fe6d1a7e7d0b0337161a8cd9816553d9cb1f674e3 Jul 10 22:07:54.686406 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:54.686380 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" event={"ID":"723bd115-a9a8-4ca9-b4d1-dd76b54b802a","Type":"ContainerStarted","Data":"e99a7dad5925bed5a1c8d9024f373a2c290a395bda752a0310b402489330cb1e"} Jul 10 22:07:55.104918 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:55.104875 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs\") pod \"network-metrics-daemon-rbtmx\" (UID: \"31e9f715-aeb8-4938-bc61-4bc61dd8c82a\") " pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:07:55.105118 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:55.105093 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:07:55.105187 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:55.105163 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs podName:31e9f715-aeb8-4938-bc61-4bc61dd8c82a nodeName:}" failed. No retries permitted until 2026-07-10 22:07:57.105142685 +0000 UTC m=+6.019079925 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs") pod "network-metrics-daemon-rbtmx" (UID: "31e9f715-aeb8-4938-bc61-4bc61dd8c82a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:07:55.205916 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:55.205874 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9xrv\" (UniqueName: \"kubernetes.io/projected/005d0536-3d14-4e5c-808b-9bb203a2aced-kube-api-access-x9xrv\") pod \"network-check-target-b5fbv\" (UID: \"005d0536-3d14-4e5c-808b-9bb203a2aced\") " pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:07:55.206108 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:55.205946 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-original-pull-secret\") pod \"global-pull-secret-syncer-8qjtp\" (UID: \"50d3b770-a6bb-4280-b6dc-6c1dfec697d1\") " pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:07:55.206108 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:55.206077 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 22:07:55.206248 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:55.206142 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-original-pull-secret podName:50d3b770-a6bb-4280-b6dc-6c1dfec697d1 nodeName:}" failed. No retries permitted until 2026-07-10 22:07:57.206121655 +0000 UTC m=+6.120058892 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-original-pull-secret") pod "global-pull-secret-syncer-8qjtp" (UID: "50d3b770-a6bb-4280-b6dc-6c1dfec697d1") : object "kube-system"/"original-pull-secret" not registered Jul 10 22:07:55.206670 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:55.206647 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 22:07:55.206768 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:55.206679 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 22:07:55.206768 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:55.206693 2578 projected.go:196] Error preparing data for projected volume kube-api-access-x9xrv for pod openshift-network-diagnostics/network-check-target-b5fbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:07:55.206768 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:55.206742 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/005d0536-3d14-4e5c-808b-9bb203a2aced-kube-api-access-x9xrv podName:005d0536-3d14-4e5c-808b-9bb203a2aced nodeName:}" failed. No retries permitted until 2026-07-10 22:07:57.206726386 +0000 UTC m=+6.120663634 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9xrv" (UniqueName: "kubernetes.io/projected/005d0536-3d14-4e5c-808b-9bb203a2aced-kube-api-access-x9xrv") pod "network-check-target-b5fbv" (UID: "005d0536-3d14-4e5c-808b-9bb203a2aced") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:07:55.593957 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:55.593909 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 22:02:53 +0000 UTC" deadline="2027-12-15 04:16:08.493670208 +0000 UTC" Jul 10 22:07:55.593957 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:55.593956 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12534h8m12.899720263s" Jul 10 22:07:55.627003 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:55.626971 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:07:55.627176 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:55.627113 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qjtp" podUID="50d3b770-a6bb-4280-b6dc-6c1dfec697d1" Jul 10 22:07:55.627658 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:55.627555 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:07:55.627754 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:55.627677 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbtmx" podUID="31e9f715-aeb8-4938-bc61-4bc61dd8c82a" Jul 10 22:07:55.627754 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:55.627556 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:07:55.627860 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:55.627778 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5fbv" podUID="005d0536-3d14-4e5c-808b-9bb203a2aced" Jul 10 22:07:55.727320 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:55.727280 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hrwzf" event={"ID":"8b318bfc-cb4a-459a-9f6c-ed3246ec6334","Type":"ContainerStarted","Data":"0c3f62fbd922a6749949889fe6d1a7e7d0b0337161a8cd9816553d9cb1f674e3"} Jul 10 22:07:57.123110 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:57.123076 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs\") pod \"network-metrics-daemon-rbtmx\" (UID: \"31e9f715-aeb8-4938-bc61-4bc61dd8c82a\") " pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:07:57.123583 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:57.123281 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:07:57.123583 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:57.123345 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs podName:31e9f715-aeb8-4938-bc61-4bc61dd8c82a nodeName:}" failed. No retries permitted until 2026-07-10 22:08:01.123325724 +0000 UTC m=+10.037262955 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs") pod "network-metrics-daemon-rbtmx" (UID: "31e9f715-aeb8-4938-bc61-4bc61dd8c82a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:07:57.224303 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:57.224267 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9xrv\" (UniqueName: \"kubernetes.io/projected/005d0536-3d14-4e5c-808b-9bb203a2aced-kube-api-access-x9xrv\") pod \"network-check-target-b5fbv\" (UID: \"005d0536-3d14-4e5c-808b-9bb203a2aced\") " pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:07:57.224480 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:57.224331 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-original-pull-secret\") pod \"global-pull-secret-syncer-8qjtp\" (UID: \"50d3b770-a6bb-4280-b6dc-6c1dfec697d1\") " pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:07:57.224480 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:57.224475 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 22:07:57.224586 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:57.224533 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-original-pull-secret podName:50d3b770-a6bb-4280-b6dc-6c1dfec697d1 nodeName:}" failed. No retries permitted until 2026-07-10 22:08:01.224515699 +0000 UTC m=+10.138452931 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-original-pull-secret") pod "global-pull-secret-syncer-8qjtp" (UID: "50d3b770-a6bb-4280-b6dc-6c1dfec697d1") : object "kube-system"/"original-pull-secret" not registered Jul 10 22:07:57.224658 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:57.224616 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 22:07:57.224658 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:57.224636 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 22:07:57.224658 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:57.224647 2578 projected.go:196] Error preparing data for projected volume kube-api-access-x9xrv for pod openshift-network-diagnostics/network-check-target-b5fbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:07:57.224798 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:57.224682 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/005d0536-3d14-4e5c-808b-9bb203a2aced-kube-api-access-x9xrv podName:005d0536-3d14-4e5c-808b-9bb203a2aced nodeName:}" failed. No retries permitted until 2026-07-10 22:08:01.224671341 +0000 UTC m=+10.138608575 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9xrv" (UniqueName: "kubernetes.io/projected/005d0536-3d14-4e5c-808b-9bb203a2aced-kube-api-access-x9xrv") pod "network-check-target-b5fbv" (UID: "005d0536-3d14-4e5c-808b-9bb203a2aced") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:07:57.625897 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:57.625864 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:07:57.625897 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:57.625899 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:07:57.626152 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:57.625864 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:07:57.626152 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:57.625990 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5fbv" podUID="005d0536-3d14-4e5c-808b-9bb203a2aced" Jul 10 22:07:57.626152 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:57.626100 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbtmx" podUID="31e9f715-aeb8-4938-bc61-4bc61dd8c82a" Jul 10 22:07:57.626318 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:57.626211 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qjtp" podUID="50d3b770-a6bb-4280-b6dc-6c1dfec697d1" Jul 10 22:07:59.625370 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:59.625287 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:07:59.625785 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:59.625430 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbtmx" podUID="31e9f715-aeb8-4938-bc61-4bc61dd8c82a" Jul 10 22:07:59.625854 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:59.625835 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:07:59.625951 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:59.625930 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5fbv" podUID="005d0536-3d14-4e5c-808b-9bb203a2aced" Jul 10 22:07:59.626111 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:07:59.626085 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:07:59.626234 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:07:59.626209 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qjtp" podUID="50d3b770-a6bb-4280-b6dc-6c1dfec697d1" Jul 10 22:08:01.156579 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:01.156346 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs\") pod \"network-metrics-daemon-rbtmx\" (UID: \"31e9f715-aeb8-4938-bc61-4bc61dd8c82a\") " pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:08:01.156579 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:01.156506 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:08:01.156579 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:01.156574 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs podName:31e9f715-aeb8-4938-bc61-4bc61dd8c82a nodeName:}" failed. No retries permitted until 2026-07-10 22:08:09.156553368 +0000 UTC m=+18.070490601 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs") pod "network-metrics-daemon-rbtmx" (UID: "31e9f715-aeb8-4938-bc61-4bc61dd8c82a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:08:01.257290 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:01.257249 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9xrv\" (UniqueName: \"kubernetes.io/projected/005d0536-3d14-4e5c-808b-9bb203a2aced-kube-api-access-x9xrv\") pod \"network-check-target-b5fbv\" (UID: \"005d0536-3d14-4e5c-808b-9bb203a2aced\") " pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:08:01.257473 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:01.257320 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-original-pull-secret\") pod \"global-pull-secret-syncer-8qjtp\" (UID: \"50d3b770-a6bb-4280-b6dc-6c1dfec697d1\") " pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:08:01.257543 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:01.257471 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 22:08:01.257543 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:01.257529 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-original-pull-secret podName:50d3b770-a6bb-4280-b6dc-6c1dfec697d1 nodeName:}" failed. No retries permitted until 2026-07-10 22:08:09.257512024 +0000 UTC m=+18.171449254 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-original-pull-secret") pod "global-pull-secret-syncer-8qjtp" (UID: "50d3b770-a6bb-4280-b6dc-6c1dfec697d1") : object "kube-system"/"original-pull-secret" not registered Jul 10 22:08:01.257932 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:01.257908 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 22:08:01.257932 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:01.257934 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 22:08:01.257932 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:01.257946 2578 projected.go:196] Error preparing data for projected volume kube-api-access-x9xrv for pod openshift-network-diagnostics/network-check-target-b5fbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:08:01.258200 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:01.257989 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/005d0536-3d14-4e5c-808b-9bb203a2aced-kube-api-access-x9xrv podName:005d0536-3d14-4e5c-808b-9bb203a2aced nodeName:}" failed. No retries permitted until 2026-07-10 22:08:09.257975948 +0000 UTC m=+18.171913180 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9xrv" (UniqueName: "kubernetes.io/projected/005d0536-3d14-4e5c-808b-9bb203a2aced-kube-api-access-x9xrv") pod "network-check-target-b5fbv" (UID: "005d0536-3d14-4e5c-808b-9bb203a2aced") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:08:01.628913 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:01.628885 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:08:01.629094 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:01.628995 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:08:01.629094 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:01.629007 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qjtp" podUID="50d3b770-a6bb-4280-b6dc-6c1dfec697d1" Jul 10 22:08:01.629094 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:01.629034 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:08:01.629280 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:01.629116 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbtmx" podUID="31e9f715-aeb8-4938-bc61-4bc61dd8c82a" Jul 10 22:08:01.629280 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:01.629208 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5fbv" podUID="005d0536-3d14-4e5c-808b-9bb203a2aced" Jul 10 22:08:03.625659 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:03.625371 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:08:03.626074 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:03.625731 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbtmx" podUID="31e9f715-aeb8-4938-bc61-4bc61dd8c82a" Jul 10 22:08:03.626074 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:03.625524 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:08:03.626074 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:03.625827 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qjtp" podUID="50d3b770-a6bb-4280-b6dc-6c1dfec697d1" Jul 10 22:08:03.626074 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:03.625510 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:08:03.626074 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:03.625902 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5fbv" podUID="005d0536-3d14-4e5c-808b-9bb203a2aced" Jul 10 22:08:05.625745 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:05.625711 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:08:05.626179 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:05.625711 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:08:05.626179 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:05.625844 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbtmx" podUID="31e9f715-aeb8-4938-bc61-4bc61dd8c82a" Jul 10 22:08:05.626179 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:05.625721 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:08:05.626179 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:05.625924 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qjtp" podUID="50d3b770-a6bb-4280-b6dc-6c1dfec697d1" Jul 10 22:08:05.626179 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:05.625990 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5fbv" podUID="005d0536-3d14-4e5c-808b-9bb203a2aced" Jul 10 22:08:07.628957 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:07.628924 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:08:07.629401 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:07.628963 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:08:07.629401 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:07.628924 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:08:07.629401 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:07.629049 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5fbv" podUID="005d0536-3d14-4e5c-808b-9bb203a2aced" Jul 10 22:08:07.629401 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:07.629138 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbtmx" podUID="31e9f715-aeb8-4938-bc61-4bc61dd8c82a" Jul 10 22:08:07.629401 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:07.629222 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qjtp" podUID="50d3b770-a6bb-4280-b6dc-6c1dfec697d1" Jul 10 22:08:09.217871 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:09.217836 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs\") pod \"network-metrics-daemon-rbtmx\" (UID: \"31e9f715-aeb8-4938-bc61-4bc61dd8c82a\") " pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:08:09.218353 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:09.217966 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:08:09.218353 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:09.218025 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs podName:31e9f715-aeb8-4938-bc61-4bc61dd8c82a nodeName:}" failed. No retries permitted until 2026-07-10 22:08:25.218007569 +0000 UTC m=+34.131944797 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs") pod "network-metrics-daemon-rbtmx" (UID: "31e9f715-aeb8-4938-bc61-4bc61dd8c82a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:08:09.318615 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:09.318585 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9xrv\" (UniqueName: \"kubernetes.io/projected/005d0536-3d14-4e5c-808b-9bb203a2aced-kube-api-access-x9xrv\") pod \"network-check-target-b5fbv\" (UID: \"005d0536-3d14-4e5c-808b-9bb203a2aced\") " pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:08:09.318796 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:09.318636 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-original-pull-secret\") pod \"global-pull-secret-syncer-8qjtp\" (UID: \"50d3b770-a6bb-4280-b6dc-6c1dfec697d1\") " pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:08:09.318796 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:09.318750 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 22:08:09.318796 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:09.318779 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 22:08:09.318796 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:09.318799 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 22:08:09.318967 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:09.318809 2578 projected.go:196] Error preparing data for projected volume kube-api-access-x9xrv for pod openshift-network-diagnostics/network-check-target-b5fbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:08:09.318967 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:09.318811 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-original-pull-secret podName:50d3b770-a6bb-4280-b6dc-6c1dfec697d1 nodeName:}" failed. No retries permitted until 2026-07-10 22:08:25.318790394 +0000 UTC m=+34.232727630 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-original-pull-secret") pod "global-pull-secret-syncer-8qjtp" (UID: "50d3b770-a6bb-4280-b6dc-6c1dfec697d1") : object "kube-system"/"original-pull-secret" not registered Jul 10 22:08:09.318967 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:09.318860 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/005d0536-3d14-4e5c-808b-9bb203a2aced-kube-api-access-x9xrv podName:005d0536-3d14-4e5c-808b-9bb203a2aced nodeName:}" failed. No retries permitted until 2026-07-10 22:08:25.318845021 +0000 UTC m=+34.232782248 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9xrv" (UniqueName: "kubernetes.io/projected/005d0536-3d14-4e5c-808b-9bb203a2aced-kube-api-access-x9xrv") pod "network-check-target-b5fbv" (UID: "005d0536-3d14-4e5c-808b-9bb203a2aced") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:08:09.625865 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:09.625782 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:08:09.626015 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:09.625913 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:08:09.626015 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:09.625912 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qjtp" podUID="50d3b770-a6bb-4280-b6dc-6c1dfec697d1" Jul 10 22:08:09.626149 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:09.626023 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbtmx" podUID="31e9f715-aeb8-4938-bc61-4bc61dd8c82a" Jul 10 22:08:09.626149 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:09.625919 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:08:09.626149 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:09.626120 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5fbv" podUID="005d0536-3d14-4e5c-808b-9bb203a2aced" Jul 10 22:08:11.626083 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:11.626050 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:08:11.626539 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:11.626173 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:08:11.626539 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:11.626185 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbtmx" podUID="31e9f715-aeb8-4938-bc61-4bc61dd8c82a" Jul 10 22:08:11.626539 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:11.626278 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5fbv" podUID="005d0536-3d14-4e5c-808b-9bb203a2aced" Jul 10 22:08:11.626539 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:11.626339 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:08:11.626539 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:11.626421 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qjtp" podUID="50d3b770-a6bb-4280-b6dc-6c1dfec697d1" Jul 10 22:08:13.625975 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:13.625901 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:08:13.626449 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:13.625901 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:08:13.626449 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:13.626039 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qjtp" podUID="50d3b770-a6bb-4280-b6dc-6c1dfec697d1" Jul 10 22:08:13.626449 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:13.626051 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:08:13.626449 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:13.626235 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbtmx" podUID="31e9f715-aeb8-4938-bc61-4bc61dd8c82a" Jul 10 22:08:13.626449 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:13.626332 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5fbv" podUID="005d0536-3d14-4e5c-808b-9bb203a2aced" Jul 10 22:08:14.772777 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:14.772463 2578 generic.go:356] "Generic (PLEG): container finished" podID="1a76ec413de110e8f73baffdec3c3161" containerID="c590092bf749fa7f62c54560f8328d76323c9c05c25ab514b33d95ac2801a93c" exitCode=0 Jul 10 22:08:14.773416 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:14.772545 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal" event={"ID":"1a76ec413de110e8f73baffdec3c3161","Type":"ContainerDied","Data":"c590092bf749fa7f62c54560f8328d76323c9c05c25ab514b33d95ac2801a93c"} Jul 10 22:08:14.774269 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:14.774246 2578 generic.go:356] "Generic (PLEG): container finished" podID="d632308b-166b-4f72-b311-f3a3c20d206c" containerID="0fad2053e4c8d1b527dd9278218f894c5f0c38f3d2985c44e451b52da1a26635" exitCode=0 Jul 10 22:08:14.774367 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:14.774320 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gpgqm" event={"ID":"d632308b-166b-4f72-b311-f3a3c20d206c","Type":"ContainerDied","Data":"0fad2053e4c8d1b527dd9278218f894c5f0c38f3d2985c44e451b52da1a26635"} Jul 10 22:08:14.775673 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:14.775652 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-236.ec2.internal" event={"ID":"6d92aa44007fbeeba58b77b0f3aaedc2","Type":"ContainerStarted","Data":"d2cca670d5ecbfb2490b48ad75a7c98064c42436ee42ae0b3fa714fb747f2d7f"} Jul 10 22:08:14.777004 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:14.776951 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hrwzf" event={"ID":"8b318bfc-cb4a-459a-9f6c-ed3246ec6334","Type":"ContainerStarted","Data":"02a94acd1ec7c90b3bd1ce9d42f05c8458b5a7b174cddf7bb9d01580e1c35306"} Jul 10 22:08:14.779290 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:14.779273 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2w5j_723bd115-a9a8-4ca9-b4d1-dd76b54b802a/ovn-acl-logging/0.log" Jul 10 22:08:14.779713 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:14.779696 2578 generic.go:356] "Generic (PLEG): container finished" podID="723bd115-a9a8-4ca9-b4d1-dd76b54b802a" containerID="91867293623b9bff51e9b6f1d1429979bee8458ebb7eb1b8984c21fda67491cc" exitCode=1 Jul 10 22:08:14.779809 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:14.779748 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" event={"ID":"723bd115-a9a8-4ca9-b4d1-dd76b54b802a","Type":"ContainerStarted","Data":"6ca5fc7b6df598b3f95db5d5d7091a29b110f3dba6a6114a5b6696b511d43e9c"} Jul 10 22:08:14.779875 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:14.779817 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" event={"ID":"723bd115-a9a8-4ca9-b4d1-dd76b54b802a","Type":"ContainerStarted","Data":"2b75ecddae4d95266b891f92c208e95a05f38d167795890889dcb8e74bc5fb8f"} Jul 10 22:08:14.779875 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:14.779867 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" event={"ID":"723bd115-a9a8-4ca9-b4d1-dd76b54b802a","Type":"ContainerStarted","Data":"f9f3b6d640d69f4b57f6fc256c9ee8ce40e86ae850f5ed172bde9a10b0e5564b"} Jul 10 22:08:14.779981 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:14.779913 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" event={"ID":"723bd115-a9a8-4ca9-b4d1-dd76b54b802a","Type":"ContainerDied","Data":"91867293623b9bff51e9b6f1d1429979bee8458ebb7eb1b8984c21fda67491cc"} Jul 10 22:08:14.779981 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:14.779952 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" event={"ID":"723bd115-a9a8-4ca9-b4d1-dd76b54b802a","Type":"ContainerStarted","Data":"eecdd160b590930ae780ca5a096d7090bf117f133d0a79366d9e5c047fbcd5d6"} Jul 10 22:08:14.784094 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:14.784071 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" event={"ID":"0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8","Type":"ContainerStarted","Data":"473a3285054ab31783e1a09f557f4e803e7fa35d36be1359b347efc5282894cf"} Jul 10 22:08:14.785288 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:14.785268 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j67dl" event={"ID":"da2b4896-f7f4-43a2-a721-670b0c264462","Type":"ContainerStarted","Data":"32a69f7cdd59b6b187d316e734089a25b9ca38d8ec7311dcb3b45e6fec475c5c"} Jul 10 22:08:14.789034 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:14.789013 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ctkbw" event={"ID":"81543b68-820c-44cd-b221-c379b5c27e7d","Type":"ContainerStarted","Data":"0348d8f79bdfd7b9a6ae1522c44db90a8134303985c75ac880b961a7ed4cb77f"} Jul 10 22:08:14.790269 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:14.790252 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" event={"ID":"48d5aed0-5ea4-4534-9f46-59ac020c70af","Type":"ContainerStarted","Data":"6d8d1e8dfde9cf6c18a7add7f32a7e9949caae8c20e2a3f5d7e93ff7dc8a2797"} Jul 10 22:08:14.791590 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:14.791567 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bjbhb" event={"ID":"6729845a-5a43-4a34-91c1-58f0bd7b45a6","Type":"ContainerStarted","Data":"edb32295c1224df2b1f307b649498a7ae7dec94e089d06f46bacfa157a33d1b8"} Jul 10 22:08:14.836392 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:14.836332 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ctkbw" podStartSLOduration=2.963285208 podStartE2EDuration="22.836313161s" totalImagesPullingTime="19.873027953s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:07:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:08:14.817279298 +0000 UTC m=+23.731216547" watchObservedRunningTime="2026-07-10 22:08:14.836313161 +0000 UTC m=+23.750250411" Jul 10 22:08:14.836479 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:14.836456 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hrwzf" podStartSLOduration=3.404957027 podStartE2EDuration="22.836448425s" totalImagesPullingTime="19.431491398s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:07:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:08:14.835919807 +0000 UTC m=+23.749857062" watchObservedRunningTime="2026-07-10 22:08:14.836448425 +0000 UTC m=+23.750385676" Jul 10 22:08:14.855312 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:14.855275 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-236.ec2.internal" podStartSLOduration=22.855262691 podStartE2EDuration="22.855262691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:07:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:08:14.854841586 +0000 UTC m=+23.768778835" watchObservedRunningTime="2026-07-10 22:08:14.855262691 +0000 UTC m=+23.769199941" Jul 10 22:08:14.871813 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:14.871765 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bjbhb" podStartSLOduration=2.710085071 podStartE2EDuration="22.871746327s" totalImagesPullingTime="20.161661256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:07:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:08:14.870772475 +0000 UTC m=+23.784709726" watchObservedRunningTime="2026-07-10 22:08:14.871746327 +0000 UTC m=+23.785683580" Jul 10 22:08:14.912150 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:14.912081 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-j67dl" podStartSLOduration=11.273983709 podStartE2EDuration="22.912061881s" totalImagesPullingTime="11.638078172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:07:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:08:14.911774253 +0000 UTC m=+23.825711504" watchObservedRunningTime="2026-07-10 22:08:14.912061881 +0000 UTC m=+23.825999131" Jul 10 22:08:15.459031 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:15.458998 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-j67dl" Jul 10 22:08:15.459709 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:15.459684 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-j67dl" Jul 10 22:08:15.482156 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:15.482096 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tq4gb" podStartSLOduration=3.516697869 podStartE2EDuration="23.482081469s" totalImagesPullingTime="19.9653836s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:07:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:08:14.930839015 +0000 UTC m=+23.844776265" watchObservedRunningTime="2026-07-10 22:08:15.482081469 +0000 UTC m=+24.396018723" Jul 10 22:08:15.625750 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:15.625724 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:08:15.625898 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:15.625724 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:08:15.625898 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:15.625840 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5fbv" podUID="005d0536-3d14-4e5c-808b-9bb203a2aced" Jul 10 22:08:15.625987 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:15.625893 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qjtp" podUID="50d3b770-a6bb-4280-b6dc-6c1dfec697d1" Jul 10 22:08:15.625987 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:15.625722 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:08:15.625987 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:15.625965 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbtmx" podUID="31e9f715-aeb8-4938-bc61-4bc61dd8c82a" Jul 10 22:08:15.797048 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:15.796987 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2w5j_723bd115-a9a8-4ca9-b4d1-dd76b54b802a/ovn-acl-logging/0.log" Jul 10 22:08:15.797420 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:15.797365 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" event={"ID":"723bd115-a9a8-4ca9-b4d1-dd76b54b802a","Type":"ContainerStarted","Data":"f1bef679c0c452ba20cb16b7c0774da33fe730c8a41656b262dc8822752af1a3"} Jul 10 22:08:15.798641 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:15.798611 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c6shj" event={"ID":"758ed1f0-d6b0-47c5-9be1-a43dafefce32","Type":"ContainerStarted","Data":"5ab8e1abe4f312f2bd78cd1426064aa9bff28b6d58aadfa746a7430525290d9a"} Jul 10 22:08:15.800224 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:15.800196 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal" event={"ID":"1a76ec413de110e8f73baffdec3c3161","Type":"ContainerStarted","Data":"0e44b23601067cdd5b9825068e3435798acce3d69b92437c020bca06eec4ad75"} Jul 10 22:08:15.802619 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:15.802183 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-j67dl" Jul 10 22:08:15.803807 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:15.802951 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-j67dl" Jul 10 22:08:15.817016 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:15.816960 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c6shj" podStartSLOduration=4.085488881 podStartE2EDuration="23.816948768s" totalImagesPullingTime="19.731459887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:07:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:08:15.816183073 +0000 UTC m=+24.730120323" watchObservedRunningTime="2026-07-10 22:08:15.816948768 +0000 UTC m=+24.730886017" Jul 10 22:08:15.868866 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:15.868826 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-236.ec2.internal" podStartSLOduration=23.868813042 podStartE2EDuration="23.868813042s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:07:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:08:15.868691629 +0000 UTC m=+24.782628882" watchObservedRunningTime="2026-07-10 22:08:15.868813042 +0000 UTC m=+24.782750291" Jul 10 22:08:15.996781 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:15.996756 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 10 22:08:16.540109 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:16.540003 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T22:08:15.996776667Z","UUID":"40db452d-343a-4e5b-8097-257c690b740a","Handler":null,"Name":"","Endpoint":""} Jul 10 22:08:16.541649 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:16.541626 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 10 22:08:16.541772 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:16.541659 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 10 22:08:16.805177 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:16.805032 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" event={"ID":"0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8","Type":"ContainerStarted","Data":"4901be973ced329f050c0e4c245f11608ebc584debb6bb66f6b9d18189815b4c"} Jul 10 22:08:17.625156 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:17.625068 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:08:17.625156 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:17.625068 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:08:17.625400 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:17.625198 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:08:17.625400 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:17.625204 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbtmx" podUID="31e9f715-aeb8-4938-bc61-4bc61dd8c82a" Jul 10 22:08:17.625400 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:17.625324 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qjtp" podUID="50d3b770-a6bb-4280-b6dc-6c1dfec697d1" Jul 10 22:08:17.625400 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:17.625394 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5fbv" podUID="005d0536-3d14-4e5c-808b-9bb203a2aced" Jul 10 22:08:17.810849 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:17.810823 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2w5j_723bd115-a9a8-4ca9-b4d1-dd76b54b802a/ovn-acl-logging/0.log" Jul 10 22:08:17.811359 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:17.811251 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" event={"ID":"723bd115-a9a8-4ca9-b4d1-dd76b54b802a","Type":"ContainerStarted","Data":"301d00dff5b02623c3261e9bdbcd0f4be3abd4b2657a328bb5e5c428d2b7df28"} Jul 10 22:08:17.813431 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:17.813397 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" event={"ID":"0ceaaf7e-ad4d-4589-9ba9-85f8e39887b8","Type":"ContainerStarted","Data":"8b318b16cba29b9a20efefaf9e9f2c9aeb26fef1b21165f924e87b9cb6fcfe3b"} Jul 10 22:08:17.832922 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:17.832882 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h2vj8" podStartSLOduration=3.496615915 podStartE2EDuration="25.832868124s" totalImagesPullingTime="22.336252209s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:07:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:08:17.832813533 +0000 UTC m=+26.746750783" watchObservedRunningTime="2026-07-10 22:08:17.832868124 +0000 UTC m=+26.746805401" Jul 10 22:08:19.625681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:19.625424 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:08:19.626309 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:19.625424 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:08:19.626309 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:19.625783 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qjtp" podUID="50d3b770-a6bb-4280-b6dc-6c1dfec697d1" Jul 10 22:08:19.626309 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:19.625424 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:08:19.626309 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:19.625832 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbtmx" podUID="31e9f715-aeb8-4938-bc61-4bc61dd8c82a" Jul 10 22:08:19.626309 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:19.625913 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5fbv" podUID="005d0536-3d14-4e5c-808b-9bb203a2aced" Jul 10 22:08:19.819689 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:19.819646 2578 generic.go:356] "Generic (PLEG): container finished" podID="d632308b-166b-4f72-b311-f3a3c20d206c" containerID="41b62560da1f056a0ea44ddedc68c12d9f2419304c38014459d445c9a57f3b68" exitCode=0 Jul 10 22:08:19.819917 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:19.819709 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gpgqm" event={"ID":"d632308b-166b-4f72-b311-f3a3c20d206c","Type":"ContainerDied","Data":"41b62560da1f056a0ea44ddedc68c12d9f2419304c38014459d445c9a57f3b68"} Jul 10 22:08:19.823097 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:19.823064 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2w5j_723bd115-a9a8-4ca9-b4d1-dd76b54b802a/ovn-acl-logging/0.log" Jul 10 22:08:19.823500 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:19.823482 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" event={"ID":"723bd115-a9a8-4ca9-b4d1-dd76b54b802a","Type":"ContainerStarted","Data":"7002d024098c2bae87e8cfc72ac4566ae1fc852fe6debe2401b6c17c021beedd"} Jul 10 22:08:19.823703 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:19.823683 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:08:19.823780 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:19.823754 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:08:19.823883 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:19.823872 2578 scope.go:117] "RemoveContainer" containerID="91867293623b9bff51e9b6f1d1429979bee8458ebb7eb1b8984c21fda67491cc" Jul 10 22:08:19.840382 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:19.840363 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:08:20.829219 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:20.829190 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2w5j_723bd115-a9a8-4ca9-b4d1-dd76b54b802a/ovn-acl-logging/0.log" Jul 10 22:08:20.829630 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:20.829552 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" event={"ID":"723bd115-a9a8-4ca9-b4d1-dd76b54b802a","Type":"ContainerStarted","Data":"87af29829bf99f12acd80502a6075e6146142a9729a4203d7f3689f1e993be4f"} Jul 10 22:08:20.829727 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:20.829711 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:08:20.843834 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:20.843811 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:08:20.901713 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:20.901621 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" podStartSLOduration=9.114325126 podStartE2EDuration="28.901607096s" totalImagesPullingTime="19.78728197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:07:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:08:20.86636543 +0000 UTC m=+29.780302678" watchObservedRunningTime="2026-07-10 22:08:20.901607096 +0000 UTC m=+29.815544372" Jul 10 22:08:21.626613 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:21.626583 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:08:21.626910 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:21.626667 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qjtp" podUID="50d3b770-a6bb-4280-b6dc-6c1dfec697d1" Jul 10 22:08:21.626910 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:21.626766 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:08:21.626910 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:21.626870 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbtmx" podUID="31e9f715-aeb8-4938-bc61-4bc61dd8c82a" Jul 10 22:08:21.627073 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:21.626916 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:08:21.627073 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:21.626964 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5fbv" podUID="005d0536-3d14-4e5c-808b-9bb203a2aced" Jul 10 22:08:21.792566 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:21.792531 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b5fbv"] Jul 10 22:08:21.796320 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:21.796266 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rbtmx"] Jul 10 22:08:21.797013 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:21.796986 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8qjtp"] Jul 10 22:08:21.833688 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:21.833662 2578 generic.go:356] "Generic (PLEG): container finished" podID="d632308b-166b-4f72-b311-f3a3c20d206c" containerID="64a2fe1291fab7833a7898361cf91641538ac1e339c3321d13ecee4aa91f9d1f" exitCode=0 Jul 10 22:08:21.834067 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:21.833761 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gpgqm" event={"ID":"d632308b-166b-4f72-b311-f3a3c20d206c","Type":"ContainerDied","Data":"64a2fe1291fab7833a7898361cf91641538ac1e339c3321d13ecee4aa91f9d1f"} Jul 10 22:08:21.834171 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:21.834152 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:08:21.834223 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:21.834172 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:08:21.834349 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:21.834253 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5fbv" podUID="005d0536-3d14-4e5c-808b-9bb203a2aced" Jul 10 22:08:21.834394 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:21.834343 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbtmx" podUID="31e9f715-aeb8-4938-bc61-4bc61dd8c82a" Jul 10 22:08:21.834433 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:21.834396 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:08:21.834539 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:21.834468 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qjtp" podUID="50d3b770-a6bb-4280-b6dc-6c1dfec697d1" Jul 10 22:08:23.625401 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:23.625365 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:08:23.625788 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:23.625367 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:08:23.625788 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:23.625470 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qjtp" podUID="50d3b770-a6bb-4280-b6dc-6c1dfec697d1" Jul 10 22:08:23.625788 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:23.625588 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbtmx" podUID="31e9f715-aeb8-4938-bc61-4bc61dd8c82a" Jul 10 22:08:23.625788 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:23.625370 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:08:23.625788 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:23.625693 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5fbv" podUID="005d0536-3d14-4e5c-808b-9bb203a2aced" Jul 10 22:08:23.840552 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:23.840265 2578 generic.go:356] "Generic (PLEG): container finished" podID="d632308b-166b-4f72-b311-f3a3c20d206c" containerID="10c58c3e0c89ff7bf796d30fc027c7882463a8ae4ef0527af232dc54477da211" exitCode=0 Jul 10 22:08:23.840552 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:23.840337 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gpgqm" event={"ID":"d632308b-166b-4f72-b311-f3a3c20d206c","Type":"ContainerDied","Data":"10c58c3e0c89ff7bf796d30fc027c7882463a8ae4ef0527af232dc54477da211"} Jul 10 22:08:25.225900 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:25.225858 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs\") pod \"network-metrics-daemon-rbtmx\" (UID: \"31e9f715-aeb8-4938-bc61-4bc61dd8c82a\") " pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:08:25.226354 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:25.225962 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:08:25.226354 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:25.226029 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs podName:31e9f715-aeb8-4938-bc61-4bc61dd8c82a nodeName:}" failed. No retries permitted until 2026-07-10 22:08:57.22600862 +0000 UTC m=+66.139945847 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs") pod "network-metrics-daemon-rbtmx" (UID: "31e9f715-aeb8-4938-bc61-4bc61dd8c82a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 22:08:25.326346 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:25.326310 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9xrv\" (UniqueName: \"kubernetes.io/projected/005d0536-3d14-4e5c-808b-9bb203a2aced-kube-api-access-x9xrv\") pod \"network-check-target-b5fbv\" (UID: \"005d0536-3d14-4e5c-808b-9bb203a2aced\") " pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:08:25.326528 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:25.326361 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-original-pull-secret\") pod \"global-pull-secret-syncer-8qjtp\" (UID: \"50d3b770-a6bb-4280-b6dc-6c1dfec697d1\") " pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:08:25.326528 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:25.326457 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 22:08:25.326528 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:25.326470 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 22:08:25.326528 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:25.326491 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 22:08:25.326528 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:25.326501 2578 projected.go:196] Error preparing data for projected volume kube-api-access-x9xrv for pod openshift-network-diagnostics/network-check-target-b5fbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:08:25.326528 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:25.326520 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-original-pull-secret podName:50d3b770-a6bb-4280-b6dc-6c1dfec697d1 nodeName:}" failed. No retries permitted until 2026-07-10 22:08:57.326502612 +0000 UTC m=+66.240439858 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-original-pull-secret") pod "global-pull-secret-syncer-8qjtp" (UID: "50d3b770-a6bb-4280-b6dc-6c1dfec697d1") : object "kube-system"/"original-pull-secret" not registered Jul 10 22:08:25.326812 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:25.326538 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/005d0536-3d14-4e5c-808b-9bb203a2aced-kube-api-access-x9xrv podName:005d0536-3d14-4e5c-808b-9bb203a2aced nodeName:}" failed. No retries permitted until 2026-07-10 22:08:57.326526031 +0000 UTC m=+66.240463258 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9xrv" (UniqueName: "kubernetes.io/projected/005d0536-3d14-4e5c-808b-9bb203a2aced-kube-api-access-x9xrv") pod "network-check-target-b5fbv" (UID: "005d0536-3d14-4e5c-808b-9bb203a2aced") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 22:08:25.625742 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:25.625654 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:08:25.625889 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:25.625665 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:08:25.625889 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:25.625773 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5fbv" podUID="005d0536-3d14-4e5c-808b-9bb203a2aced" Jul 10 22:08:25.625999 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:25.625910 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qjtp" podUID="50d3b770-a6bb-4280-b6dc-6c1dfec697d1" Jul 10 22:08:25.625999 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:25.625947 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:08:25.626084 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:25.626034 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbtmx" podUID="31e9f715-aeb8-4938-bc61-4bc61dd8c82a" Jul 10 22:08:27.625141 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:27.625100 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:08:27.625550 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:27.625100 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:08:27.625550 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:27.625257 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbtmx" podUID="31e9f715-aeb8-4938-bc61-4bc61dd8c82a" Jul 10 22:08:27.625550 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:27.625101 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:08:27.625550 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:27.625354 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qjtp" podUID="50d3b770-a6bb-4280-b6dc-6c1dfec697d1" Jul 10 22:08:27.625550 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:27.625426 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b5fbv" podUID="005d0536-3d14-4e5c-808b-9bb203a2aced" Jul 10 22:08:27.892910 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:27.892834 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-236.ec2.internal" event="NodeReady" Jul 10 22:08:27.893053 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:27.892981 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 10 22:08:27.936400 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:27.936366 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d9f6cd95d-xrbwq"] Jul 10 22:08:27.939055 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:27.939029 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:27.941755 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:27.941732 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 10 22:08:27.941881 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:27.941774 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 10 22:08:27.941881 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:27.941836 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 10 22:08:27.942105 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:27.942090 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nbszp\"" Jul 10 22:08:27.951746 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:27.951724 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 10 22:08:27.957165 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:27.957058 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d9f6cd95d-xrbwq"] Jul 10 22:08:27.957869 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:27.957847 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s4gtz"] Jul 10 22:08:27.960342 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:27.960313 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s4gtz" Jul 10 22:08:27.960581 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:27.960557 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mzpnz"] Jul 10 22:08:27.962401 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:27.962383 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mzpnz" Jul 10 22:08:27.962933 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:27.962916 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 10 22:08:27.963022 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:27.962958 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5fbdp\"" Jul 10 22:08:27.963022 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:27.962947 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 10 22:08:27.964874 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:27.964858 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 10 22:08:27.965591 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:27.965573 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 10 22:08:27.965875 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:27.965860 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 10 22:08:27.966093 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:27.966077 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4kgs8\"" Jul 10 22:08:27.974170 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:27.974108 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mzpnz"] Jul 10 22:08:27.974976 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:27.974958 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s4gtz"] Jul 10 22:08:28.049033 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.048995 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16b445d4-390f-490f-bdc7-2da3c70fa6dd-cert\") pod \"ingress-canary-mzpnz\" (UID: \"16b445d4-390f-490f-bdc7-2da3c70fa6dd\") " pod="openshift-ingress-canary/ingress-canary-mzpnz" Jul 10 22:08:28.049232 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.049043 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfzqh\" (UniqueName: \"kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-kube-api-access-tfzqh\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:28.049232 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.049075 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/819f5f1d-e5d6-4086-8859-adb446fc911b-installation-pull-secrets\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:28.049232 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.049117 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-bound-sa-token\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:28.049396 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.049231 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/819f5f1d-e5d6-4086-8859-adb446fc911b-ca-trust-extracted\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:28.049396 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.049285 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-certificates\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:28.049396 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.049342 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/819f5f1d-e5d6-4086-8859-adb446fc911b-image-registry-private-configuration\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:28.049396 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.049365 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:28.049581 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.049429 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c28a3232-980e-4224-9122-6d6d16856660-config-volume\") pod \"dns-default-s4gtz\" (UID: \"c28a3232-980e-4224-9122-6d6d16856660\") " pod="openshift-dns/dns-default-s4gtz" Jul 10 22:08:28.049581 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.049461 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfrgv\" (UniqueName: \"kubernetes.io/projected/c28a3232-980e-4224-9122-6d6d16856660-kube-api-access-rfrgv\") pod \"dns-default-s4gtz\" (UID: \"c28a3232-980e-4224-9122-6d6d16856660\") " pod="openshift-dns/dns-default-s4gtz" Jul 10 22:08:28.049581 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.049505 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9xwp\" (UniqueName: \"kubernetes.io/projected/16b445d4-390f-490f-bdc7-2da3c70fa6dd-kube-api-access-t9xwp\") pod \"ingress-canary-mzpnz\" (UID: \"16b445d4-390f-490f-bdc7-2da3c70fa6dd\") " pod="openshift-ingress-canary/ingress-canary-mzpnz" Jul 10 22:08:28.049581 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.049527 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/819f5f1d-e5d6-4086-8859-adb446fc911b-trusted-ca\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:28.049581 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.049552 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c28a3232-980e-4224-9122-6d6d16856660-metrics-tls\") pod \"dns-default-s4gtz\" (UID: \"c28a3232-980e-4224-9122-6d6d16856660\") " pod="openshift-dns/dns-default-s4gtz" Jul 10 22:08:28.049581 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.049567 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c28a3232-980e-4224-9122-6d6d16856660-tmp-dir\") pod \"dns-default-s4gtz\" (UID: \"c28a3232-980e-4224-9122-6d6d16856660\") " pod="openshift-dns/dns-default-s4gtz" Jul 10 22:08:28.150972 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.150885 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-certificates\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:28.150972 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.150926 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/819f5f1d-e5d6-4086-8859-adb446fc911b-image-registry-private-configuration\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:28.150972 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.150947 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:28.151301 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.150994 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c28a3232-980e-4224-9122-6d6d16856660-config-volume\") pod \"dns-default-s4gtz\" (UID: \"c28a3232-980e-4224-9122-6d6d16856660\") " pod="openshift-dns/dns-default-s4gtz" Jul 10 22:08:28.151301 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.151010 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfrgv\" (UniqueName: \"kubernetes.io/projected/c28a3232-980e-4224-9122-6d6d16856660-kube-api-access-rfrgv\") pod \"dns-default-s4gtz\" (UID: \"c28a3232-980e-4224-9122-6d6d16856660\") " pod="openshift-dns/dns-default-s4gtz" Jul 10 22:08:28.151301 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.151049 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9xwp\" (UniqueName: \"kubernetes.io/projected/16b445d4-390f-490f-bdc7-2da3c70fa6dd-kube-api-access-t9xwp\") pod \"ingress-canary-mzpnz\" (UID: \"16b445d4-390f-490f-bdc7-2da3c70fa6dd\") " pod="openshift-ingress-canary/ingress-canary-mzpnz" Jul 10 22:08:28.151301 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.151072 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/819f5f1d-e5d6-4086-8859-adb446fc911b-trusted-ca\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:28.151301 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.151094 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c28a3232-980e-4224-9122-6d6d16856660-metrics-tls\") pod \"dns-default-s4gtz\" (UID: \"c28a3232-980e-4224-9122-6d6d16856660\") " pod="openshift-dns/dns-default-s4gtz" Jul 10 22:08:28.151301 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.151117 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c28a3232-980e-4224-9122-6d6d16856660-tmp-dir\") pod \"dns-default-s4gtz\" (UID: \"c28a3232-980e-4224-9122-6d6d16856660\") " pod="openshift-dns/dns-default-s4gtz" Jul 10 22:08:28.151301 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:28.151140 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 22:08:28.151301 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:28.151180 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d9f6cd95d-xrbwq: secret "image-registry-tls" not found Jul 10 22:08:28.151301 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.151185 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16b445d4-390f-490f-bdc7-2da3c70fa6dd-cert\") pod \"ingress-canary-mzpnz\" (UID: \"16b445d4-390f-490f-bdc7-2da3c70fa6dd\") " pod="openshift-ingress-canary/ingress-canary-mzpnz" Jul 10 22:08:28.151301 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.151203 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfzqh\" (UniqueName: \"kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-kube-api-access-tfzqh\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:28.151301 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.151220 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/819f5f1d-e5d6-4086-8859-adb446fc911b-installation-pull-secrets\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:28.151301 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:28.151244 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls podName:819f5f1d-e5d6-4086-8859-adb446fc911b nodeName:}" failed. No retries permitted until 2026-07-10 22:08:28.651221565 +0000 UTC m=+37.565158815 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls") pod "image-registry-7d9f6cd95d-xrbwq" (UID: "819f5f1d-e5d6-4086-8859-adb446fc911b") : secret "image-registry-tls" not found Jul 10 22:08:28.151301 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.151278 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-bound-sa-token\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:28.151925 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.151317 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/819f5f1d-e5d6-4086-8859-adb446fc911b-ca-trust-extracted\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:28.151925 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.151613 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-certificates\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:28.151925 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.151613 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/819f5f1d-e5d6-4086-8859-adb446fc911b-ca-trust-extracted\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:28.152350 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:28.152224 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 22:08:28.152350 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:28.152292 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c28a3232-980e-4224-9122-6d6d16856660-metrics-tls podName:c28a3232-980e-4224-9122-6d6d16856660 nodeName:}" failed. No retries permitted until 2026-07-10 22:08:28.652275528 +0000 UTC m=+37.566212761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c28a3232-980e-4224-9122-6d6d16856660-metrics-tls") pod "dns-default-s4gtz" (UID: "c28a3232-980e-4224-9122-6d6d16856660") : secret "dns-default-metrics-tls" not found Jul 10 22:08:28.152526 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.152399 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c28a3232-980e-4224-9122-6d6d16856660-config-volume\") pod \"dns-default-s4gtz\" (UID: \"c28a3232-980e-4224-9122-6d6d16856660\") " pod="openshift-dns/dns-default-s4gtz" Jul 10 22:08:28.152526 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.152399 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c28a3232-980e-4224-9122-6d6d16856660-tmp-dir\") pod \"dns-default-s4gtz\" (UID: \"c28a3232-980e-4224-9122-6d6d16856660\") " pod="openshift-dns/dns-default-s4gtz" Jul 10 22:08:28.152601 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.152557 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/819f5f1d-e5d6-4086-8859-adb446fc911b-trusted-ca\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:28.156254 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.156235 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/819f5f1d-e5d6-4086-8859-adb446fc911b-installation-pull-secrets\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:28.156391 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.156260 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/819f5f1d-e5d6-4086-8859-adb446fc911b-image-registry-private-configuration\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:28.156391 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.156305 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16b445d4-390f-490f-bdc7-2da3c70fa6dd-cert\") pod \"ingress-canary-mzpnz\" (UID: \"16b445d4-390f-490f-bdc7-2da3c70fa6dd\") " pod="openshift-ingress-canary/ingress-canary-mzpnz" Jul 10 22:08:28.163487 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.163454 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfzqh\" (UniqueName: \"kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-kube-api-access-tfzqh\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:28.163487 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.163473 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9xwp\" (UniqueName: \"kubernetes.io/projected/16b445d4-390f-490f-bdc7-2da3c70fa6dd-kube-api-access-t9xwp\") pod \"ingress-canary-mzpnz\" (UID: \"16b445d4-390f-490f-bdc7-2da3c70fa6dd\") " pod="openshift-ingress-canary/ingress-canary-mzpnz" Jul 10 22:08:28.164422 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.164404 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfrgv\" (UniqueName: \"kubernetes.io/projected/c28a3232-980e-4224-9122-6d6d16856660-kube-api-access-rfrgv\") pod \"dns-default-s4gtz\" (UID: \"c28a3232-980e-4224-9122-6d6d16856660\") " pod="openshift-dns/dns-default-s4gtz" Jul 10 22:08:28.164676 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.164657 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-bound-sa-token\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:28.278442 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.278410 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mzpnz" Jul 10 22:08:28.413167 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.413024 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mzpnz"] Jul 10 22:08:28.416149 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:08:28.416114 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16b445d4_390f_490f_bdc7_2da3c70fa6dd.slice/crio-1aa08b3dde5959f7477d39c3db6bb3751cbe6e767aabcceb6c6b83cb6b1cc5f1 WatchSource:0}: Error finding container 1aa08b3dde5959f7477d39c3db6bb3751cbe6e767aabcceb6c6b83cb6b1cc5f1: Status 404 returned error can't find the container with id 1aa08b3dde5959f7477d39c3db6bb3751cbe6e767aabcceb6c6b83cb6b1cc5f1 Jul 10 22:08:28.655707 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.655671 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:28.656445 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.655735 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c28a3232-980e-4224-9122-6d6d16856660-metrics-tls\") pod \"dns-default-s4gtz\" (UID: \"c28a3232-980e-4224-9122-6d6d16856660\") " pod="openshift-dns/dns-default-s4gtz" Jul 10 22:08:28.656445 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:28.655853 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 22:08:28.656445 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:28.655876 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 22:08:28.656445 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:28.655896 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d9f6cd95d-xrbwq: secret "image-registry-tls" not found Jul 10 22:08:28.656445 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:28.655910 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c28a3232-980e-4224-9122-6d6d16856660-metrics-tls podName:c28a3232-980e-4224-9122-6d6d16856660 nodeName:}" failed. No retries permitted until 2026-07-10 22:08:29.655891816 +0000 UTC m=+38.569829043 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c28a3232-980e-4224-9122-6d6d16856660-metrics-tls") pod "dns-default-s4gtz" (UID: "c28a3232-980e-4224-9122-6d6d16856660") : secret "dns-default-metrics-tls" not found Jul 10 22:08:28.656445 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:28.655944 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls podName:819f5f1d-e5d6-4086-8859-adb446fc911b nodeName:}" failed. No retries permitted until 2026-07-10 22:08:29.655929511 +0000 UTC m=+38.569866754 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls") pod "image-registry-7d9f6cd95d-xrbwq" (UID: "819f5f1d-e5d6-4086-8859-adb446fc911b") : secret "image-registry-tls" not found Jul 10 22:08:28.854745 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.854654 2578 generic.go:356] "Generic (PLEG): container finished" podID="d632308b-166b-4f72-b311-f3a3c20d206c" containerID="599a05acc0246b706dba90d241b8224f518e706b6a7ab7c4c9a7c4b70d4c0098" exitCode=0 Jul 10 22:08:28.854745 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.854700 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gpgqm" event={"ID":"d632308b-166b-4f72-b311-f3a3c20d206c","Type":"ContainerDied","Data":"599a05acc0246b706dba90d241b8224f518e706b6a7ab7c4c9a7c4b70d4c0098"} Jul 10 22:08:28.856361 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:28.856321 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mzpnz" event={"ID":"16b445d4-390f-490f-bdc7-2da3c70fa6dd","Type":"ContainerStarted","Data":"1aa08b3dde5959f7477d39c3db6bb3751cbe6e767aabcceb6c6b83cb6b1cc5f1"} Jul 10 22:08:29.625558 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:29.625523 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:08:29.625722 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:29.625569 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:08:29.625722 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:29.625523 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:08:29.628769 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:29.628744 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 22:08:29.628886 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:29.628808 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 22:08:29.629656 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:29.629635 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gq72h\"" Jul 10 22:08:29.629769 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:29.629693 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rbprr\"" Jul 10 22:08:29.629769 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:29.629706 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 22:08:29.629886 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:29.629809 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 22:08:29.663349 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:29.663328 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c28a3232-980e-4224-9122-6d6d16856660-metrics-tls\") pod \"dns-default-s4gtz\" (UID: \"c28a3232-980e-4224-9122-6d6d16856660\") " pod="openshift-dns/dns-default-s4gtz" Jul 10 22:08:29.663657 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:29.663386 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:29.663657 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:29.663478 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 22:08:29.663657 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:29.663512 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 22:08:29.663657 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:29.663524 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d9f6cd95d-xrbwq: secret "image-registry-tls" not found Jul 10 22:08:29.663657 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:29.663535 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c28a3232-980e-4224-9122-6d6d16856660-metrics-tls podName:c28a3232-980e-4224-9122-6d6d16856660 nodeName:}" failed. No retries permitted until 2026-07-10 22:08:31.663516848 +0000 UTC m=+40.577454079 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c28a3232-980e-4224-9122-6d6d16856660-metrics-tls") pod "dns-default-s4gtz" (UID: "c28a3232-980e-4224-9122-6d6d16856660") : secret "dns-default-metrics-tls" not found Jul 10 22:08:29.663657 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:29.663564 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls podName:819f5f1d-e5d6-4086-8859-adb446fc911b nodeName:}" failed. No retries permitted until 2026-07-10 22:08:31.663552765 +0000 UTC m=+40.577489993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls") pod "image-registry-7d9f6cd95d-xrbwq" (UID: "819f5f1d-e5d6-4086-8859-adb446fc911b") : secret "image-registry-tls" not found Jul 10 22:08:29.863182 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:29.863113 2578 generic.go:356] "Generic (PLEG): container finished" podID="d632308b-166b-4f72-b311-f3a3c20d206c" containerID="bf783a0f9ecd94cacc1e16ebfca4f6821a0e3a90c73d9f464cac64a8a5fe362a" exitCode=0 Jul 10 22:08:29.863335 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:29.863179 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gpgqm" event={"ID":"d632308b-166b-4f72-b311-f3a3c20d206c","Type":"ContainerDied","Data":"bf783a0f9ecd94cacc1e16ebfca4f6821a0e3a90c73d9f464cac64a8a5fe362a"} Jul 10 22:08:30.869888 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:30.869672 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gpgqm" event={"ID":"d632308b-166b-4f72-b311-f3a3c20d206c","Type":"ContainerStarted","Data":"4d029c4875b7675ad4c0aa9755c185443c15f5800c1669188de22cd8f8074642"} Jul 10 22:08:30.871166 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:30.871113 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mzpnz" event={"ID":"16b445d4-390f-490f-bdc7-2da3c70fa6dd","Type":"ContainerStarted","Data":"b5618fe0b319a783ceb6495e7e030836ff8cabd5b185b765ecbd9da8d7c5666a"} Jul 10 22:08:30.894628 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:30.894578 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gpgqm" podStartSLOduration=7.419296159 podStartE2EDuration="38.894563872s" totalImagesPullingTime="31.475267713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:07:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:08:30.893271603 +0000 UTC m=+39.807208851" watchObservedRunningTime="2026-07-10 22:08:30.894563872 +0000 UTC m=+39.808501121" Jul 10 22:08:30.909886 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:30.909840 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mzpnz" podStartSLOduration=1.8058251360000002 podStartE2EDuration="3.90982145s" totalImagesPullingTime="2.103996314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:08:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:08:30.909409086 +0000 UTC m=+39.823346349" watchObservedRunningTime="2026-07-10 22:08:30.90982145 +0000 UTC m=+39.823758701" Jul 10 22:08:31.677040 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:31.677012 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:31.677225 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:31.677082 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c28a3232-980e-4224-9122-6d6d16856660-metrics-tls\") pod \"dns-default-s4gtz\" (UID: \"c28a3232-980e-4224-9122-6d6d16856660\") " pod="openshift-dns/dns-default-s4gtz" Jul 10 22:08:31.677225 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:31.677172 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 22:08:31.677225 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:31.677185 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d9f6cd95d-xrbwq: secret "image-registry-tls" not found Jul 10 22:08:31.677225 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:31.677218 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 22:08:31.677347 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:31.677232 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls podName:819f5f1d-e5d6-4086-8859-adb446fc911b nodeName:}" failed. No retries permitted until 2026-07-10 22:08:35.677218921 +0000 UTC m=+44.591156153 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls") pod "image-registry-7d9f6cd95d-xrbwq" (UID: "819f5f1d-e5d6-4086-8859-adb446fc911b") : secret "image-registry-tls" not found Jul 10 22:08:31.677347 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:31.677270 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c28a3232-980e-4224-9122-6d6d16856660-metrics-tls podName:c28a3232-980e-4224-9122-6d6d16856660 nodeName:}" failed. No retries permitted until 2026-07-10 22:08:35.677256857 +0000 UTC m=+44.591194084 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c28a3232-980e-4224-9122-6d6d16856660-metrics-tls") pod "dns-default-s4gtz" (UID: "c28a3232-980e-4224-9122-6d6d16856660") : secret "dns-default-metrics-tls" not found Jul 10 22:08:35.705771 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:35.705739 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:35.706218 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:35.705807 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c28a3232-980e-4224-9122-6d6d16856660-metrics-tls\") pod \"dns-default-s4gtz\" (UID: \"c28a3232-980e-4224-9122-6d6d16856660\") " pod="openshift-dns/dns-default-s4gtz" Jul 10 22:08:35.706218 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:35.705912 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 22:08:35.706218 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:35.705970 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c28a3232-980e-4224-9122-6d6d16856660-metrics-tls podName:c28a3232-980e-4224-9122-6d6d16856660 nodeName:}" failed. No retries permitted until 2026-07-10 22:08:43.705957062 +0000 UTC m=+52.619894290 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c28a3232-980e-4224-9122-6d6d16856660-metrics-tls") pod "dns-default-s4gtz" (UID: "c28a3232-980e-4224-9122-6d6d16856660") : secret "dns-default-metrics-tls" not found Jul 10 22:08:35.706218 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:35.705913 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 22:08:35.706218 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:35.706007 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d9f6cd95d-xrbwq: secret "image-registry-tls" not found Jul 10 22:08:35.706218 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:35.706059 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls podName:819f5f1d-e5d6-4086-8859-adb446fc911b nodeName:}" failed. No retries permitted until 2026-07-10 22:08:43.706046513 +0000 UTC m=+52.619983756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls") pod "image-registry-7d9f6cd95d-xrbwq" (UID: "819f5f1d-e5d6-4086-8859-adb446fc911b") : secret "image-registry-tls" not found Jul 10 22:08:43.763981 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:43.763945 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:43.764506 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:43.764013 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c28a3232-980e-4224-9122-6d6d16856660-metrics-tls\") pod \"dns-default-s4gtz\" (UID: \"c28a3232-980e-4224-9122-6d6d16856660\") " pod="openshift-dns/dns-default-s4gtz" Jul 10 22:08:43.764506 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:43.764099 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 22:08:43.764506 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:43.764108 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 22:08:43.764506 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:43.764116 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d9f6cd95d-xrbwq: secret "image-registry-tls" not found Jul 10 22:08:43.764506 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:43.764174 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c28a3232-980e-4224-9122-6d6d16856660-metrics-tls podName:c28a3232-980e-4224-9122-6d6d16856660 nodeName:}" failed. No retries permitted until 2026-07-10 22:08:59.764159869 +0000 UTC m=+68.678097097 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c28a3232-980e-4224-9122-6d6d16856660-metrics-tls") pod "dns-default-s4gtz" (UID: "c28a3232-980e-4224-9122-6d6d16856660") : secret "dns-default-metrics-tls" not found Jul 10 22:08:43.764506 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:43.764187 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls podName:819f5f1d-e5d6-4086-8859-adb446fc911b nodeName:}" failed. No retries permitted until 2026-07-10 22:08:59.764180966 +0000 UTC m=+68.678118193 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls") pod "image-registry-7d9f6cd95d-xrbwq" (UID: "819f5f1d-e5d6-4086-8859-adb446fc911b") : secret "image-registry-tls" not found Jul 10 22:08:52.847719 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:52.847693 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q2w5j" Jul 10 22:08:54.671175 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:54.671143 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hc8sp"] Jul 10 22:08:54.673898 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:54.673883 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:08:54.678187 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:54.678165 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 10 22:08:54.678286 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:54.678260 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 10 22:08:54.680406 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:54.680215 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 10 22:08:54.680406 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:54.680217 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 10 22:08:54.680842 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:54.680828 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rp44b\"" Jul 10 22:08:54.688403 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:54.688384 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hc8sp"] Jul 10 22:08:54.745816 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:54.745780 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b6c4c998-9c92-450c-abc7-1da46e0de252-crio-socket\") pod \"insights-runtime-extractor-hc8sp\" (UID: \"b6c4c998-9c92-450c-abc7-1da46e0de252\") " pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:08:54.745816 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:54.745817 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s7v5\" (UniqueName: \"kubernetes.io/projected/b6c4c998-9c92-450c-abc7-1da46e0de252-kube-api-access-9s7v5\") pod \"insights-runtime-extractor-hc8sp\" (UID: \"b6c4c998-9c92-450c-abc7-1da46e0de252\") " pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:08:54.746019 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:54.745893 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6c4c998-9c92-450c-abc7-1da46e0de252-data-volume\") pod \"insights-runtime-extractor-hc8sp\" (UID: \"b6c4c998-9c92-450c-abc7-1da46e0de252\") " pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:08:54.746019 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:54.745950 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6c4c998-9c92-450c-abc7-1da46e0de252-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hc8sp\" (UID: \"b6c4c998-9c92-450c-abc7-1da46e0de252\") " pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:08:54.746019 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:54.745973 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6c4c998-9c92-450c-abc7-1da46e0de252-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hc8sp\" (UID: \"b6c4c998-9c92-450c-abc7-1da46e0de252\") " pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:08:54.846233 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:54.846197 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6c4c998-9c92-450c-abc7-1da46e0de252-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hc8sp\" (UID: \"b6c4c998-9c92-450c-abc7-1da46e0de252\") " pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:08:54.846233 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:54.846234 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6c4c998-9c92-450c-abc7-1da46e0de252-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hc8sp\" (UID: \"b6c4c998-9c92-450c-abc7-1da46e0de252\") " pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:08:54.846384 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:54.846254 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b6c4c998-9c92-450c-abc7-1da46e0de252-crio-socket\") pod \"insights-runtime-extractor-hc8sp\" (UID: \"b6c4c998-9c92-450c-abc7-1da46e0de252\") " pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:08:54.846384 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:54.846271 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s7v5\" (UniqueName: \"kubernetes.io/projected/b6c4c998-9c92-450c-abc7-1da46e0de252-kube-api-access-9s7v5\") pod \"insights-runtime-extractor-hc8sp\" (UID: \"b6c4c998-9c92-450c-abc7-1da46e0de252\") " pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:08:54.846384 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:54.846308 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 22:08:54.846384 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:54.846352 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 22:08:54.846384 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:54.846374 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6c4c998-9c92-450c-abc7-1da46e0de252-kube-rbac-proxy-cm podName:b6c4c998-9c92-450c-abc7-1da46e0de252 nodeName:}" failed. No retries permitted until 2026-07-10 22:08:55.346357629 +0000 UTC m=+64.260294857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b6c4c998-9c92-450c-abc7-1da46e0de252-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hc8sp" (UID: "b6c4c998-9c92-450c-abc7-1da46e0de252") : configmap "kube-rbac-proxy" not found Jul 10 22:08:54.846567 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:54.846410 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c4c998-9c92-450c-abc7-1da46e0de252-insights-runtime-extractor-tls podName:b6c4c998-9c92-450c-abc7-1da46e0de252 nodeName:}" failed. No retries permitted until 2026-07-10 22:08:55.346394207 +0000 UTC m=+64.260331434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b6c4c998-9c92-450c-abc7-1da46e0de252-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hc8sp" (UID: "b6c4c998-9c92-450c-abc7-1da46e0de252") : secret "insights-runtime-extractor-tls" not found Jul 10 22:08:54.846567 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:54.846360 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6c4c998-9c92-450c-abc7-1da46e0de252-data-volume\") pod \"insights-runtime-extractor-hc8sp\" (UID: \"b6c4c998-9c92-450c-abc7-1da46e0de252\") " pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:08:54.846567 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:54.846461 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b6c4c998-9c92-450c-abc7-1da46e0de252-crio-socket\") pod \"insights-runtime-extractor-hc8sp\" (UID: \"b6c4c998-9c92-450c-abc7-1da46e0de252\") " pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:08:54.846701 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:54.846620 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6c4c998-9c92-450c-abc7-1da46e0de252-data-volume\") pod \"insights-runtime-extractor-hc8sp\" (UID: \"b6c4c998-9c92-450c-abc7-1da46e0de252\") " pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:08:54.860220 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:54.860192 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s7v5\" (UniqueName: \"kubernetes.io/projected/b6c4c998-9c92-450c-abc7-1da46e0de252-kube-api-access-9s7v5\") pod \"insights-runtime-extractor-hc8sp\" (UID: \"b6c4c998-9c92-450c-abc7-1da46e0de252\") " pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:08:55.350929 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:55.350893 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6c4c998-9c92-450c-abc7-1da46e0de252-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hc8sp\" (UID: \"b6c4c998-9c92-450c-abc7-1da46e0de252\") " pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:08:55.350929 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:55.350927 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6c4c998-9c92-450c-abc7-1da46e0de252-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hc8sp\" (UID: \"b6c4c998-9c92-450c-abc7-1da46e0de252\") " pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:08:55.351113 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:55.351010 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 22:08:55.351113 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:55.351023 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 22:08:55.351113 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:55.351084 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6c4c998-9c92-450c-abc7-1da46e0de252-kube-rbac-proxy-cm podName:b6c4c998-9c92-450c-abc7-1da46e0de252 nodeName:}" failed. No retries permitted until 2026-07-10 22:08:56.351069003 +0000 UTC m=+65.265006245 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b6c4c998-9c92-450c-abc7-1da46e0de252-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hc8sp" (UID: "b6c4c998-9c92-450c-abc7-1da46e0de252") : configmap "kube-rbac-proxy" not found Jul 10 22:08:55.351113 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:55.351099 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c4c998-9c92-450c-abc7-1da46e0de252-insights-runtime-extractor-tls podName:b6c4c998-9c92-450c-abc7-1da46e0de252 nodeName:}" failed. No retries permitted until 2026-07-10 22:08:56.351092609 +0000 UTC m=+65.265029836 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b6c4c998-9c92-450c-abc7-1da46e0de252-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hc8sp" (UID: "b6c4c998-9c92-450c-abc7-1da46e0de252") : secret "insights-runtime-extractor-tls" not found Jul 10 22:08:56.358241 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:56.358204 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6c4c998-9c92-450c-abc7-1da46e0de252-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hc8sp\" (UID: \"b6c4c998-9c92-450c-abc7-1da46e0de252\") " pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:08:56.358241 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:56.358247 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6c4c998-9c92-450c-abc7-1da46e0de252-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hc8sp\" (UID: \"b6c4c998-9c92-450c-abc7-1da46e0de252\") " pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:08:56.358756 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:56.358339 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 22:08:56.358756 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:56.358344 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 22:08:56.358756 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:56.358414 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6c4c998-9c92-450c-abc7-1da46e0de252-kube-rbac-proxy-cm podName:b6c4c998-9c92-450c-abc7-1da46e0de252 nodeName:}" failed. No retries permitted until 2026-07-10 22:08:58.358391567 +0000 UTC m=+67.272328811 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b6c4c998-9c92-450c-abc7-1da46e0de252-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hc8sp" (UID: "b6c4c998-9c92-450c-abc7-1da46e0de252") : configmap "kube-rbac-proxy" not found Jul 10 22:08:56.358756 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:56.358445 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c4c998-9c92-450c-abc7-1da46e0de252-insights-runtime-extractor-tls podName:b6c4c998-9c92-450c-abc7-1da46e0de252 nodeName:}" failed. No retries permitted until 2026-07-10 22:08:58.358431996 +0000 UTC m=+67.272369228 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b6c4c998-9c92-450c-abc7-1da46e0de252-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hc8sp" (UID: "b6c4c998-9c92-450c-abc7-1da46e0de252") : secret "insights-runtime-extractor-tls" not found Jul 10 22:08:56.471400 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:56.471378 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ctkbw_81543b68-820c-44cd-b221-c379b5c27e7d/dns-node-resolver/0.log" Jul 10 22:08:57.264273 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:57.264238 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs\") pod \"network-metrics-daemon-rbtmx\" (UID: \"31e9f715-aeb8-4938-bc61-4bc61dd8c82a\") " pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:08:57.266361 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:57.266344 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 22:08:57.269033 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:57.269018 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bjbhb_6729845a-5a43-4a34-91c1-58f0bd7b45a6/node-ca/0.log" Jul 10 22:08:57.275109 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:57.275095 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 10 22:08:57.275172 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:57.275165 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs podName:31e9f715-aeb8-4938-bc61-4bc61dd8c82a nodeName:}" failed. No retries permitted until 2026-07-10 22:10:01.275152777 +0000 UTC m=+130.189090004 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs") pod "network-metrics-daemon-rbtmx" (UID: "31e9f715-aeb8-4938-bc61-4bc61dd8c82a") : secret "metrics-daemon-secret" not found Jul 10 22:08:57.365006 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:57.364970 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9xrv\" (UniqueName: \"kubernetes.io/projected/005d0536-3d14-4e5c-808b-9bb203a2aced-kube-api-access-x9xrv\") pod \"network-check-target-b5fbv\" (UID: \"005d0536-3d14-4e5c-808b-9bb203a2aced\") " pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:08:57.365414 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:57.365021 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-original-pull-secret\") pod \"global-pull-secret-syncer-8qjtp\" (UID: \"50d3b770-a6bb-4280-b6dc-6c1dfec697d1\") " pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:08:57.367491 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:57.367471 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 22:08:57.367599 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:57.367541 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 22:08:57.377155 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:57.377119 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 22:08:57.377247 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:57.377197 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50d3b770-a6bb-4280-b6dc-6c1dfec697d1-original-pull-secret\") pod \"global-pull-secret-syncer-8qjtp\" (UID: \"50d3b770-a6bb-4280-b6dc-6c1dfec697d1\") " pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:08:57.387954 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:57.387933 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9xrv\" (UniqueName: \"kubernetes.io/projected/005d0536-3d14-4e5c-808b-9bb203a2aced-kube-api-access-x9xrv\") pod \"network-check-target-b5fbv\" (UID: \"005d0536-3d14-4e5c-808b-9bb203a2aced\") " pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:08:57.540498 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:57.540424 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rbprr\"" Jul 10 22:08:57.544330 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:57.544315 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qjtp" Jul 10 22:08:57.548270 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:57.548248 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:08:57.697828 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:57.697804 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8qjtp"] Jul 10 22:08:57.715449 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:57.715029 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b5fbv"] Jul 10 22:08:57.719419 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:08:57.719394 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod005d0536_3d14_4e5c_808b_9bb203a2aced.slice/crio-2ffc8d1c397542736504073628705ad6a7bcb5688a933402fbc57c3de9c5c274 WatchSource:0}: Error finding container 2ffc8d1c397542736504073628705ad6a7bcb5688a933402fbc57c3de9c5c274: Status 404 returned error can't find the container with id 2ffc8d1c397542736504073628705ad6a7bcb5688a933402fbc57c3de9c5c274 Jul 10 22:08:57.933298 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:57.933260 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b5fbv" event={"ID":"005d0536-3d14-4e5c-808b-9bb203a2aced","Type":"ContainerStarted","Data":"2ffc8d1c397542736504073628705ad6a7bcb5688a933402fbc57c3de9c5c274"} Jul 10 22:08:57.934319 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:57.934295 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8qjtp" event={"ID":"50d3b770-a6bb-4280-b6dc-6c1dfec697d1","Type":"ContainerStarted","Data":"130a1faf1247d3f0e4c541c8ae9b470efc2c028af10d12019ece7b83675707cb"} Jul 10 22:08:58.372850 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:58.372765 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6c4c998-9c92-450c-abc7-1da46e0de252-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hc8sp\" (UID: \"b6c4c998-9c92-450c-abc7-1da46e0de252\") " pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:08:58.372850 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:58.372814 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6c4c998-9c92-450c-abc7-1da46e0de252-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hc8sp\" (UID: \"b6c4c998-9c92-450c-abc7-1da46e0de252\") " pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:08:58.373348 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:58.372892 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 22:08:58.373348 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:58.372965 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6c4c998-9c92-450c-abc7-1da46e0de252-kube-rbac-proxy-cm podName:b6c4c998-9c92-450c-abc7-1da46e0de252 nodeName:}" failed. No retries permitted until 2026-07-10 22:09:02.37294979 +0000 UTC m=+71.286887017 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b6c4c998-9c92-450c-abc7-1da46e0de252-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hc8sp" (UID: "b6c4c998-9c92-450c-abc7-1da46e0de252") : configmap "kube-rbac-proxy" not found Jul 10 22:08:58.373348 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:58.373013 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 22:08:58.373348 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:58.373077 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c4c998-9c92-450c-abc7-1da46e0de252-insights-runtime-extractor-tls podName:b6c4c998-9c92-450c-abc7-1da46e0de252 nodeName:}" failed. No retries permitted until 2026-07-10 22:09:02.373059056 +0000 UTC m=+71.286996285 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b6c4c998-9c92-450c-abc7-1da46e0de252-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hc8sp" (UID: "b6c4c998-9c92-450c-abc7-1da46e0de252") : secret "insights-runtime-extractor-tls" not found Jul 10 22:08:58.470290 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:58.470257 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mzpnz_16b445d4-390f-490f-bdc7-2da3c70fa6dd/serve-healthcheck-canary/0.log" Jul 10 22:08:59.785311 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:59.785272 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c28a3232-980e-4224-9122-6d6d16856660-metrics-tls\") pod \"dns-default-s4gtz\" (UID: \"c28a3232-980e-4224-9122-6d6d16856660\") " pod="openshift-dns/dns-default-s4gtz" Jul 10 22:08:59.785773 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:59.785444 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 22:08:59.785773 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:59.785524 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c28a3232-980e-4224-9122-6d6d16856660-metrics-tls podName:c28a3232-980e-4224-9122-6d6d16856660 nodeName:}" failed. No retries permitted until 2026-07-10 22:09:31.785502184 +0000 UTC m=+100.699439414 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c28a3232-980e-4224-9122-6d6d16856660-metrics-tls") pod "dns-default-s4gtz" (UID: "c28a3232-980e-4224-9122-6d6d16856660") : secret "dns-default-metrics-tls" not found Jul 10 22:08:59.785773 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:08:59.785561 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:08:59.785773 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:59.785669 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 22:08:59.785773 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:59.785685 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d9f6cd95d-xrbwq: secret "image-registry-tls" not found Jul 10 22:08:59.785773 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:08:59.785734 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls podName:819f5f1d-e5d6-4086-8859-adb446fc911b nodeName:}" failed. No retries permitted until 2026-07-10 22:09:31.785719107 +0000 UTC m=+100.699656348 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls") pod "image-registry-7d9f6cd95d-xrbwq" (UID: "819f5f1d-e5d6-4086-8859-adb446fc911b") : secret "image-registry-tls" not found Jul 10 22:09:00.358647 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:00.358610 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8bvnm"] Jul 10 22:09:00.391347 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:00.391305 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8bvnm"] Jul 10 22:09:00.391515 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:00.391420 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8bvnm" Jul 10 22:09:00.394080 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:00.394053 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 10 22:09:00.394253 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:00.394158 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 10 22:09:00.394253 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:00.394155 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 10 22:09:00.394253 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:00.394179 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 10 22:09:00.394826 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:00.394804 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-grzns\"" Jul 10 22:09:00.491806 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:00.491767 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/858f95a5-4497-4267-9aec-d745abb6e57e-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-8bvnm\" (UID: \"858f95a5-4497-4267-9aec-d745abb6e57e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8bvnm" Jul 10 22:09:00.491979 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:00.491817 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzt9g\" (UniqueName: \"kubernetes.io/projected/858f95a5-4497-4267-9aec-d745abb6e57e-kube-api-access-xzt9g\") pod \"kube-storage-version-migrator-operator-799cb7f958-8bvnm\" (UID: \"858f95a5-4497-4267-9aec-d745abb6e57e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8bvnm" Jul 10 22:09:00.491979 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:00.491912 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/858f95a5-4497-4267-9aec-d745abb6e57e-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-8bvnm\" (UID: \"858f95a5-4497-4267-9aec-d745abb6e57e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8bvnm" Jul 10 22:09:00.592478 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:00.592435 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/858f95a5-4497-4267-9aec-d745abb6e57e-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-8bvnm\" (UID: \"858f95a5-4497-4267-9aec-d745abb6e57e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8bvnm" Jul 10 22:09:00.592665 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:00.592489 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzt9g\" (UniqueName: \"kubernetes.io/projected/858f95a5-4497-4267-9aec-d745abb6e57e-kube-api-access-xzt9g\") pod \"kube-storage-version-migrator-operator-799cb7f958-8bvnm\" (UID: \"858f95a5-4497-4267-9aec-d745abb6e57e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8bvnm" Jul 10 22:09:00.592665 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:00.592568 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/858f95a5-4497-4267-9aec-d745abb6e57e-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-8bvnm\" (UID: \"858f95a5-4497-4267-9aec-d745abb6e57e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8bvnm" Jul 10 22:09:00.593029 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:00.593006 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/858f95a5-4497-4267-9aec-d745abb6e57e-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-8bvnm\" (UID: \"858f95a5-4497-4267-9aec-d745abb6e57e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8bvnm" Jul 10 22:09:00.595236 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:00.595204 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/858f95a5-4497-4267-9aec-d745abb6e57e-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-8bvnm\" (UID: \"858f95a5-4497-4267-9aec-d745abb6e57e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8bvnm" Jul 10 22:09:00.600488 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:00.600462 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzt9g\" (UniqueName: \"kubernetes.io/projected/858f95a5-4497-4267-9aec-d745abb6e57e-kube-api-access-xzt9g\") pod \"kube-storage-version-migrator-operator-799cb7f958-8bvnm\" (UID: \"858f95a5-4497-4267-9aec-d745abb6e57e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8bvnm" Jul 10 22:09:00.702391 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:00.702356 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8bvnm" Jul 10 22:09:00.853643 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:00.853613 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8bvnm"] Jul 10 22:09:00.856897 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:09:00.856863 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod858f95a5_4497_4267_9aec_d745abb6e57e.slice/crio-f14fa768c14ffcfcaccd3f5f9f08396ac1501ca125a4c1be7f03ddf8de66ccf5 WatchSource:0}: Error finding container f14fa768c14ffcfcaccd3f5f9f08396ac1501ca125a4c1be7f03ddf8de66ccf5: Status 404 returned error can't find the container with id f14fa768c14ffcfcaccd3f5f9f08396ac1501ca125a4c1be7f03ddf8de66ccf5 Jul 10 22:09:00.943873 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:00.943834 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8bvnm" event={"ID":"858f95a5-4497-4267-9aec-d745abb6e57e","Type":"ContainerStarted","Data":"f14fa768c14ffcfcaccd3f5f9f08396ac1501ca125a4c1be7f03ddf8de66ccf5"} Jul 10 22:09:01.948358 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:01.948317 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b5fbv" event={"ID":"005d0536-3d14-4e5c-808b-9bb203a2aced","Type":"ContainerStarted","Data":"fdb53562500e3809ba9e16f65a81b5f68eb9b5ee5c40d648cf9cf564b15ef4ef"} Jul 10 22:09:01.948770 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:01.948462 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:09:01.965841 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:01.965795 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-b5fbv" podStartSLOduration=66.635500969 podStartE2EDuration="1m9.965779767s" totalImagesPullingTime="3.330278798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:07:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:09:01.964987229 +0000 UTC m=+70.878924489" watchObservedRunningTime="2026-07-10 22:09:01.965779767 +0000 UTC m=+70.879717039" Jul 10 22:09:02.408092 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:02.408001 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6c4c998-9c92-450c-abc7-1da46e0de252-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hc8sp\" (UID: \"b6c4c998-9c92-450c-abc7-1da46e0de252\") " pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:09:02.408092 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:02.408040 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6c4c998-9c92-450c-abc7-1da46e0de252-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hc8sp\" (UID: \"b6c4c998-9c92-450c-abc7-1da46e0de252\") " pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:09:02.408388 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:09:02.408138 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 22:09:02.408388 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:09:02.408221 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6c4c998-9c92-450c-abc7-1da46e0de252-kube-rbac-proxy-cm podName:b6c4c998-9c92-450c-abc7-1da46e0de252 nodeName:}" failed. No retries permitted until 2026-07-10 22:09:10.408200008 +0000 UTC m=+79.322137237 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b6c4c998-9c92-450c-abc7-1da46e0de252-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hc8sp" (UID: "b6c4c998-9c92-450c-abc7-1da46e0de252") : configmap "kube-rbac-proxy" not found Jul 10 22:09:02.408388 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:09:02.408233 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 22:09:02.408388 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:09:02.408288 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c4c998-9c92-450c-abc7-1da46e0de252-insights-runtime-extractor-tls podName:b6c4c998-9c92-450c-abc7-1da46e0de252 nodeName:}" failed. No retries permitted until 2026-07-10 22:09:10.408272297 +0000 UTC m=+79.322209526 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b6c4c998-9c92-450c-abc7-1da46e0de252-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hc8sp" (UID: "b6c4c998-9c92-450c-abc7-1da46e0de252") : secret "insights-runtime-extractor-tls" not found Jul 10 22:09:02.952558 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:02.952517 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8qjtp" event={"ID":"50d3b770-a6bb-4280-b6dc-6c1dfec697d1","Type":"ContainerStarted","Data":"0ee8367f87f46790d16a0ac875f66d4b92ef58fba16c9c5afeccf3a8423b9659"} Jul 10 22:09:02.968478 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:02.968429 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8qjtp" podStartSLOduration=66.02317717 podStartE2EDuration="1m10.968414831s" totalImagesPullingTime="4.945237661s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:07:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:09:02.967196167 +0000 UTC m=+71.881133416" watchObservedRunningTime="2026-07-10 22:09:02.968414831 +0000 UTC m=+71.882352079" Jul 10 22:09:04.958310 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:04.958266 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8bvnm" event={"ID":"858f95a5-4497-4267-9aec-d745abb6e57e","Type":"ContainerStarted","Data":"3234b850a3f4abaac0549ec71bf01acc79a97de6073291e851b4b6bc40cb50f8"} Jul 10 22:09:04.975616 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:04.975571 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8bvnm" podStartSLOduration=1.537568233 podStartE2EDuration="4.975553966s" totalImagesPullingTime="3.437985733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:09:04.974471506 +0000 UTC m=+73.888408754" watchObservedRunningTime="2026-07-10 22:09:04.975553966 +0000 UTC m=+73.889491216" Jul 10 22:09:05.684469 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:05.684431 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-c7wjm"] Jul 10 22:09:05.686548 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:05.686532 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-c7wjm" Jul 10 22:09:05.688944 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:05.688917 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rktrq\"" Jul 10 22:09:05.689574 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:05.689560 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 10 22:09:05.689574 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:05.689572 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 10 22:09:05.700098 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:05.698844 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-c7wjm"] Jul 10 22:09:05.735893 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:05.735864 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqjwq\" (UniqueName: \"kubernetes.io/projected/9aad5259-34dd-4598-804f-c751630acf0f-kube-api-access-cqjwq\") pod \"migrator-7f59b54f6c-c7wjm\" (UID: \"9aad5259-34dd-4598-804f-c751630acf0f\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-c7wjm" Jul 10 22:09:05.836254 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:05.836210 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqjwq\" (UniqueName: \"kubernetes.io/projected/9aad5259-34dd-4598-804f-c751630acf0f-kube-api-access-cqjwq\") pod \"migrator-7f59b54f6c-c7wjm\" (UID: \"9aad5259-34dd-4598-804f-c751630acf0f\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-c7wjm" Jul 10 22:09:05.844457 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:05.844424 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqjwq\" (UniqueName: \"kubernetes.io/projected/9aad5259-34dd-4598-804f-c751630acf0f-kube-api-access-cqjwq\") pod \"migrator-7f59b54f6c-c7wjm\" (UID: \"9aad5259-34dd-4598-804f-c751630acf0f\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-c7wjm" Jul 10 22:09:05.995339 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:05.995262 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-c7wjm" Jul 10 22:09:06.114820 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:06.114790 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-c7wjm"] Jul 10 22:09:06.118182 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:09:06.118158 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aad5259_34dd_4598_804f_c751630acf0f.slice/crio-6b0c39fd39ce030ab83f2fd8e1c68b0abfce5478c842926c9f5db9f9fd30c1fe WatchSource:0}: Error finding container 6b0c39fd39ce030ab83f2fd8e1c68b0abfce5478c842926c9f5db9f9fd30c1fe: Status 404 returned error can't find the container with id 6b0c39fd39ce030ab83f2fd8e1c68b0abfce5478c842926c9f5db9f9fd30c1fe Jul 10 22:09:06.964436 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:06.964399 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-c7wjm" event={"ID":"9aad5259-34dd-4598-804f-c751630acf0f","Type":"ContainerStarted","Data":"6b0c39fd39ce030ab83f2fd8e1c68b0abfce5478c842926c9f5db9f9fd30c1fe"} Jul 10 22:09:07.242657 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:07.242576 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-mps9q"] Jul 10 22:09:07.244779 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:07.244761 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-mps9q" Jul 10 22:09:07.247060 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:07.247043 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 10 22:09:07.247792 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:07.247769 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 10 22:09:07.247792 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:07.247786 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-slvmh\"" Jul 10 22:09:07.247962 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:07.247768 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 10 22:09:07.248011 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:07.248000 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 10 22:09:07.252146 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:07.252116 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-mps9q"] Jul 10 22:09:07.349052 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:07.349016 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/011bdf63-e651-44e8-b7ed-f7f00562355e-signing-cabundle\") pod \"service-ca-79f68b9f4f-mps9q\" (UID: \"011bdf63-e651-44e8-b7ed-f7f00562355e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mps9q" Jul 10 22:09:07.349224 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:07.349093 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/011bdf63-e651-44e8-b7ed-f7f00562355e-signing-key\") pod \"service-ca-79f68b9f4f-mps9q\" (UID: \"011bdf63-e651-44e8-b7ed-f7f00562355e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mps9q" Jul 10 22:09:07.349224 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:07.349148 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d24x6\" (UniqueName: \"kubernetes.io/projected/011bdf63-e651-44e8-b7ed-f7f00562355e-kube-api-access-d24x6\") pod \"service-ca-79f68b9f4f-mps9q\" (UID: \"011bdf63-e651-44e8-b7ed-f7f00562355e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mps9q" Jul 10 22:09:07.449668 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:07.449628 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/011bdf63-e651-44e8-b7ed-f7f00562355e-signing-cabundle\") pod \"service-ca-79f68b9f4f-mps9q\" (UID: \"011bdf63-e651-44e8-b7ed-f7f00562355e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mps9q" Jul 10 22:09:07.449838 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:07.449721 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/011bdf63-e651-44e8-b7ed-f7f00562355e-signing-key\") pod \"service-ca-79f68b9f4f-mps9q\" (UID: \"011bdf63-e651-44e8-b7ed-f7f00562355e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mps9q" Jul 10 22:09:07.449838 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:07.449759 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d24x6\" (UniqueName: \"kubernetes.io/projected/011bdf63-e651-44e8-b7ed-f7f00562355e-kube-api-access-d24x6\") pod \"service-ca-79f68b9f4f-mps9q\" (UID: \"011bdf63-e651-44e8-b7ed-f7f00562355e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mps9q" Jul 10 22:09:07.450357 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:07.450311 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/011bdf63-e651-44e8-b7ed-f7f00562355e-signing-cabundle\") pod \"service-ca-79f68b9f4f-mps9q\" (UID: \"011bdf63-e651-44e8-b7ed-f7f00562355e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mps9q" Jul 10 22:09:07.452316 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:07.452296 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/011bdf63-e651-44e8-b7ed-f7f00562355e-signing-key\") pod \"service-ca-79f68b9f4f-mps9q\" (UID: \"011bdf63-e651-44e8-b7ed-f7f00562355e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mps9q" Jul 10 22:09:07.458505 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:07.458485 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d24x6\" (UniqueName: \"kubernetes.io/projected/011bdf63-e651-44e8-b7ed-f7f00562355e-kube-api-access-d24x6\") pod \"service-ca-79f68b9f4f-mps9q\" (UID: \"011bdf63-e651-44e8-b7ed-f7f00562355e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-mps9q" Jul 10 22:09:07.553689 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:07.553620 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-mps9q" Jul 10 22:09:07.681012 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:07.680991 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-mps9q"] Jul 10 22:09:07.684297 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:09:07.684272 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod011bdf63_e651_44e8_b7ed_f7f00562355e.slice/crio-134391f159b3edf5e465318803efb9b13105b6575707d1c4d496030fadd8b341 WatchSource:0}: Error finding container 134391f159b3edf5e465318803efb9b13105b6575707d1c4d496030fadd8b341: Status 404 returned error can't find the container with id 134391f159b3edf5e465318803efb9b13105b6575707d1c4d496030fadd8b341 Jul 10 22:09:07.968634 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:07.968593 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-mps9q" event={"ID":"011bdf63-e651-44e8-b7ed-f7f00562355e","Type":"ContainerStarted","Data":"134391f159b3edf5e465318803efb9b13105b6575707d1c4d496030fadd8b341"} Jul 10 22:09:07.970083 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:07.970060 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-c7wjm" event={"ID":"9aad5259-34dd-4598-804f-c751630acf0f","Type":"ContainerStarted","Data":"afad589fe228506e0ae2b18e0cdab11af2a097262808a94f4d4a47c625b79785"} Jul 10 22:09:07.970210 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:07.970096 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-c7wjm" event={"ID":"9aad5259-34dd-4598-804f-c751630acf0f","Type":"ContainerStarted","Data":"56e99034e0d2bcfc98e192261fb48cf95c0cbdaf11439ffb7d1661f2e5d31602"} Jul 10 22:09:07.987534 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:07.987495 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-c7wjm" podStartSLOduration=1.547511911 podStartE2EDuration="2.987481411s" totalImagesPullingTime="1.4399695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:09:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:09:07.98684398 +0000 UTC m=+76.900781226" watchObservedRunningTime="2026-07-10 22:09:07.987481411 +0000 UTC m=+76.901418659" Jul 10 22:09:09.978654 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:09.978614 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-mps9q" event={"ID":"011bdf63-e651-44e8-b7ed-f7f00562355e","Type":"ContainerStarted","Data":"e8f90bd43080f559d020c49b5e72b4bf78015603320e2b06a332cf6e6d0bb53c"} Jul 10 22:09:09.996837 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:09.996791 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-mps9q" podStartSLOduration=1.097255381 podStartE2EDuration="2.99677497s" totalImagesPullingTime="1.899519589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:09:09.99597711 +0000 UTC m=+78.909914357" watchObservedRunningTime="2026-07-10 22:09:09.99677497 +0000 UTC m=+78.910712218" Jul 10 22:09:10.471517 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:10.471486 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6c4c998-9c92-450c-abc7-1da46e0de252-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hc8sp\" (UID: \"b6c4c998-9c92-450c-abc7-1da46e0de252\") " pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:09:10.471715 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:10.471522 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6c4c998-9c92-450c-abc7-1da46e0de252-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hc8sp\" (UID: \"b6c4c998-9c92-450c-abc7-1da46e0de252\") " pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:09:10.471715 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:09:10.471624 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 22:09:10.471715 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:09:10.471676 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c4c998-9c92-450c-abc7-1da46e0de252-insights-runtime-extractor-tls podName:b6c4c998-9c92-450c-abc7-1da46e0de252 nodeName:}" failed. No retries permitted until 2026-07-10 22:09:26.471662974 +0000 UTC m=+95.385600201 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b6c4c998-9c92-450c-abc7-1da46e0de252-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hc8sp" (UID: "b6c4c998-9c92-450c-abc7-1da46e0de252") : secret "insights-runtime-extractor-tls" not found Jul 10 22:09:10.472079 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:10.472052 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6c4c998-9c92-450c-abc7-1da46e0de252-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hc8sp\" (UID: \"b6c4c998-9c92-450c-abc7-1da46e0de252\") " pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:09:26.495419 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:26.495277 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6c4c998-9c92-450c-abc7-1da46e0de252-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hc8sp\" (UID: \"b6c4c998-9c92-450c-abc7-1da46e0de252\") " pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:09:26.497571 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:26.497553 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6c4c998-9c92-450c-abc7-1da46e0de252-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hc8sp\" (UID: \"b6c4c998-9c92-450c-abc7-1da46e0de252\") " pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:09:26.782398 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:26.782309 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hc8sp" Jul 10 22:09:26.907333 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:26.907299 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hc8sp"] Jul 10 22:09:26.910472 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:09:26.910435 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6c4c998_9c92_450c_abc7_1da46e0de252.slice/crio-da14f119a866caa58bc9734e61b5dd6a0389fbfeaf2947e2862fd4f3b15542ff WatchSource:0}: Error finding container da14f119a866caa58bc9734e61b5dd6a0389fbfeaf2947e2862fd4f3b15542ff: Status 404 returned error can't find the container with id da14f119a866caa58bc9734e61b5dd6a0389fbfeaf2947e2862fd4f3b15542ff Jul 10 22:09:27.029202 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:27.029171 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hc8sp" event={"ID":"b6c4c998-9c92-450c-abc7-1da46e0de252","Type":"ContainerStarted","Data":"da14f119a866caa58bc9734e61b5dd6a0389fbfeaf2947e2862fd4f3b15542ff"} Jul 10 22:09:28.342707 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.342671 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr"] Jul 10 22:09:28.344779 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.344760 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr" Jul 10 22:09:28.347060 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.346959 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 10 22:09:28.348722 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.348700 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 10 22:09:28.349258 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.349232 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 10 22:09:28.349400 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.349281 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 10 22:09:28.349400 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.349298 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 10 22:09:28.349400 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.349312 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 10 22:09:28.349729 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.349671 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 10 22:09:28.359403 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.359379 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr"] Jul 10 22:09:28.415365 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.415330 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/31848d83-1e21-4a0f-a45e-8c606b7a5eb8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65f48c7c55-nvttr\" (UID: \"31848d83-1e21-4a0f-a45e-8c606b7a5eb8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr" Jul 10 22:09:28.415365 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.415368 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/31848d83-1e21-4a0f-a45e-8c606b7a5eb8-hub\") pod \"cluster-proxy-proxy-agent-65f48c7c55-nvttr\" (UID: \"31848d83-1e21-4a0f-a45e-8c606b7a5eb8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr" Jul 10 22:09:28.415600 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.415430 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/31848d83-1e21-4a0f-a45e-8c606b7a5eb8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65f48c7c55-nvttr\" (UID: \"31848d83-1e21-4a0f-a45e-8c606b7a5eb8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr" Jul 10 22:09:28.415600 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.415457 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/31848d83-1e21-4a0f-a45e-8c606b7a5eb8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65f48c7c55-nvttr\" (UID: \"31848d83-1e21-4a0f-a45e-8c606b7a5eb8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr" Jul 10 22:09:28.415600 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.415531 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/31848d83-1e21-4a0f-a45e-8c606b7a5eb8-ca\") pod \"cluster-proxy-proxy-agent-65f48c7c55-nvttr\" (UID: \"31848d83-1e21-4a0f-a45e-8c606b7a5eb8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr" Jul 10 22:09:28.415600 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.415581 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkpfn\" (UniqueName: \"kubernetes.io/projected/31848d83-1e21-4a0f-a45e-8c606b7a5eb8-kube-api-access-qkpfn\") pod \"cluster-proxy-proxy-agent-65f48c7c55-nvttr\" (UID: \"31848d83-1e21-4a0f-a45e-8c606b7a5eb8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr" Jul 10 22:09:28.516423 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.516380 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/31848d83-1e21-4a0f-a45e-8c606b7a5eb8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65f48c7c55-nvttr\" (UID: \"31848d83-1e21-4a0f-a45e-8c606b7a5eb8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr" Jul 10 22:09:28.516423 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.516422 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/31848d83-1e21-4a0f-a45e-8c606b7a5eb8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65f48c7c55-nvttr\" (UID: \"31848d83-1e21-4a0f-a45e-8c606b7a5eb8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr" Jul 10 22:09:28.516679 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.516471 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/31848d83-1e21-4a0f-a45e-8c606b7a5eb8-ca\") pod \"cluster-proxy-proxy-agent-65f48c7c55-nvttr\" (UID: \"31848d83-1e21-4a0f-a45e-8c606b7a5eb8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr" Jul 10 22:09:28.516679 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.516492 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkpfn\" (UniqueName: \"kubernetes.io/projected/31848d83-1e21-4a0f-a45e-8c606b7a5eb8-kube-api-access-qkpfn\") pod \"cluster-proxy-proxy-agent-65f48c7c55-nvttr\" (UID: \"31848d83-1e21-4a0f-a45e-8c606b7a5eb8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr" Jul 10 22:09:28.516679 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.516553 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/31848d83-1e21-4a0f-a45e-8c606b7a5eb8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65f48c7c55-nvttr\" (UID: \"31848d83-1e21-4a0f-a45e-8c606b7a5eb8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr" Jul 10 22:09:28.516829 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.516732 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/31848d83-1e21-4a0f-a45e-8c606b7a5eb8-hub\") pod \"cluster-proxy-proxy-agent-65f48c7c55-nvttr\" (UID: \"31848d83-1e21-4a0f-a45e-8c606b7a5eb8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr" Jul 10 22:09:28.517202 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.517168 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/31848d83-1e21-4a0f-a45e-8c606b7a5eb8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65f48c7c55-nvttr\" (UID: \"31848d83-1e21-4a0f-a45e-8c606b7a5eb8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr" Jul 10 22:09:28.519772 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.519751 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/31848d83-1e21-4a0f-a45e-8c606b7a5eb8-ca\") pod \"cluster-proxy-proxy-agent-65f48c7c55-nvttr\" (UID: \"31848d83-1e21-4a0f-a45e-8c606b7a5eb8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr" Jul 10 22:09:28.519868 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.519848 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/31848d83-1e21-4a0f-a45e-8c606b7a5eb8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65f48c7c55-nvttr\" (UID: \"31848d83-1e21-4a0f-a45e-8c606b7a5eb8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr" Jul 10 22:09:28.519918 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.519864 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/31848d83-1e21-4a0f-a45e-8c606b7a5eb8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65f48c7c55-nvttr\" (UID: \"31848d83-1e21-4a0f-a45e-8c606b7a5eb8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr" Jul 10 22:09:28.519918 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.519863 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/31848d83-1e21-4a0f-a45e-8c606b7a5eb8-hub\") pod \"cluster-proxy-proxy-agent-65f48c7c55-nvttr\" (UID: \"31848d83-1e21-4a0f-a45e-8c606b7a5eb8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr" Jul 10 22:09:28.532574 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.532549 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkpfn\" (UniqueName: \"kubernetes.io/projected/31848d83-1e21-4a0f-a45e-8c606b7a5eb8-kube-api-access-qkpfn\") pod \"cluster-proxy-proxy-agent-65f48c7c55-nvttr\" (UID: \"31848d83-1e21-4a0f-a45e-8c606b7a5eb8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr" Jul 10 22:09:28.661771 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:28.661692 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr" Jul 10 22:09:30.573902 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:30.573836 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr"] Jul 10 22:09:30.576907 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:09:30.576880 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31848d83_1e21_4a0f_a45e_8c606b7a5eb8.slice/crio-f6b0543b20ba3561427d84914fcd85ffb4dc59f037d2eb666ca5b5a54a11f8c9 WatchSource:0}: Error finding container f6b0543b20ba3561427d84914fcd85ffb4dc59f037d2eb666ca5b5a54a11f8c9: Status 404 returned error can't find the container with id f6b0543b20ba3561427d84914fcd85ffb4dc59f037d2eb666ca5b5a54a11f8c9 Jul 10 22:09:31.044068 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:31.044033 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr" event={"ID":"31848d83-1e21-4a0f-a45e-8c606b7a5eb8","Type":"ContainerStarted","Data":"f6b0543b20ba3561427d84914fcd85ffb4dc59f037d2eb666ca5b5a54a11f8c9"} Jul 10 22:09:31.045404 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:31.045377 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hc8sp" event={"ID":"b6c4c998-9c92-450c-abc7-1da46e0de252","Type":"ContainerStarted","Data":"68d33ae4ecb0cd8e7ee9813356cec67b419faa52b1489bf7443882b0a7bb2c00"} Jul 10 22:09:31.843682 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:31.843313 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c28a3232-980e-4224-9122-6d6d16856660-metrics-tls\") pod \"dns-default-s4gtz\" (UID: \"c28a3232-980e-4224-9122-6d6d16856660\") " pod="openshift-dns/dns-default-s4gtz" Jul 10 22:09:31.843682 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:31.843381 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:09:31.846329 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:31.846270 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c28a3232-980e-4224-9122-6d6d16856660-metrics-tls\") pod \"dns-default-s4gtz\" (UID: \"c28a3232-980e-4224-9122-6d6d16856660\") " pod="openshift-dns/dns-default-s4gtz" Jul 10 22:09:31.848892 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:31.848846 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls\") pod \"image-registry-7d9f6cd95d-xrbwq\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:09:31.854955 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:31.854744 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nbszp\"" Jul 10 22:09:31.862040 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:31.862017 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:09:31.874530 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:31.874509 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5fbdp\"" Jul 10 22:09:31.883277 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:31.883060 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s4gtz" Jul 10 22:09:32.051488 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:32.051459 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d9f6cd95d-xrbwq"] Jul 10 22:09:32.054668 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:09:32.054631 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod819f5f1d_e5d6_4086_8859_adb446fc911b.slice/crio-24cae056db7f9d2a884e6325756b24427c44b35ddbde9d9ef6c0319f67c62d1a WatchSource:0}: Error finding container 24cae056db7f9d2a884e6325756b24427c44b35ddbde9d9ef6c0319f67c62d1a: Status 404 returned error can't find the container with id 24cae056db7f9d2a884e6325756b24427c44b35ddbde9d9ef6c0319f67c62d1a Jul 10 22:09:32.055368 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:32.055338 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hc8sp" event={"ID":"b6c4c998-9c92-450c-abc7-1da46e0de252","Type":"ContainerStarted","Data":"b8771c9487f5250186b0c679c2897cca920826a26fa18b468f4241e8417c5f94"} Jul 10 22:09:32.078398 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:32.078344 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s4gtz"] Jul 10 22:09:32.081796 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:09:32.081767 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc28a3232_980e_4224_9122_6d6d16856660.slice/crio-6e315529206edd397b8eba34dd033ac81b07b59c8e80b87deef10817839bd44c WatchSource:0}: Error finding container 6e315529206edd397b8eba34dd033ac81b07b59c8e80b87deef10817839bd44c: Status 404 returned error can't find the container with id 6e315529206edd397b8eba34dd033ac81b07b59c8e80b87deef10817839bd44c Jul 10 22:09:32.955879 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:32.955276 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-b5fbv" Jul 10 22:09:33.060915 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:33.060869 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s4gtz" event={"ID":"c28a3232-980e-4224-9122-6d6d16856660","Type":"ContainerStarted","Data":"6e315529206edd397b8eba34dd033ac81b07b59c8e80b87deef10817839bd44c"} Jul 10 22:09:33.062903 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:33.062828 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" event={"ID":"819f5f1d-e5d6-4086-8859-adb446fc911b","Type":"ContainerStarted","Data":"eab776d0c5a37cfcd9890f31d1e1600ddcdab124a581851e93d85349c0ff5da1"} Jul 10 22:09:33.062903 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:33.062875 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" event={"ID":"819f5f1d-e5d6-4086-8859-adb446fc911b","Type":"ContainerStarted","Data":"24cae056db7f9d2a884e6325756b24427c44b35ddbde9d9ef6c0319f67c62d1a"} Jul 10 22:09:33.063107 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:33.062984 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:09:33.085491 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:33.085433 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" podStartSLOduration=101.085409433 podStartE2EDuration="1m41.085409433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:07:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:09:33.083434275 +0000 UTC m=+101.997371539" watchObservedRunningTime="2026-07-10 22:09:33.085409433 +0000 UTC m=+101.999346683" Jul 10 22:09:37.081027 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:37.080759 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr" event={"ID":"31848d83-1e21-4a0f-a45e-8c606b7a5eb8","Type":"ContainerStarted","Data":"13bd434204105bd890ce77961cb0e4efc2997f70e417b4d88f9abbd07dcfe1c1"} Jul 10 22:09:37.081027 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:37.080808 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr" event={"ID":"31848d83-1e21-4a0f-a45e-8c606b7a5eb8","Type":"ContainerStarted","Data":"64749662c71d02dd5e5ff92b4d804536a614ed576fd95a6b57a18967ec439fd8"} Jul 10 22:09:37.081027 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:37.080821 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr" event={"ID":"31848d83-1e21-4a0f-a45e-8c606b7a5eb8","Type":"ContainerStarted","Data":"d4aa006704db2cc4e9d5f2bbf4f9b8049829794dfac54b96352d54871ff314d9"} Jul 10 22:09:37.083448 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:37.083418 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hc8sp" event={"ID":"b6c4c998-9c92-450c-abc7-1da46e0de252","Type":"ContainerStarted","Data":"9674d490244d1bb1abecce1efdcd1cea6ce3982554b15e19baf17c2d931975a9"} Jul 10 22:09:37.085415 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:37.085388 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s4gtz" event={"ID":"c28a3232-980e-4224-9122-6d6d16856660","Type":"ContainerStarted","Data":"e2ea667dcdabb6396e47e1f6852f7174fa5435087f2b018c7480a46d9590e5df"} Jul 10 22:09:37.099696 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:37.099648 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65f48c7c55-nvttr" podStartSLOduration=3.0521473 podStartE2EDuration="9.099629888s" totalImagesPullingTime="6.047482588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:09:37.098538648 +0000 UTC m=+106.012475900" watchObservedRunningTime="2026-07-10 22:09:37.099629888 +0000 UTC m=+106.013567139" Jul 10 22:09:37.116288 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:37.116248 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hc8sp" podStartSLOduration=33.544926572 podStartE2EDuration="43.116236935s" totalImagesPullingTime="9.571310363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:08:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:09:37.115423657 +0000 UTC m=+106.029360908" watchObservedRunningTime="2026-07-10 22:09:37.116236935 +0000 UTC m=+106.030174184" Jul 10 22:09:38.090103 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.090067 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s4gtz" event={"ID":"c28a3232-980e-4224-9122-6d6d16856660","Type":"ContainerStarted","Data":"b74405f441f65503f164ec16eb564324d4a2732d2c2e7ef868328356ddd06752"} Jul 10 22:09:38.107680 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.107633 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-s4gtz" podStartSLOduration=66.283275734 podStartE2EDuration="1m11.107616563s" totalImagesPullingTime="4.824340829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:08:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:09:38.106925733 +0000 UTC m=+107.020862992" watchObservedRunningTime="2026-07-10 22:09:38.107616563 +0000 UTC m=+107.021553812" Jul 10 22:09:38.550939 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.550912 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v4x5f"] Jul 10 22:09:38.553823 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.553797 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:38.556138 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.556100 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 10 22:09:38.556279 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.556224 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 10 22:09:38.556279 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.556234 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bllsp\"" Jul 10 22:09:38.556279 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.556232 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 10 22:09:38.556568 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.556548 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 10 22:09:38.556568 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.556559 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 10 22:09:38.556947 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.556931 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 10 22:09:38.701963 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.701928 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrzlj\" (UniqueName: \"kubernetes.io/projected/5159ee18-5f72-4a36-b728-517cb5c7a1f8-kube-api-access-mrzlj\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:38.702182 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.701969 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5159ee18-5f72-4a36-b728-517cb5c7a1f8-metrics-client-ca\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:38.702182 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.702035 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5159ee18-5f72-4a36-b728-517cb5c7a1f8-node-exporter-tls\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:38.702182 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.702056 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5159ee18-5f72-4a36-b728-517cb5c7a1f8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:38.702182 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.702149 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5159ee18-5f72-4a36-b728-517cb5c7a1f8-sys\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:38.702389 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.702191 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5159ee18-5f72-4a36-b728-517cb5c7a1f8-root\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:38.702389 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.702227 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5159ee18-5f72-4a36-b728-517cb5c7a1f8-node-exporter-textfile\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:38.702389 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.702265 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5159ee18-5f72-4a36-b728-517cb5c7a1f8-node-exporter-accelerators-collector-config\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:38.702389 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.702293 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5159ee18-5f72-4a36-b728-517cb5c7a1f8-node-exporter-wtmp\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:38.803586 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.803489 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5159ee18-5f72-4a36-b728-517cb5c7a1f8-node-exporter-tls\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:38.803586 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.803538 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5159ee18-5f72-4a36-b728-517cb5c7a1f8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:38.803586 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.803571 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5159ee18-5f72-4a36-b728-517cb5c7a1f8-sys\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:38.803868 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.803601 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5159ee18-5f72-4a36-b728-517cb5c7a1f8-root\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:38.803868 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.803632 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5159ee18-5f72-4a36-b728-517cb5c7a1f8-node-exporter-textfile\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:38.803868 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:09:38.803657 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 10 22:09:38.803868 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.803699 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5159ee18-5f72-4a36-b728-517cb5c7a1f8-sys\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:38.803868 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:09:38.803731 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5159ee18-5f72-4a36-b728-517cb5c7a1f8-node-exporter-tls podName:5159ee18-5f72-4a36-b728-517cb5c7a1f8 nodeName:}" failed. No retries permitted until 2026-07-10 22:09:39.303708148 +0000 UTC m=+108.217645392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5159ee18-5f72-4a36-b728-517cb5c7a1f8-node-exporter-tls") pod "node-exporter-v4x5f" (UID: "5159ee18-5f72-4a36-b728-517cb5c7a1f8") : secret "node-exporter-tls" not found Jul 10 22:09:38.803868 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.803665 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5159ee18-5f72-4a36-b728-517cb5c7a1f8-node-exporter-accelerators-collector-config\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:38.803868 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.803769 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5159ee18-5f72-4a36-b728-517cb5c7a1f8-node-exporter-wtmp\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:38.803868 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.803701 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5159ee18-5f72-4a36-b728-517cb5c7a1f8-root\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:38.804280 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.803869 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrzlj\" (UniqueName: \"kubernetes.io/projected/5159ee18-5f72-4a36-b728-517cb5c7a1f8-kube-api-access-mrzlj\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:38.804280 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.803901 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5159ee18-5f72-4a36-b728-517cb5c7a1f8-metrics-client-ca\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:38.804280 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.803907 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5159ee18-5f72-4a36-b728-517cb5c7a1f8-node-exporter-wtmp\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:38.804449 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.804318 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5159ee18-5f72-4a36-b728-517cb5c7a1f8-node-exporter-textfile\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:38.810430 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.804527 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5159ee18-5f72-4a36-b728-517cb5c7a1f8-metrics-client-ca\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:38.810430 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.804875 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5159ee18-5f72-4a36-b728-517cb5c7a1f8-node-exporter-accelerators-collector-config\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:38.811035 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.810799 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5159ee18-5f72-4a36-b728-517cb5c7a1f8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:38.812972 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:38.812952 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrzlj\" (UniqueName: \"kubernetes.io/projected/5159ee18-5f72-4a36-b728-517cb5c7a1f8-kube-api-access-mrzlj\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:39.093212 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:39.093120 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s4gtz" Jul 10 22:09:39.308340 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:39.308299 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5159ee18-5f72-4a36-b728-517cb5c7a1f8-node-exporter-tls\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:39.310609 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:39.310574 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5159ee18-5f72-4a36-b728-517cb5c7a1f8-node-exporter-tls\") pod \"node-exporter-v4x5f\" (UID: \"5159ee18-5f72-4a36-b728-517cb5c7a1f8\") " pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:39.464285 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:39.464257 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v4x5f" Jul 10 22:09:39.473534 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:09:39.473510 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5159ee18_5f72_4a36_b728_517cb5c7a1f8.slice/crio-777fe407b89f54c473a4b5dc3af96a6a6991dc7522eba526710b7f5d4970f3b3 WatchSource:0}: Error finding container 777fe407b89f54c473a4b5dc3af96a6a6991dc7522eba526710b7f5d4970f3b3: Status 404 returned error can't find the container with id 777fe407b89f54c473a4b5dc3af96a6a6991dc7522eba526710b7f5d4970f3b3 Jul 10 22:09:40.097941 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:40.097901 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v4x5f" event={"ID":"5159ee18-5f72-4a36-b728-517cb5c7a1f8","Type":"ContainerStarted","Data":"777fe407b89f54c473a4b5dc3af96a6a6991dc7522eba526710b7f5d4970f3b3"} Jul 10 22:09:41.103352 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:41.103320 2578 generic.go:356] "Generic (PLEG): container finished" podID="5159ee18-5f72-4a36-b728-517cb5c7a1f8" containerID="778b789738e25f5e7a5fc01330ef9a347894f33b59a9de86962c0b52ddb944ea" exitCode=0 Jul 10 22:09:41.103735 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:41.103378 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v4x5f" event={"ID":"5159ee18-5f72-4a36-b728-517cb5c7a1f8","Type":"ContainerDied","Data":"778b789738e25f5e7a5fc01330ef9a347894f33b59a9de86962c0b52ddb944ea"} Jul 10 22:09:42.108800 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:42.108769 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v4x5f" event={"ID":"5159ee18-5f72-4a36-b728-517cb5c7a1f8","Type":"ContainerStarted","Data":"e283c858f472d1877ab860dc3ab9c158bc95b20be7ef9f8950543ed9c9daaf76"} Jul 10 22:09:42.109203 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:42.108817 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v4x5f" event={"ID":"5159ee18-5f72-4a36-b728-517cb5c7a1f8","Type":"ContainerStarted","Data":"a70c43b80d9a12c70c5b0404cc5e04245fbfa6f71c5f8aac92dc08c0755573e5"} Jul 10 22:09:42.127469 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:42.127418 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v4x5f" podStartSLOduration=3.215738836 podStartE2EDuration="4.127402086s" totalImagesPullingTime="849.066605ms" totalInitContainerRuntime="62.596645ms" isStatefulPod=true podCreationTimestamp="2026-07-10 22:09:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:09:42.126399901 +0000 UTC m=+111.040337153" watchObservedRunningTime="2026-07-10 22:09:42.127402086 +0000 UTC m=+111.041339335" Jul 10 22:09:43.391437 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.391398 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66d6f6b998-njtxv"] Jul 10 22:09:43.393658 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.393634 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:43.396554 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.396534 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8rjs5\"" Jul 10 22:09:43.397542 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.397487 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 10 22:09:43.397542 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.397524 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 10 22:09:43.397542 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.397537 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 10 22:09:43.397748 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.397558 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 10 22:09:43.397748 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.397568 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 10 22:09:43.397748 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.397558 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 10 22:09:43.397748 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.397641 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 10 22:09:43.403815 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.403793 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 10 22:09:43.404767 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.404747 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66d6f6b998-njtxv"] Jul 10 22:09:43.543265 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.543203 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d67a8ffc-0414-4927-8ef8-223618dbfe27-console-serving-cert\") pod \"console-66d6f6b998-njtxv\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:43.543265 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.543274 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d67a8ffc-0414-4927-8ef8-223618dbfe27-console-oauth-config\") pod \"console-66d6f6b998-njtxv\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:43.543481 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.543394 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d67a8ffc-0414-4927-8ef8-223618dbfe27-console-config\") pod \"console-66d6f6b998-njtxv\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:43.543481 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.543440 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl494\" (UniqueName: \"kubernetes.io/projected/d67a8ffc-0414-4927-8ef8-223618dbfe27-kube-api-access-zl494\") pod \"console-66d6f6b998-njtxv\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:43.543481 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.543464 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d67a8ffc-0414-4927-8ef8-223618dbfe27-service-ca\") pod \"console-66d6f6b998-njtxv\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:43.543581 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.543483 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d67a8ffc-0414-4927-8ef8-223618dbfe27-trusted-ca-bundle\") pod \"console-66d6f6b998-njtxv\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:43.543581 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.543518 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d67a8ffc-0414-4927-8ef8-223618dbfe27-oauth-serving-cert\") pod \"console-66d6f6b998-njtxv\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:43.644568 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.644494 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d67a8ffc-0414-4927-8ef8-223618dbfe27-console-config\") pod \"console-66d6f6b998-njtxv\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:43.644568 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.644536 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl494\" (UniqueName: \"kubernetes.io/projected/d67a8ffc-0414-4927-8ef8-223618dbfe27-kube-api-access-zl494\") pod \"console-66d6f6b998-njtxv\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:43.644568 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.644563 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d67a8ffc-0414-4927-8ef8-223618dbfe27-service-ca\") pod \"console-66d6f6b998-njtxv\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:43.644788 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.644682 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d67a8ffc-0414-4927-8ef8-223618dbfe27-trusted-ca-bundle\") pod \"console-66d6f6b998-njtxv\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:43.644788 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.644716 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d67a8ffc-0414-4927-8ef8-223618dbfe27-oauth-serving-cert\") pod \"console-66d6f6b998-njtxv\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:43.644788 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.644748 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d67a8ffc-0414-4927-8ef8-223618dbfe27-console-serving-cert\") pod \"console-66d6f6b998-njtxv\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:43.644788 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.644773 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d67a8ffc-0414-4927-8ef8-223618dbfe27-console-oauth-config\") pod \"console-66d6f6b998-njtxv\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:43.645339 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.645310 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d67a8ffc-0414-4927-8ef8-223618dbfe27-service-ca\") pod \"console-66d6f6b998-njtxv\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:43.645452 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.645310 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d67a8ffc-0414-4927-8ef8-223618dbfe27-console-config\") pod \"console-66d6f6b998-njtxv\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:43.645452 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.645371 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d67a8ffc-0414-4927-8ef8-223618dbfe27-oauth-serving-cert\") pod \"console-66d6f6b998-njtxv\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:43.645621 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.645602 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d67a8ffc-0414-4927-8ef8-223618dbfe27-trusted-ca-bundle\") pod \"console-66d6f6b998-njtxv\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:43.647720 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.647695 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d67a8ffc-0414-4927-8ef8-223618dbfe27-console-serving-cert\") pod \"console-66d6f6b998-njtxv\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:43.647807 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.647734 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d67a8ffc-0414-4927-8ef8-223618dbfe27-console-oauth-config\") pod \"console-66d6f6b998-njtxv\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:43.652274 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.652251 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl494\" (UniqueName: \"kubernetes.io/projected/d67a8ffc-0414-4927-8ef8-223618dbfe27-kube-api-access-zl494\") pod \"console-66d6f6b998-njtxv\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:43.703017 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.702981 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:43.827745 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:43.827707 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66d6f6b998-njtxv"] Jul 10 22:09:43.830618 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:09:43.830588 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd67a8ffc_0414_4927_8ef8_223618dbfe27.slice/crio-8c3e5c2263fb46a922998448745b2891e477b3f5dcf368c8e2a455b0caa7b75a WatchSource:0}: Error finding container 8c3e5c2263fb46a922998448745b2891e477b3f5dcf368c8e2a455b0caa7b75a: Status 404 returned error can't find the container with id 8c3e5c2263fb46a922998448745b2891e477b3f5dcf368c8e2a455b0caa7b75a Jul 10 22:09:44.120916 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:44.120881 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66d6f6b998-njtxv" event={"ID":"d67a8ffc-0414-4927-8ef8-223618dbfe27","Type":"ContainerStarted","Data":"8c3e5c2263fb46a922998448745b2891e477b3f5dcf368c8e2a455b0caa7b75a"} Jul 10 22:09:47.138830 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:47.138792 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66d6f6b998-njtxv" event={"ID":"d67a8ffc-0414-4927-8ef8-223618dbfe27","Type":"ContainerStarted","Data":"7e3352b85f6b937a43442a2ea7529f4811a2d57b48145aee9f0ca994c12fbfc5"} Jul 10 22:09:47.158195 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:47.158154 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66d6f6b998-njtxv" podStartSLOduration=1.739636823 podStartE2EDuration="4.15814038s" totalImagesPullingTime="2.418503557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:09:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:09:47.157242831 +0000 UTC m=+116.071180080" watchObservedRunningTime="2026-07-10 22:09:47.15814038 +0000 UTC m=+116.072077619" Jul 10 22:09:49.100658 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:49.100626 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s4gtz" Jul 10 22:09:51.866716 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:51.866675 2578 patch_prober.go:28] interesting pod/image-registry-7d9f6cd95d-xrbwq container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 10 22:09:51.867084 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:51.866730 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" podUID="819f5f1d-e5d6-4086-8859-adb446fc911b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 22:09:52.624895 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:52.624859 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d9f6cd95d-xrbwq"] Jul 10 22:09:52.629081 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:52.629056 2578 patch_prober.go:28] interesting pod/image-registry-7d9f6cd95d-xrbwq container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 10 22:09:52.629219 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:52.629141 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" podUID="819f5f1d-e5d6-4086-8859-adb446fc911b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 22:09:53.703803 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:53.703776 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:53.704174 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:53.703829 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:53.708496 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:53.708475 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:54.165878 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:54.165802 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:09:55.158890 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:55.158857 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-689f54656b-t4wdc"] Jul 10 22:09:55.161311 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:55.161296 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:09:55.172582 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:55.172559 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-689f54656b-t4wdc"] Jul 10 22:09:55.241380 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:55.241350 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-console-serving-cert\") pod \"console-689f54656b-t4wdc\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:09:55.241380 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:55.241380 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-console-oauth-config\") pod \"console-689f54656b-t4wdc\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:09:55.241610 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:55.241521 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-console-config\") pod \"console-689f54656b-t4wdc\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:09:55.241610 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:55.241561 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-service-ca\") pod \"console-689f54656b-t4wdc\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:09:55.241700 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:55.241611 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-oauth-serving-cert\") pod \"console-689f54656b-t4wdc\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:09:55.241734 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:55.241693 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-trusted-ca-bundle\") pod \"console-689f54656b-t4wdc\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:09:55.241818 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:55.241777 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkdmz\" (UniqueName: \"kubernetes.io/projected/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-kube-api-access-tkdmz\") pod \"console-689f54656b-t4wdc\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:09:55.342740 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:55.342697 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkdmz\" (UniqueName: \"kubernetes.io/projected/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-kube-api-access-tkdmz\") pod \"console-689f54656b-t4wdc\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:09:55.342862 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:55.342756 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-console-serving-cert\") pod \"console-689f54656b-t4wdc\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:09:55.342862 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:55.342780 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-console-oauth-config\") pod \"console-689f54656b-t4wdc\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:09:55.342862 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:55.342830 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-console-config\") pod \"console-689f54656b-t4wdc\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:09:55.342862 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:55.342853 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-service-ca\") pod \"console-689f54656b-t4wdc\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:09:55.342993 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:55.342962 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-oauth-serving-cert\") pod \"console-689f54656b-t4wdc\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:09:55.343033 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:55.342993 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-trusted-ca-bundle\") pod \"console-689f54656b-t4wdc\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:09:55.343721 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:55.343695 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-console-config\") pod \"console-689f54656b-t4wdc\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:09:55.343835 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:55.343695 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-service-ca\") pod \"console-689f54656b-t4wdc\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:09:55.343907 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:55.343883 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-oauth-serving-cert\") pod \"console-689f54656b-t4wdc\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:09:55.344023 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:55.344009 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-trusted-ca-bundle\") pod \"console-689f54656b-t4wdc\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:09:55.345239 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:55.345221 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-console-oauth-config\") pod \"console-689f54656b-t4wdc\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:09:55.345333 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:55.345316 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-console-serving-cert\") pod \"console-689f54656b-t4wdc\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:09:55.351042 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:55.351002 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkdmz\" (UniqueName: \"kubernetes.io/projected/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-kube-api-access-tkdmz\") pod \"console-689f54656b-t4wdc\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:09:55.472702 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:55.472659 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:09:55.597230 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:55.597200 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-689f54656b-t4wdc"] Jul 10 22:09:55.600031 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:09:55.600007 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8bfeb6b_e066_41d6_b4cb_2133f0baf3c7.slice/crio-953f1255e2350cf9264c14920a93e67e6a4b25c2d36cdc23d23f003d7d858a63 WatchSource:0}: Error finding container 953f1255e2350cf9264c14920a93e67e6a4b25c2d36cdc23d23f003d7d858a63: Status 404 returned error can't find the container with id 953f1255e2350cf9264c14920a93e67e6a4b25c2d36cdc23d23f003d7d858a63 Jul 10 22:09:56.173347 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:56.173305 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689f54656b-t4wdc" event={"ID":"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7","Type":"ContainerStarted","Data":"d2b096dec1e1f0b9c9e5ab9b7ad3446c48f3ac29f95dd5b445589dc94bead82a"} Jul 10 22:09:56.173685 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:56.173363 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689f54656b-t4wdc" event={"ID":"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7","Type":"ContainerStarted","Data":"953f1255e2350cf9264c14920a93e67e6a4b25c2d36cdc23d23f003d7d858a63"} Jul 10 22:09:56.192608 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:09:56.192564 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-689f54656b-t4wdc" podStartSLOduration=1.1925487590000001 podStartE2EDuration="1.192548759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:09:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:09:56.191610212 +0000 UTC m=+125.105547462" watchObservedRunningTime="2026-07-10 22:09:56.192548759 +0000 UTC m=+125.106486008" Jul 10 22:10:01.288982 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:01.288936 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs\") pod \"network-metrics-daemon-rbtmx\" (UID: \"31e9f715-aeb8-4938-bc61-4bc61dd8c82a\") " pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:10:01.291171 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:01.291148 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31e9f715-aeb8-4938-bc61-4bc61dd8c82a-metrics-certs\") pod \"network-metrics-daemon-rbtmx\" (UID: \"31e9f715-aeb8-4938-bc61-4bc61dd8c82a\") " pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:10:01.453483 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:01.453449 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gq72h\"" Jul 10 22:10:01.461318 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:01.461295 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbtmx" Jul 10 22:10:01.594119 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:01.594089 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rbtmx"] Jul 10 22:10:01.596991 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:10:01.596971 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31e9f715_aeb8_4938_bc61_4bc61dd8c82a.slice/crio-3e4c75f2d49e3ea7dc47ab803dedd44871cbfc5aed5eb1badfc4304d36d6d328 WatchSource:0}: Error finding container 3e4c75f2d49e3ea7dc47ab803dedd44871cbfc5aed5eb1badfc4304d36d6d328: Status 404 returned error can't find the container with id 3e4c75f2d49e3ea7dc47ab803dedd44871cbfc5aed5eb1badfc4304d36d6d328 Jul 10 22:10:02.194855 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:02.194821 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rbtmx" event={"ID":"31e9f715-aeb8-4938-bc61-4bc61dd8c82a","Type":"ContainerStarted","Data":"3e4c75f2d49e3ea7dc47ab803dedd44871cbfc5aed5eb1badfc4304d36d6d328"} Jul 10 22:10:02.629982 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:02.629909 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:10:03.200374 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:03.200286 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rbtmx" event={"ID":"31e9f715-aeb8-4938-bc61-4bc61dd8c82a","Type":"ContainerStarted","Data":"ab4272932ca6786481dab626cb948025fcae76500fc9da3dc7ca5e133fbfdc46"} Jul 10 22:10:03.200374 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:03.200341 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rbtmx" event={"ID":"31e9f715-aeb8-4938-bc61-4bc61dd8c82a","Type":"ContainerStarted","Data":"7e5501eaa195ce3f4161574452cdc9d6ec9692a1f93a0fa37c55addc9374af97"} Jul 10 22:10:03.219471 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:03.219418 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rbtmx" podStartSLOduration=129.882180734 podStartE2EDuration="2m11.219401595s" totalImagesPullingTime="1.337220861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:07:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:10:03.218095292 +0000 UTC m=+132.132032551" watchObservedRunningTime="2026-07-10 22:10:03.219401595 +0000 UTC m=+132.133338845" Jul 10 22:10:05.473511 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:05.473469 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:10:05.473962 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:05.473579 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:10:05.477974 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:05.477949 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:10:06.213786 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:06.213754 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:10:06.266329 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:06.266298 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66d6f6b998-njtxv"] Jul 10 22:10:11.228855 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:11.228821 2578 generic.go:356] "Generic (PLEG): container finished" podID="858f95a5-4497-4267-9aec-d745abb6e57e" containerID="3234b850a3f4abaac0549ec71bf01acc79a97de6073291e851b4b6bc40cb50f8" exitCode=0 Jul 10 22:10:11.229244 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:11.228892 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8bvnm" event={"ID":"858f95a5-4497-4267-9aec-d745abb6e57e","Type":"ContainerDied","Data":"3234b850a3f4abaac0549ec71bf01acc79a97de6073291e851b4b6bc40cb50f8"} Jul 10 22:10:11.229244 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:11.229221 2578 scope.go:117] "RemoveContainer" containerID="3234b850a3f4abaac0549ec71bf01acc79a97de6073291e851b4b6bc40cb50f8" Jul 10 22:10:12.233958 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:12.233922 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-8bvnm" event={"ID":"858f95a5-4497-4267-9aec-d745abb6e57e","Type":"ContainerStarted","Data":"55d725b9e7ba0a80247af13c7186f5147bf4962f376a9749615fc4b42dcd3672"} Jul 10 22:10:17.644530 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:17.644494 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" podUID="819f5f1d-e5d6-4086-8859-adb446fc911b" containerName="registry" containerID="cri-o://eab776d0c5a37cfcd9890f31d1e1600ddcdab124a581851e93d85349c0ff5da1" gracePeriod=30 Jul 10 22:10:17.882926 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:17.882903 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:10:18.020254 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.020223 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfzqh\" (UniqueName: \"kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-kube-api-access-tfzqh\") pod \"819f5f1d-e5d6-4086-8859-adb446fc911b\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " Jul 10 22:10:18.020254 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.020259 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls\") pod \"819f5f1d-e5d6-4086-8859-adb446fc911b\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " Jul 10 22:10:18.020500 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.020284 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-certificates\") pod \"819f5f1d-e5d6-4086-8859-adb446fc911b\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " Jul 10 22:10:18.020500 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.020309 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-bound-sa-token\") pod \"819f5f1d-e5d6-4086-8859-adb446fc911b\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " Jul 10 22:10:18.020500 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.020358 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/819f5f1d-e5d6-4086-8859-adb446fc911b-ca-trust-extracted\") pod \"819f5f1d-e5d6-4086-8859-adb446fc911b\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " Jul 10 22:10:18.020500 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.020391 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/819f5f1d-e5d6-4086-8859-adb446fc911b-trusted-ca\") pod \"819f5f1d-e5d6-4086-8859-adb446fc911b\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " Jul 10 22:10:18.020500 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.020437 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/819f5f1d-e5d6-4086-8859-adb446fc911b-installation-pull-secrets\") pod \"819f5f1d-e5d6-4086-8859-adb446fc911b\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " Jul 10 22:10:18.020500 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.020456 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/819f5f1d-e5d6-4086-8859-adb446fc911b-image-registry-private-configuration\") pod \"819f5f1d-e5d6-4086-8859-adb446fc911b\" (UID: \"819f5f1d-e5d6-4086-8859-adb446fc911b\") " Jul 10 22:10:18.020792 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.020726 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "819f5f1d-e5d6-4086-8859-adb446fc911b" (UID: "819f5f1d-e5d6-4086-8859-adb446fc911b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 22:10:18.020926 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.020897 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/819f5f1d-e5d6-4086-8859-adb446fc911b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "819f5f1d-e5d6-4086-8859-adb446fc911b" (UID: "819f5f1d-e5d6-4086-8859-adb446fc911b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 22:10:18.022880 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.022831 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "819f5f1d-e5d6-4086-8859-adb446fc911b" (UID: "819f5f1d-e5d6-4086-8859-adb446fc911b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 22:10:18.022989 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.022891 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "819f5f1d-e5d6-4086-8859-adb446fc911b" (UID: "819f5f1d-e5d6-4086-8859-adb446fc911b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 22:10:18.022989 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.022938 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/819f5f1d-e5d6-4086-8859-adb446fc911b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "819f5f1d-e5d6-4086-8859-adb446fc911b" (UID: "819f5f1d-e5d6-4086-8859-adb446fc911b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 22:10:18.023156 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.023086 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/819f5f1d-e5d6-4086-8859-adb446fc911b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "819f5f1d-e5d6-4086-8859-adb446fc911b" (UID: "819f5f1d-e5d6-4086-8859-adb446fc911b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 22:10:18.023224 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.023198 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-kube-api-access-tfzqh" (OuterVolumeSpecName: "kube-api-access-tfzqh") pod "819f5f1d-e5d6-4086-8859-adb446fc911b" (UID: "819f5f1d-e5d6-4086-8859-adb446fc911b"). InnerVolumeSpecName "kube-api-access-tfzqh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 22:10:18.028405 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.028382 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/819f5f1d-e5d6-4086-8859-adb446fc911b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "819f5f1d-e5d6-4086-8859-adb446fc911b" (UID: "819f5f1d-e5d6-4086-8859-adb446fc911b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 22:10:18.121605 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.121560 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/819f5f1d-e5d6-4086-8859-adb446fc911b-image-registry-private-configuration\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:10:18.121605 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.121598 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfzqh\" (UniqueName: \"kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-kube-api-access-tfzqh\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:10:18.121605 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.121610 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-tls\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:10:18.121605 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.121623 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/819f5f1d-e5d6-4086-8859-adb446fc911b-registry-certificates\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:10:18.121864 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.121632 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/819f5f1d-e5d6-4086-8859-adb446fc911b-bound-sa-token\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:10:18.121864 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.121640 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/819f5f1d-e5d6-4086-8859-adb446fc911b-ca-trust-extracted\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:10:18.121864 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.121650 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/819f5f1d-e5d6-4086-8859-adb446fc911b-trusted-ca\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:10:18.121864 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.121659 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/819f5f1d-e5d6-4086-8859-adb446fc911b-installation-pull-secrets\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:10:18.255670 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.255635 2578 generic.go:356] "Generic (PLEG): container finished" podID="819f5f1d-e5d6-4086-8859-adb446fc911b" containerID="eab776d0c5a37cfcd9890f31d1e1600ddcdab124a581851e93d85349c0ff5da1" exitCode=0 Jul 10 22:10:18.255813 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.255683 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" Jul 10 22:10:18.255813 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.255715 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" event={"ID":"819f5f1d-e5d6-4086-8859-adb446fc911b","Type":"ContainerDied","Data":"eab776d0c5a37cfcd9890f31d1e1600ddcdab124a581851e93d85349c0ff5da1"} Jul 10 22:10:18.255813 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.255759 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d9f6cd95d-xrbwq" event={"ID":"819f5f1d-e5d6-4086-8859-adb446fc911b","Type":"ContainerDied","Data":"24cae056db7f9d2a884e6325756b24427c44b35ddbde9d9ef6c0319f67c62d1a"} Jul 10 22:10:18.255813 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.255792 2578 scope.go:117] "RemoveContainer" containerID="eab776d0c5a37cfcd9890f31d1e1600ddcdab124a581851e93d85349c0ff5da1" Jul 10 22:10:18.263915 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.263897 2578 scope.go:117] "RemoveContainer" containerID="eab776d0c5a37cfcd9890f31d1e1600ddcdab124a581851e93d85349c0ff5da1" Jul 10 22:10:18.264189 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:10:18.264167 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eab776d0c5a37cfcd9890f31d1e1600ddcdab124a581851e93d85349c0ff5da1\": container with ID starting with eab776d0c5a37cfcd9890f31d1e1600ddcdab124a581851e93d85349c0ff5da1 not found: ID does not exist" containerID="eab776d0c5a37cfcd9890f31d1e1600ddcdab124a581851e93d85349c0ff5da1" Jul 10 22:10:18.264310 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.264195 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eab776d0c5a37cfcd9890f31d1e1600ddcdab124a581851e93d85349c0ff5da1"} err="failed to get container status \"eab776d0c5a37cfcd9890f31d1e1600ddcdab124a581851e93d85349c0ff5da1\": rpc error: code = NotFound desc = could not find container \"eab776d0c5a37cfcd9890f31d1e1600ddcdab124a581851e93d85349c0ff5da1\": container with ID starting with eab776d0c5a37cfcd9890f31d1e1600ddcdab124a581851e93d85349c0ff5da1 not found: ID does not exist" Jul 10 22:10:18.275565 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.275518 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d9f6cd95d-xrbwq"] Jul 10 22:10:18.278855 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:18.278838 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7d9f6cd95d-xrbwq"] Jul 10 22:10:19.630000 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:19.629955 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="819f5f1d-e5d6-4086-8859-adb446fc911b" path="/var/lib/kubelet/pods/819f5f1d-e5d6-4086-8859-adb446fc911b/volumes" Jul 10 22:10:31.291107 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:31.291049 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66d6f6b998-njtxv" podUID="d67a8ffc-0414-4927-8ef8-223618dbfe27" containerName="console" containerID="cri-o://7e3352b85f6b937a43442a2ea7529f4811a2d57b48145aee9f0ca994c12fbfc5" gracePeriod=15 Jul 10 22:10:31.523516 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:31.523491 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:10:31.621527 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:31.621488 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d67a8ffc-0414-4927-8ef8-223618dbfe27-console-serving-cert\") pod \"d67a8ffc-0414-4927-8ef8-223618dbfe27\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " Jul 10 22:10:31.621527 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:31.621532 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d67a8ffc-0414-4927-8ef8-223618dbfe27-console-config\") pod \"d67a8ffc-0414-4927-8ef8-223618dbfe27\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " Jul 10 22:10:31.621781 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:31.621552 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d67a8ffc-0414-4927-8ef8-223618dbfe27-trusted-ca-bundle\") pod \"d67a8ffc-0414-4927-8ef8-223618dbfe27\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " Jul 10 22:10:31.621781 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:31.621582 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zl494\" (UniqueName: \"kubernetes.io/projected/d67a8ffc-0414-4927-8ef8-223618dbfe27-kube-api-access-zl494\") pod \"d67a8ffc-0414-4927-8ef8-223618dbfe27\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " Jul 10 22:10:31.621781 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:31.621653 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d67a8ffc-0414-4927-8ef8-223618dbfe27-oauth-serving-cert\") pod \"d67a8ffc-0414-4927-8ef8-223618dbfe27\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " Jul 10 22:10:31.621781 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:31.621705 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d67a8ffc-0414-4927-8ef8-223618dbfe27-console-oauth-config\") pod \"d67a8ffc-0414-4927-8ef8-223618dbfe27\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " Jul 10 22:10:31.621781 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:31.621730 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d67a8ffc-0414-4927-8ef8-223618dbfe27-service-ca\") pod \"d67a8ffc-0414-4927-8ef8-223618dbfe27\" (UID: \"d67a8ffc-0414-4927-8ef8-223618dbfe27\") " Jul 10 22:10:31.622017 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:31.621994 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d67a8ffc-0414-4927-8ef8-223618dbfe27-console-config" (OuterVolumeSpecName: "console-config") pod "d67a8ffc-0414-4927-8ef8-223618dbfe27" (UID: "d67a8ffc-0414-4927-8ef8-223618dbfe27"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 22:10:31.622109 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:31.622010 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d67a8ffc-0414-4927-8ef8-223618dbfe27-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d67a8ffc-0414-4927-8ef8-223618dbfe27" (UID: "d67a8ffc-0414-4927-8ef8-223618dbfe27"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 22:10:31.622183 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:31.622078 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d67a8ffc-0414-4927-8ef8-223618dbfe27-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d67a8ffc-0414-4927-8ef8-223618dbfe27" (UID: "d67a8ffc-0414-4927-8ef8-223618dbfe27"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 22:10:31.622226 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:31.622199 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d67a8ffc-0414-4927-8ef8-223618dbfe27-service-ca" (OuterVolumeSpecName: "service-ca") pod "d67a8ffc-0414-4927-8ef8-223618dbfe27" (UID: "d67a8ffc-0414-4927-8ef8-223618dbfe27"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 22:10:31.623881 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:31.623858 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d67a8ffc-0414-4927-8ef8-223618dbfe27-kube-api-access-zl494" (OuterVolumeSpecName: "kube-api-access-zl494") pod "d67a8ffc-0414-4927-8ef8-223618dbfe27" (UID: "d67a8ffc-0414-4927-8ef8-223618dbfe27"). InnerVolumeSpecName "kube-api-access-zl494". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 22:10:31.624079 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:31.624059 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d67a8ffc-0414-4927-8ef8-223618dbfe27-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d67a8ffc-0414-4927-8ef8-223618dbfe27" (UID: "d67a8ffc-0414-4927-8ef8-223618dbfe27"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 22:10:31.624151 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:31.624076 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d67a8ffc-0414-4927-8ef8-223618dbfe27-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d67a8ffc-0414-4927-8ef8-223618dbfe27" (UID: "d67a8ffc-0414-4927-8ef8-223618dbfe27"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 22:10:31.722816 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:31.722721 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d67a8ffc-0414-4927-8ef8-223618dbfe27-oauth-serving-cert\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:10:31.722816 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:31.722756 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d67a8ffc-0414-4927-8ef8-223618dbfe27-console-oauth-config\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:10:31.722816 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:31.722769 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d67a8ffc-0414-4927-8ef8-223618dbfe27-service-ca\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:10:31.722816 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:31.722780 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d67a8ffc-0414-4927-8ef8-223618dbfe27-console-serving-cert\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:10:31.722816 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:31.722790 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d67a8ffc-0414-4927-8ef8-223618dbfe27-console-config\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:10:31.722816 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:31.722802 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d67a8ffc-0414-4927-8ef8-223618dbfe27-trusted-ca-bundle\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:10:31.722816 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:31.722813 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zl494\" (UniqueName: \"kubernetes.io/projected/d67a8ffc-0414-4927-8ef8-223618dbfe27-kube-api-access-zl494\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:10:32.303371 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:32.303325 2578 generic.go:356] "Generic (PLEG): container finished" podID="d67a8ffc-0414-4927-8ef8-223618dbfe27" containerID="7e3352b85f6b937a43442a2ea7529f4811a2d57b48145aee9f0ca994c12fbfc5" exitCode=0 Jul 10 22:10:32.303756 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:32.303388 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66d6f6b998-njtxv" Jul 10 22:10:32.303756 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:32.303412 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66d6f6b998-njtxv" event={"ID":"d67a8ffc-0414-4927-8ef8-223618dbfe27","Type":"ContainerDied","Data":"7e3352b85f6b937a43442a2ea7529f4811a2d57b48145aee9f0ca994c12fbfc5"} Jul 10 22:10:32.303756 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:32.303468 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66d6f6b998-njtxv" event={"ID":"d67a8ffc-0414-4927-8ef8-223618dbfe27","Type":"ContainerDied","Data":"8c3e5c2263fb46a922998448745b2891e477b3f5dcf368c8e2a455b0caa7b75a"} Jul 10 22:10:32.303756 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:32.303489 2578 scope.go:117] "RemoveContainer" containerID="7e3352b85f6b937a43442a2ea7529f4811a2d57b48145aee9f0ca994c12fbfc5" Jul 10 22:10:32.311742 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:32.311727 2578 scope.go:117] "RemoveContainer" containerID="7e3352b85f6b937a43442a2ea7529f4811a2d57b48145aee9f0ca994c12fbfc5" Jul 10 22:10:32.311979 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:10:32.311960 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e3352b85f6b937a43442a2ea7529f4811a2d57b48145aee9f0ca994c12fbfc5\": container with ID starting with 7e3352b85f6b937a43442a2ea7529f4811a2d57b48145aee9f0ca994c12fbfc5 not found: ID does not exist" containerID="7e3352b85f6b937a43442a2ea7529f4811a2d57b48145aee9f0ca994c12fbfc5" Jul 10 22:10:32.312029 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:32.311987 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e3352b85f6b937a43442a2ea7529f4811a2d57b48145aee9f0ca994c12fbfc5"} err="failed to get container status \"7e3352b85f6b937a43442a2ea7529f4811a2d57b48145aee9f0ca994c12fbfc5\": rpc error: code = NotFound desc = could not find container \"7e3352b85f6b937a43442a2ea7529f4811a2d57b48145aee9f0ca994c12fbfc5\": container with ID starting with 7e3352b85f6b937a43442a2ea7529f4811a2d57b48145aee9f0ca994c12fbfc5 not found: ID does not exist" Jul 10 22:10:32.320506 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:32.320486 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66d6f6b998-njtxv"] Jul 10 22:10:32.324442 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:32.324422 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66d6f6b998-njtxv"] Jul 10 22:10:33.629850 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:10:33.629817 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d67a8ffc-0414-4927-8ef8-223618dbfe27" path="/var/lib/kubelet/pods/d67a8ffc-0414-4927-8ef8-223618dbfe27/volumes" Jul 10 22:11:07.120606 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:07.120567 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-689f54656b-t4wdc"] Jul 10 22:11:32.140046 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.139989 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-689f54656b-t4wdc" podUID="f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7" containerName="console" containerID="cri-o://d2b096dec1e1f0b9c9e5ab9b7ad3446c48f3ac29f95dd5b445589dc94bead82a" gracePeriod=15 Jul 10 22:11:32.382721 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.382692 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:11:32.460367 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.460334 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-service-ca\") pod \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " Jul 10 22:11:32.460530 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.460373 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-console-config\") pod \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " Jul 10 22:11:32.460530 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.460400 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-console-oauth-config\") pod \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " Jul 10 22:11:32.460530 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.460434 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-oauth-serving-cert\") pod \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " Jul 10 22:11:32.460530 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.460472 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-console-serving-cert\") pod \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " Jul 10 22:11:32.460530 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.460507 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkdmz\" (UniqueName: \"kubernetes.io/projected/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-kube-api-access-tkdmz\") pod \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " Jul 10 22:11:32.460530 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.460529 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-trusted-ca-bundle\") pod \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\" (UID: \"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7\") " Jul 10 22:11:32.460795 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.460767 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-console-config" (OuterVolumeSpecName: "console-config") pod "f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7" (UID: "f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 22:11:32.460973 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.460830 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7" (UID: "f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 22:11:32.461098 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.461024 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7" (UID: "f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 22:11:32.461098 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.461077 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-service-ca" (OuterVolumeSpecName: "service-ca") pod "f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7" (UID: "f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 22:11:32.462558 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.462524 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7" (UID: "f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 22:11:32.462647 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.462570 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7" (UID: "f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 22:11:32.462647 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.462625 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-kube-api-access-tkdmz" (OuterVolumeSpecName: "kube-api-access-tkdmz") pod "f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7" (UID: "f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7"). InnerVolumeSpecName "kube-api-access-tkdmz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 22:11:32.509339 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.509310 2578 generic.go:356] "Generic (PLEG): container finished" podID="f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7" containerID="d2b096dec1e1f0b9c9e5ab9b7ad3446c48f3ac29f95dd5b445589dc94bead82a" exitCode=0 Jul 10 22:11:32.509434 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.509355 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689f54656b-t4wdc" Jul 10 22:11:32.509434 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.509375 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689f54656b-t4wdc" event={"ID":"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7","Type":"ContainerDied","Data":"d2b096dec1e1f0b9c9e5ab9b7ad3446c48f3ac29f95dd5b445589dc94bead82a"} Jul 10 22:11:32.509434 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.509415 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689f54656b-t4wdc" event={"ID":"f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7","Type":"ContainerDied","Data":"953f1255e2350cf9264c14920a93e67e6a4b25c2d36cdc23d23f003d7d858a63"} Jul 10 22:11:32.509434 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.509433 2578 scope.go:117] "RemoveContainer" containerID="d2b096dec1e1f0b9c9e5ab9b7ad3446c48f3ac29f95dd5b445589dc94bead82a" Jul 10 22:11:32.517052 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.517037 2578 scope.go:117] "RemoveContainer" containerID="d2b096dec1e1f0b9c9e5ab9b7ad3446c48f3ac29f95dd5b445589dc94bead82a" Jul 10 22:11:32.517326 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:11:32.517308 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2b096dec1e1f0b9c9e5ab9b7ad3446c48f3ac29f95dd5b445589dc94bead82a\": container with ID starting with d2b096dec1e1f0b9c9e5ab9b7ad3446c48f3ac29f95dd5b445589dc94bead82a not found: ID does not exist" containerID="d2b096dec1e1f0b9c9e5ab9b7ad3446c48f3ac29f95dd5b445589dc94bead82a" Jul 10 22:11:32.517375 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.517333 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2b096dec1e1f0b9c9e5ab9b7ad3446c48f3ac29f95dd5b445589dc94bead82a"} err="failed to get container status \"d2b096dec1e1f0b9c9e5ab9b7ad3446c48f3ac29f95dd5b445589dc94bead82a\": rpc error: code = NotFound desc = could not find container \"d2b096dec1e1f0b9c9e5ab9b7ad3446c48f3ac29f95dd5b445589dc94bead82a\": container with ID starting with d2b096dec1e1f0b9c9e5ab9b7ad3446c48f3ac29f95dd5b445589dc94bead82a not found: ID does not exist" Jul 10 22:11:32.529273 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.529254 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-689f54656b-t4wdc"] Jul 10 22:11:32.532969 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.532951 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-689f54656b-t4wdc"] Jul 10 22:11:32.561325 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.561310 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-service-ca\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:11:32.561407 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.561326 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-console-config\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:11:32.561407 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.561335 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-console-oauth-config\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:11:32.561407 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.561343 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-oauth-serving-cert\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:11:32.561407 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.561352 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-console-serving-cert\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:11:32.561407 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.561360 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkdmz\" (UniqueName: \"kubernetes.io/projected/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-kube-api-access-tkdmz\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:11:32.561407 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:32.561369 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7-trusted-ca-bundle\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:11:33.630045 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:11:33.630015 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7" path="/var/lib/kubelet/pods/f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7/volumes" Jul 10 22:12:14.605616 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:14.605530 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-flljm"] Jul 10 22:12:14.606175 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:14.605784 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d67a8ffc-0414-4927-8ef8-223618dbfe27" containerName="console" Jul 10 22:12:14.606175 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:14.605800 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d67a8ffc-0414-4927-8ef8-223618dbfe27" containerName="console" Jul 10 22:12:14.606175 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:14.605811 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7" containerName="console" Jul 10 22:12:14.606175 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:14.605819 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7" containerName="console" Jul 10 22:12:14.606175 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:14.605839 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="819f5f1d-e5d6-4086-8859-adb446fc911b" containerName="registry" Jul 10 22:12:14.606175 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:14.605848 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="819f5f1d-e5d6-4086-8859-adb446fc911b" containerName="registry" Jul 10 22:12:14.606175 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:14.605901 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d67a8ffc-0414-4927-8ef8-223618dbfe27" containerName="console" Jul 10 22:12:14.606175 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:14.605908 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8bfeb6b-e066-41d6-b4cb-2133f0baf3c7" containerName="console" Jul 10 22:12:14.606175 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:14.605916 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="819f5f1d-e5d6-4086-8859-adb446fc911b" containerName="registry" Jul 10 22:12:14.608530 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:14.608511 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-flljm" Jul 10 22:12:14.610710 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:14.610691 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 10 22:12:14.611638 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:14.611615 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-swnr2\"" Jul 10 22:12:14.611742 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:14.611634 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 10 22:12:14.619854 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:14.619830 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-flljm"] Jul 10 22:12:14.748258 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:14.748225 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e29d0b1c-7389-4467-a29d-72663ac5afb6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-flljm\" (UID: \"e29d0b1c-7389-4467-a29d-72663ac5afb6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-flljm" Jul 10 22:12:14.748443 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:14.748268 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss9q2\" (UniqueName: \"kubernetes.io/projected/e29d0b1c-7389-4467-a29d-72663ac5afb6-kube-api-access-ss9q2\") pod \"cert-manager-webhook-6486ffd997-flljm\" (UID: \"e29d0b1c-7389-4467-a29d-72663ac5afb6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-flljm" Jul 10 22:12:14.848932 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:14.848892 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss9q2\" (UniqueName: \"kubernetes.io/projected/e29d0b1c-7389-4467-a29d-72663ac5afb6-kube-api-access-ss9q2\") pod \"cert-manager-webhook-6486ffd997-flljm\" (UID: \"e29d0b1c-7389-4467-a29d-72663ac5afb6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-flljm" Jul 10 22:12:14.849120 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:14.848975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e29d0b1c-7389-4467-a29d-72663ac5afb6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-flljm\" (UID: \"e29d0b1c-7389-4467-a29d-72663ac5afb6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-flljm" Jul 10 22:12:14.866728 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:14.866665 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss9q2\" (UniqueName: \"kubernetes.io/projected/e29d0b1c-7389-4467-a29d-72663ac5afb6-kube-api-access-ss9q2\") pod \"cert-manager-webhook-6486ffd997-flljm\" (UID: \"e29d0b1c-7389-4467-a29d-72663ac5afb6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-flljm" Jul 10 22:12:14.874850 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:14.874824 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e29d0b1c-7389-4467-a29d-72663ac5afb6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-flljm\" (UID: \"e29d0b1c-7389-4467-a29d-72663ac5afb6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-flljm" Jul 10 22:12:14.917173 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:14.917116 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-flljm" Jul 10 22:12:14.990824 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:14.990793 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8fl4w"] Jul 10 22:12:14.993962 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:14.993941 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8fl4w" Jul 10 22:12:14.997683 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:14.997311 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-p766r\"" Jul 10 22:12:15.008684 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:15.008657 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8fl4w"] Jul 10 22:12:15.050634 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:15.050600 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95fd45c1-812a-4005-aa67-20d21badfa8b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8fl4w\" (UID: \"95fd45c1-812a-4005-aa67-20d21badfa8b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8fl4w" Jul 10 22:12:15.050796 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:15.050644 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjltg\" (UniqueName: \"kubernetes.io/projected/95fd45c1-812a-4005-aa67-20d21badfa8b-kube-api-access-hjltg\") pod \"cert-manager-cainjector-559cdd8c87-8fl4w\" (UID: \"95fd45c1-812a-4005-aa67-20d21badfa8b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8fl4w" Jul 10 22:12:15.065447 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:15.065416 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-flljm"] Jul 10 22:12:15.070644 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:12:15.070617 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode29d0b1c_7389_4467_a29d_72663ac5afb6.slice/crio-2cfaeba850e8942e7d86ec6ddf13937f04f99bb19c0f1ca2d65a2b83fd735984 WatchSource:0}: Error finding container 2cfaeba850e8942e7d86ec6ddf13937f04f99bb19c0f1ca2d65a2b83fd735984: Status 404 returned error can't find the container with id 2cfaeba850e8942e7d86ec6ddf13937f04f99bb19c0f1ca2d65a2b83fd735984 Jul 10 22:12:15.151821 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:15.151719 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95fd45c1-812a-4005-aa67-20d21badfa8b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8fl4w\" (UID: \"95fd45c1-812a-4005-aa67-20d21badfa8b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8fl4w" Jul 10 22:12:15.151821 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:15.151774 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjltg\" (UniqueName: \"kubernetes.io/projected/95fd45c1-812a-4005-aa67-20d21badfa8b-kube-api-access-hjltg\") pod \"cert-manager-cainjector-559cdd8c87-8fl4w\" (UID: \"95fd45c1-812a-4005-aa67-20d21badfa8b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8fl4w" Jul 10 22:12:15.163680 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:15.163651 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95fd45c1-812a-4005-aa67-20d21badfa8b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-8fl4w\" (UID: \"95fd45c1-812a-4005-aa67-20d21badfa8b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8fl4w" Jul 10 22:12:15.164195 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:15.164176 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjltg\" (UniqueName: \"kubernetes.io/projected/95fd45c1-812a-4005-aa67-20d21badfa8b-kube-api-access-hjltg\") pod \"cert-manager-cainjector-559cdd8c87-8fl4w\" (UID: \"95fd45c1-812a-4005-aa67-20d21badfa8b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-8fl4w" Jul 10 22:12:15.305021 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:15.304988 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8fl4w" Jul 10 22:12:15.445944 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:15.445911 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-8fl4w"] Jul 10 22:12:15.450168 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:12:15.450139 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95fd45c1_812a_4005_aa67_20d21badfa8b.slice/crio-b880fb559333c14a0c6718338ecb238188f367b44951b63fa1aa68cd7eccb959 WatchSource:0}: Error finding container b880fb559333c14a0c6718338ecb238188f367b44951b63fa1aa68cd7eccb959: Status 404 returned error can't find the container with id b880fb559333c14a0c6718338ecb238188f367b44951b63fa1aa68cd7eccb959 Jul 10 22:12:15.649697 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:15.649664 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8fl4w" event={"ID":"95fd45c1-812a-4005-aa67-20d21badfa8b","Type":"ContainerStarted","Data":"b880fb559333c14a0c6718338ecb238188f367b44951b63fa1aa68cd7eccb959"} Jul 10 22:12:15.650754 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:15.650735 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-flljm" event={"ID":"e29d0b1c-7389-4467-a29d-72663ac5afb6","Type":"ContainerStarted","Data":"2cfaeba850e8942e7d86ec6ddf13937f04f99bb19c0f1ca2d65a2b83fd735984"} Jul 10 22:12:18.667313 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:18.667263 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8fl4w" event={"ID":"95fd45c1-812a-4005-aa67-20d21badfa8b","Type":"ContainerStarted","Data":"3532698209f6fade57f975452b537187f58e8f6936b8073b0b945ae027140082"} Jul 10 22:12:18.670183 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:18.670150 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-flljm" event={"ID":"e29d0b1c-7389-4467-a29d-72663ac5afb6","Type":"ContainerStarted","Data":"144c13b56cca1a57a7b089d4ddf7fe137294c7e33dd2d097883214237a80b41b"} Jul 10 22:12:18.670664 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:18.670641 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-flljm" Jul 10 22:12:18.686107 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:18.686056 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-8fl4w" podStartSLOduration=1.664262099 podStartE2EDuration="4.686042133s" totalImagesPullingTime="3.021780034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:12:18.685165915 +0000 UTC m=+267.599103162" watchObservedRunningTime="2026-07-10 22:12:18.686042133 +0000 UTC m=+267.599979383" Jul 10 22:12:18.703045 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:18.702990 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-flljm" podStartSLOduration=1.311328037 podStartE2EDuration="4.702968396s" totalImagesPullingTime="3.391640359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:12:18.702081122 +0000 UTC m=+267.616018385" watchObservedRunningTime="2026-07-10 22:12:18.702968396 +0000 UTC m=+267.616905647" Jul 10 22:12:25.679542 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:25.679512 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-flljm" Jul 10 22:12:49.022525 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:49.022491 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7"] Jul 10 22:12:49.025642 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:49.025620 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7" Jul 10 22:12:49.029254 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:49.029236 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 10 22:12:49.029729 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:49.029709 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 10 22:12:49.029729 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:49.029722 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 10 22:12:49.029861 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:49.029726 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gtq7m\"" Jul 10 22:12:49.030001 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:49.029985 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 10 22:12:49.059511 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:49.059488 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7"] Jul 10 22:12:49.197013 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:49.196981 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqzvl\" (UniqueName: \"kubernetes.io/projected/7f20d8cc-385d-43ad-a05a-a6842827ee02-kube-api-access-hqzvl\") pod \"opendatahub-operator-controller-manager-5dc77f46d4-rlpm7\" (UID: \"7f20d8cc-385d-43ad-a05a-a6842827ee02\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7" Jul 10 22:12:49.197215 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:49.197025 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7f20d8cc-385d-43ad-a05a-a6842827ee02-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dc77f46d4-rlpm7\" (UID: \"7f20d8cc-385d-43ad-a05a-a6842827ee02\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7" Jul 10 22:12:49.197215 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:49.197053 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7f20d8cc-385d-43ad-a05a-a6842827ee02-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dc77f46d4-rlpm7\" (UID: \"7f20d8cc-385d-43ad-a05a-a6842827ee02\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7" Jul 10 22:12:49.197215 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:49.197144 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f20d8cc-385d-43ad-a05a-a6842827ee02-tmp\") pod \"opendatahub-operator-controller-manager-5dc77f46d4-rlpm7\" (UID: \"7f20d8cc-385d-43ad-a05a-a6842827ee02\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7" Jul 10 22:12:49.197215 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:49.197180 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7f20d8cc-385d-43ad-a05a-a6842827ee02-manifests\") pod \"opendatahub-operator-controller-manager-5dc77f46d4-rlpm7\" (UID: \"7f20d8cc-385d-43ad-a05a-a6842827ee02\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7" Jul 10 22:12:49.298538 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:49.298451 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f20d8cc-385d-43ad-a05a-a6842827ee02-tmp\") pod \"opendatahub-operator-controller-manager-5dc77f46d4-rlpm7\" (UID: \"7f20d8cc-385d-43ad-a05a-a6842827ee02\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7" Jul 10 22:12:49.298538 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:49.298487 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7f20d8cc-385d-43ad-a05a-a6842827ee02-manifests\") pod \"opendatahub-operator-controller-manager-5dc77f46d4-rlpm7\" (UID: \"7f20d8cc-385d-43ad-a05a-a6842827ee02\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7" Jul 10 22:12:49.298538 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:49.298517 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqzvl\" (UniqueName: \"kubernetes.io/projected/7f20d8cc-385d-43ad-a05a-a6842827ee02-kube-api-access-hqzvl\") pod \"opendatahub-operator-controller-manager-5dc77f46d4-rlpm7\" (UID: \"7f20d8cc-385d-43ad-a05a-a6842827ee02\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7" Jul 10 22:12:49.298820 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:49.298642 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7f20d8cc-385d-43ad-a05a-a6842827ee02-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dc77f46d4-rlpm7\" (UID: \"7f20d8cc-385d-43ad-a05a-a6842827ee02\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7" Jul 10 22:12:49.298820 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:49.298702 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7f20d8cc-385d-43ad-a05a-a6842827ee02-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dc77f46d4-rlpm7\" (UID: \"7f20d8cc-385d-43ad-a05a-a6842827ee02\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7" Jul 10 22:12:49.298820 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:49.298810 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7f20d8cc-385d-43ad-a05a-a6842827ee02-manifests\") pod \"opendatahub-operator-controller-manager-5dc77f46d4-rlpm7\" (UID: \"7f20d8cc-385d-43ad-a05a-a6842827ee02\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7" Jul 10 22:12:49.300735 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:49.300713 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f20d8cc-385d-43ad-a05a-a6842827ee02-tmp\") pod \"opendatahub-operator-controller-manager-5dc77f46d4-rlpm7\" (UID: \"7f20d8cc-385d-43ad-a05a-a6842827ee02\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7" Jul 10 22:12:49.300970 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:49.300951 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7f20d8cc-385d-43ad-a05a-a6842827ee02-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dc77f46d4-rlpm7\" (UID: \"7f20d8cc-385d-43ad-a05a-a6842827ee02\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7" Jul 10 22:12:49.301031 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:49.300975 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7f20d8cc-385d-43ad-a05a-a6842827ee02-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dc77f46d4-rlpm7\" (UID: \"7f20d8cc-385d-43ad-a05a-a6842827ee02\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7" Jul 10 22:12:49.314772 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:49.314752 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqzvl\" (UniqueName: \"kubernetes.io/projected/7f20d8cc-385d-43ad-a05a-a6842827ee02-kube-api-access-hqzvl\") pod \"opendatahub-operator-controller-manager-5dc77f46d4-rlpm7\" (UID: \"7f20d8cc-385d-43ad-a05a-a6842827ee02\") " pod="opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7" Jul 10 22:12:49.335653 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:49.335622 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7" Jul 10 22:12:49.472029 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:49.471990 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7"] Jul 10 22:12:49.475307 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:12:49.475282 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f20d8cc_385d_43ad_a05a_a6842827ee02.slice/crio-137ce5427c926dcf80b4686d724afe6e57afb715710aa3ea4a8e5dc508a37396 WatchSource:0}: Error finding container 137ce5427c926dcf80b4686d724afe6e57afb715710aa3ea4a8e5dc508a37396: Status 404 returned error can't find the container with id 137ce5427c926dcf80b4686d724afe6e57afb715710aa3ea4a8e5dc508a37396 Jul 10 22:12:49.778857 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:49.778818 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7" event={"ID":"7f20d8cc-385d-43ad-a05a-a6842827ee02","Type":"ContainerStarted","Data":"137ce5427c926dcf80b4686d724afe6e57afb715710aa3ea4a8e5dc508a37396"} Jul 10 22:12:52.595816 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:52.595789 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2w5j_723bd115-a9a8-4ca9-b4d1-dd76b54b802a/ovn-acl-logging/0.log" Jul 10 22:12:52.598142 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:52.595790 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q2w5j_723bd115-a9a8-4ca9-b4d1-dd76b54b802a/ovn-acl-logging/0.log" Jul 10 22:12:52.602321 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:52.602297 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 10 22:12:52.791888 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:52.791854 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7" event={"ID":"7f20d8cc-385d-43ad-a05a-a6842827ee02","Type":"ContainerStarted","Data":"e686f839ed742dc4b707a4e28159867b013773ee5b7082367e02ec63b72df676"} Jul 10 22:12:53.796578 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:53.796545 2578 generic.go:356] "Generic (PLEG): container finished" podID="7f20d8cc-385d-43ad-a05a-a6842827ee02" containerID="e686f839ed742dc4b707a4e28159867b013773ee5b7082367e02ec63b72df676" exitCode=0 Jul 10 22:12:53.796927 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:53.796599 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7" event={"ID":"7f20d8cc-385d-43ad-a05a-a6842827ee02","Type":"ContainerDied","Data":"e686f839ed742dc4b707a4e28159867b013773ee5b7082367e02ec63b72df676"} Jul 10 22:12:54.802198 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:54.802164 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7" event={"ID":"7f20d8cc-385d-43ad-a05a-a6842827ee02","Type":"ContainerStarted","Data":"1753baa6718b239d12a4b0037901f39c68ad376768859c90bac7abb9be6e3ee3"} Jul 10 22:12:54.802557 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:54.802361 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7" Jul 10 22:12:54.838570 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:12:54.838520 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7" podStartSLOduration=2.29490359 podStartE2EDuration="6.838501791s" totalImagesPullingTime="3.520494183s" totalInitContainerRuntime="1.023104018s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:12:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:12:54.837382368 +0000 UTC m=+303.751319645" watchObservedRunningTime="2026-07-10 22:12:54.838501791 +0000 UTC m=+303.752439042" Jul 10 22:13:05.808350 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:05.808316 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5dc77f46d4-rlpm7" Jul 10 22:13:08.885433 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:08.885395 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-545dc8f6c6-vzmtg"] Jul 10 22:13:08.893931 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:08.893904 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-545dc8f6c6-vzmtg" Jul 10 22:13:08.897429 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:08.897398 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 10 22:13:08.898229 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:08.898206 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 10 22:13:08.898340 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:08.898206 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-kqkfv\"" Jul 10 22:13:08.898340 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:08.898261 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 10 22:13:08.898340 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:08.898261 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 10 22:13:08.901105 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:08.901085 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-545dc8f6c6-vzmtg"] Jul 10 22:13:08.935788 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:08.935761 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l26dn\" (UniqueName: \"kubernetes.io/projected/5d0f70f1-829d-45f3-9dba-1dacd15e1743-kube-api-access-l26dn\") pod \"kube-auth-proxy-545dc8f6c6-vzmtg\" (UID: \"5d0f70f1-829d-45f3-9dba-1dacd15e1743\") " pod="openshift-ingress/kube-auth-proxy-545dc8f6c6-vzmtg" Jul 10 22:13:08.935951 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:08.935793 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d0f70f1-829d-45f3-9dba-1dacd15e1743-tls-certs\") pod \"kube-auth-proxy-545dc8f6c6-vzmtg\" (UID: \"5d0f70f1-829d-45f3-9dba-1dacd15e1743\") " pod="openshift-ingress/kube-auth-proxy-545dc8f6c6-vzmtg" Jul 10 22:13:08.935951 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:08.935834 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d0f70f1-829d-45f3-9dba-1dacd15e1743-tmp\") pod \"kube-auth-proxy-545dc8f6c6-vzmtg\" (UID: \"5d0f70f1-829d-45f3-9dba-1dacd15e1743\") " pod="openshift-ingress/kube-auth-proxy-545dc8f6c6-vzmtg" Jul 10 22:13:09.011444 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.011412 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2ttr8"] Jul 10 22:13:09.014517 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.014497 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2ttr8" Jul 10 22:13:09.016802 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.016780 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 10 22:13:09.016896 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.016861 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-2jfds\"" Jul 10 22:13:09.024762 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.024740 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2ttr8"] Jul 10 22:13:09.036959 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.036939 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2c75\" (UniqueName: \"kubernetes.io/projected/d21ce17f-1efc-4b19-ac4c-08f331548d35-kube-api-access-r2c75\") pod \"odh-model-controller-7998c67dc4-2ttr8\" (UID: \"d21ce17f-1efc-4b19-ac4c-08f331548d35\") " pod="opendatahub/odh-model-controller-7998c67dc4-2ttr8" Jul 10 22:13:09.037076 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.036978 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d0f70f1-829d-45f3-9dba-1dacd15e1743-tmp\") pod \"kube-auth-proxy-545dc8f6c6-vzmtg\" (UID: \"5d0f70f1-829d-45f3-9dba-1dacd15e1743\") " pod="openshift-ingress/kube-auth-proxy-545dc8f6c6-vzmtg" Jul 10 22:13:09.037076 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.037008 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d21ce17f-1efc-4b19-ac4c-08f331548d35-cert\") pod \"odh-model-controller-7998c67dc4-2ttr8\" (UID: \"d21ce17f-1efc-4b19-ac4c-08f331548d35\") " pod="opendatahub/odh-model-controller-7998c67dc4-2ttr8" Jul 10 22:13:09.037076 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.037042 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l26dn\" (UniqueName: \"kubernetes.io/projected/5d0f70f1-829d-45f3-9dba-1dacd15e1743-kube-api-access-l26dn\") pod \"kube-auth-proxy-545dc8f6c6-vzmtg\" (UID: \"5d0f70f1-829d-45f3-9dba-1dacd15e1743\") " pod="openshift-ingress/kube-auth-proxy-545dc8f6c6-vzmtg" Jul 10 22:13:09.037076 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.037064 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d0f70f1-829d-45f3-9dba-1dacd15e1743-tls-certs\") pod \"kube-auth-proxy-545dc8f6c6-vzmtg\" (UID: \"5d0f70f1-829d-45f3-9dba-1dacd15e1743\") " pod="openshift-ingress/kube-auth-proxy-545dc8f6c6-vzmtg" Jul 10 22:13:09.039817 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.039790 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d0f70f1-829d-45f3-9dba-1dacd15e1743-tmp\") pod \"kube-auth-proxy-545dc8f6c6-vzmtg\" (UID: \"5d0f70f1-829d-45f3-9dba-1dacd15e1743\") " pod="openshift-ingress/kube-auth-proxy-545dc8f6c6-vzmtg" Jul 10 22:13:09.039936 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.039920 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d0f70f1-829d-45f3-9dba-1dacd15e1743-tls-certs\") pod \"kube-auth-proxy-545dc8f6c6-vzmtg\" (UID: \"5d0f70f1-829d-45f3-9dba-1dacd15e1743\") " pod="openshift-ingress/kube-auth-proxy-545dc8f6c6-vzmtg" Jul 10 22:13:09.049366 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.049345 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l26dn\" (UniqueName: \"kubernetes.io/projected/5d0f70f1-829d-45f3-9dba-1dacd15e1743-kube-api-access-l26dn\") pod \"kube-auth-proxy-545dc8f6c6-vzmtg\" (UID: \"5d0f70f1-829d-45f3-9dba-1dacd15e1743\") " pod="openshift-ingress/kube-auth-proxy-545dc8f6c6-vzmtg" Jul 10 22:13:09.137744 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.137666 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d21ce17f-1efc-4b19-ac4c-08f331548d35-cert\") pod \"odh-model-controller-7998c67dc4-2ttr8\" (UID: \"d21ce17f-1efc-4b19-ac4c-08f331548d35\") " pod="opendatahub/odh-model-controller-7998c67dc4-2ttr8" Jul 10 22:13:09.137744 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.137717 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2c75\" (UniqueName: \"kubernetes.io/projected/d21ce17f-1efc-4b19-ac4c-08f331548d35-kube-api-access-r2c75\") pod \"odh-model-controller-7998c67dc4-2ttr8\" (UID: \"d21ce17f-1efc-4b19-ac4c-08f331548d35\") " pod="opendatahub/odh-model-controller-7998c67dc4-2ttr8" Jul 10 22:13:09.137969 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:13:09.137827 2578 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 10 22:13:09.137969 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:13:09.137901 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d21ce17f-1efc-4b19-ac4c-08f331548d35-cert podName:d21ce17f-1efc-4b19-ac4c-08f331548d35 nodeName:}" failed. No retries permitted until 2026-07-10 22:13:09.637880131 +0000 UTC m=+318.551817372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d21ce17f-1efc-4b19-ac4c-08f331548d35-cert") pod "odh-model-controller-7998c67dc4-2ttr8" (UID: "d21ce17f-1efc-4b19-ac4c-08f331548d35") : secret "odh-model-controller-webhook-cert" not found Jul 10 22:13:09.146602 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.146571 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2c75\" (UniqueName: \"kubernetes.io/projected/d21ce17f-1efc-4b19-ac4c-08f331548d35-kube-api-access-r2c75\") pod \"odh-model-controller-7998c67dc4-2ttr8\" (UID: \"d21ce17f-1efc-4b19-ac4c-08f331548d35\") " pod="opendatahub/odh-model-controller-7998c67dc4-2ttr8" Jul 10 22:13:09.204859 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.204823 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-545dc8f6c6-vzmtg" Jul 10 22:13:09.351003 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.350960 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-545dc8f6c6-vzmtg"] Jul 10 22:13:09.355097 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:13:09.355066 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d0f70f1_829d_45f3_9dba_1dacd15e1743.slice/crio-4aedf3cd1faf735d1fd339793f83796a90fc4ddbd22efc69e319c16337dd70b5 WatchSource:0}: Error finding container 4aedf3cd1faf735d1fd339793f83796a90fc4ddbd22efc69e319c16337dd70b5: Status 404 returned error can't find the container with id 4aedf3cd1faf735d1fd339793f83796a90fc4ddbd22efc69e319c16337dd70b5 Jul 10 22:13:09.357361 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.357340 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 22:13:09.642352 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.642324 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d21ce17f-1efc-4b19-ac4c-08f331548d35-cert\") pod \"odh-model-controller-7998c67dc4-2ttr8\" (UID: \"d21ce17f-1efc-4b19-ac4c-08f331548d35\") " pod="opendatahub/odh-model-controller-7998c67dc4-2ttr8" Jul 10 22:13:09.644633 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.644605 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d21ce17f-1efc-4b19-ac4c-08f331548d35-cert\") pod \"odh-model-controller-7998c67dc4-2ttr8\" (UID: \"d21ce17f-1efc-4b19-ac4c-08f331548d35\") " pod="opendatahub/odh-model-controller-7998c67dc4-2ttr8" Jul 10 22:13:09.857654 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.857564 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-545dc8f6c6-vzmtg" event={"ID":"5d0f70f1-829d-45f3-9dba-1dacd15e1743","Type":"ContainerStarted","Data":"4aedf3cd1faf735d1fd339793f83796a90fc4ddbd22efc69e319c16337dd70b5"} Jul 10 22:13:09.906770 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.906691 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-z66s2"] Jul 10 22:13:09.911218 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.911195 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-z66s2" Jul 10 22:13:09.913491 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.913472 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 10 22:13:09.913610 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.913498 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-mhbnk\"" Jul 10 22:13:09.920280 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.920252 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-z66s2"] Jul 10 22:13:09.924538 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.924510 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2ttr8" Jul 10 22:13:09.945228 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.945197 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1a2f16c-9b0f-4cfd-8c9f-1f63f077708c-tls-certs\") pod \"model-serving-api-54d89bd5fc-z66s2\" (UID: \"d1a2f16c-9b0f-4cfd-8c9f-1f63f077708c\") " pod="opendatahub/model-serving-api-54d89bd5fc-z66s2" Jul 10 22:13:09.945351 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.945255 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-469jz\" (UniqueName: \"kubernetes.io/projected/d1a2f16c-9b0f-4cfd-8c9f-1f63f077708c-kube-api-access-469jz\") pod \"model-serving-api-54d89bd5fc-z66s2\" (UID: \"d1a2f16c-9b0f-4cfd-8c9f-1f63f077708c\") " pod="opendatahub/model-serving-api-54d89bd5fc-z66s2" Jul 10 22:13:09.970078 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.970044 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6"] Jul 10 22:13:09.973855 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.973834 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:09.977193 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.976259 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 10 22:13:09.977193 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.976502 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9hght\"" Jul 10 22:13:09.977193 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.976715 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 10 22:13:09.977193 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.976986 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 10 22:13:09.977193 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.977074 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 10 22:13:09.989467 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:09.989408 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6"] Jul 10 22:13:10.046413 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.046342 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cd36b5e1-579e-4eed-ba93-df041df67e50-cacerts\") pod \"istiod-openshift-gateway-7574459656-sq5m6\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:10.046413 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.046386 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cd36b5e1-579e-4eed-ba93-df041df67e50-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-sq5m6\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:10.046636 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.046438 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cd36b5e1-579e-4eed-ba93-df041df67e50-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-sq5m6\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:10.046636 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.046612 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1a2f16c-9b0f-4cfd-8c9f-1f63f077708c-tls-certs\") pod \"model-serving-api-54d89bd5fc-z66s2\" (UID: \"d1a2f16c-9b0f-4cfd-8c9f-1f63f077708c\") " pod="opendatahub/model-serving-api-54d89bd5fc-z66s2" Jul 10 22:13:10.046753 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.046647 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd36b5e1-579e-4eed-ba93-df041df67e50-local-certs\") pod \"istiod-openshift-gateway-7574459656-sq5m6\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:10.046753 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.046675 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd36b5e1-579e-4eed-ba93-df041df67e50-istio-token\") pod \"istiod-openshift-gateway-7574459656-sq5m6\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:10.046753 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.046718 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-469jz\" (UniqueName: \"kubernetes.io/projected/d1a2f16c-9b0f-4cfd-8c9f-1f63f077708c-kube-api-access-469jz\") pod \"model-serving-api-54d89bd5fc-z66s2\" (UID: \"d1a2f16c-9b0f-4cfd-8c9f-1f63f077708c\") " pod="opendatahub/model-serving-api-54d89bd5fc-z66s2" Jul 10 22:13:10.046753 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.046743 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cd36b5e1-579e-4eed-ba93-df041df67e50-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-sq5m6\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:10.046957 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.046792 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p5x9\" (UniqueName: \"kubernetes.io/projected/cd36b5e1-579e-4eed-ba93-df041df67e50-kube-api-access-7p5x9\") pod \"istiod-openshift-gateway-7574459656-sq5m6\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:10.046957 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:13:10.046928 2578 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 10 22:13:10.047075 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:13:10.046996 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1a2f16c-9b0f-4cfd-8c9f-1f63f077708c-tls-certs podName:d1a2f16c-9b0f-4cfd-8c9f-1f63f077708c nodeName:}" failed. No retries permitted until 2026-07-10 22:13:10.546974783 +0000 UTC m=+319.460912026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d1a2f16c-9b0f-4cfd-8c9f-1f63f077708c-tls-certs") pod "model-serving-api-54d89bd5fc-z66s2" (UID: "d1a2f16c-9b0f-4cfd-8c9f-1f63f077708c") : secret "model-serving-api-tls" not found Jul 10 22:13:10.061922 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.061768 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-469jz\" (UniqueName: \"kubernetes.io/projected/d1a2f16c-9b0f-4cfd-8c9f-1f63f077708c-kube-api-access-469jz\") pod \"model-serving-api-54d89bd5fc-z66s2\" (UID: \"d1a2f16c-9b0f-4cfd-8c9f-1f63f077708c\") " pod="opendatahub/model-serving-api-54d89bd5fc-z66s2" Jul 10 22:13:10.075798 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.075726 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2ttr8"] Jul 10 22:13:10.078927 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:13:10.078898 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd21ce17f_1efc_4b19_ac4c_08f331548d35.slice/crio-82ad43692de49d1452a104939c5a9d7ab43391562f102d443d8db895f4c0e500 WatchSource:0}: Error finding container 82ad43692de49d1452a104939c5a9d7ab43391562f102d443d8db895f4c0e500: Status 404 returned error can't find the container with id 82ad43692de49d1452a104939c5a9d7ab43391562f102d443d8db895f4c0e500 Jul 10 22:13:10.147270 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.147231 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cd36b5e1-579e-4eed-ba93-df041df67e50-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-sq5m6\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:10.147454 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.147310 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd36b5e1-579e-4eed-ba93-df041df67e50-local-certs\") pod \"istiod-openshift-gateway-7574459656-sq5m6\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:10.147454 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.147333 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd36b5e1-579e-4eed-ba93-df041df67e50-istio-token\") pod \"istiod-openshift-gateway-7574459656-sq5m6\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:10.147454 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.147372 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cd36b5e1-579e-4eed-ba93-df041df67e50-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-sq5m6\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:10.147454 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.147415 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p5x9\" (UniqueName: \"kubernetes.io/projected/cd36b5e1-579e-4eed-ba93-df041df67e50-kube-api-access-7p5x9\") pod \"istiod-openshift-gateway-7574459656-sq5m6\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:10.147454 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.147447 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cd36b5e1-579e-4eed-ba93-df041df67e50-cacerts\") pod \"istiod-openshift-gateway-7574459656-sq5m6\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:10.147712 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.147471 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cd36b5e1-579e-4eed-ba93-df041df67e50-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-sq5m6\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:10.148172 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.148141 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cd36b5e1-579e-4eed-ba93-df041df67e50-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-sq5m6\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:10.150530 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.150499 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cd36b5e1-579e-4eed-ba93-df041df67e50-cacerts\") pod \"istiod-openshift-gateway-7574459656-sq5m6\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:10.150644 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.150519 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cd36b5e1-579e-4eed-ba93-df041df67e50-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-sq5m6\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:10.151201 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.151179 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd36b5e1-579e-4eed-ba93-df041df67e50-local-certs\") pod \"istiod-openshift-gateway-7574459656-sq5m6\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:10.152372 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.152349 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cd36b5e1-579e-4eed-ba93-df041df67e50-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-sq5m6\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:10.163200 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.162828 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd36b5e1-579e-4eed-ba93-df041df67e50-istio-token\") pod \"istiod-openshift-gateway-7574459656-sq5m6\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:10.163200 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.163162 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p5x9\" (UniqueName: \"kubernetes.io/projected/cd36b5e1-579e-4eed-ba93-df041df67e50-kube-api-access-7p5x9\") pod \"istiod-openshift-gateway-7574459656-sq5m6\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:10.286253 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.286220 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:10.456461 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.456422 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6"] Jul 10 22:13:10.460786 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:13:10.460757 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd36b5e1_579e_4eed_ba93_df041df67e50.slice/crio-fcd15a967bc6d5f26d591faab648cd2f08770c6789bf730053041e4f2b893cb5 WatchSource:0}: Error finding container fcd15a967bc6d5f26d591faab648cd2f08770c6789bf730053041e4f2b893cb5: Status 404 returned error can't find the container with id fcd15a967bc6d5f26d591faab648cd2f08770c6789bf730053041e4f2b893cb5 Jul 10 22:13:10.551364 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.551316 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1a2f16c-9b0f-4cfd-8c9f-1f63f077708c-tls-certs\") pod \"model-serving-api-54d89bd5fc-z66s2\" (UID: \"d1a2f16c-9b0f-4cfd-8c9f-1f63f077708c\") " pod="opendatahub/model-serving-api-54d89bd5fc-z66s2" Jul 10 22:13:10.554003 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.553971 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1a2f16c-9b0f-4cfd-8c9f-1f63f077708c-tls-certs\") pod \"model-serving-api-54d89bd5fc-z66s2\" (UID: \"d1a2f16c-9b0f-4cfd-8c9f-1f63f077708c\") " pod="opendatahub/model-serving-api-54d89bd5fc-z66s2" Jul 10 22:13:10.822510 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.822427 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-z66s2" Jul 10 22:13:10.867688 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.867596 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" event={"ID":"cd36b5e1-579e-4eed-ba93-df041df67e50","Type":"ContainerStarted","Data":"fcd15a967bc6d5f26d591faab648cd2f08770c6789bf730053041e4f2b893cb5"} Jul 10 22:13:10.869408 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:10.869341 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2ttr8" event={"ID":"d21ce17f-1efc-4b19-ac4c-08f331548d35","Type":"ContainerStarted","Data":"82ad43692de49d1452a104939c5a9d7ab43391562f102d443d8db895f4c0e500"} Jul 10 22:13:11.012207 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:11.012110 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-z66s2"] Jul 10 22:13:11.016832 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:13:11.016799 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1a2f16c_9b0f_4cfd_8c9f_1f63f077708c.slice/crio-9f68cb2a798c341c1497c112009cf55469123113cb6c010f40ad293015e7c951 WatchSource:0}: Error finding container 9f68cb2a798c341c1497c112009cf55469123113cb6c010f40ad293015e7c951: Status 404 returned error can't find the container with id 9f68cb2a798c341c1497c112009cf55469123113cb6c010f40ad293015e7c951 Jul 10 22:13:11.876514 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:11.876474 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-z66s2" event={"ID":"d1a2f16c-9b0f-4cfd-8c9f-1f63f077708c","Type":"ContainerStarted","Data":"9f68cb2a798c341c1497c112009cf55469123113cb6c010f40ad293015e7c951"} Jul 10 22:13:15.436362 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:15.436325 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 22:13:15.436796 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:15.436391 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 22:13:15.896063 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:15.896025 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-545dc8f6c6-vzmtg" event={"ID":"5d0f70f1-829d-45f3-9dba-1dacd15e1743","Type":"ContainerStarted","Data":"ce9374ebf1ebd5f8f66555955092c3b802f179af1277c35b2fa21a6c2c907a42"} Jul 10 22:13:15.897552 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:15.897527 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-z66s2" event={"ID":"d1a2f16c-9b0f-4cfd-8c9f-1f63f077708c","Type":"ContainerStarted","Data":"cba371955916a86261fc63cacedb4f65fe57f9e1b7bc342895a34a0fb2a32bd8"} Jul 10 22:13:15.897688 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:15.897596 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-z66s2" Jul 10 22:13:15.899106 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:15.899083 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2ttr8" event={"ID":"d21ce17f-1efc-4b19-ac4c-08f331548d35","Type":"ContainerStarted","Data":"5a1c3fcf9769ff1f73d5ca095f11a044c8bd0117210a6eb7c4d356a1d742ac02"} Jul 10 22:13:15.899226 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:15.899147 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-2ttr8" Jul 10 22:13:15.900872 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:15.900850 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" event={"ID":"cd36b5e1-579e-4eed-ba93-df041df67e50","Type":"ContainerStarted","Data":"cfcd17a48d1fcc245a75a8a4a82d3270008ba29eb52a01bcfc282f4b287077af"} Jul 10 22:13:15.901091 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:15.901073 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:15.913706 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:15.913659 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-545dc8f6c6-vzmtg" podStartSLOduration=1.839483527 podStartE2EDuration="7.913642014s" totalImagesPullingTime="6.074158487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:13:15.912883759 +0000 UTC m=+324.826821009" watchObservedRunningTime="2026-07-10 22:13:15.913642014 +0000 UTC m=+324.827579265" Jul 10 22:13:15.930175 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:15.930091 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-2ttr8" podStartSLOduration=2.5672134189999998 podStartE2EDuration="7.93007226s" totalImagesPullingTime="5.362858841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:13:15.92818674 +0000 UTC m=+324.842123991" watchObservedRunningTime="2026-07-10 22:13:15.93007226 +0000 UTC m=+324.844009510" Jul 10 22:13:15.950271 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:15.950230 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-z66s2" podStartSLOduration=2.529877224 podStartE2EDuration="6.950211097s" totalImagesPullingTime="4.420333873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:13:15.949255002 +0000 UTC m=+324.863192247" watchObservedRunningTime="2026-07-10 22:13:15.950211097 +0000 UTC m=+324.864148347" Jul 10 22:13:15.971730 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:15.971690 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" podStartSLOduration=1.998853654 podStartE2EDuration="6.971677738s" totalImagesPullingTime="4.972824084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:13:15.970244287 +0000 UTC m=+324.884181537" watchObservedRunningTime="2026-07-10 22:13:15.971677738 +0000 UTC m=+324.885614987" Jul 10 22:13:16.906200 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:16.906165 2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-sq5m6 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 10 22:13:16.906641 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:16.906227 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" podUID="cd36b5e1-579e-4eed-ba93-df041df67e50" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 22:13:19.905789 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:19.905757 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:20.715921 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:20.715875 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nmdcq"] Jul 10 22:13:20.719466 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:20.719448 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nmdcq" Jul 10 22:13:20.722510 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:20.722348 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 10 22:13:20.722510 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:20.722376 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-9f95l\"" Jul 10 22:13:20.727398 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:20.726994 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-86rkb"] Jul 10 22:13:20.730361 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:20.730254 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-86rkb" Jul 10 22:13:20.730462 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:20.730446 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nmdcq"] Jul 10 22:13:20.732675 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:20.732564 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 10 22:13:20.732810 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:20.732789 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-7zl9w\"" Jul 10 22:13:20.743863 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:20.743842 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-86rkb"] Jul 10 22:13:20.836448 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:20.836194 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed4215ce-31dd-4a09-b41d-290a54cb1811-cert\") pod \"kserve-controller-manager-d6f4b65b8-nmdcq\" (UID: \"ed4215ce-31dd-4a09-b41d-290a54cb1811\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nmdcq" Jul 10 22:13:20.836448 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:20.836236 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67fa5554-4028-470c-957c-b4c24a7feb8c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-86rkb\" (UID: \"67fa5554-4028-470c-957c-b4c24a7feb8c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-86rkb" Jul 10 22:13:20.836448 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:20.836282 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkk6f\" (UniqueName: \"kubernetes.io/projected/ed4215ce-31dd-4a09-b41d-290a54cb1811-kube-api-access-zkk6f\") pod \"kserve-controller-manager-d6f4b65b8-nmdcq\" (UID: \"ed4215ce-31dd-4a09-b41d-290a54cb1811\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nmdcq" Jul 10 22:13:20.836448 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:20.836324 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4flm\" (UniqueName: \"kubernetes.io/projected/67fa5554-4028-470c-957c-b4c24a7feb8c-kube-api-access-w4flm\") pod \"llmisvc-controller-manager-777c6bd7d5-86rkb\" (UID: \"67fa5554-4028-470c-957c-b4c24a7feb8c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-86rkb" Jul 10 22:13:20.937396 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:20.937360 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed4215ce-31dd-4a09-b41d-290a54cb1811-cert\") pod \"kserve-controller-manager-d6f4b65b8-nmdcq\" (UID: \"ed4215ce-31dd-4a09-b41d-290a54cb1811\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nmdcq" Jul 10 22:13:20.937841 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:20.937402 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67fa5554-4028-470c-957c-b4c24a7feb8c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-86rkb\" (UID: \"67fa5554-4028-470c-957c-b4c24a7feb8c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-86rkb" Jul 10 22:13:20.937917 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:20.937901 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkk6f\" (UniqueName: \"kubernetes.io/projected/ed4215ce-31dd-4a09-b41d-290a54cb1811-kube-api-access-zkk6f\") pod \"kserve-controller-manager-d6f4b65b8-nmdcq\" (UID: \"ed4215ce-31dd-4a09-b41d-290a54cb1811\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nmdcq" Jul 10 22:13:20.941160 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:20.938003 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4flm\" (UniqueName: \"kubernetes.io/projected/67fa5554-4028-470c-957c-b4c24a7feb8c-kube-api-access-w4flm\") pod \"llmisvc-controller-manager-777c6bd7d5-86rkb\" (UID: \"67fa5554-4028-470c-957c-b4c24a7feb8c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-86rkb" Jul 10 22:13:20.941160 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:13:20.938208 2578 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 10 22:13:20.941160 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:13:20.938686 2578 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 10 22:13:20.941160 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:13:20.938702 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67fa5554-4028-470c-957c-b4c24a7feb8c-cert podName:67fa5554-4028-470c-957c-b4c24a7feb8c nodeName:}" failed. No retries permitted until 2026-07-10 22:13:21.438677704 +0000 UTC m=+330.352614948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/67fa5554-4028-470c-957c-b4c24a7feb8c-cert") pod "llmisvc-controller-manager-777c6bd7d5-86rkb" (UID: "67fa5554-4028-470c-957c-b4c24a7feb8c") : secret "llmisvc-webhook-server-cert" not found Jul 10 22:13:20.941160 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:13:20.939320 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed4215ce-31dd-4a09-b41d-290a54cb1811-cert podName:ed4215ce-31dd-4a09-b41d-290a54cb1811 nodeName:}" failed. No retries permitted until 2026-07-10 22:13:21.439300598 +0000 UTC m=+330.353237842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ed4215ce-31dd-4a09-b41d-290a54cb1811-cert") pod "kserve-controller-manager-d6f4b65b8-nmdcq" (UID: "ed4215ce-31dd-4a09-b41d-290a54cb1811") : secret "kserve-webhook-server-cert" not found Jul 10 22:13:20.952719 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:20.952685 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4flm\" (UniqueName: \"kubernetes.io/projected/67fa5554-4028-470c-957c-b4c24a7feb8c-kube-api-access-w4flm\") pod \"llmisvc-controller-manager-777c6bd7d5-86rkb\" (UID: \"67fa5554-4028-470c-957c-b4c24a7feb8c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-86rkb" Jul 10 22:13:20.952997 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:20.952980 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkk6f\" (UniqueName: \"kubernetes.io/projected/ed4215ce-31dd-4a09-b41d-290a54cb1811-kube-api-access-zkk6f\") pod \"kserve-controller-manager-d6f4b65b8-nmdcq\" (UID: \"ed4215ce-31dd-4a09-b41d-290a54cb1811\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nmdcq" Jul 10 22:13:21.441894 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:21.441860 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed4215ce-31dd-4a09-b41d-290a54cb1811-cert\") pod \"kserve-controller-manager-d6f4b65b8-nmdcq\" (UID: \"ed4215ce-31dd-4a09-b41d-290a54cb1811\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nmdcq" Jul 10 22:13:21.441894 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:21.441896 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67fa5554-4028-470c-957c-b4c24a7feb8c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-86rkb\" (UID: \"67fa5554-4028-470c-957c-b4c24a7feb8c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-86rkb" Jul 10 22:13:21.444286 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:21.444267 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67fa5554-4028-470c-957c-b4c24a7feb8c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-86rkb\" (UID: \"67fa5554-4028-470c-957c-b4c24a7feb8c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-86rkb" Jul 10 22:13:21.444429 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:21.444406 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed4215ce-31dd-4a09-b41d-290a54cb1811-cert\") pod \"kserve-controller-manager-d6f4b65b8-nmdcq\" (UID: \"ed4215ce-31dd-4a09-b41d-290a54cb1811\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nmdcq" Jul 10 22:13:21.632166 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:21.632121 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nmdcq" Jul 10 22:13:21.642666 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:21.642639 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-86rkb" Jul 10 22:13:21.770616 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:21.770562 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nmdcq"] Jul 10 22:13:21.773009 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:13:21.772961 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded4215ce_31dd_4a09_b41d_290a54cb1811.slice/crio-9d6ea04380accb8abd0ebbd1d7cabf68ffbbace2e2285348f9311a4ca044d4aa WatchSource:0}: Error finding container 9d6ea04380accb8abd0ebbd1d7cabf68ffbbace2e2285348f9311a4ca044d4aa: Status 404 returned error can't find the container with id 9d6ea04380accb8abd0ebbd1d7cabf68ffbbace2e2285348f9311a4ca044d4aa Jul 10 22:13:21.796513 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:21.796490 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-86rkb"] Jul 10 22:13:21.798845 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:13:21.798816 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod67fa5554_4028_470c_957c_b4c24a7feb8c.slice/crio-eff39442125851c18f4496e3fc89e9c188d0d897e1e3a5535190000fc76159cd WatchSource:0}: Error finding container eff39442125851c18f4496e3fc89e9c188d0d897e1e3a5535190000fc76159cd: Status 404 returned error can't find the container with id eff39442125851c18f4496e3fc89e9c188d0d897e1e3a5535190000fc76159cd Jul 10 22:13:21.924881 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:21.924842 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-86rkb" event={"ID":"67fa5554-4028-470c-957c-b4c24a7feb8c","Type":"ContainerStarted","Data":"eff39442125851c18f4496e3fc89e9c188d0d897e1e3a5535190000fc76159cd"} Jul 10 22:13:21.926058 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:21.926027 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nmdcq" event={"ID":"ed4215ce-31dd-4a09-b41d-290a54cb1811","Type":"ContainerStarted","Data":"9d6ea04380accb8abd0ebbd1d7cabf68ffbbace2e2285348f9311a4ca044d4aa"} Jul 10 22:13:23.800244 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:23.800208 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6"] Jul 10 22:13:23.800720 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:23.800440 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" podUID="cd36b5e1-579e-4eed-ba93-df041df67e50" containerName="discovery" containerID="cri-o://cfcd17a48d1fcc245a75a8a4a82d3270008ba29eb52a01bcfc282f4b287077af" gracePeriod=30 Jul 10 22:13:24.428574 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.428550 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:24.472622 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.471957 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cd36b5e1-579e-4eed-ba93-df041df67e50-istio-csr-dns-cert\") pod \"cd36b5e1-579e-4eed-ba93-df041df67e50\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " Jul 10 22:13:24.472622 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.472009 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cd36b5e1-579e-4eed-ba93-df041df67e50-istio-kubeconfig\") pod \"cd36b5e1-579e-4eed-ba93-df041df67e50\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " Jul 10 22:13:24.472622 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.472070 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd36b5e1-579e-4eed-ba93-df041df67e50-local-certs\") pod \"cd36b5e1-579e-4eed-ba93-df041df67e50\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " Jul 10 22:13:24.472622 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.472100 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd36b5e1-579e-4eed-ba93-df041df67e50-istio-token\") pod \"cd36b5e1-579e-4eed-ba93-df041df67e50\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " Jul 10 22:13:24.472622 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.472163 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cd36b5e1-579e-4eed-ba93-df041df67e50-istio-csr-ca-configmap\") pod \"cd36b5e1-579e-4eed-ba93-df041df67e50\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " Jul 10 22:13:24.472622 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.472197 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cd36b5e1-579e-4eed-ba93-df041df67e50-cacerts\") pod \"cd36b5e1-579e-4eed-ba93-df041df67e50\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " Jul 10 22:13:24.472622 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.472230 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7p5x9\" (UniqueName: \"kubernetes.io/projected/cd36b5e1-579e-4eed-ba93-df041df67e50-kube-api-access-7p5x9\") pod \"cd36b5e1-579e-4eed-ba93-df041df67e50\" (UID: \"cd36b5e1-579e-4eed-ba93-df041df67e50\") " Jul 10 22:13:24.472622 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.472580 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd36b5e1-579e-4eed-ba93-df041df67e50-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "cd36b5e1-579e-4eed-ba93-df041df67e50" (UID: "cd36b5e1-579e-4eed-ba93-df041df67e50"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 22:13:24.475600 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.475549 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd36b5e1-579e-4eed-ba93-df041df67e50-local-certs" (OuterVolumeSpecName: "local-certs") pod "cd36b5e1-579e-4eed-ba93-df041df67e50" (UID: "cd36b5e1-579e-4eed-ba93-df041df67e50"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 22:13:24.476323 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.476100 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd36b5e1-579e-4eed-ba93-df041df67e50-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "cd36b5e1-579e-4eed-ba93-df041df67e50" (UID: "cd36b5e1-579e-4eed-ba93-df041df67e50"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 22:13:24.476517 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.476469 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd36b5e1-579e-4eed-ba93-df041df67e50-istio-token" (OuterVolumeSpecName: "istio-token") pod "cd36b5e1-579e-4eed-ba93-df041df67e50" (UID: "cd36b5e1-579e-4eed-ba93-df041df67e50"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 22:13:24.476855 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.476819 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd36b5e1-579e-4eed-ba93-df041df67e50-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "cd36b5e1-579e-4eed-ba93-df041df67e50" (UID: "cd36b5e1-579e-4eed-ba93-df041df67e50"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 22:13:24.476940 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.476900 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd36b5e1-579e-4eed-ba93-df041df67e50-kube-api-access-7p5x9" (OuterVolumeSpecName: "kube-api-access-7p5x9") pod "cd36b5e1-579e-4eed-ba93-df041df67e50" (UID: "cd36b5e1-579e-4eed-ba93-df041df67e50"). InnerVolumeSpecName "kube-api-access-7p5x9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 22:13:24.477395 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.477369 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd36b5e1-579e-4eed-ba93-df041df67e50-cacerts" (OuterVolumeSpecName: "cacerts") pod "cd36b5e1-579e-4eed-ba93-df041df67e50" (UID: "cd36b5e1-579e-4eed-ba93-df041df67e50"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 22:13:24.572839 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.572764 2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cd36b5e1-579e-4eed-ba93-df041df67e50-istio-csr-dns-cert\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:13:24.572839 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.572793 2578 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cd36b5e1-579e-4eed-ba93-df041df67e50-istio-kubeconfig\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:13:24.572839 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.572803 2578 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd36b5e1-579e-4eed-ba93-df041df67e50-local-certs\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:13:24.572839 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.572810 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd36b5e1-579e-4eed-ba93-df041df67e50-istio-token\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:13:24.572839 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.572819 2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cd36b5e1-579e-4eed-ba93-df041df67e50-istio-csr-ca-configmap\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:13:24.572839 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.572827 2578 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cd36b5e1-579e-4eed-ba93-df041df67e50-cacerts\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:13:24.572839 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.572836 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7p5x9\" (UniqueName: \"kubernetes.io/projected/cd36b5e1-579e-4eed-ba93-df041df67e50-kube-api-access-7p5x9\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:13:24.945059 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.945015 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nmdcq" event={"ID":"ed4215ce-31dd-4a09-b41d-290a54cb1811","Type":"ContainerStarted","Data":"873c8d72743936628bc19cc4ba3fcba5fe3239f8e80d4153865390592527cefa"} Jul 10 22:13:24.945512 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.945147 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nmdcq" Jul 10 22:13:24.946737 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.946652 2578 generic.go:356] "Generic (PLEG): container finished" podID="cd36b5e1-579e-4eed-ba93-df041df67e50" containerID="cfcd17a48d1fcc245a75a8a4a82d3270008ba29eb52a01bcfc282f4b287077af" exitCode=0 Jul 10 22:13:24.946737 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.946675 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" event={"ID":"cd36b5e1-579e-4eed-ba93-df041df67e50","Type":"ContainerDied","Data":"cfcd17a48d1fcc245a75a8a4a82d3270008ba29eb52a01bcfc282f4b287077af"} Jul 10 22:13:24.946737 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.946705 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" Jul 10 22:13:24.946737 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.946722 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6" event={"ID":"cd36b5e1-579e-4eed-ba93-df041df67e50","Type":"ContainerDied","Data":"fcd15a967bc6d5f26d591faab648cd2f08770c6789bf730053041e4f2b893cb5"} Jul 10 22:13:24.947025 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.946750 2578 scope.go:117] "RemoveContainer" containerID="cfcd17a48d1fcc245a75a8a4a82d3270008ba29eb52a01bcfc282f4b287077af" Jul 10 22:13:24.971187 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.971140 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nmdcq" podStartSLOduration=2.415276896 podStartE2EDuration="4.971109552s" totalImagesPullingTime="2.555832656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:13:24.964453551 +0000 UTC m=+333.878390797" watchObservedRunningTime="2026-07-10 22:13:24.971109552 +0000 UTC m=+333.885046805" Jul 10 22:13:24.981636 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.981606 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6"] Jul 10 22:13:24.985931 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:24.985905 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-sq5m6"] Jul 10 22:13:25.085751 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:25.085729 2578 scope.go:117] "RemoveContainer" containerID="cfcd17a48d1fcc245a75a8a4a82d3270008ba29eb52a01bcfc282f4b287077af" Jul 10 22:13:25.086056 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:13:25.086031 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfcd17a48d1fcc245a75a8a4a82d3270008ba29eb52a01bcfc282f4b287077af\": container with ID starting with cfcd17a48d1fcc245a75a8a4a82d3270008ba29eb52a01bcfc282f4b287077af not found: ID does not exist" containerID="cfcd17a48d1fcc245a75a8a4a82d3270008ba29eb52a01bcfc282f4b287077af" Jul 10 22:13:25.086169 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:25.086061 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfcd17a48d1fcc245a75a8a4a82d3270008ba29eb52a01bcfc282f4b287077af"} err="failed to get container status \"cfcd17a48d1fcc245a75a8a4a82d3270008ba29eb52a01bcfc282f4b287077af\": rpc error: code = NotFound desc = could not find container \"cfcd17a48d1fcc245a75a8a4a82d3270008ba29eb52a01bcfc282f4b287077af\": container with ID starting with cfcd17a48d1fcc245a75a8a4a82d3270008ba29eb52a01bcfc282f4b287077af not found: ID does not exist" Jul 10 22:13:25.631262 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:25.631192 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd36b5e1-579e-4eed-ba93-df041df67e50" path="/var/lib/kubelet/pods/cd36b5e1-579e-4eed-ba93-df041df67e50/volumes" Jul 10 22:13:25.953067 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:25.953037 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-86rkb" event={"ID":"67fa5554-4028-470c-957c-b4c24a7feb8c","Type":"ContainerStarted","Data":"0e3a8c64d21a0e0979c45d29c9942c18981f6db893de92e7db90ad21a8eeeacc"} Jul 10 22:13:25.953484 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:25.953167 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-86rkb" Jul 10 22:13:25.974949 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:25.974894 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-86rkb" podStartSLOduration=2.6417839450000002 podStartE2EDuration="5.974878738s" totalImagesPullingTime="3.333094793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:13:25.973495299 +0000 UTC m=+334.887432548" watchObservedRunningTime="2026-07-10 22:13:25.974878738 +0000 UTC m=+334.888815988" Jul 10 22:13:26.907251 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:26.907219 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-2ttr8" Jul 10 22:13:26.909035 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:26.909011 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-z66s2" Jul 10 22:13:55.959828 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:55.959794 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nmdcq" Jul 10 22:13:56.960376 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:13:56.960347 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-86rkb" Jul 10 22:14:09.770962 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:09.770913 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4rgz5"] Jul 10 22:14:09.771368 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:09.771221 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd36b5e1-579e-4eed-ba93-df041df67e50" containerName="discovery" Jul 10 22:14:09.771368 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:09.771233 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd36b5e1-579e-4eed-ba93-df041df67e50" containerName="discovery" Jul 10 22:14:09.771368 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:09.771286 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd36b5e1-579e-4eed-ba93-df041df67e50" containerName="discovery" Jul 10 22:14:09.780654 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:09.780627 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4rgz5" Jul 10 22:14:09.783075 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:09.783038 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 10 22:14:09.783555 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:09.783533 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-8xdmz\"" Jul 10 22:14:09.783740 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:09.783719 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 10 22:14:09.784179 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:09.784153 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4rgz5"] Jul 10 22:14:09.826830 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:09.826801 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pc7v\" (UniqueName: \"kubernetes.io/projected/9ee1e74d-9157-4f86-83b8-9b6b470e5ddc-kube-api-access-5pc7v\") pod \"kuadrant-operator-catalog-4rgz5\" (UID: \"9ee1e74d-9157-4f86-83b8-9b6b470e5ddc\") " pod="kuadrant-system/kuadrant-operator-catalog-4rgz5" Jul 10 22:14:09.927196 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:09.927167 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pc7v\" (UniqueName: \"kubernetes.io/projected/9ee1e74d-9157-4f86-83b8-9b6b470e5ddc-kube-api-access-5pc7v\") pod \"kuadrant-operator-catalog-4rgz5\" (UID: \"9ee1e74d-9157-4f86-83b8-9b6b470e5ddc\") " pod="kuadrant-system/kuadrant-operator-catalog-4rgz5" Jul 10 22:14:09.936184 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:09.936158 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pc7v\" (UniqueName: \"kubernetes.io/projected/9ee1e74d-9157-4f86-83b8-9b6b470e5ddc-kube-api-access-5pc7v\") pod \"kuadrant-operator-catalog-4rgz5\" (UID: \"9ee1e74d-9157-4f86-83b8-9b6b470e5ddc\") " pod="kuadrant-system/kuadrant-operator-catalog-4rgz5" Jul 10 22:14:10.091162 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:10.091065 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4rgz5" Jul 10 22:14:10.133085 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:10.133039 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4rgz5"] Jul 10 22:14:10.214089 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:10.214058 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4rgz5"] Jul 10 22:14:10.217271 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:14:10.217247 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ee1e74d_9157_4f86_83b8_9b6b470e5ddc.slice/crio-d96f1f4260a389eaf3be3046df94d59d2c53e9ca3e11f2b380b935ad0c8ea2ac WatchSource:0}: Error finding container d96f1f4260a389eaf3be3046df94d59d2c53e9ca3e11f2b380b935ad0c8ea2ac: Status 404 returned error can't find the container with id d96f1f4260a389eaf3be3046df94d59d2c53e9ca3e11f2b380b935ad0c8ea2ac Jul 10 22:14:10.342959 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:10.342868 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s4fgg"] Jul 10 22:14:10.345690 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:10.345675 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s4fgg" Jul 10 22:14:10.353705 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:10.353676 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s4fgg"] Jul 10 22:14:10.429779 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:10.429738 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfdc8\" (UniqueName: \"kubernetes.io/projected/c9b8525e-d6ad-4ca6-890e-876398c4bd1d-kube-api-access-bfdc8\") pod \"kuadrant-operator-catalog-s4fgg\" (UID: \"c9b8525e-d6ad-4ca6-890e-876398c4bd1d\") " pod="kuadrant-system/kuadrant-operator-catalog-s4fgg" Jul 10 22:14:10.531115 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:10.531084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfdc8\" (UniqueName: \"kubernetes.io/projected/c9b8525e-d6ad-4ca6-890e-876398c4bd1d-kube-api-access-bfdc8\") pod \"kuadrant-operator-catalog-s4fgg\" (UID: \"c9b8525e-d6ad-4ca6-890e-876398c4bd1d\") " pod="kuadrant-system/kuadrant-operator-catalog-s4fgg" Jul 10 22:14:10.539305 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:10.539267 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfdc8\" (UniqueName: \"kubernetes.io/projected/c9b8525e-d6ad-4ca6-890e-876398c4bd1d-kube-api-access-bfdc8\") pod \"kuadrant-operator-catalog-s4fgg\" (UID: \"c9b8525e-d6ad-4ca6-890e-876398c4bd1d\") " pod="kuadrant-system/kuadrant-operator-catalog-s4fgg" Jul 10 22:14:10.654835 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:10.654734 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s4fgg" Jul 10 22:14:10.785879 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:10.785834 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s4fgg"] Jul 10 22:14:10.830111 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:14:10.830073 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9b8525e_d6ad_4ca6_890e_876398c4bd1d.slice/crio-4af2892df647fa5e3b35f76f38d25d1046a11b6960a2f9edf700048d9319081a WatchSource:0}: Error finding container 4af2892df647fa5e3b35f76f38d25d1046a11b6960a2f9edf700048d9319081a: Status 404 returned error can't find the container with id 4af2892df647fa5e3b35f76f38d25d1046a11b6960a2f9edf700048d9319081a Jul 10 22:14:11.136503 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:11.136465 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s4fgg" event={"ID":"c9b8525e-d6ad-4ca6-890e-876398c4bd1d","Type":"ContainerStarted","Data":"4af2892df647fa5e3b35f76f38d25d1046a11b6960a2f9edf700048d9319081a"} Jul 10 22:14:11.137723 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:11.137703 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4rgz5" event={"ID":"9ee1e74d-9157-4f86-83b8-9b6b470e5ddc","Type":"ContainerStarted","Data":"d96f1f4260a389eaf3be3046df94d59d2c53e9ca3e11f2b380b935ad0c8ea2ac"} Jul 10 22:14:13.148013 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:13.147975 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s4fgg" event={"ID":"c9b8525e-d6ad-4ca6-890e-876398c4bd1d","Type":"ContainerStarted","Data":"ee8d05bb183e3cd16da4a9b74d7c2382f271774df21fbcf5c1054e0f1f424187"} Jul 10 22:14:13.149404 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:13.149380 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4rgz5" event={"ID":"9ee1e74d-9157-4f86-83b8-9b6b470e5ddc","Type":"ContainerStarted","Data":"de6a0242a24f3b5068a9f7ab05fee14deb5b8beb08b4c8fcf3bee32a74180508"} Jul 10 22:14:13.149520 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:13.149462 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-4rgz5" podUID="9ee1e74d-9157-4f86-83b8-9b6b470e5ddc" containerName="registry-server" containerID="cri-o://de6a0242a24f3b5068a9f7ab05fee14deb5b8beb08b4c8fcf3bee32a74180508" gracePeriod=2 Jul 10 22:14:13.167961 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:13.167903 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-s4fgg" podStartSLOduration=1.685131273 podStartE2EDuration="3.1678843s" totalImagesPullingTime="1.482753027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:14:13.164389813 +0000 UTC m=+382.078327053" watchObservedRunningTime="2026-07-10 22:14:13.1678843 +0000 UTC m=+382.081821551" Jul 10 22:14:13.180601 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:13.180553 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4rgz5" podStartSLOduration=2.087684483 podStartE2EDuration="4.180535511s" totalImagesPullingTime="2.092851028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:14:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:14:13.180068071 +0000 UTC m=+382.094005319" watchObservedRunningTime="2026-07-10 22:14:13.180535511 +0000 UTC m=+382.094472759" Jul 10 22:14:13.386020 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:13.385997 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4rgz5" Jul 10 22:14:13.453446 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:13.453410 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pc7v\" (UniqueName: \"kubernetes.io/projected/9ee1e74d-9157-4f86-83b8-9b6b470e5ddc-kube-api-access-5pc7v\") pod \"9ee1e74d-9157-4f86-83b8-9b6b470e5ddc\" (UID: \"9ee1e74d-9157-4f86-83b8-9b6b470e5ddc\") " Jul 10 22:14:13.455492 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:13.455465 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ee1e74d-9157-4f86-83b8-9b6b470e5ddc-kube-api-access-5pc7v" (OuterVolumeSpecName: "kube-api-access-5pc7v") pod "9ee1e74d-9157-4f86-83b8-9b6b470e5ddc" (UID: "9ee1e74d-9157-4f86-83b8-9b6b470e5ddc"). InnerVolumeSpecName "kube-api-access-5pc7v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 22:14:13.554024 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:13.553988 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pc7v\" (UniqueName: \"kubernetes.io/projected/9ee1e74d-9157-4f86-83b8-9b6b470e5ddc-kube-api-access-5pc7v\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:14:14.155065 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:14.155025 2578 generic.go:356] "Generic (PLEG): container finished" podID="9ee1e74d-9157-4f86-83b8-9b6b470e5ddc" containerID="de6a0242a24f3b5068a9f7ab05fee14deb5b8beb08b4c8fcf3bee32a74180508" exitCode=0 Jul 10 22:14:14.155065 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:14.155069 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4rgz5" Jul 10 22:14:14.155536 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:14.155113 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4rgz5" event={"ID":"9ee1e74d-9157-4f86-83b8-9b6b470e5ddc","Type":"ContainerDied","Data":"de6a0242a24f3b5068a9f7ab05fee14deb5b8beb08b4c8fcf3bee32a74180508"} Jul 10 22:14:14.155536 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:14.155185 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4rgz5" event={"ID":"9ee1e74d-9157-4f86-83b8-9b6b470e5ddc","Type":"ContainerDied","Data":"d96f1f4260a389eaf3be3046df94d59d2c53e9ca3e11f2b380b935ad0c8ea2ac"} Jul 10 22:14:14.155536 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:14.155205 2578 scope.go:117] "RemoveContainer" containerID="de6a0242a24f3b5068a9f7ab05fee14deb5b8beb08b4c8fcf3bee32a74180508" Jul 10 22:14:14.163519 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:14.163504 2578 scope.go:117] "RemoveContainer" containerID="de6a0242a24f3b5068a9f7ab05fee14deb5b8beb08b4c8fcf3bee32a74180508" Jul 10 22:14:14.163769 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:14:14.163753 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de6a0242a24f3b5068a9f7ab05fee14deb5b8beb08b4c8fcf3bee32a74180508\": container with ID starting with de6a0242a24f3b5068a9f7ab05fee14deb5b8beb08b4c8fcf3bee32a74180508 not found: ID does not exist" containerID="de6a0242a24f3b5068a9f7ab05fee14deb5b8beb08b4c8fcf3bee32a74180508" Jul 10 22:14:14.163806 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:14.163776 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de6a0242a24f3b5068a9f7ab05fee14deb5b8beb08b4c8fcf3bee32a74180508"} err="failed to get container status \"de6a0242a24f3b5068a9f7ab05fee14deb5b8beb08b4c8fcf3bee32a74180508\": rpc error: code = NotFound desc = could not find container \"de6a0242a24f3b5068a9f7ab05fee14deb5b8beb08b4c8fcf3bee32a74180508\": container with ID starting with de6a0242a24f3b5068a9f7ab05fee14deb5b8beb08b4c8fcf3bee32a74180508 not found: ID does not exist" Jul 10 22:14:14.170384 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:14.170362 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4rgz5"] Jul 10 22:14:14.174058 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:14.174040 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4rgz5"] Jul 10 22:14:15.630466 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:15.630430 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ee1e74d-9157-4f86-83b8-9b6b470e5ddc" path="/var/lib/kubelet/pods/9ee1e74d-9157-4f86-83b8-9b6b470e5ddc/volumes" Jul 10 22:14:20.655497 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:20.655449 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-s4fgg" Jul 10 22:14:20.655902 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:20.655517 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-s4fgg" Jul 10 22:14:20.677208 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:20.677183 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-s4fgg" Jul 10 22:14:21.205560 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:21.205530 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-s4fgg" Jul 10 22:14:38.176506 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:38.176476 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl"] Jul 10 22:14:38.176910 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:38.176756 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ee1e74d-9157-4f86-83b8-9b6b470e5ddc" containerName="registry-server" Jul 10 22:14:38.176910 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:38.176766 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ee1e74d-9157-4f86-83b8-9b6b470e5ddc" containerName="registry-server" Jul 10 22:14:38.176910 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:38.176823 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ee1e74d-9157-4f86-83b8-9b6b470e5ddc" containerName="registry-server" Jul 10 22:14:38.181659 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:38.181643 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl" Jul 10 22:14:38.184248 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:38.184227 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hg5dx\"" Jul 10 22:14:38.200826 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:38.200803 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl"] Jul 10 22:14:38.242837 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:38.242802 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9kn8\" (UniqueName: \"kubernetes.io/projected/89c10a76-0ea7-4709-9d68-da8b0ed75fdd-kube-api-access-g9kn8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xb9zl\" (UID: \"89c10a76-0ea7-4709-9d68-da8b0ed75fdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl" Jul 10 22:14:38.242982 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:38.242845 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89c10a76-0ea7-4709-9d68-da8b0ed75fdd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xb9zl\" (UID: \"89c10a76-0ea7-4709-9d68-da8b0ed75fdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl" Jul 10 22:14:38.343735 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:38.343702 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9kn8\" (UniqueName: \"kubernetes.io/projected/89c10a76-0ea7-4709-9d68-da8b0ed75fdd-kube-api-access-g9kn8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xb9zl\" (UID: \"89c10a76-0ea7-4709-9d68-da8b0ed75fdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl" Jul 10 22:14:38.343914 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:38.343742 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89c10a76-0ea7-4709-9d68-da8b0ed75fdd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xb9zl\" (UID: \"89c10a76-0ea7-4709-9d68-da8b0ed75fdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl" Jul 10 22:14:38.344098 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:38.344081 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89c10a76-0ea7-4709-9d68-da8b0ed75fdd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xb9zl\" (UID: \"89c10a76-0ea7-4709-9d68-da8b0ed75fdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl" Jul 10 22:14:38.352680 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:38.352656 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9kn8\" (UniqueName: \"kubernetes.io/projected/89c10a76-0ea7-4709-9d68-da8b0ed75fdd-kube-api-access-g9kn8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xb9zl\" (UID: \"89c10a76-0ea7-4709-9d68-da8b0ed75fdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl" Jul 10 22:14:38.491092 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:38.491005 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl" Jul 10 22:14:38.619477 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:38.619447 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl"] Jul 10 22:14:38.622727 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:14:38.622700 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89c10a76_0ea7_4709_9d68_da8b0ed75fdd.slice/crio-28375a37feaadfacb8cb8124b716decfa3b29372835ff92ebf9a645daa98cabd WatchSource:0}: Error finding container 28375a37feaadfacb8cb8124b716decfa3b29372835ff92ebf9a645daa98cabd: Status 404 returned error can't find the container with id 28375a37feaadfacb8cb8124b716decfa3b29372835ff92ebf9a645daa98cabd Jul 10 22:14:39.254567 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:39.254527 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl" event={"ID":"89c10a76-0ea7-4709-9d68-da8b0ed75fdd","Type":"ContainerStarted","Data":"28375a37feaadfacb8cb8124b716decfa3b29372835ff92ebf9a645daa98cabd"} Jul 10 22:14:41.581317 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:41.581279 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbqmv"] Jul 10 22:14:41.584845 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:41.584822 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbqmv" Jul 10 22:14:41.587211 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:41.587187 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-8p4zs\"" Jul 10 22:14:41.595824 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:41.595774 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbqmv"] Jul 10 22:14:41.669515 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:41.669473 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chv52\" (UniqueName: \"kubernetes.io/projected/233decee-8709-454c-9897-95de8dd6d892-kube-api-access-chv52\") pod \"limitador-operator-controller-manager-859d7b78bd-tbqmv\" (UID: \"233decee-8709-454c-9897-95de8dd6d892\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbqmv" Jul 10 22:14:41.769898 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:41.769864 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chv52\" (UniqueName: \"kubernetes.io/projected/233decee-8709-454c-9897-95de8dd6d892-kube-api-access-chv52\") pod \"limitador-operator-controller-manager-859d7b78bd-tbqmv\" (UID: \"233decee-8709-454c-9897-95de8dd6d892\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbqmv" Jul 10 22:14:41.780668 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:41.780645 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chv52\" (UniqueName: \"kubernetes.io/projected/233decee-8709-454c-9897-95de8dd6d892-kube-api-access-chv52\") pod \"limitador-operator-controller-manager-859d7b78bd-tbqmv\" (UID: \"233decee-8709-454c-9897-95de8dd6d892\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbqmv" Jul 10 22:14:41.897511 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:41.897439 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbqmv" Jul 10 22:14:42.039330 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:42.039304 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbqmv"] Jul 10 22:14:42.041257 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:14:42.041228 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod233decee_8709_454c_9897_95de8dd6d892.slice/crio-7d6f47211bd9a8f8ed3e248d228bdde5c9a8d12f2a5ae1a8499211b595d3a323 WatchSource:0}: Error finding container 7d6f47211bd9a8f8ed3e248d228bdde5c9a8d12f2a5ae1a8499211b595d3a323: Status 404 returned error can't find the container with id 7d6f47211bd9a8f8ed3e248d228bdde5c9a8d12f2a5ae1a8499211b595d3a323 Jul 10 22:14:42.269860 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:42.269824 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbqmv" event={"ID":"233decee-8709-454c-9897-95de8dd6d892","Type":"ContainerStarted","Data":"7d6f47211bd9a8f8ed3e248d228bdde5c9a8d12f2a5ae1a8499211b595d3a323"} Jul 10 22:14:44.280202 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:44.280167 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbqmv" event={"ID":"233decee-8709-454c-9897-95de8dd6d892","Type":"ContainerStarted","Data":"f4b033cc80f3119411a80dad659ed8d45ba3c38f8f7a991c34918047304d5230"} Jul 10 22:14:44.280625 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:44.280230 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbqmv" Jul 10 22:14:44.303500 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:44.303448 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbqmv" podStartSLOduration=1.6652930970000002 podStartE2EDuration="3.303432353s" totalImagesPullingTime="1.638139256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:14:44.301180947 +0000 UTC m=+413.215118195" watchObservedRunningTime="2026-07-10 22:14:44.303432353 +0000 UTC m=+413.217369601" Jul 10 22:14:45.274596 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:45.274570 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jk9gf"] Jul 10 22:14:45.277938 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:45.277923 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jk9gf" Jul 10 22:14:45.280287 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:45.280267 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-45lsq\"" Jul 10 22:14:45.290786 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:45.290763 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jk9gf"] Jul 10 22:14:45.402429 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:45.402394 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkspd\" (UniqueName: \"kubernetes.io/projected/929820b1-a3ea-4d7d-ae86-d8a9c6db9068-kube-api-access-jkspd\") pod \"authorino-operator-75cc8d5cb7-jk9gf\" (UID: \"929820b1-a3ea-4d7d-ae86-d8a9c6db9068\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jk9gf" Jul 10 22:14:45.503287 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:45.503256 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkspd\" (UniqueName: \"kubernetes.io/projected/929820b1-a3ea-4d7d-ae86-d8a9c6db9068-kube-api-access-jkspd\") pod \"authorino-operator-75cc8d5cb7-jk9gf\" (UID: \"929820b1-a3ea-4d7d-ae86-d8a9c6db9068\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jk9gf" Jul 10 22:14:45.519319 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:45.519254 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkspd\" (UniqueName: \"kubernetes.io/projected/929820b1-a3ea-4d7d-ae86-d8a9c6db9068-kube-api-access-jkspd\") pod \"authorino-operator-75cc8d5cb7-jk9gf\" (UID: \"929820b1-a3ea-4d7d-ae86-d8a9c6db9068\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jk9gf" Jul 10 22:14:45.606251 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:45.606218 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jk9gf" Jul 10 22:14:45.739435 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:45.739401 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jk9gf"] Jul 10 22:14:45.742642 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:14:45.742609 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod929820b1_a3ea_4d7d_ae86_d8a9c6db9068.slice/crio-2e7c080f0c8676530203f7f05ec2357082155d8570d7a777bdaa43f3209ae236 WatchSource:0}: Error finding container 2e7c080f0c8676530203f7f05ec2357082155d8570d7a777bdaa43f3209ae236: Status 404 returned error can't find the container with id 2e7c080f0c8676530203f7f05ec2357082155d8570d7a777bdaa43f3209ae236 Jul 10 22:14:46.288875 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:46.288840 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl" event={"ID":"89c10a76-0ea7-4709-9d68-da8b0ed75fdd","Type":"ContainerStarted","Data":"5992a6c3f55f15b6c5febace0c7164605b13bb87d40e236e1b35cc4b09a81313"} Jul 10 22:14:46.289324 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:46.289019 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl" Jul 10 22:14:46.290017 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:46.289991 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jk9gf" event={"ID":"929820b1-a3ea-4d7d-ae86-d8a9c6db9068","Type":"ContainerStarted","Data":"2e7c080f0c8676530203f7f05ec2357082155d8570d7a777bdaa43f3209ae236"} Jul 10 22:14:48.301006 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:48.300972 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jk9gf" event={"ID":"929820b1-a3ea-4d7d-ae86-d8a9c6db9068","Type":"ContainerStarted","Data":"36e624f1d831258424e5939c508c0608f8888a42b4564905291233a4f12f2697"} Jul 10 22:14:48.301399 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:48.301092 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jk9gf" Jul 10 22:14:48.319561 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:48.319505 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl" podStartSLOduration=3.682785922 podStartE2EDuration="10.319486136s" totalImagesPullingTime="6.636700214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:14:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:14:46.316924958 +0000 UTC m=+415.230862208" watchObservedRunningTime="2026-07-10 22:14:48.319486136 +0000 UTC m=+417.233423385" Jul 10 22:14:48.319916 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:48.319883 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jk9gf" podStartSLOduration=1.165181602 podStartE2EDuration="3.319873532s" totalImagesPullingTime="2.15469193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:14:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:14:48.317189989 +0000 UTC m=+417.231127238" watchObservedRunningTime="2026-07-10 22:14:48.319873532 +0000 UTC m=+417.233810781" Jul 10 22:14:48.360492 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:48.360459 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-wjfxf"] Jul 10 22:14:48.363785 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:48.363760 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wjfxf" Jul 10 22:14:48.366196 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:48.366174 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 10 22:14:48.366401 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:48.366236 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nd8wm\"" Jul 10 22:14:48.366495 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:48.366443 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 10 22:14:48.375773 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:48.375749 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-wjfxf"] Jul 10 22:14:48.427630 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:48.427594 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7f01f28d-74e6-41fa-9957-f735cd2094d8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-wjfxf\" (UID: \"7f01f28d-74e6-41fa-9957-f735cd2094d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wjfxf" Jul 10 22:14:48.427630 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:48.427629 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl49r\" (UniqueName: \"kubernetes.io/projected/7f01f28d-74e6-41fa-9957-f735cd2094d8-kube-api-access-kl49r\") pod \"kuadrant-console-plugin-66b5774985-wjfxf\" (UID: \"7f01f28d-74e6-41fa-9957-f735cd2094d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wjfxf" Jul 10 22:14:48.427818 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:48.427715 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f01f28d-74e6-41fa-9957-f735cd2094d8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-wjfxf\" (UID: \"7f01f28d-74e6-41fa-9957-f735cd2094d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wjfxf" Jul 10 22:14:48.528779 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:48.528739 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f01f28d-74e6-41fa-9957-f735cd2094d8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-wjfxf\" (UID: \"7f01f28d-74e6-41fa-9957-f735cd2094d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wjfxf" Jul 10 22:14:48.528930 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:48.528817 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7f01f28d-74e6-41fa-9957-f735cd2094d8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-wjfxf\" (UID: \"7f01f28d-74e6-41fa-9957-f735cd2094d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wjfxf" Jul 10 22:14:48.528930 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:48.528845 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl49r\" (UniqueName: \"kubernetes.io/projected/7f01f28d-74e6-41fa-9957-f735cd2094d8-kube-api-access-kl49r\") pod \"kuadrant-console-plugin-66b5774985-wjfxf\" (UID: \"7f01f28d-74e6-41fa-9957-f735cd2094d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wjfxf" Jul 10 22:14:48.528930 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:14:48.528897 2578 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 10 22:14:48.529026 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:14:48.528972 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f01f28d-74e6-41fa-9957-f735cd2094d8-plugin-serving-cert podName:7f01f28d-74e6-41fa-9957-f735cd2094d8 nodeName:}" failed. No retries permitted until 2026-07-10 22:14:49.028951258 +0000 UTC m=+417.942888499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/7f01f28d-74e6-41fa-9957-f735cd2094d8-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-wjfxf" (UID: "7f01f28d-74e6-41fa-9957-f735cd2094d8") : secret "plugin-serving-cert" not found Jul 10 22:14:48.529480 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:48.529462 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7f01f28d-74e6-41fa-9957-f735cd2094d8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-wjfxf\" (UID: \"7f01f28d-74e6-41fa-9957-f735cd2094d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wjfxf" Jul 10 22:14:48.540044 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:48.540021 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl49r\" (UniqueName: \"kubernetes.io/projected/7f01f28d-74e6-41fa-9957-f735cd2094d8-kube-api-access-kl49r\") pod \"kuadrant-console-plugin-66b5774985-wjfxf\" (UID: \"7f01f28d-74e6-41fa-9957-f735cd2094d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wjfxf" Jul 10 22:14:49.033826 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:49.033784 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f01f28d-74e6-41fa-9957-f735cd2094d8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-wjfxf\" (UID: \"7f01f28d-74e6-41fa-9957-f735cd2094d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wjfxf" Jul 10 22:14:49.036039 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:49.036021 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f01f28d-74e6-41fa-9957-f735cd2094d8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-wjfxf\" (UID: \"7f01f28d-74e6-41fa-9957-f735cd2094d8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wjfxf" Jul 10 22:14:49.273383 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:49.273331 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wjfxf" Jul 10 22:14:49.399174 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:49.399146 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-wjfxf"] Jul 10 22:14:49.401567 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:14:49.401528 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f01f28d_74e6_41fa_9957_f735cd2094d8.slice/crio-d9856073f629f67b8944de5f9fdfa035cb99ab1a6d1948ec62d9785e9140b169 WatchSource:0}: Error finding container d9856073f629f67b8944de5f9fdfa035cb99ab1a6d1948ec62d9785e9140b169: Status 404 returned error can't find the container with id d9856073f629f67b8944de5f9fdfa035cb99ab1a6d1948ec62d9785e9140b169 Jul 10 22:14:50.310959 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:50.310918 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wjfxf" event={"ID":"7f01f28d-74e6-41fa-9957-f735cd2094d8","Type":"ContainerStarted","Data":"d9856073f629f67b8944de5f9fdfa035cb99ab1a6d1948ec62d9785e9140b169"} Jul 10 22:14:55.287153 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:55.286973 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbqmv" Jul 10 22:14:57.297738 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:57.297703 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl" Jul 10 22:14:58.991406 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:58.991371 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl"] Jul 10 22:14:58.991836 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:58.991593 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl" podUID="89c10a76-0ea7-4709-9d68-da8b0ed75fdd" containerName="manager" containerID="cri-o://5992a6c3f55f15b6c5febace0c7164605b13bb87d40e236e1b35cc4b09a81313" gracePeriod=2 Jul 10 22:14:59.031380 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.031313 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl"] Jul 10 22:14:59.049829 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.049791 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2s5b6"] Jul 10 22:14:59.050369 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.050303 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89c10a76-0ea7-4709-9d68-da8b0ed75fdd" containerName="manager" Jul 10 22:14:59.050369 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.050327 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="89c10a76-0ea7-4709-9d68-da8b0ed75fdd" containerName="manager" Jul 10 22:14:59.050604 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.050402 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="89c10a76-0ea7-4709-9d68-da8b0ed75fdd" containerName="manager" Jul 10 22:14:59.054227 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.054205 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2s5b6" Jul 10 22:14:59.056940 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:14:59.056866 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xb9zl\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="89c10a76-0ea7-4709-9d68-da8b0ed75fdd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl" Jul 10 22:14:59.060555 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.059691 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbqmv"] Jul 10 22:14:59.060555 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.059901 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbqmv" podUID="233decee-8709-454c-9897-95de8dd6d892" containerName="manager" containerID="cri-o://f4b033cc80f3119411a80dad659ed8d45ba3c38f8f7a991c34918047304d5230" gracePeriod=2 Jul 10 22:14:59.067017 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.066967 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbqmv"] Jul 10 22:14:59.077197 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.077172 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2s5b6"] Jul 10 22:14:59.094006 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.093978 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-86p5r"] Jul 10 22:14:59.094560 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.094531 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="233decee-8709-454c-9897-95de8dd6d892" containerName="manager" Jul 10 22:14:59.094710 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.094697 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="233decee-8709-454c-9897-95de8dd6d892" containerName="manager" Jul 10 22:14:59.094925 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.094903 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="233decee-8709-454c-9897-95de8dd6d892" containerName="manager" Jul 10 22:14:59.098160 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.098113 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-86p5r" Jul 10 22:14:59.111793 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:14:59.111678 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tbqmv\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="233decee-8709-454c-9897-95de8dd6d892" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbqmv" Jul 10 22:14:59.115315 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.115293 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-86p5r"] Jul 10 22:14:59.125516 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.125494 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmjhk\" (UniqueName: \"kubernetes.io/projected/a5593b2c-739e-4820-8a77-554b83258b55-kube-api-access-cmjhk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2s5b6\" (UID: \"a5593b2c-739e-4820-8a77-554b83258b55\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2s5b6" Jul 10 22:14:59.125617 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.125585 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5593b2c-739e-4820-8a77-554b83258b55-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2s5b6\" (UID: \"a5593b2c-739e-4820-8a77-554b83258b55\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2s5b6" Jul 10 22:14:59.139815 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:14:59.139780 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xb9zl\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="89c10a76-0ea7-4709-9d68-da8b0ed75fdd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl" Jul 10 22:14:59.226315 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.226271 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmjhk\" (UniqueName: \"kubernetes.io/projected/a5593b2c-739e-4820-8a77-554b83258b55-kube-api-access-cmjhk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2s5b6\" (UID: \"a5593b2c-739e-4820-8a77-554b83258b55\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2s5b6" Jul 10 22:14:59.226499 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.226349 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dmwb\" (UniqueName: \"kubernetes.io/projected/7facb195-6d13-4546-a8d8-dd4fd781bd62-kube-api-access-2dmwb\") pod \"kuadrant-operator-controller-manager-86878c769f-86p5r\" (UID: \"7facb195-6d13-4546-a8d8-dd4fd781bd62\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-86p5r" Jul 10 22:14:59.226499 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.226385 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7facb195-6d13-4546-a8d8-dd4fd781bd62-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-86p5r\" (UID: \"7facb195-6d13-4546-a8d8-dd4fd781bd62\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-86p5r" Jul 10 22:14:59.226499 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.226426 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5593b2c-739e-4820-8a77-554b83258b55-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2s5b6\" (UID: \"a5593b2c-739e-4820-8a77-554b83258b55\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2s5b6" Jul 10 22:14:59.226806 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.226788 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5593b2c-739e-4820-8a77-554b83258b55-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2s5b6\" (UID: \"a5593b2c-739e-4820-8a77-554b83258b55\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2s5b6" Jul 10 22:14:59.242383 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.242312 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmjhk\" (UniqueName: \"kubernetes.io/projected/a5593b2c-739e-4820-8a77-554b83258b55-kube-api-access-cmjhk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2s5b6\" (UID: \"a5593b2c-739e-4820-8a77-554b83258b55\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2s5b6" Jul 10 22:14:59.308628 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.308600 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jk9gf" Jul 10 22:14:59.312022 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:14:59.311984 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xb9zl\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="89c10a76-0ea7-4709-9d68-da8b0ed75fdd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl" Jul 10 22:14:59.314087 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:14:59.314055 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tbqmv\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="233decee-8709-454c-9897-95de8dd6d892" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbqmv" Jul 10 22:14:59.327542 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.327505 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dmwb\" (UniqueName: \"kubernetes.io/projected/7facb195-6d13-4546-a8d8-dd4fd781bd62-kube-api-access-2dmwb\") pod \"kuadrant-operator-controller-manager-86878c769f-86p5r\" (UID: \"7facb195-6d13-4546-a8d8-dd4fd781bd62\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-86p5r" Jul 10 22:14:59.327669 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.327555 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7facb195-6d13-4546-a8d8-dd4fd781bd62-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-86p5r\" (UID: \"7facb195-6d13-4546-a8d8-dd4fd781bd62\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-86p5r" Jul 10 22:14:59.328155 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.328099 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7facb195-6d13-4546-a8d8-dd4fd781bd62-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-86p5r\" (UID: \"7facb195-6d13-4546-a8d8-dd4fd781bd62\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-86p5r" Jul 10 22:14:59.344194 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.344167 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dmwb\" (UniqueName: \"kubernetes.io/projected/7facb195-6d13-4546-a8d8-dd4fd781bd62-kube-api-access-2dmwb\") pod \"kuadrant-operator-controller-manager-86878c769f-86p5r\" (UID: \"7facb195-6d13-4546-a8d8-dd4fd781bd62\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-86p5r" Jul 10 22:14:59.431867 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.431833 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2s5b6" Jul 10 22:14:59.439518 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.439486 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-86p5r" Jul 10 22:14:59.922436 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.922380 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-576f969444-xbc9f"] Jul 10 22:14:59.933246 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.933217 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:14:59.938283 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.938114 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 10 22:14:59.938283 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.938114 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 10 22:14:59.938283 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.938281 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8rjs5\"" Jul 10 22:14:59.938602 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.938410 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 10 22:14:59.938602 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.938549 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 10 22:14:59.939072 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.938839 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 10 22:14:59.939072 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.938887 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 10 22:14:59.940720 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.940674 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 10 22:14:59.943715 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.943696 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 10 22:14:59.947910 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:14:59.947889 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-576f969444-xbc9f"] Jul 10 22:15:00.032695 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:00.032657 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24947257-0fab-45f7-989e-025d9f71266d-console-serving-cert\") pod \"console-576f969444-xbc9f\" (UID: \"24947257-0fab-45f7-989e-025d9f71266d\") " pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:15:00.032695 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:00.032697 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24947257-0fab-45f7-989e-025d9f71266d-console-oauth-config\") pod \"console-576f969444-xbc9f\" (UID: \"24947257-0fab-45f7-989e-025d9f71266d\") " pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:15:00.033181 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:00.032754 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24947257-0fab-45f7-989e-025d9f71266d-service-ca\") pod \"console-576f969444-xbc9f\" (UID: \"24947257-0fab-45f7-989e-025d9f71266d\") " pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:15:00.033181 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:00.032788 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24947257-0fab-45f7-989e-025d9f71266d-trusted-ca-bundle\") pod \"console-576f969444-xbc9f\" (UID: \"24947257-0fab-45f7-989e-025d9f71266d\") " pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:15:00.033181 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:00.032820 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xr2n\" (UniqueName: \"kubernetes.io/projected/24947257-0fab-45f7-989e-025d9f71266d-kube-api-access-9xr2n\") pod \"console-576f969444-xbc9f\" (UID: \"24947257-0fab-45f7-989e-025d9f71266d\") " pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:15:00.033181 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:00.032929 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24947257-0fab-45f7-989e-025d9f71266d-oauth-serving-cert\") pod \"console-576f969444-xbc9f\" (UID: \"24947257-0fab-45f7-989e-025d9f71266d\") " pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:15:00.033181 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:00.032979 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24947257-0fab-45f7-989e-025d9f71266d-console-config\") pod \"console-576f969444-xbc9f\" (UID: \"24947257-0fab-45f7-989e-025d9f71266d\") " pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:15:00.133707 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:00.133662 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24947257-0fab-45f7-989e-025d9f71266d-trusted-ca-bundle\") pod \"console-576f969444-xbc9f\" (UID: \"24947257-0fab-45f7-989e-025d9f71266d\") " pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:15:00.133707 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:00.133711 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xr2n\" (UniqueName: \"kubernetes.io/projected/24947257-0fab-45f7-989e-025d9f71266d-kube-api-access-9xr2n\") pod \"console-576f969444-xbc9f\" (UID: \"24947257-0fab-45f7-989e-025d9f71266d\") " pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:15:00.133956 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:00.133754 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24947257-0fab-45f7-989e-025d9f71266d-oauth-serving-cert\") pod \"console-576f969444-xbc9f\" (UID: \"24947257-0fab-45f7-989e-025d9f71266d\") " pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:15:00.133956 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:00.133783 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24947257-0fab-45f7-989e-025d9f71266d-console-config\") pod \"console-576f969444-xbc9f\" (UID: \"24947257-0fab-45f7-989e-025d9f71266d\") " pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:15:00.133956 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:00.133837 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24947257-0fab-45f7-989e-025d9f71266d-console-serving-cert\") pod \"console-576f969444-xbc9f\" (UID: \"24947257-0fab-45f7-989e-025d9f71266d\") " pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:15:00.133956 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:00.133861 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24947257-0fab-45f7-989e-025d9f71266d-console-oauth-config\") pod \"console-576f969444-xbc9f\" (UID: \"24947257-0fab-45f7-989e-025d9f71266d\") " pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:15:00.133956 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:00.133895 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24947257-0fab-45f7-989e-025d9f71266d-service-ca\") pod \"console-576f969444-xbc9f\" (UID: \"24947257-0fab-45f7-989e-025d9f71266d\") " pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:15:00.134594 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:00.134566 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24947257-0fab-45f7-989e-025d9f71266d-console-config\") pod \"console-576f969444-xbc9f\" (UID: \"24947257-0fab-45f7-989e-025d9f71266d\") " pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:15:00.134703 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:00.134624 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24947257-0fab-45f7-989e-025d9f71266d-oauth-serving-cert\") pod \"console-576f969444-xbc9f\" (UID: \"24947257-0fab-45f7-989e-025d9f71266d\") " pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:15:00.134969 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:00.134948 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24947257-0fab-45f7-989e-025d9f71266d-service-ca\") pod \"console-576f969444-xbc9f\" (UID: \"24947257-0fab-45f7-989e-025d9f71266d\") " pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:15:00.135392 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:00.135243 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24947257-0fab-45f7-989e-025d9f71266d-trusted-ca-bundle\") pod \"console-576f969444-xbc9f\" (UID: \"24947257-0fab-45f7-989e-025d9f71266d\") " pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:15:00.136883 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:00.136858 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24947257-0fab-45f7-989e-025d9f71266d-console-oauth-config\") pod \"console-576f969444-xbc9f\" (UID: \"24947257-0fab-45f7-989e-025d9f71266d\") " pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:15:00.137050 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:00.137029 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24947257-0fab-45f7-989e-025d9f71266d-console-serving-cert\") pod \"console-576f969444-xbc9f\" (UID: \"24947257-0fab-45f7-989e-025d9f71266d\") " pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:15:00.146411 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:00.146388 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xr2n\" (UniqueName: \"kubernetes.io/projected/24947257-0fab-45f7-989e-025d9f71266d-kube-api-access-9xr2n\") pod \"console-576f969444-xbc9f\" (UID: \"24947257-0fab-45f7-989e-025d9f71266d\") " pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:15:00.246166 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:00.246055 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:15:10.979880 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:10.979844 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbqmv" Jul 10 22:15:10.980469 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:10.980444 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2s5b6"] Jul 10 22:15:10.981972 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:15:10.981950 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5593b2c_739e_4820_8a77_554b83258b55.slice/crio-179a071a0684b2c6589a956df7c6c74a507c1a99c6ac555840092d2c46f85893 WatchSource:0}: Error finding container 179a071a0684b2c6589a956df7c6c74a507c1a99c6ac555840092d2c46f85893: Status 404 returned error can't find the container with id 179a071a0684b2c6589a956df7c6c74a507c1a99c6ac555840092d2c46f85893 Jul 10 22:15:10.982060 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:15:10.981972 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tbqmv\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="233decee-8709-454c-9897-95de8dd6d892" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbqmv" Jul 10 22:15:10.984267 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:10.984017 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl" Jul 10 22:15:10.985830 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:15:10.985807 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tbqmv\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="233decee-8709-454c-9897-95de8dd6d892" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbqmv" Jul 10 22:15:10.987572 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:15:10.987544 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xb9zl\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="89c10a76-0ea7-4709-9d68-da8b0ed75fdd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl" Jul 10 22:15:11.131004 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.130972 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chv52\" (UniqueName: \"kubernetes.io/projected/233decee-8709-454c-9897-95de8dd6d892-kube-api-access-chv52\") pod \"233decee-8709-454c-9897-95de8dd6d892\" (UID: \"233decee-8709-454c-9897-95de8dd6d892\") " Jul 10 22:15:11.131223 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.131019 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9kn8\" (UniqueName: \"kubernetes.io/projected/89c10a76-0ea7-4709-9d68-da8b0ed75fdd-kube-api-access-g9kn8\") pod \"89c10a76-0ea7-4709-9d68-da8b0ed75fdd\" (UID: \"89c10a76-0ea7-4709-9d68-da8b0ed75fdd\") " Jul 10 22:15:11.131223 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.131053 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89c10a76-0ea7-4709-9d68-da8b0ed75fdd-extensions-socket-volume\") pod \"89c10a76-0ea7-4709-9d68-da8b0ed75fdd\" (UID: \"89c10a76-0ea7-4709-9d68-da8b0ed75fdd\") " Jul 10 22:15:11.131504 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.131472 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89c10a76-0ea7-4709-9d68-da8b0ed75fdd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "89c10a76-0ea7-4709-9d68-da8b0ed75fdd" (UID: "89c10a76-0ea7-4709-9d68-da8b0ed75fdd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 22:15:11.133117 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.133086 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/233decee-8709-454c-9897-95de8dd6d892-kube-api-access-chv52" (OuterVolumeSpecName: "kube-api-access-chv52") pod "233decee-8709-454c-9897-95de8dd6d892" (UID: "233decee-8709-454c-9897-95de8dd6d892"). InnerVolumeSpecName "kube-api-access-chv52". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 22:15:11.133117 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.133090 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89c10a76-0ea7-4709-9d68-da8b0ed75fdd-kube-api-access-g9kn8" (OuterVolumeSpecName: "kube-api-access-g9kn8") pod "89c10a76-0ea7-4709-9d68-da8b0ed75fdd" (UID: "89c10a76-0ea7-4709-9d68-da8b0ed75fdd"). InnerVolumeSpecName "kube-api-access-g9kn8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 22:15:11.213964 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.213877 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-86p5r"] Jul 10 22:15:11.216542 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.216521 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-576f969444-xbc9f"] Jul 10 22:15:11.217511 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:15:11.217490 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7facb195_6d13_4546_a8d8_dd4fd781bd62.slice/crio-30a6cca561535b99ebcf0156ba6422bddf1874789d0616aea2a6d7b8d00ae15e WatchSource:0}: Error finding container 30a6cca561535b99ebcf0156ba6422bddf1874789d0616aea2a6d7b8d00ae15e: Status 404 returned error can't find the container with id 30a6cca561535b99ebcf0156ba6422bddf1874789d0616aea2a6d7b8d00ae15e Jul 10 22:15:11.218195 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:15:11.218171 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24947257_0fab_45f7_989e_025d9f71266d.slice/crio-ffd0ea7f9a1a2fe4ecfd8cf20bda8ba0b2a99b031650b5ee4e7b0b60bb61ea07 WatchSource:0}: Error finding container ffd0ea7f9a1a2fe4ecfd8cf20bda8ba0b2a99b031650b5ee4e7b0b60bb61ea07: Status 404 returned error can't find the container with id ffd0ea7f9a1a2fe4ecfd8cf20bda8ba0b2a99b031650b5ee4e7b0b60bb61ea07 Jul 10 22:15:11.231639 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.231619 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chv52\" (UniqueName: \"kubernetes.io/projected/233decee-8709-454c-9897-95de8dd6d892-kube-api-access-chv52\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:15:11.231639 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.231639 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9kn8\" (UniqueName: \"kubernetes.io/projected/89c10a76-0ea7-4709-9d68-da8b0ed75fdd-kube-api-access-g9kn8\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:15:11.231747 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.231650 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89c10a76-0ea7-4709-9d68-da8b0ed75fdd-extensions-socket-volume\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:15:11.415833 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.415740 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wjfxf" event={"ID":"7f01f28d-74e6-41fa-9957-f735cd2094d8","Type":"ContainerStarted","Data":"dd3e4a59987e764f09f2f02f1e97a683e591bbdd02bd3251731cbe647f4b213e"} Jul 10 22:15:11.417318 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.417292 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-86p5r" event={"ID":"7facb195-6d13-4546-a8d8-dd4fd781bd62","Type":"ContainerStarted","Data":"000be74d5de0e24be375016d4eb8c0a386831c35d2e7ec2e0c69ab6852c6a688"} Jul 10 22:15:11.417440 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.417330 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-86p5r" event={"ID":"7facb195-6d13-4546-a8d8-dd4fd781bd62","Type":"ContainerStarted","Data":"30a6cca561535b99ebcf0156ba6422bddf1874789d0616aea2a6d7b8d00ae15e"} Jul 10 22:15:11.417440 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.417384 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-86p5r" Jul 10 22:15:11.418547 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.418511 2578 generic.go:356] "Generic (PLEG): container finished" podID="233decee-8709-454c-9897-95de8dd6d892" containerID="f4b033cc80f3119411a80dad659ed8d45ba3c38f8f7a991c34918047304d5230" exitCode=0 Jul 10 22:15:11.418665 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.418552 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbqmv" Jul 10 22:15:11.418665 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.418604 2578 scope.go:117] "RemoveContainer" containerID="f4b033cc80f3119411a80dad659ed8d45ba3c38f8f7a991c34918047304d5230" Jul 10 22:15:11.420265 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.420246 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-576f969444-xbc9f" event={"ID":"24947257-0fab-45f7-989e-025d9f71266d","Type":"ContainerStarted","Data":"98f5a6c280ba13127411ee1d94c3f7f363dc7060e54daa6bcb783aac96da86b4"} Jul 10 22:15:11.420429 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.420282 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-576f969444-xbc9f" event={"ID":"24947257-0fab-45f7-989e-025d9f71266d","Type":"ContainerStarted","Data":"ffd0ea7f9a1a2fe4ecfd8cf20bda8ba0b2a99b031650b5ee4e7b0b60bb61ea07"} Jul 10 22:15:11.422054 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.422029 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2s5b6" event={"ID":"a5593b2c-739e-4820-8a77-554b83258b55","Type":"ContainerStarted","Data":"3155ca8c6fbecdc1eaf80dd6f1a3a29ca24a6c057a45a39bb96d0b6288cd6d93"} Jul 10 22:15:11.422230 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.422075 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2s5b6" event={"ID":"a5593b2c-739e-4820-8a77-554b83258b55","Type":"ContainerStarted","Data":"179a071a0684b2c6589a956df7c6c74a507c1a99c6ac555840092d2c46f85893"} Jul 10 22:15:11.422230 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.422153 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2s5b6" Jul 10 22:15:11.426283 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.423800 2578 generic.go:356] "Generic (PLEG): container finished" podID="89c10a76-0ea7-4709-9d68-da8b0ed75fdd" containerID="5992a6c3f55f15b6c5febace0c7164605b13bb87d40e236e1b35cc4b09a81313" exitCode=0 Jul 10 22:15:11.426283 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.423841 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl" Jul 10 22:15:11.436692 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.431350 2578 scope.go:117] "RemoveContainer" containerID="f4b033cc80f3119411a80dad659ed8d45ba3c38f8f7a991c34918047304d5230" Jul 10 22:15:11.436692 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.434729 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wjfxf" podStartSLOduration=1.9364276459999998 podStartE2EDuration="23.434709914s" totalImagesPullingTime="21.498282268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:15:11.434218895 +0000 UTC m=+440.348156145" watchObservedRunningTime="2026-07-10 22:15:11.434709914 +0000 UTC m=+440.348647164" Jul 10 22:15:11.436692 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:15:11.436322 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tbqmv\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="233decee-8709-454c-9897-95de8dd6d892" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbqmv" Jul 10 22:15:11.436864 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:15:11.436664 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4b033cc80f3119411a80dad659ed8d45ba3c38f8f7a991c34918047304d5230\": container with ID starting with f4b033cc80f3119411a80dad659ed8d45ba3c38f8f7a991c34918047304d5230 not found: ID does not exist" containerID="f4b033cc80f3119411a80dad659ed8d45ba3c38f8f7a991c34918047304d5230" Jul 10 22:15:11.436864 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.436730 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4b033cc80f3119411a80dad659ed8d45ba3c38f8f7a991c34918047304d5230"} err="failed to get container status \"f4b033cc80f3119411a80dad659ed8d45ba3c38f8f7a991c34918047304d5230\": rpc error: code = NotFound desc = could not find container \"f4b033cc80f3119411a80dad659ed8d45ba3c38f8f7a991c34918047304d5230\": container with ID starting with f4b033cc80f3119411a80dad659ed8d45ba3c38f8f7a991c34918047304d5230 not found: ID does not exist" Jul 10 22:15:11.436864 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.436756 2578 scope.go:117] "RemoveContainer" containerID="5992a6c3f55f15b6c5febace0c7164605b13bb87d40e236e1b35cc4b09a81313" Jul 10 22:15:11.438113 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:15:11.438089 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xb9zl\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="89c10a76-0ea7-4709-9d68-da8b0ed75fdd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl" Jul 10 22:15:11.445833 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.445814 2578 scope.go:117] "RemoveContainer" containerID="5992a6c3f55f15b6c5febace0c7164605b13bb87d40e236e1b35cc4b09a81313" Jul 10 22:15:11.446095 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:15:11.446076 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5992a6c3f55f15b6c5febace0c7164605b13bb87d40e236e1b35cc4b09a81313\": container with ID starting with 5992a6c3f55f15b6c5febace0c7164605b13bb87d40e236e1b35cc4b09a81313 not found: ID does not exist" containerID="5992a6c3f55f15b6c5febace0c7164605b13bb87d40e236e1b35cc4b09a81313" Jul 10 22:15:11.446188 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.446102 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5992a6c3f55f15b6c5febace0c7164605b13bb87d40e236e1b35cc4b09a81313"} err="failed to get container status \"5992a6c3f55f15b6c5febace0c7164605b13bb87d40e236e1b35cc4b09a81313\": rpc error: code = NotFound desc = could not find container \"5992a6c3f55f15b6c5febace0c7164605b13bb87d40e236e1b35cc4b09a81313\": container with ID starting with 5992a6c3f55f15b6c5febace0c7164605b13bb87d40e236e1b35cc4b09a81313 not found: ID does not exist" Jul 10 22:15:11.460111 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.460061 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-86p5r" podStartSLOduration=12.46004269 podStartE2EDuration="12.46004269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:14:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:15:11.45894652 +0000 UTC m=+440.372883751" watchObservedRunningTime="2026-07-10 22:15:11.46004269 +0000 UTC m=+440.373979939" Jul 10 22:15:11.460918 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:15:11.460889 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tbqmv\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="233decee-8709-454c-9897-95de8dd6d892" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbqmv" Jul 10 22:15:11.482136 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.482081 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-576f969444-xbc9f" podStartSLOduration=12.482067219 podStartE2EDuration="12.482067219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:14:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:15:11.48029257 +0000 UTC m=+440.394229821" watchObservedRunningTime="2026-07-10 22:15:11.482067219 +0000 UTC m=+440.396004468" Jul 10 22:15:11.500098 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.500058 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2s5b6" podStartSLOduration=12.500044678 podStartE2EDuration="12.500044678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:14:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:15:11.49842659 +0000 UTC m=+440.412363836" watchObservedRunningTime="2026-07-10 22:15:11.500044678 +0000 UTC m=+440.413981927" Jul 10 22:15:11.500343 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:15:11.500316 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xb9zl\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="89c10a76-0ea7-4709-9d68-da8b0ed75fdd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl" Jul 10 22:15:11.501893 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:15:11.501873 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tbqmv\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="233decee-8709-454c-9897-95de8dd6d892" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbqmv" Jul 10 22:15:11.503215 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:15:11.503196 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xb9zl\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="89c10a76-0ea7-4709-9d68-da8b0ed75fdd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl" Jul 10 22:15:11.629638 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:15:11.629599 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tbqmv\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="233decee-8709-454c-9897-95de8dd6d892" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tbqmv" Jul 10 22:15:11.631302 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:15:11.631273 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xb9zl\" is forbidden: User \"system:node:ip-10-0-142-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-236.ec2.internal' and this object" podUID="89c10a76-0ea7-4709-9d68-da8b0ed75fdd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xb9zl" Jul 10 22:15:11.633632 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.633611 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="233decee-8709-454c-9897-95de8dd6d892" path="/var/lib/kubelet/pods/233decee-8709-454c-9897-95de8dd6d892/volumes" Jul 10 22:15:11.634245 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:11.634224 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89c10a76-0ea7-4709-9d68-da8b0ed75fdd" path="/var/lib/kubelet/pods/89c10a76-0ea7-4709-9d68-da8b0ed75fdd/volumes" Jul 10 22:15:20.246907 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:20.246830 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:15:20.246907 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:20.246885 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:15:20.251202 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:20.251184 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:15:20.467053 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:20.467024 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-576f969444-xbc9f" Jul 10 22:15:22.432732 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:22.432699 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2s5b6" Jul 10 22:15:22.433202 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:22.432780 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-86p5r" Jul 10 22:15:22.506781 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:22.506749 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2s5b6"] Jul 10 22:15:22.506988 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:22.506922 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2s5b6" podUID="a5593b2c-739e-4820-8a77-554b83258b55" containerName="manager" containerID="cri-o://3155ca8c6fbecdc1eaf80dd6f1a3a29ca24a6c057a45a39bb96d0b6288cd6d93" gracePeriod=10 Jul 10 22:15:23.328099 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:23.328073 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2s5b6" Jul 10 22:15:23.335249 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:23.335226 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmjhk\" (UniqueName: \"kubernetes.io/projected/a5593b2c-739e-4820-8a77-554b83258b55-kube-api-access-cmjhk\") pod \"a5593b2c-739e-4820-8a77-554b83258b55\" (UID: \"a5593b2c-739e-4820-8a77-554b83258b55\") " Jul 10 22:15:23.335351 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:23.335296 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5593b2c-739e-4820-8a77-554b83258b55-extensions-socket-volume\") pod \"a5593b2c-739e-4820-8a77-554b83258b55\" (UID: \"a5593b2c-739e-4820-8a77-554b83258b55\") " Jul 10 22:15:23.335700 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:23.335678 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5593b2c-739e-4820-8a77-554b83258b55-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a5593b2c-739e-4820-8a77-554b83258b55" (UID: "a5593b2c-739e-4820-8a77-554b83258b55"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 22:15:23.337206 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:23.337181 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5593b2c-739e-4820-8a77-554b83258b55-kube-api-access-cmjhk" (OuterVolumeSpecName: "kube-api-access-cmjhk") pod "a5593b2c-739e-4820-8a77-554b83258b55" (UID: "a5593b2c-739e-4820-8a77-554b83258b55"). InnerVolumeSpecName "kube-api-access-cmjhk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 22:15:23.436259 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:23.436193 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5593b2c-739e-4820-8a77-554b83258b55-extensions-socket-volume\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:15:23.436259 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:23.436216 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmjhk\" (UniqueName: \"kubernetes.io/projected/a5593b2c-739e-4820-8a77-554b83258b55-kube-api-access-cmjhk\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:15:23.476458 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:23.476430 2578 generic.go:356] "Generic (PLEG): container finished" podID="a5593b2c-739e-4820-8a77-554b83258b55" containerID="3155ca8c6fbecdc1eaf80dd6f1a3a29ca24a6c057a45a39bb96d0b6288cd6d93" exitCode=0 Jul 10 22:15:23.476584 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:23.476471 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2s5b6" Jul 10 22:15:23.476584 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:23.476482 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2s5b6" event={"ID":"a5593b2c-739e-4820-8a77-554b83258b55","Type":"ContainerDied","Data":"3155ca8c6fbecdc1eaf80dd6f1a3a29ca24a6c057a45a39bb96d0b6288cd6d93"} Jul 10 22:15:23.476584 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:23.476522 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2s5b6" event={"ID":"a5593b2c-739e-4820-8a77-554b83258b55","Type":"ContainerDied","Data":"179a071a0684b2c6589a956df7c6c74a507c1a99c6ac555840092d2c46f85893"} Jul 10 22:15:23.476584 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:23.476543 2578 scope.go:117] "RemoveContainer" containerID="3155ca8c6fbecdc1eaf80dd6f1a3a29ca24a6c057a45a39bb96d0b6288cd6d93" Jul 10 22:15:23.485994 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:23.485975 2578 scope.go:117] "RemoveContainer" containerID="3155ca8c6fbecdc1eaf80dd6f1a3a29ca24a6c057a45a39bb96d0b6288cd6d93" Jul 10 22:15:23.486263 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:15:23.486243 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3155ca8c6fbecdc1eaf80dd6f1a3a29ca24a6c057a45a39bb96d0b6288cd6d93\": container with ID starting with 3155ca8c6fbecdc1eaf80dd6f1a3a29ca24a6c057a45a39bb96d0b6288cd6d93 not found: ID does not exist" containerID="3155ca8c6fbecdc1eaf80dd6f1a3a29ca24a6c057a45a39bb96d0b6288cd6d93" Jul 10 22:15:23.486336 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:23.486274 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3155ca8c6fbecdc1eaf80dd6f1a3a29ca24a6c057a45a39bb96d0b6288cd6d93"} err="failed to get container status \"3155ca8c6fbecdc1eaf80dd6f1a3a29ca24a6c057a45a39bb96d0b6288cd6d93\": rpc error: code = NotFound desc = could not find container \"3155ca8c6fbecdc1eaf80dd6f1a3a29ca24a6c057a45a39bb96d0b6288cd6d93\": container with ID starting with 3155ca8c6fbecdc1eaf80dd6f1a3a29ca24a6c057a45a39bb96d0b6288cd6d93 not found: ID does not exist" Jul 10 22:15:23.501637 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:23.501615 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2s5b6"] Jul 10 22:15:23.505588 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:23.505569 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2s5b6"] Jul 10 22:15:23.630797 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:23.630765 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5593b2c-739e-4820-8a77-554b83258b55" path="/var/lib/kubelet/pods/a5593b2c-739e-4820-8a77-554b83258b55/volumes" Jul 10 22:15:38.805656 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:38.805618 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn"] Jul 10 22:15:38.806104 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:38.805922 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5593b2c-739e-4820-8a77-554b83258b55" containerName="manager" Jul 10 22:15:38.806104 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:38.805932 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5593b2c-739e-4820-8a77-554b83258b55" containerName="manager" Jul 10 22:15:38.806104 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:38.806002 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5593b2c-739e-4820-8a77-554b83258b55" containerName="manager" Jul 10 22:15:38.834216 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:38.834184 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn"] Jul 10 22:15:38.834355 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:38.834288 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:38.836596 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:38.836569 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 10 22:15:38.836745 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:38.836611 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-zbbxh\"" Jul 10 22:15:38.966506 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:38.966470 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66f95673-7cc0-4982-b91b-38516cfa1593-istio-data\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:38.966506 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:38.966505 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66f95673-7cc0-4982-b91b-38516cfa1593-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:38.966717 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:38.966526 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66f95673-7cc0-4982-b91b-38516cfa1593-credential-socket\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:38.966717 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:38.966546 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqmc8\" (UniqueName: \"kubernetes.io/projected/66f95673-7cc0-4982-b91b-38516cfa1593-kube-api-access-lqmc8\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:38.966717 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:38.966588 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66f95673-7cc0-4982-b91b-38516cfa1593-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:38.966717 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:38.966606 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66f95673-7cc0-4982-b91b-38516cfa1593-istio-token\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:38.966717 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:38.966655 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66f95673-7cc0-4982-b91b-38516cfa1593-workload-socket\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:38.966717 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:38.966682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66f95673-7cc0-4982-b91b-38516cfa1593-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:38.966717 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:38.966700 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66f95673-7cc0-4982-b91b-38516cfa1593-workload-certs\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:39.067479 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:39.067395 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66f95673-7cc0-4982-b91b-38516cfa1593-istio-token\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:39.067479 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:39.067441 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66f95673-7cc0-4982-b91b-38516cfa1593-workload-socket\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:39.067695 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:39.067561 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66f95673-7cc0-4982-b91b-38516cfa1593-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:39.067695 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:39.067601 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66f95673-7cc0-4982-b91b-38516cfa1593-workload-certs\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:39.067695 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:39.067675 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66f95673-7cc0-4982-b91b-38516cfa1593-istio-data\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:39.067850 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:39.067700 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66f95673-7cc0-4982-b91b-38516cfa1593-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:39.067850 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:39.067728 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66f95673-7cc0-4982-b91b-38516cfa1593-credential-socket\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:39.067850 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:39.067754 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqmc8\" (UniqueName: \"kubernetes.io/projected/66f95673-7cc0-4982-b91b-38516cfa1593-kube-api-access-lqmc8\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:39.067850 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:39.067797 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66f95673-7cc0-4982-b91b-38516cfa1593-workload-socket\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:39.067850 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:39.067799 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66f95673-7cc0-4982-b91b-38516cfa1593-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:39.068102 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:39.068050 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66f95673-7cc0-4982-b91b-38516cfa1593-istio-data\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:39.068184 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:39.068106 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66f95673-7cc0-4982-b91b-38516cfa1593-workload-certs\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:39.068358 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:39.068335 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66f95673-7cc0-4982-b91b-38516cfa1593-credential-socket\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:39.068475 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:39.068427 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66f95673-7cc0-4982-b91b-38516cfa1593-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:39.069812 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:39.069793 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66f95673-7cc0-4982-b91b-38516cfa1593-istio-envoy\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:39.070067 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:39.070051 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66f95673-7cc0-4982-b91b-38516cfa1593-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:39.076782 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:39.076752 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66f95673-7cc0-4982-b91b-38516cfa1593-istio-token\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:39.077785 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:39.077757 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqmc8\" (UniqueName: \"kubernetes.io/projected/66f95673-7cc0-4982-b91b-38516cfa1593-kube-api-access-lqmc8\") pod \"maas-default-gateway-openshift-default-5df9b4f89-p4tpn\" (UID: \"66f95673-7cc0-4982-b91b-38516cfa1593\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:39.145117 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:39.145092 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:39.283146 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:39.283099 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn"] Jul 10 22:15:39.286457 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:15:39.286428 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66f95673_7cc0_4982_b91b_38516cfa1593.slice/crio-01522e530f99962ad67d8f1d9836823a8cb106987dc1755c71c9e2b05212a2e9 WatchSource:0}: Error finding container 01522e530f99962ad67d8f1d9836823a8cb106987dc1755c71c9e2b05212a2e9: Status 404 returned error can't find the container with id 01522e530f99962ad67d8f1d9836823a8cb106987dc1755c71c9e2b05212a2e9 Jul 10 22:15:39.546090 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:39.546056 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" event={"ID":"66f95673-7cc0-4982-b91b-38516cfa1593","Type":"ContainerStarted","Data":"01522e530f99962ad67d8f1d9836823a8cb106987dc1755c71c9e2b05212a2e9"} Jul 10 22:15:41.858161 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:41.858103 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 22:15:41.858385 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:41.858191 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 22:15:41.858385 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:41.858219 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 22:15:42.563240 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:42.563202 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" event={"ID":"66f95673-7cc0-4982-b91b-38516cfa1593","Type":"ContainerStarted","Data":"e1b909982dc2097a0cc5dd9540d1fd316a601a2921d898547fcc4b0e525c5894"} Jul 10 22:15:42.584851 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:42.584804 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" podStartSLOduration=2.01554922 podStartE2EDuration="4.584789238s" totalImagesPullingTime="2.569240018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:15:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:15:42.584413841 +0000 UTC m=+471.498351092" watchObservedRunningTime="2026-07-10 22:15:42.584789238 +0000 UTC m=+471.498726486" Jul 10 22:15:43.145738 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:43.145705 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:43.150723 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:43.150697 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:43.567171 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:43.567142 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:43.568246 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:43.568218 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5df9b4f89-p4tpn" Jul 10 22:15:43.681494 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:43.681464 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j5hnc"] Jul 10 22:15:43.684042 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:43.684022 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-j5hnc" Jul 10 22:15:43.686510 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:43.686489 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 10 22:15:43.694460 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:43.694439 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j5hnc"] Jul 10 22:15:43.779194 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:43.779157 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j5hnc"] Jul 10 22:15:43.809442 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:43.809415 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5e58c337-b77d-4c64-86b5-9a78835e1b1f-config-file\") pod \"limitador-limitador-64c94fd64f-j5hnc\" (UID: \"5e58c337-b77d-4c64-86b5-9a78835e1b1f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j5hnc" Jul 10 22:15:43.809629 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:43.809473 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psxjb\" (UniqueName: \"kubernetes.io/projected/5e58c337-b77d-4c64-86b5-9a78835e1b1f-kube-api-access-psxjb\") pod \"limitador-limitador-64c94fd64f-j5hnc\" (UID: \"5e58c337-b77d-4c64-86b5-9a78835e1b1f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j5hnc" Jul 10 22:15:43.910528 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:43.910445 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psxjb\" (UniqueName: \"kubernetes.io/projected/5e58c337-b77d-4c64-86b5-9a78835e1b1f-kube-api-access-psxjb\") pod \"limitador-limitador-64c94fd64f-j5hnc\" (UID: \"5e58c337-b77d-4c64-86b5-9a78835e1b1f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j5hnc" Jul 10 22:15:43.910528 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:43.910501 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5e58c337-b77d-4c64-86b5-9a78835e1b1f-config-file\") pod \"limitador-limitador-64c94fd64f-j5hnc\" (UID: \"5e58c337-b77d-4c64-86b5-9a78835e1b1f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j5hnc" Jul 10 22:15:43.911097 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:43.911080 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5e58c337-b77d-4c64-86b5-9a78835e1b1f-config-file\") pod \"limitador-limitador-64c94fd64f-j5hnc\" (UID: \"5e58c337-b77d-4c64-86b5-9a78835e1b1f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j5hnc" Jul 10 22:15:43.919070 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:43.919042 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psxjb\" (UniqueName: \"kubernetes.io/projected/5e58c337-b77d-4c64-86b5-9a78835e1b1f-kube-api-access-psxjb\") pod \"limitador-limitador-64c94fd64f-j5hnc\" (UID: \"5e58c337-b77d-4c64-86b5-9a78835e1b1f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-j5hnc" Jul 10 22:15:43.995308 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:43.995277 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-j5hnc" Jul 10 22:15:44.132354 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:44.132181 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j5hnc"] Jul 10 22:15:44.134864 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:15:44.134833 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e58c337_b77d_4c64_86b5_9a78835e1b1f.slice/crio-cc749f98a8a62b465836439a3633e8a672a5ba82c40170627192460648086af4 WatchSource:0}: Error finding container cc749f98a8a62b465836439a3633e8a672a5ba82c40170627192460648086af4: Status 404 returned error can't find the container with id cc749f98a8a62b465836439a3633e8a672a5ba82c40170627192460648086af4 Jul 10 22:15:44.138548 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:44.138527 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vqmsf"] Jul 10 22:15:44.141568 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:44.141549 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vqmsf" Jul 10 22:15:44.161354 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:44.161295 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vqmsf"] Jul 10 22:15:44.189375 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:44.189340 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vqmsf"] Jul 10 22:15:44.213378 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:44.213347 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/950398aa-798c-4a7b-b820-e62b8392c3a9-config-file\") pod \"limitador-limitador-54d6d988d5-vqmsf\" (UID: \"950398aa-798c-4a7b-b820-e62b8392c3a9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vqmsf" Jul 10 22:15:44.213540 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:44.213406 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncrs4\" (UniqueName: \"kubernetes.io/projected/950398aa-798c-4a7b-b820-e62b8392c3a9-kube-api-access-ncrs4\") pod \"limitador-limitador-54d6d988d5-vqmsf\" (UID: \"950398aa-798c-4a7b-b820-e62b8392c3a9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vqmsf" Jul 10 22:15:44.314297 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:44.314263 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncrs4\" (UniqueName: \"kubernetes.io/projected/950398aa-798c-4a7b-b820-e62b8392c3a9-kube-api-access-ncrs4\") pod \"limitador-limitador-54d6d988d5-vqmsf\" (UID: \"950398aa-798c-4a7b-b820-e62b8392c3a9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vqmsf" Jul 10 22:15:44.314470 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:44.314334 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/950398aa-798c-4a7b-b820-e62b8392c3a9-config-file\") pod \"limitador-limitador-54d6d988d5-vqmsf\" (UID: \"950398aa-798c-4a7b-b820-e62b8392c3a9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vqmsf" Jul 10 22:15:44.314980 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:44.314959 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/950398aa-798c-4a7b-b820-e62b8392c3a9-config-file\") pod \"limitador-limitador-54d6d988d5-vqmsf\" (UID: \"950398aa-798c-4a7b-b820-e62b8392c3a9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vqmsf" Jul 10 22:15:44.323753 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:44.323729 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncrs4\" (UniqueName: \"kubernetes.io/projected/950398aa-798c-4a7b-b820-e62b8392c3a9-kube-api-access-ncrs4\") pod \"limitador-limitador-54d6d988d5-vqmsf\" (UID: \"950398aa-798c-4a7b-b820-e62b8392c3a9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vqmsf" Jul 10 22:15:44.456883 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:44.456854 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vqmsf" Jul 10 22:15:44.573628 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:44.573596 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-j5hnc" event={"ID":"5e58c337-b77d-4c64-86b5-9a78835e1b1f","Type":"ContainerStarted","Data":"cc749f98a8a62b465836439a3633e8a672a5ba82c40170627192460648086af4"} Jul 10 22:15:44.595877 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:44.595845 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vqmsf"] Jul 10 22:15:44.599186 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:15:44.599160 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod950398aa_798c_4a7b_b820_e62b8392c3a9.slice/crio-789e61e6c9dcc88e73838f665e243fdd4e962ff889d3b7097ef70dd278fe1597 WatchSource:0}: Error finding container 789e61e6c9dcc88e73838f665e243fdd4e962ff889d3b7097ef70dd278fe1597: Status 404 returned error can't find the container with id 789e61e6c9dcc88e73838f665e243fdd4e962ff889d3b7097ef70dd278fe1597 Jul 10 22:15:45.587582 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:45.587543 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vqmsf" event={"ID":"950398aa-798c-4a7b-b820-e62b8392c3a9","Type":"ContainerStarted","Data":"789e61e6c9dcc88e73838f665e243fdd4e962ff889d3b7097ef70dd278fe1597"} Jul 10 22:15:47.598109 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:47.598007 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vqmsf" event={"ID":"950398aa-798c-4a7b-b820-e62b8392c3a9","Type":"ContainerStarted","Data":"6a6b8a60507e0811ab48e604608c7c72d1243fde658ee1e922a53bdf5d7d9242"} Jul 10 22:15:47.598109 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:47.598071 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vqmsf" Jul 10 22:15:47.599442 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:47.599418 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-j5hnc" event={"ID":"5e58c337-b77d-4c64-86b5-9a78835e1b1f","Type":"ContainerStarted","Data":"7253045d696671e577bf69f1022b0d8125229e944c9b1d85501891e67f171e5a"} Jul 10 22:15:47.599557 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:47.599547 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-j5hnc" Jul 10 22:15:47.616272 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:47.616220 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-vqmsf" podStartSLOduration=0.945007906 podStartE2EDuration="3.616207108s" totalImagesPullingTime="2.671199202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:15:47.614186934 +0000 UTC m=+476.528124179" watchObservedRunningTime="2026-07-10 22:15:47.616207108 +0000 UTC m=+476.530144357" Jul 10 22:15:47.631228 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:47.631186 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-j5hnc" podStartSLOduration=1.503389223 podStartE2EDuration="4.631172097s" totalImagesPullingTime="3.127782874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:15:47.629837394 +0000 UTC m=+476.543774644" watchObservedRunningTime="2026-07-10 22:15:47.631172097 +0000 UTC m=+476.545109347" Jul 10 22:15:58.604945 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:58.604917 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vqmsf" Jul 10 22:15:58.605383 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:58.604979 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-j5hnc" Jul 10 22:15:58.685337 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:58.685303 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j5hnc"] Jul 10 22:15:58.685504 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:58.685461 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-j5hnc" podUID="5e58c337-b77d-4c64-86b5-9a78835e1b1f" containerName="limitador" containerID="cri-o://7253045d696671e577bf69f1022b0d8125229e944c9b1d85501891e67f171e5a" gracePeriod=30 Jul 10 22:15:59.626702 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:59.626675 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-j5hnc" Jul 10 22:15:59.658247 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:59.658210 2578 generic.go:356] "Generic (PLEG): container finished" podID="5e58c337-b77d-4c64-86b5-9a78835e1b1f" containerID="7253045d696671e577bf69f1022b0d8125229e944c9b1d85501891e67f171e5a" exitCode=0 Jul 10 22:15:59.658396 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:59.658255 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-j5hnc" Jul 10 22:15:59.658396 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:59.658290 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-j5hnc" event={"ID":"5e58c337-b77d-4c64-86b5-9a78835e1b1f","Type":"ContainerDied","Data":"7253045d696671e577bf69f1022b0d8125229e944c9b1d85501891e67f171e5a"} Jul 10 22:15:59.658396 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:59.658343 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-j5hnc" event={"ID":"5e58c337-b77d-4c64-86b5-9a78835e1b1f","Type":"ContainerDied","Data":"cc749f98a8a62b465836439a3633e8a672a5ba82c40170627192460648086af4"} Jul 10 22:15:59.658396 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:59.658369 2578 scope.go:117] "RemoveContainer" containerID="7253045d696671e577bf69f1022b0d8125229e944c9b1d85501891e67f171e5a" Jul 10 22:15:59.666447 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:59.666430 2578 scope.go:117] "RemoveContainer" containerID="7253045d696671e577bf69f1022b0d8125229e944c9b1d85501891e67f171e5a" Jul 10 22:15:59.666695 ip-10-0-142-236 kubenswrapper[2578]: E0710 22:15:59.666667 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7253045d696671e577bf69f1022b0d8125229e944c9b1d85501891e67f171e5a\": container with ID starting with 7253045d696671e577bf69f1022b0d8125229e944c9b1d85501891e67f171e5a not found: ID does not exist" containerID="7253045d696671e577bf69f1022b0d8125229e944c9b1d85501891e67f171e5a" Jul 10 22:15:59.666780 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:59.666698 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7253045d696671e577bf69f1022b0d8125229e944c9b1d85501891e67f171e5a"} err="failed to get container status \"7253045d696671e577bf69f1022b0d8125229e944c9b1d85501891e67f171e5a\": rpc error: code = NotFound desc = could not find container \"7253045d696671e577bf69f1022b0d8125229e944c9b1d85501891e67f171e5a\": container with ID starting with 7253045d696671e577bf69f1022b0d8125229e944c9b1d85501891e67f171e5a not found: ID does not exist" Jul 10 22:15:59.746531 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:59.746499 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5e58c337-b77d-4c64-86b5-9a78835e1b1f-config-file\") pod \"5e58c337-b77d-4c64-86b5-9a78835e1b1f\" (UID: \"5e58c337-b77d-4c64-86b5-9a78835e1b1f\") " Jul 10 22:15:59.746685 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:59.746565 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psxjb\" (UniqueName: \"kubernetes.io/projected/5e58c337-b77d-4c64-86b5-9a78835e1b1f-kube-api-access-psxjb\") pod \"5e58c337-b77d-4c64-86b5-9a78835e1b1f\" (UID: \"5e58c337-b77d-4c64-86b5-9a78835e1b1f\") " Jul 10 22:15:59.746888 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:59.746867 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e58c337-b77d-4c64-86b5-9a78835e1b1f-config-file" (OuterVolumeSpecName: "config-file") pod "5e58c337-b77d-4c64-86b5-9a78835e1b1f" (UID: "5e58c337-b77d-4c64-86b5-9a78835e1b1f"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 22:15:59.748668 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:59.748622 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e58c337-b77d-4c64-86b5-9a78835e1b1f-kube-api-access-psxjb" (OuterVolumeSpecName: "kube-api-access-psxjb") pod "5e58c337-b77d-4c64-86b5-9a78835e1b1f" (UID: "5e58c337-b77d-4c64-86b5-9a78835e1b1f"). InnerVolumeSpecName "kube-api-access-psxjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 22:15:59.847604 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:59.847577 2578 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5e58c337-b77d-4c64-86b5-9a78835e1b1f-config-file\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:15:59.847604 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:59.847598 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psxjb\" (UniqueName: \"kubernetes.io/projected/5e58c337-b77d-4c64-86b5-9a78835e1b1f-kube-api-access-psxjb\") on node \"ip-10-0-142-236.ec2.internal\" DevicePath \"\"" Jul 10 22:15:59.985286 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:59.985257 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j5hnc"] Jul 10 22:15:59.989867 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:15:59.989843 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-j5hnc"] Jul 10 22:16:01.631293 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:01.631263 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e58c337-b77d-4c64-86b5-9a78835e1b1f" path="/var/lib/kubelet/pods/5e58c337-b77d-4c64-86b5-9a78835e1b1f/volumes" Jul 10 22:16:22.555484 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:22.555456 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-nmdcq_ed4215ce-31dd-4a09-b41d-290a54cb1811/manager/0.log" Jul 10 22:16:22.690007 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:22.689982 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-86rkb_67fa5554-4028-470c-957c-b4c24a7feb8c/manager/0.log" Jul 10 22:16:22.806857 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:22.806783 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-z66s2_d1a2f16c-9b0f-4cfd-8c9f-1f63f077708c/server/0.log" Jul 10 22:16:22.919651 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:22.919625 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2ttr8_d21ce17f-1efc-4b19-ac4c-08f331548d35/manager/0.log" Jul 10 22:16:23.268821 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:23.268792 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dc77f46d4-rlpm7_7f20d8cc-385d-43ad-a05a-a6842827ee02/copy-manifests/0.log" Jul 10 22:16:23.281359 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:23.281328 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dc77f46d4-rlpm7_7f20d8cc-385d-43ad-a05a-a6842827ee02/manager/0.log" Jul 10 22:16:24.928359 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:24.928332 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jk9gf_929820b1-a3ea-4d7d-ae86-d8a9c6db9068/manager/0.log" Jul 10 22:16:25.156552 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:25.156524 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-wjfxf_7f01f28d-74e6-41fa-9957-f735cd2094d8/kuadrant-console-plugin/0.log" Jul 10 22:16:25.266444 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:25.266362 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-s4fgg_c9b8525e-d6ad-4ca6-890e-876398c4bd1d/registry-server/0.log" Jul 10 22:16:25.381944 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:25.381914 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-86p5r_7facb195-6d13-4546-a8d8-dd4fd781bd62/manager/0.log" Jul 10 22:16:25.493274 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:25.493247 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vqmsf_950398aa-798c-4a7b-b820-e62b8392c3a9/limitador/0.log" Jul 10 22:16:26.297011 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:26.296983 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545dc8f6c6-vzmtg_5d0f70f1-829d-45f3-9dba-1dacd15e1743/kube-auth-proxy/0.log" Jul 10 22:16:26.414731 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:26.414705 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df9b4f89-p4tpn_66f95673-7cc0-4982-b91b-38516cfa1593/istio-proxy/0.log" Jul 10 22:16:30.764022 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:30.763988 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-29sdj/must-gather-zdw5b"] Jul 10 22:16:30.764411 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:30.764314 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e58c337-b77d-4c64-86b5-9a78835e1b1f" containerName="limitador" Jul 10 22:16:30.764411 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:30.764325 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e58c337-b77d-4c64-86b5-9a78835e1b1f" containerName="limitador" Jul 10 22:16:30.764411 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:30.764402 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e58c337-b77d-4c64-86b5-9a78835e1b1f" containerName="limitador" Jul 10 22:16:30.771109 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:30.771088 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-29sdj/must-gather-zdw5b" Jul 10 22:16:30.773483 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:30.773459 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-29sdj\"/\"kube-root-ca.crt\"" Jul 10 22:16:30.774243 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:30.774226 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-29sdj\"/\"default-dockercfg-j4cxw\"" Jul 10 22:16:30.774348 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:30.774243 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-29sdj\"/\"openshift-service-ca.crt\"" Jul 10 22:16:30.778865 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:30.778842 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-29sdj/must-gather-zdw5b"] Jul 10 22:16:30.802630 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:30.802602 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nq8g\" (UniqueName: \"kubernetes.io/projected/b8ee61d4-9a0c-48ef-b472-9b9b7f6ee2ab-kube-api-access-7nq8g\") pod \"must-gather-zdw5b\" (UID: \"b8ee61d4-9a0c-48ef-b472-9b9b7f6ee2ab\") " pod="openshift-must-gather-29sdj/must-gather-zdw5b" Jul 10 22:16:30.802772 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:30.802751 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b8ee61d4-9a0c-48ef-b472-9b9b7f6ee2ab-must-gather-output\") pod \"must-gather-zdw5b\" (UID: \"b8ee61d4-9a0c-48ef-b472-9b9b7f6ee2ab\") " pod="openshift-must-gather-29sdj/must-gather-zdw5b" Jul 10 22:16:30.903732 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:30.903705 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nq8g\" (UniqueName: \"kubernetes.io/projected/b8ee61d4-9a0c-48ef-b472-9b9b7f6ee2ab-kube-api-access-7nq8g\") pod \"must-gather-zdw5b\" (UID: \"b8ee61d4-9a0c-48ef-b472-9b9b7f6ee2ab\") " pod="openshift-must-gather-29sdj/must-gather-zdw5b" Jul 10 22:16:30.903898 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:30.903749 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b8ee61d4-9a0c-48ef-b472-9b9b7f6ee2ab-must-gather-output\") pod \"must-gather-zdw5b\" (UID: \"b8ee61d4-9a0c-48ef-b472-9b9b7f6ee2ab\") " pod="openshift-must-gather-29sdj/must-gather-zdw5b" Jul 10 22:16:30.904021 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:30.904004 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b8ee61d4-9a0c-48ef-b472-9b9b7f6ee2ab-must-gather-output\") pod \"must-gather-zdw5b\" (UID: \"b8ee61d4-9a0c-48ef-b472-9b9b7f6ee2ab\") " pod="openshift-must-gather-29sdj/must-gather-zdw5b" Jul 10 22:16:30.911951 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:30.911922 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nq8g\" (UniqueName: \"kubernetes.io/projected/b8ee61d4-9a0c-48ef-b472-9b9b7f6ee2ab-kube-api-access-7nq8g\") pod \"must-gather-zdw5b\" (UID: \"b8ee61d4-9a0c-48ef-b472-9b9b7f6ee2ab\") " pod="openshift-must-gather-29sdj/must-gather-zdw5b" Jul 10 22:16:31.080852 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:31.080781 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-29sdj/must-gather-zdw5b" Jul 10 22:16:31.217156 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:31.217000 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-29sdj/must-gather-zdw5b"] Jul 10 22:16:31.219686 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:16:31.219655 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8ee61d4_9a0c_48ef_b472_9b9b7f6ee2ab.slice/crio-b0dabd94e9d0560b0d86cc83608c1639ebac6f9b7d5b8fc6fe6276c0cc3ab5f7 WatchSource:0}: Error finding container b0dabd94e9d0560b0d86cc83608c1639ebac6f9b7d5b8fc6fe6276c0cc3ab5f7: Status 404 returned error can't find the container with id b0dabd94e9d0560b0d86cc83608c1639ebac6f9b7d5b8fc6fe6276c0cc3ab5f7 Jul 10 22:16:31.814750 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:31.814710 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-29sdj/must-gather-zdw5b" event={"ID":"b8ee61d4-9a0c-48ef-b472-9b9b7f6ee2ab","Type":"ContainerStarted","Data":"b0dabd94e9d0560b0d86cc83608c1639ebac6f9b7d5b8fc6fe6276c0cc3ab5f7"} Jul 10 22:16:32.824306 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:32.824268 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-29sdj/must-gather-zdw5b" event={"ID":"b8ee61d4-9a0c-48ef-b472-9b9b7f6ee2ab","Type":"ContainerStarted","Data":"c50fec8405a93357f29e00d1f06ce355b50fdde004e59e2522eaf8e3eeed8809"} Jul 10 22:16:32.824765 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:32.824319 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-29sdj/must-gather-zdw5b" event={"ID":"b8ee61d4-9a0c-48ef-b472-9b9b7f6ee2ab","Type":"ContainerStarted","Data":"dad3f691dcc077400abd08ff201a7fd496e6a1c18abe5ba5572ea5a2eb303296"} Jul 10 22:16:32.842419 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:32.842368 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-29sdj/must-gather-zdw5b" podStartSLOduration=2.01360036 podStartE2EDuration="2.842350842s" totalImagesPullingTime="828.750482ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:16:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:16:32.841027064 +0000 UTC m=+521.754964316" watchObservedRunningTime="2026-07-10 22:16:32.842350842 +0000 UTC m=+521.756288125" Jul 10 22:16:33.640764 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:33.640732 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8qjtp_50d3b770-a6bb-4280-b6dc-6c1dfec697d1/global-pull-secret-syncer/0.log" Jul 10 22:16:33.832746 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:33.832716 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-j67dl_da2b4896-f7f4-43a2-a721-670b0c264462/konnectivity-agent/0.log" Jul 10 22:16:33.904355 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:33.904281 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-236.ec2.internal_6d92aa44007fbeeba58b77b0f3aaedc2/haproxy/0.log" Jul 10 22:16:39.024752 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:39.024723 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jk9gf_929820b1-a3ea-4d7d-ae86-d8a9c6db9068/manager/0.log" Jul 10 22:16:39.093040 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:39.093006 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-wjfxf_7f01f28d-74e6-41fa-9957-f735cd2094d8/kuadrant-console-plugin/0.log" Jul 10 22:16:39.124640 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:39.124612 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-s4fgg_c9b8525e-d6ad-4ca6-890e-876398c4bd1d/registry-server/0.log" Jul 10 22:16:39.156280 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:39.156251 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-86p5r_7facb195-6d13-4546-a8d8-dd4fd781bd62/manager/0.log" Jul 10 22:16:39.180865 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:39.180826 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vqmsf_950398aa-798c-4a7b-b820-e62b8392c3a9/limitador/0.log" Jul 10 22:16:41.562105 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:41.562072 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v4x5f_5159ee18-5f72-4a36-b728-517cb5c7a1f8/node-exporter/0.log" Jul 10 22:16:41.591196 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:41.591154 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v4x5f_5159ee18-5f72-4a36-b728-517cb5c7a1f8/kube-rbac-proxy/0.log" Jul 10 22:16:41.627836 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:41.627746 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v4x5f_5159ee18-5f72-4a36-b728-517cb5c7a1f8/init-textfile/0.log" Jul 10 22:16:43.616892 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:43.616807 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-29sdj/perf-node-gather-daemonset-bgf8g"] Jul 10 22:16:43.625042 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:43.625013 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-29sdj/perf-node-gather-daemonset-bgf8g" Jul 10 22:16:43.634519 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:43.634492 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-29sdj/perf-node-gather-daemonset-bgf8g"] Jul 10 22:16:43.725304 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:43.725271 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cc11529-1179-4ea5-9afe-8f23170f7053-lib-modules\") pod \"perf-node-gather-daemonset-bgf8g\" (UID: \"4cc11529-1179-4ea5-9afe-8f23170f7053\") " pod="openshift-must-gather-29sdj/perf-node-gather-daemonset-bgf8g" Jul 10 22:16:43.725570 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:43.725549 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4cc11529-1179-4ea5-9afe-8f23170f7053-proc\") pod \"perf-node-gather-daemonset-bgf8g\" (UID: \"4cc11529-1179-4ea5-9afe-8f23170f7053\") " pod="openshift-must-gather-29sdj/perf-node-gather-daemonset-bgf8g" Jul 10 22:16:43.725729 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:43.725709 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cc11529-1179-4ea5-9afe-8f23170f7053-sys\") pod \"perf-node-gather-daemonset-bgf8g\" (UID: \"4cc11529-1179-4ea5-9afe-8f23170f7053\") " pod="openshift-must-gather-29sdj/perf-node-gather-daemonset-bgf8g" Jul 10 22:16:43.725863 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:43.725743 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slfxg\" (UniqueName: \"kubernetes.io/projected/4cc11529-1179-4ea5-9afe-8f23170f7053-kube-api-access-slfxg\") pod \"perf-node-gather-daemonset-bgf8g\" (UID: \"4cc11529-1179-4ea5-9afe-8f23170f7053\") " pod="openshift-must-gather-29sdj/perf-node-gather-daemonset-bgf8g" Jul 10 22:16:43.725863 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:43.725792 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4cc11529-1179-4ea5-9afe-8f23170f7053-podres\") pod \"perf-node-gather-daemonset-bgf8g\" (UID: \"4cc11529-1179-4ea5-9afe-8f23170f7053\") " pod="openshift-must-gather-29sdj/perf-node-gather-daemonset-bgf8g" Jul 10 22:16:43.827169 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:43.827119 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4cc11529-1179-4ea5-9afe-8f23170f7053-proc\") pod \"perf-node-gather-daemonset-bgf8g\" (UID: \"4cc11529-1179-4ea5-9afe-8f23170f7053\") " pod="openshift-must-gather-29sdj/perf-node-gather-daemonset-bgf8g" Jul 10 22:16:43.827448 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:43.827428 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cc11529-1179-4ea5-9afe-8f23170f7053-sys\") pod \"perf-node-gather-daemonset-bgf8g\" (UID: \"4cc11529-1179-4ea5-9afe-8f23170f7053\") " pod="openshift-must-gather-29sdj/perf-node-gather-daemonset-bgf8g" Jul 10 22:16:43.827587 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:43.827571 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slfxg\" (UniqueName: \"kubernetes.io/projected/4cc11529-1179-4ea5-9afe-8f23170f7053-kube-api-access-slfxg\") pod \"perf-node-gather-daemonset-bgf8g\" (UID: \"4cc11529-1179-4ea5-9afe-8f23170f7053\") " pod="openshift-must-gather-29sdj/perf-node-gather-daemonset-bgf8g" Jul 10 22:16:43.827749 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:43.827731 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4cc11529-1179-4ea5-9afe-8f23170f7053-podres\") pod \"perf-node-gather-daemonset-bgf8g\" (UID: \"4cc11529-1179-4ea5-9afe-8f23170f7053\") " pod="openshift-must-gather-29sdj/perf-node-gather-daemonset-bgf8g" Jul 10 22:16:43.827910 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:43.827238 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4cc11529-1179-4ea5-9afe-8f23170f7053-proc\") pod \"perf-node-gather-daemonset-bgf8g\" (UID: \"4cc11529-1179-4ea5-9afe-8f23170f7053\") " pod="openshift-must-gather-29sdj/perf-node-gather-daemonset-bgf8g" Jul 10 22:16:43.828111 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:43.827511 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cc11529-1179-4ea5-9afe-8f23170f7053-sys\") pod \"perf-node-gather-daemonset-bgf8g\" (UID: \"4cc11529-1179-4ea5-9afe-8f23170f7053\") " pod="openshift-must-gather-29sdj/perf-node-gather-daemonset-bgf8g" Jul 10 22:16:43.828260 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:43.827887 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cc11529-1179-4ea5-9afe-8f23170f7053-lib-modules\") pod \"perf-node-gather-daemonset-bgf8g\" (UID: \"4cc11529-1179-4ea5-9afe-8f23170f7053\") " pod="openshift-must-gather-29sdj/perf-node-gather-daemonset-bgf8g" Jul 10 22:16:43.828400 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:43.827904 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4cc11529-1179-4ea5-9afe-8f23170f7053-podres\") pod \"perf-node-gather-daemonset-bgf8g\" (UID: \"4cc11529-1179-4ea5-9afe-8f23170f7053\") " pod="openshift-must-gather-29sdj/perf-node-gather-daemonset-bgf8g" Jul 10 22:16:43.828504 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:43.828002 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cc11529-1179-4ea5-9afe-8f23170f7053-lib-modules\") pod \"perf-node-gather-daemonset-bgf8g\" (UID: \"4cc11529-1179-4ea5-9afe-8f23170f7053\") " pod="openshift-must-gather-29sdj/perf-node-gather-daemonset-bgf8g" Jul 10 22:16:43.836232 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:43.836203 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slfxg\" (UniqueName: \"kubernetes.io/projected/4cc11529-1179-4ea5-9afe-8f23170f7053-kube-api-access-slfxg\") pod \"perf-node-gather-daemonset-bgf8g\" (UID: \"4cc11529-1179-4ea5-9afe-8f23170f7053\") " pod="openshift-must-gather-29sdj/perf-node-gather-daemonset-bgf8g" Jul 10 22:16:43.946291 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:43.946256 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-29sdj/perf-node-gather-daemonset-bgf8g" Jul 10 22:16:44.119540 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:44.119465 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-29sdj/perf-node-gather-daemonset-bgf8g"] Jul 10 22:16:44.125796 ip-10-0-142-236 kubenswrapper[2578]: W0710 22:16:44.125752 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4cc11529_1179_4ea5_9afe_8f23170f7053.slice/crio-c2c4ad981047f24edab2d58c38264dd4b44e40404f6ba108f7c8ea23c224a38e WatchSource:0}: Error finding container c2c4ad981047f24edab2d58c38264dd4b44e40404f6ba108f7c8ea23c224a38e: Status 404 returned error can't find the container with id c2c4ad981047f24edab2d58c38264dd4b44e40404f6ba108f7c8ea23c224a38e Jul 10 22:16:44.680217 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:44.680184 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-576f969444-xbc9f_24947257-0fab-45f7-989e-025d9f71266d/console/0.log" Jul 10 22:16:44.899456 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:44.899413 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-29sdj/perf-node-gather-daemonset-bgf8g" event={"ID":"4cc11529-1179-4ea5-9afe-8f23170f7053","Type":"ContainerStarted","Data":"723f854dcf9dc9a15cdc972b7be7209f80b71d085ffa36d21971cdeac95cfe8e"} Jul 10 22:16:44.899615 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:44.899480 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-29sdj/perf-node-gather-daemonset-bgf8g" event={"ID":"4cc11529-1179-4ea5-9afe-8f23170f7053","Type":"ContainerStarted","Data":"c2c4ad981047f24edab2d58c38264dd4b44e40404f6ba108f7c8ea23c224a38e"} Jul 10 22:16:44.900177 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:44.900155 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-29sdj/perf-node-gather-daemonset-bgf8g" Jul 10 22:16:44.921865 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:44.921800 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-29sdj/perf-node-gather-daemonset-bgf8g" podStartSLOduration=1.9217802389999998 podStartE2EDuration="1.921780239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:16:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:16:44.920210232 +0000 UTC m=+533.834147484" watchObservedRunningTime="2026-07-10 22:16:44.921780239 +0000 UTC m=+533.835717489" Jul 10 22:16:46.434681 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:46.434655 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s4gtz_c28a3232-980e-4224-9122-6d6d16856660/dns/0.log" Jul 10 22:16:46.459120 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:46.459090 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s4gtz_c28a3232-980e-4224-9122-6d6d16856660/kube-rbac-proxy/0.log" Jul 10 22:16:46.531414 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:46.531377 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ctkbw_81543b68-820c-44cd-b221-c379b5c27e7d/dns-node-resolver/0.log" Jul 10 22:16:47.146170 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:47.146120 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bjbhb_6729845a-5a43-4a34-91c1-58f0bd7b45a6/node-ca/0.log" Jul 10 22:16:48.242375 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:48.242347 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545dc8f6c6-vzmtg_5d0f70f1-829d-45f3-9dba-1dacd15e1743/kube-auth-proxy/0.log" Jul 10 22:16:48.272373 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:48.272338 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df9b4f89-p4tpn_66f95673-7cc0-4982-b91b-38516cfa1593/istio-proxy/0.log" Jul 10 22:16:48.979243 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:48.979219 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mzpnz_16b445d4-390f-490f-bdc7-2da3c70fa6dd/serve-healthcheck-canary/0.log" Jul 10 22:16:49.496618 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:49.496583 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hc8sp_b6c4c998-9c92-450c-abc7-1da46e0de252/kube-rbac-proxy/0.log" Jul 10 22:16:49.517186 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:49.517155 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hc8sp_b6c4c998-9c92-450c-abc7-1da46e0de252/exporter/0.log" Jul 10 22:16:49.538460 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:49.538436 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hc8sp_b6c4c998-9c92-450c-abc7-1da46e0de252/extractor/0.log" Jul 10 22:16:51.795198 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:51.795159 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-nmdcq_ed4215ce-31dd-4a09-b41d-290a54cb1811/manager/0.log" Jul 10 22:16:51.822335 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:51.822260 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-86rkb_67fa5554-4028-470c-957c-b4c24a7feb8c/manager/0.log" Jul 10 22:16:51.845600 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:51.845572 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-z66s2_d1a2f16c-9b0f-4cfd-8c9f-1f63f077708c/server/0.log" Jul 10 22:16:51.899728 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:51.899690 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2ttr8_d21ce17f-1efc-4b19-ac4c-08f331548d35/manager/0.log" Jul 10 22:16:51.923773 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:51.923750 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-29sdj/perf-node-gather-daemonset-bgf8g" Jul 10 22:16:52.056815 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:52.056789 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dc77f46d4-rlpm7_7f20d8cc-385d-43ad-a05a-a6842827ee02/manager/0.log" Jul 10 22:16:52.085232 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:52.085153 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dc77f46d4-rlpm7_7f20d8cc-385d-43ad-a05a-a6842827ee02/copy-manifests/0.log" Jul 10 22:16:53.944266 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:53.944238 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545dc8f6c6-vzmtg_5d0f70f1-829d-45f3-9dba-1dacd15e1743/kube-auth-proxy/0.log" Jul 10 22:16:53.968056 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:53.968025 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df9b4f89-p4tpn_66f95673-7cc0-4982-b91b-38516cfa1593/istio-proxy/0.log" Jul 10 22:16:55.259697 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:55.259596 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545dc8f6c6-vzmtg_5d0f70f1-829d-45f3-9dba-1dacd15e1743/kube-auth-proxy/0.log" Jul 10 22:16:55.279800 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:55.279771 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5df9b4f89-p4tpn_66f95673-7cc0-4982-b91b-38516cfa1593/istio-proxy/0.log" Jul 10 22:16:58.802729 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:58.802698 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-c7wjm_9aad5259-34dd-4598-804f-c751630acf0f/migrator/0.log" Jul 10 22:16:58.837337 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:58.837305 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-c7wjm_9aad5259-34dd-4598-804f-c751630acf0f/graceful-termination/0.log" Jul 10 22:16:59.331034 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:59.330970 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-8bvnm_858f95a5-4497-4267-9aec-d745abb6e57e/kube-storage-version-migrator-operator/1.log" Jul 10 22:16:59.331969 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:16:59.331947 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-8bvnm_858f95a5-4497-4267-9aec-d745abb6e57e/kube-storage-version-migrator-operator/0.log" Jul 10 22:17:00.872705 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:17:00.872672 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gpgqm_d632308b-166b-4f72-b311-f3a3c20d206c/kube-multus-additional-cni-plugins/0.log" Jul 10 22:17:00.903306 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:17:00.903273 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gpgqm_d632308b-166b-4f72-b311-f3a3c20d206c/egress-router-binary-copy/0.log" Jul 10 22:17:00.944148 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:17:00.944101 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gpgqm_d632308b-166b-4f72-b311-f3a3c20d206c/cni-plugins/0.log" Jul 10 22:17:00.974903 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:17:00.974875 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gpgqm_d632308b-166b-4f72-b311-f3a3c20d206c/bond-cni-plugin/0.log" Jul 10 22:17:01.000746 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:17:01.000719 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gpgqm_d632308b-166b-4f72-b311-f3a3c20d206c/routeoverride-cni/0.log" Jul 10 22:17:01.030050 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:17:01.030018 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gpgqm_d632308b-166b-4f72-b311-f3a3c20d206c/whereabouts-cni-bincopy/0.log" Jul 10 22:17:01.064653 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:17:01.064626 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gpgqm_d632308b-166b-4f72-b311-f3a3c20d206c/whereabouts-cni/0.log" Jul 10 22:17:01.463716 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:17:01.463691 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hrwzf_8b318bfc-cb4a-459a-9f6c-ed3246ec6334/kube-multus/0.log" Jul 10 22:17:01.645048 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:17:01.645020 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rbtmx_31e9f715-aeb8-4938-bc61-4bc61dd8c82a/network-metrics-daemon/0.log" Jul 10 22:17:01.668212 ip-10-0-142-236 kubenswrapper[2578]: I0710 22:17:01.668185 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rbtmx_31e9f715-aeb8-4938-bc61-4bc61dd8c82a/kube-rbac-proxy/0.log"