Jul 10 18:24:09.055756 ip-10-0-136-57 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 10 18:24:09.055768 ip-10-0-136-57 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 10 18:24:09.055777 ip-10-0-136-57 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 10 18:24:09.056134 ip-10-0-136-57 systemd[1]: Failed to start Kubernetes Kubelet. Jul 10 18:24:19.070126 ip-10-0-136-57 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 10 18:24:19.070142 ip-10-0-136-57 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c59d6978725b4aafb48b848369734db8 -- Jul 10 18:26:20.651968 ip-10-0-136-57 systemd[1]: Starting Kubernetes Kubelet... Jul 10 18:26:21.081133 ip-10-0-136-57 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 18:26:21.081133 ip-10-0-136-57 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 10 18:26:21.081133 ip-10-0-136-57 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 18:26:21.081133 ip-10-0-136-57 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 10 18:26:21.081133 ip-10-0-136-57 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 18:26:21.081133 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.027286 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 10 18:26:21.081133 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031339 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:26:21.081133 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031350 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:26:21.081133 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031354 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:26:21.081133 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031357 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:26:21.081133 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031360 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:26:21.081133 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031363 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:26:21.081133 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031366 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:26:21.081133 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031369 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:26:21.081883 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031375 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:26:21.081883 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031377 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:26:21.081883 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031380 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:26:21.081883 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031383 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:26:21.081883 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031386 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:26:21.081883 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031389 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:26:21.081883 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031391 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:26:21.081883 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031395 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:26:21.081883 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031398 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:26:21.081883 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031402 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:26:21.081883 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031404 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:26:21.081883 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031407 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:26:21.081883 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031410 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:26:21.081883 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031412 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:26:21.081883 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031415 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:26:21.081883 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031418 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:26:21.081883 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031420 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:26:21.081883 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031425 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:26:21.081883 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031430 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:26:21.082452 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031434 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:26:21.082452 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031438 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:26:21.082452 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031441 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:26:21.082452 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031444 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:26:21.082452 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031448 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:26:21.082452 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031451 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:26:21.082452 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031453 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:26:21.082452 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031456 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:26:21.082452 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031459 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:26:21.082452 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031462 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:26:21.082452 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031464 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:26:21.082452 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031467 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:26:21.082452 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031470 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:26:21.082452 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031472 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:26:21.082452 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031475 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:26:21.082452 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031477 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:26:21.082452 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031480 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:26:21.082452 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031483 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:26:21.082452 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031485 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:26:21.082452 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031489 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:26:21.082990 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031492 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:26:21.082990 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031496 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:26:21.082990 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031501 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:26:21.082990 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031503 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:26:21.082990 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031506 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:26:21.082990 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031509 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:26:21.082990 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031512 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:26:21.082990 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031515 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:26:21.082990 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031517 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:26:21.082990 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031520 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:26:21.082990 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031522 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:26:21.082990 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031525 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:26:21.082990 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031527 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:26:21.082990 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031530 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:26:21.082990 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031532 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:26:21.082990 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031535 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:26:21.082990 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031538 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:26:21.082990 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031541 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:26:21.082990 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031543 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:26:21.082990 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031546 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:26:21.083539 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031549 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:26:21.083539 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031552 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:26:21.083539 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031555 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:26:21.083539 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031558 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:26:21.083539 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031561 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:26:21.083539 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031563 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:26:21.083539 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031566 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:26:21.083539 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031568 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:26:21.083539 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031571 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:26:21.083539 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031573 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:26:21.083539 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031576 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:26:21.083539 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031580 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:26:21.083539 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031583 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:26:21.083539 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031585 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:26:21.083539 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031588 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:26:21.083539 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031591 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:26:21.083539 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031593 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:26:21.083539 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031596 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:26:21.083539 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031598 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:26:21.083539 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031601 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:26:21.084073 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031604 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:26:21.084073 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031606 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:26:21.084073 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031609 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:26:21.084073 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031611 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:26:21.084073 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031614 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:26:21.084073 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031616 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:26:21.084073 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031619 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:26:21.084073 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031621 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:26:21.084073 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031624 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:26:21.084073 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031626 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:26:21.084073 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031629 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:26:21.084073 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.031631 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:26:21.084073 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033509 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:26:21.084073 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033518 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:26:21.084073 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033521 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:26:21.084073 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033524 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:26:21.084073 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033528 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:26:21.084073 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033531 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:26:21.084073 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033534 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:26:21.084073 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033536 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:26:21.084629 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033539 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:26:21.084629 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033541 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:26:21.084629 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033544 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:26:21.084629 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033546 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:26:21.084629 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033549 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:26:21.084629 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033552 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:26:21.084629 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033554 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:26:21.084629 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033557 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:26:21.084629 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033560 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:26:21.084629 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033562 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:26:21.084629 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033565 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:26:21.084629 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033567 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:26:21.084629 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033570 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:26:21.084629 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033573 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:26:21.084629 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033577 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:26:21.084629 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033581 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:26:21.084629 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033584 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:26:21.084629 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033586 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:26:21.084629 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033589 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:26:21.085406 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033591 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:26:21.085406 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033594 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:26:21.085406 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033598 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:26:21.085406 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033602 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:26:21.085406 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033605 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:26:21.085406 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033608 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:26:21.085406 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033611 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:26:21.085406 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033615 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:26:21.085406 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033618 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:26:21.085406 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033621 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:26:21.085406 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033624 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:26:21.085406 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033627 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:26:21.085406 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033629 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:26:21.085406 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033631 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:26:21.085406 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033635 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:26:21.085406 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033637 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:26:21.085406 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033640 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:26:21.085406 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033644 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:26:21.085406 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033647 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:26:21.085974 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033649 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:26:21.085974 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033652 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:26:21.085974 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033655 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:26:21.085974 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033657 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:26:21.085974 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033660 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:26:21.085974 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033662 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:26:21.085974 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033665 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:26:21.085974 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033667 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:26:21.085974 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033670 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:26:21.085974 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033672 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:26:21.085974 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033675 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:26:21.085974 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033678 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:26:21.085974 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033680 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:26:21.085974 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033683 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:26:21.085974 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033685 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:26:21.085974 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033688 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:26:21.085974 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033690 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:26:21.085974 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033693 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:26:21.085974 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033710 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:26:21.085974 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033714 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:26:21.086594 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033717 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:26:21.086594 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033719 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:26:21.086594 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033723 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:26:21.086594 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033725 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:26:21.086594 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033728 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:26:21.086594 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033730 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:26:21.086594 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033733 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:26:21.086594 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033736 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:26:21.086594 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033739 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:26:21.086594 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033742 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:26:21.086594 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033744 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:26:21.086594 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033747 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:26:21.086594 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033750 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:26:21.086594 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033752 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:26:21.086594 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033754 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:26:21.086594 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033757 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:26:21.086594 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033760 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:26:21.086594 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033762 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:26:21.086594 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033765 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:26:21.086594 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033767 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:26:21.087136 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033770 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:26:21.087136 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033772 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:26:21.087136 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033775 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:26:21.087136 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033777 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:26:21.087136 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033779 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:26:21.087136 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033782 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:26:21.087136 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033785 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:26:21.087136 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033787 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:26:21.087136 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033790 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:26:21.087136 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033792 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:26:21.087136 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033795 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:26:21.087136 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033798 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:26:21.087136 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.033800 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:26:21.087136 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034161 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:26:21.087136 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034166 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:26:21.087136 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034169 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:26:21.087136 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034172 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:26:21.087136 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034175 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:26:21.087136 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034178 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:26:21.087136 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034180 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:26:21.087773 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034183 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:26:21.087773 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034185 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:26:21.087773 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034188 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:26:21.087773 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034190 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:26:21.087773 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034193 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:26:21.087773 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034196 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:26:21.087773 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034198 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:26:21.087773 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034201 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:26:21.087773 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034204 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:26:21.087773 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034206 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:26:21.087773 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034208 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:26:21.087773 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034211 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:26:21.087773 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034213 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:26:21.087773 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034216 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:26:21.087773 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034218 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:26:21.087773 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034221 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:26:21.087773 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034223 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:26:21.087773 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034226 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:26:21.087773 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034229 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:26:21.088478 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034232 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:26:21.088478 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034235 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:26:21.088478 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034237 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:26:21.088478 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034240 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:26:21.088478 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034242 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:26:21.088478 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034245 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:26:21.088478 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034248 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:26:21.088478 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034250 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:26:21.088478 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034253 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:26:21.088478 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034255 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:26:21.088478 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034258 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:26:21.088478 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034261 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:26:21.088478 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034265 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:26:21.088478 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034269 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:26:21.088478 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034273 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:26:21.088478 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034276 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:26:21.088478 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034281 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:26:21.088478 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034284 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:26:21.088478 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034287 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:26:21.189519 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034289 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:26:21.189519 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034292 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:26:21.189519 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034296 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:26:21.189519 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034298 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:26:21.189519 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034301 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:26:21.189519 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034303 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:26:21.189519 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034306 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:26:21.189519 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034309 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:26:21.189519 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034311 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:26:21.189519 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034314 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:26:21.189519 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034316 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:26:21.189519 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034319 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:26:21.189519 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034322 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:26:21.189519 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034324 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:26:21.189519 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034326 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:26:21.189519 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034329 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:26:21.189519 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034331 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:26:21.189519 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034334 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:26:21.189519 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034336 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:26:21.189519 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034339 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:26:21.113420 ip-10-0-136-57 systemd[1]: Started Kubernetes Kubelet. Jul 10 18:26:21.190474 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034341 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:26:21.190474 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034344 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:26:21.190474 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034346 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:26:21.190474 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034349 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:26:21.190474 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034352 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:26:21.190474 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034354 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:26:21.190474 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034357 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:26:21.190474 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034359 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:26:21.190474 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034362 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:26:21.190474 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034366 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:26:21.190474 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034370 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:26:21.190474 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034374 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:26:21.190474 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034377 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:26:21.190474 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034379 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:26:21.190474 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034382 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:26:21.190474 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034385 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:26:21.190474 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034387 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:26:21.190474 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034390 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:26:21.190474 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034392 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:26:21.190474 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034395 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:26:21.192159 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034397 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:26:21.192159 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034400 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:26:21.192159 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034402 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:26:21.192159 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034405 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:26:21.192159 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034407 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:26:21.192159 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034411 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:26:21.192159 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034413 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:26:21.192159 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034417 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:26:21.192159 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034420 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:26:21.192159 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034423 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:26:21.192159 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034426 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:26:21.192159 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034428 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:26:21.192159 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034431 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:26:21.192159 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.034434 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:26:21.192159 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034493 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 10 18:26:21.192159 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034499 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 10 18:26:21.192159 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034505 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 10 18:26:21.192159 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034509 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 10 18:26:21.192159 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034513 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 10 18:26:21.192159 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034517 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 10 18:26:21.192159 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034520 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 10 18:26:21.193250 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034526 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 10 18:26:21.193250 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034529 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 10 18:26:21.193250 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034533 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 10 18:26:21.193250 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034537 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 10 18:26:21.193250 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034540 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 10 18:26:21.193250 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034543 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 10 18:26:21.193250 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034546 2564 flags.go:64] FLAG: --cgroup-root="" Jul 10 18:26:21.193250 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034549 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 10 18:26:21.193250 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034552 2564 flags.go:64] FLAG: --client-ca-file="" Jul 10 18:26:21.193250 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034555 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 10 18:26:21.193250 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034558 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 10 18:26:21.193250 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034562 2564 flags.go:64] FLAG: --cluster-domain="" Jul 10 18:26:21.193250 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034565 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 10 18:26:21.193250 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034568 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 10 18:26:21.193250 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034571 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 10 18:26:21.193250 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034574 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 10 18:26:21.193250 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034577 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 10 18:26:21.193250 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034580 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 10 18:26:21.193250 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034583 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 10 18:26:21.193250 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034587 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 10 18:26:21.193250 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034590 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 10 18:26:21.193250 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034592 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 10 18:26:21.193250 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034595 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 10 18:26:21.193250 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034598 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 10 18:26:21.194776 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034601 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 10 18:26:21.194776 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034605 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 10 18:26:21.194776 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034608 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 10 18:26:21.194776 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034611 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 10 18:26:21.194776 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034614 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 10 18:26:21.194776 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034617 2564 flags.go:64] FLAG: --enable-server="true" Jul 10 18:26:21.194776 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034620 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 10 18:26:21.194776 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034624 2564 flags.go:64] FLAG: --event-burst="100" Jul 10 18:26:21.194776 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034628 2564 flags.go:64] FLAG: --event-qps="50" Jul 10 18:26:21.194776 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034631 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 10 18:26:21.194776 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034635 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 10 18:26:21.194776 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034638 2564 flags.go:64] FLAG: --eviction-hard="" Jul 10 18:26:21.194776 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034642 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 10 18:26:21.194776 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034645 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 10 18:26:21.194776 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034648 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 10 18:26:21.194776 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034650 2564 flags.go:64] FLAG: --eviction-soft="" Jul 10 18:26:21.194776 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034654 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 10 18:26:21.194776 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034657 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 10 18:26:21.194776 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034659 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 10 18:26:21.194776 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034662 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 10 18:26:21.194776 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034665 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 10 18:26:21.194776 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034668 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 10 18:26:21.194776 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034671 2564 flags.go:64] FLAG: --feature-gates="" Jul 10 18:26:21.194776 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034674 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 10 18:26:21.194776 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034677 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 10 18:26:21.199294 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034680 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 10 18:26:21.199294 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034683 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 10 18:26:21.199294 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034686 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 10 18:26:21.199294 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034689 2564 flags.go:64] FLAG: --help="false" Jul 10 18:26:21.199294 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034692 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-136-57.ec2.internal" Jul 10 18:26:21.199294 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034695 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 10 18:26:21.199294 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034712 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 10 18:26:21.199294 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034716 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 10 18:26:21.199294 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034719 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 10 18:26:21.199294 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034723 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 10 18:26:21.199294 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034726 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 10 18:26:21.199294 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034728 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 10 18:26:21.199294 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034731 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 10 18:26:21.199294 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034734 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 10 18:26:21.199294 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034737 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 10 18:26:21.199294 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034742 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 10 18:26:21.199294 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034745 2564 flags.go:64] FLAG: --kube-reserved="" Jul 10 18:26:21.199294 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034749 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 10 18:26:21.199294 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034752 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 10 18:26:21.199294 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034755 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 10 18:26:21.199294 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034758 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 10 18:26:21.199294 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034761 2564 flags.go:64] FLAG: --lock-file="" Jul 10 18:26:21.199294 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034764 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 10 18:26:21.199294 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034767 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 10 18:26:21.200384 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034770 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 10 18:26:21.200384 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034775 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 10 18:26:21.200384 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034778 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 10 18:26:21.200384 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034781 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 10 18:26:21.200384 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034784 2564 flags.go:64] FLAG: --logging-format="text" Jul 10 18:26:21.200384 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034787 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 10 18:26:21.200384 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034790 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 10 18:26:21.200384 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034792 2564 flags.go:64] FLAG: --manifest-url="" Jul 10 18:26:21.200384 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034795 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 10 18:26:21.200384 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034799 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 10 18:26:21.200384 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034802 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 10 18:26:21.200384 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034806 2564 flags.go:64] FLAG: --max-pods="110" Jul 10 18:26:21.200384 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034809 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 10 18:26:21.200384 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034811 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 10 18:26:21.200384 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034814 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 10 18:26:21.200384 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034817 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 10 18:26:21.200384 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034820 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 10 18:26:21.200384 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034823 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 10 18:26:21.200384 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034826 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 10 18:26:21.200384 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034832 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 10 18:26:21.200384 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034836 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 10 18:26:21.200384 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034838 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 10 18:26:21.200384 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034841 2564 flags.go:64] FLAG: --pod-cidr="" Jul 10 18:26:21.201478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034846 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 10 18:26:21.201478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034851 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 10 18:26:21.201478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034855 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 10 18:26:21.201478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034858 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 10 18:26:21.201478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034861 2564 flags.go:64] FLAG: --port="10250" Jul 10 18:26:21.201478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034864 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 10 18:26:21.201478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034867 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02d84329763823f0c" Jul 10 18:26:21.201478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034870 2564 flags.go:64] FLAG: --qos-reserved="" Jul 10 18:26:21.201478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034873 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 10 18:26:21.201478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034876 2564 flags.go:64] FLAG: --register-node="true" Jul 10 18:26:21.201478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034880 2564 flags.go:64] FLAG: --register-with-taints="" Jul 10 18:26:21.201478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034884 2564 flags.go:64] FLAG: --registry-burst="10" Jul 10 18:26:21.201478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034886 2564 flags.go:64] FLAG: --registry-qps="5" Jul 10 18:26:21.201478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034889 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 10 18:26:21.201478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034892 2564 flags.go:64] FLAG: --reserved-memory="" Jul 10 18:26:21.201478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034895 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 10 18:26:21.201478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034898 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 10 18:26:21.201478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034901 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 10 18:26:21.201478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034904 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 10 18:26:21.201478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034907 2564 flags.go:64] FLAG: --runonce="false" Jul 10 18:26:21.201478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034910 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 10 18:26:21.201478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034913 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 10 18:26:21.201478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034916 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 10 18:26:21.201478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034918 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 10 18:26:21.201478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034921 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 10 18:26:21.203442 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034924 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 10 18:26:21.203442 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034927 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 10 18:26:21.203442 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034930 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 10 18:26:21.203442 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034933 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 10 18:26:21.203442 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034936 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 10 18:26:21.203442 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034938 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 10 18:26:21.203442 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034941 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 10 18:26:21.203442 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034944 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 10 18:26:21.203442 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034948 2564 flags.go:64] FLAG: --system-cgroups="" Jul 10 18:26:21.203442 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034952 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 10 18:26:21.203442 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034957 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 10 18:26:21.203442 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034960 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 10 18:26:21.203442 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034962 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 10 18:26:21.203442 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034966 2564 flags.go:64] FLAG: --tls-min-version="" Jul 10 18:26:21.203442 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034969 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 10 18:26:21.203442 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034972 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 10 18:26:21.203442 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034974 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 10 18:26:21.203442 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034978 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 10 18:26:21.203442 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034981 2564 flags.go:64] FLAG: --v="2" Jul 10 18:26:21.203442 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034985 2564 flags.go:64] FLAG: --version="false" Jul 10 18:26:21.203442 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034989 2564 flags.go:64] FLAG: --vmodule="" Jul 10 18:26:21.203442 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034992 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 10 18:26:21.203442 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.034995 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 10 18:26:21.203442 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035099 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:26:21.203442 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035103 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:26:21.204779 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035106 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:26:21.204779 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035109 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:26:21.204779 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035112 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:26:21.204779 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035115 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:26:21.204779 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035118 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:26:21.204779 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035120 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:26:21.204779 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035122 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:26:21.204779 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035125 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:26:21.204779 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035128 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:26:21.204779 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035130 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:26:21.204779 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035133 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:26:21.204779 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035135 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:26:21.204779 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035138 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:26:21.204779 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035140 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:26:21.204779 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035143 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:26:21.204779 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035147 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:26:21.204779 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035151 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:26:21.204779 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035154 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:26:21.204779 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035157 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:26:21.204779 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035159 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:26:21.206031 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035162 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:26:21.206031 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035164 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:26:21.206031 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035167 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:26:21.206031 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035170 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:26:21.206031 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035172 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:26:21.206031 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035175 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:26:21.206031 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035178 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:26:21.206031 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035181 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:26:21.206031 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035183 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:26:21.206031 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035186 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:26:21.206031 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035188 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:26:21.206031 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035190 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:26:21.206031 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035193 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:26:21.206031 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035196 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:26:21.206031 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035198 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:26:21.206031 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035201 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:26:21.206031 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035203 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:26:21.206031 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035206 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:26:21.206031 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035208 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:26:21.207970 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035212 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:26:21.207970 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035216 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:26:21.207970 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035218 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:26:21.207970 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035221 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:26:21.207970 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035224 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:26:21.207970 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035227 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:26:21.207970 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035229 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:26:21.207970 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035232 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:26:21.207970 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035236 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:26:21.207970 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035240 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:26:21.207970 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035243 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:26:21.207970 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035245 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:26:21.207970 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035248 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:26:21.207970 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035250 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:26:21.207970 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035253 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:26:21.207970 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035255 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:26:21.207970 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035258 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:26:21.207970 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035261 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:26:21.207970 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035265 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:26:21.209068 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035268 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:26:21.209068 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035274 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:26:21.209068 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035276 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:26:21.209068 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035279 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:26:21.209068 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035281 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:26:21.209068 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035284 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:26:21.209068 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035286 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:26:21.209068 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035289 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:26:21.209068 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035292 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:26:21.209068 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035294 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:26:21.209068 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035297 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:26:21.209068 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035299 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:26:21.209068 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035302 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:26:21.209068 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035304 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:26:21.209068 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035307 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:26:21.209068 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035309 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:26:21.209068 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035311 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:26:21.209068 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035314 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:26:21.209068 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035316 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:26:21.209068 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035319 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:26:21.209068 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035322 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:26:21.210732 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035325 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:26:21.210732 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035330 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:26:21.210732 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035333 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:26:21.210732 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035337 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:26:21.210732 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035340 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:26:21.210732 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035343 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:26:21.210732 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035346 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:26:21.210732 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035349 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:26:21.210732 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035351 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:26:21.210732 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035354 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:26:21.210732 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035356 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:26:21.210732 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035359 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:26:21.210732 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035361 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:26:21.210732 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035364 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:26:21.210732 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035367 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:26:21.210732 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035369 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:26:21.210732 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035372 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:26:21.210732 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.035374 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:26:21.211600 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.036409 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 18:26:21.211600 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.051944 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 10 18:26:21.211600 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.051959 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 10 18:26:21.211600 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.052803 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 10 18:26:21.211600 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.052811 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 10 18:26:21.211600 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052867 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:26:21.211600 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052871 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:26:21.211600 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052875 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:26:21.211600 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052878 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:26:21.211600 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052881 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:26:21.211600 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052884 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:26:21.211600 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052887 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:26:21.211600 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052890 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:26:21.211600 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052892 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:26:21.211600 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052895 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:26:21.212910 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052898 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:26:21.212910 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052901 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:26:21.212910 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052903 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:26:21.212910 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052905 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:26:21.212910 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052908 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:26:21.212910 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052914 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:26:21.212910 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052917 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:26:21.212910 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052919 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:26:21.212910 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052922 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:26:21.212910 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052925 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:26:21.212910 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052928 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:26:21.212910 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052930 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:26:21.212910 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052933 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:26:21.212910 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052936 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:26:21.212910 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052939 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:26:21.212910 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052941 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:26:21.212910 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052945 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:26:21.212910 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052947 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:26:21.212910 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052950 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:26:21.212910 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052953 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:26:21.213996 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052955 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:26:21.213996 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052958 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:26:21.213996 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052961 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:26:21.213996 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052964 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:26:21.213996 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052966 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:26:21.213996 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052969 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:26:21.213996 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052973 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:26:21.213996 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052976 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:26:21.213996 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052979 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:26:21.213996 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052985 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:26:21.213996 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052988 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:26:21.213996 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052991 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:26:21.213996 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052994 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:26:21.213996 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052997 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:26:21.213996 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.052999 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:26:21.213996 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053002 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:26:21.213996 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053005 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:26:21.213996 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053009 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:26:21.213996 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053012 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:26:21.215097 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053015 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:26:21.215097 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053017 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:26:21.215097 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053020 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:26:21.215097 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053023 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:26:21.215097 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053025 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:26:21.215097 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053028 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:26:21.215097 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053030 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:26:21.215097 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053033 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:26:21.215097 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053035 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:26:21.215097 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053038 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:26:21.215097 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053040 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:26:21.215097 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053043 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:26:21.215097 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053045 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:26:21.215097 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053048 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:26:21.215097 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053050 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:26:21.215097 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053053 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:26:21.215097 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053055 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:26:21.215097 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053058 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:26:21.215097 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053060 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:26:21.215960 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053063 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:26:21.215960 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053066 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:26:21.215960 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053068 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:26:21.215960 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053073 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:26:21.215960 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053075 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:26:21.215960 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053078 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:26:21.215960 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053081 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:26:21.215960 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053083 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:26:21.215960 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053086 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:26:21.215960 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053088 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:26:21.215960 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053091 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:26:21.215960 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053096 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:26:21.215960 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053099 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:26:21.215960 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053101 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:26:21.215960 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053104 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:26:21.215960 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053107 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:26:21.215960 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053111 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:26:21.215960 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053114 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:26:21.215960 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053117 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:26:21.215960 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053120 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:26:21.217054 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053123 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:26:21.217054 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053126 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:26:21.217054 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053129 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:26:21.217054 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053132 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:26:21.217054 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053134 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:26:21.217054 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053137 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:26:21.217054 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053139 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:26:21.217054 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053142 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:26:21.217054 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053144 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:26:21.217054 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053147 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:26:21.217054 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053151 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:26:21.217054 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.053156 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 18:26:21.217054 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053257 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 18:26:21.217054 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053262 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 18:26:21.217054 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053265 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 18:26:21.217719 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053269 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 18:26:21.217719 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053272 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 18:26:21.217719 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053275 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 18:26:21.217719 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053278 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 18:26:21.217719 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053280 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 18:26:21.217719 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053283 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 18:26:21.217719 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053286 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 18:26:21.217719 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053288 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 18:26:21.217719 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053291 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 18:26:21.217719 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053296 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 18:26:21.217719 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053299 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 18:26:21.217719 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053301 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 18:26:21.217719 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053304 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 18:26:21.217719 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053307 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 18:26:21.217719 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053309 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 18:26:21.217719 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053312 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 18:26:21.217719 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053314 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 18:26:21.217719 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053317 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 18:26:21.217719 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053319 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 18:26:21.217719 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053322 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 18:26:21.218593 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053325 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 18:26:21.218593 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053327 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 18:26:21.218593 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053330 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 18:26:21.218593 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053332 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 18:26:21.218593 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053335 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 18:26:21.218593 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053337 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 18:26:21.218593 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053340 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 18:26:21.218593 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053342 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 10 18:26:21.218593 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053345 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 18:26:21.218593 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053347 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 18:26:21.218593 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053350 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 18:26:21.218593 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053352 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 18:26:21.218593 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053357 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 18:26:21.218593 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053361 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 18:26:21.218593 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053364 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 18:26:21.218593 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053367 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 18:26:21.218593 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053370 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 18:26:21.218593 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053373 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 18:26:21.218593 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053377 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 18:26:21.219459 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053380 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 18:26:21.219459 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053383 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 18:26:21.219459 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053387 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 18:26:21.219459 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053390 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 18:26:21.219459 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053393 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 18:26:21.219459 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053396 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 18:26:21.219459 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053399 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 18:26:21.219459 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053402 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 18:26:21.219459 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053405 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 18:26:21.219459 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053408 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 18:26:21.219459 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053411 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 18:26:21.219459 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053413 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 18:26:21.219459 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053416 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 18:26:21.219459 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053418 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 18:26:21.219459 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053421 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 18:26:21.219459 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053423 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 18:26:21.219459 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053426 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 18:26:21.219459 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053429 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 18:26:21.219459 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053431 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 18:26:21.219459 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053434 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 18:26:21.220334 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053437 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 18:26:21.220334 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053439 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 18:26:21.220334 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053442 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 18:26:21.220334 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053444 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 18:26:21.220334 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053447 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 18:26:21.220334 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053451 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 18:26:21.220334 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053453 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 18:26:21.220334 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053455 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 18:26:21.220334 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053458 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 18:26:21.220334 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053461 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 18:26:21.220334 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053463 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 18:26:21.220334 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053466 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 18:26:21.220334 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053470 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 18:26:21.220334 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053473 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 18:26:21.220334 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053478 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 18:26:21.220334 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053481 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 18:26:21.220334 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053484 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 18:26:21.220334 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053487 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 18:26:21.220334 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053489 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 18:26:21.220334 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053492 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 18:26:21.221199 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053494 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 18:26:21.221199 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053497 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 18:26:21.221199 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053499 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 18:26:21.221199 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053502 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 18:26:21.221199 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053505 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 18:26:21.221199 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053507 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 18:26:21.221199 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053510 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 18:26:21.221199 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053512 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 18:26:21.221199 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053515 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 18:26:21.221199 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053517 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 18:26:21.221199 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053520 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 18:26:21.221199 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053522 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 18:26:21.221199 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053524 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 18:26:21.221199 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053527 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 18:26:21.221199 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053529 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 18:26:21.221199 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053532 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 18:26:21.221199 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:21.053534 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 18:26:21.222072 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.053540 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 18:26:21.222072 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.053634 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 10 18:26:21.222072 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.055775 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 10 18:26:21.222072 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.057257 2564 server.go:1019] "Starting client certificate rotation" Jul 10 18:26:21.222072 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.057385 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 18:26:21.222072 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.057438 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 18:26:21.222072 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.059680 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 18:26:21.222072 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.060747 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 18:26:21.222072 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.069908 2564 log.go:25] "Validated CRI v1 runtime API" Jul 10 18:26:21.222072 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.071803 2564 log.go:25] "Validated CRI v1 image API" Jul 10 18:26:21.222072 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.072598 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 10 18:26:21.222072 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.075088 2564 fs.go:135] Filesystem UUIDs: map[1d2a045e-3f1a-41fd-b0ed-662ca991a65d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e690c564-517c-49b9-ba61-ade9254cad2a:/dev/nvme0n1p3] Jul 10 18:26:21.222727 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.075101 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 10 18:26:21.223574 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.082505 2564 manager.go:216] Machine: {Timestamp:2026-07-10 18:26:21.081376726 +0000 UTC m=+0.314580976 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100057 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2130c883d40d641b4d1347a8c8e7e7 SystemUUID:ec2130c8-83d4-0d64-1b4d-1347a8c8e7e7 BootID:c59d6978-725b-4aaf-b48b-848369734db8 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:45:6e:f0:46:49 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:45:6e:f0:46:49 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:59:76:85:08:1d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 10 18:26:21.223574 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.082603 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 10 18:26:21.223574 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.082668 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 10 18:26:21.223574 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.085555 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 10 18:26:21.223574 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.085577 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-57.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 10 18:26:21.223574 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.086155 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 10 18:26:21.223574 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.086165 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 10 18:26:21.223574 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.086173 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.087074 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.087352 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.088367 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.094153 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.094264 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.094291 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.094303 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.094327 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.094340 2564 kubelet.go:398] "Adding apiserver pod source" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.094350 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.094725 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.094745 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.097336 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.099217 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.099245 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.099945 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.099963 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.099970 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.099975 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.099983 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.099989 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.099997 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.100002 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.100009 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.100022 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.100031 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.100036 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.100857 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.100864 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.103894 2564 server.go:1268] "Started kubelet" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.103965 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.104134 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-57.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.104115 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.104185 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:21.104264 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:21.104335 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.112084 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:21.113024 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 10 18:26:21.224228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.114553 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:21.115012 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-57.ec2.internal.18c100f554b974bc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-57.ec2.internal,UID:ip-10-0-136-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-57.ec2.internal,},FirstTimestamp:2026-07-10 18:26:21.10385478 +0000 UTC m=+0.337059030,LastTimestamp:2026-07-10 18:26:21.10385478 +0000 UTC m=+0.337059030,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-57.ec2.internal,}" Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.119120 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.119412 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:21.119742 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-57.ec2.internal\" not found" Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.120984 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.121002 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.120985 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.121121 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.121127 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.121600 2564 factory.go:55] Registering systemd factory Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.121632 2564 factory.go:223] Registration of the systemd container factory successfully Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.121652 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jj6l5" Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.121980 2564 factory.go:153] Registering CRI-O factory Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.121994 2564 factory.go:223] Registration of the crio container factory successfully Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.122041 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.122062 2564 factory.go:103] Registering Raw factory Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.122076 2564 manager.go:1196] Started watching for new ooms in manager Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.122472 2564 manager.go:349] Starting recovery of all containers Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:21.125146 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:21.125294 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.127063 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jj6l5" Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.134736 2564 manager.go:354] Recovery completed Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.139802 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.141663 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-57.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.141689 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.141725 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-57.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.142261 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.142269 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.142282 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.142339 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.143392 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-57.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.143462 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:26:21.348071 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.143478 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-57.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:26:21.373719 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:21.143881 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-57.ec2.internal.18c100f556fa9029 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-57.ec2.internal,UID:ip-10-0-136-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-57.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-57.ec2.internal,},FirstTimestamp:2026-07-10 18:26:21.141676073 +0000 UTC m=+0.374880323,LastTimestamp:2026-07-10 18:26:21.141676073 +0000 UTC m=+0.374880323,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-57.ec2.internal,}" Jul 10 18:26:21.373719 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.144348 2564 policy_none.go:49] "None policy: Start" Jul 10 18:26:21.373719 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.144379 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 10 18:26:21.373719 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.144395 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 10 18:26:21.373719 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.146587 2564 policy_none.go:47] "Start" Jul 10 18:26:21.373719 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.178233 2564 manager.go:337] "Starting Device Plugin manager" Jul 10 18:26:21.373719 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:21.178255 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 10 18:26:21.373719 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.178263 2564 server.go:87] "Starting device plugin registration server" Jul 10 18:26:21.373719 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.178497 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 10 18:26:21.373719 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.178509 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 10 18:26:21.373719 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.178591 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 10 18:26:21.373719 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.178761 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 10 18:26:21.373719 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.178788 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 10 18:26:21.373719 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:21.179142 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 10 18:26:21.373719 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:21.179192 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-57.ec2.internal\" not found" Jul 10 18:26:21.373719 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.278811 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:26:21.373719 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.279812 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-57.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:26:21.373719 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.279848 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:26:21.373719 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.279867 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-57.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:26:21.373719 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.279903 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-57.ec2.internal" Jul 10 18:26:21.373719 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.287718 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-57.ec2.internal" Jul 10 18:26:21.373719 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:21.287735 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-57.ec2.internal\": node \"ip-10-0-136-57.ec2.internal\" not found" Jul 10 18:26:21.373719 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:21.300757 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-57.ec2.internal\" not found" Jul 10 18:26:21.474015 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.398845 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 10 18:26:21.474015 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.400065 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 10 18:26:21.474015 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.400097 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 10 18:26:21.474015 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.400114 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 10 18:26:21.474015 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:21.400144 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 10 18:26:21.474015 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:21.400803 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-57.ec2.internal\" not found" Jul 10 18:26:21.474015 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.402419 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 18:26:21.568149 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:21.504736 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-57.ec2.internal\" not found" Jul 10 18:26:21.568149 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.504747 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-57.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-57.ec2.internal"] Jul 10 18:26:21.568149 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.504809 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:26:21.568149 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.508960 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-57.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:26:21.568149 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.508987 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:26:21.568149 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.509000 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-57.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:26:21.568149 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.511493 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:26:21.568149 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.511652 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-57.ec2.internal" Jul 10 18:26:21.568149 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.511679 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:26:21.568149 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.512351 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-57.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:26:21.568149 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.512369 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:26:21.568149 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.512378 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-57.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:26:21.568149 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.514730 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-57.ec2.internal" Jul 10 18:26:21.568149 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.514751 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 18:26:21.568149 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.514896 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-57.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:26:21.568149 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.514909 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:26:21.568149 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.514918 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-57.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:26:21.568149 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.516300 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-57.ec2.internal" event="NodeHasSufficientMemory" Jul 10 18:26:21.568149 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.516317 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 18:26:21.568149 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.516326 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-57.ec2.internal" event="NodeHasSufficientPID" Jul 10 18:26:21.568149 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.532037 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e4616fa0f000af83247fd8796e5f0c82-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-57.ec2.internal\" (UID: \"e4616fa0f000af83247fd8796e5f0c82\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-57.ec2.internal" Jul 10 18:26:21.568149 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.532061 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4616fa0f000af83247fd8796e5f0c82-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-57.ec2.internal\" (UID: \"e4616fa0f000af83247fd8796e5f0c82\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-57.ec2.internal" Jul 10 18:26:21.568149 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.532078 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f8d1abcbcf866db0239ee93f6a04f030-config\") pod \"kube-apiserver-proxy-ip-10-0-136-57.ec2.internal\" (UID: \"f8d1abcbcf866db0239ee93f6a04f030\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-57.ec2.internal" Jul 10 18:26:21.568149 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:21.543085 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-57.ec2.internal\" not found" node="ip-10-0-136-57.ec2.internal" Jul 10 18:26:21.568149 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:21.548064 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-57.ec2.internal\" not found" node="ip-10-0-136-57.ec2.internal" Jul 10 18:26:21.702485 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:21.605906 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-57.ec2.internal\" not found" Jul 10 18:26:21.702485 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.632628 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f8d1abcbcf866db0239ee93f6a04f030-config\") pod \"kube-apiserver-proxy-ip-10-0-136-57.ec2.internal\" (UID: \"f8d1abcbcf866db0239ee93f6a04f030\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-57.ec2.internal" Jul 10 18:26:21.702485 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.632651 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e4616fa0f000af83247fd8796e5f0c82-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-57.ec2.internal\" (UID: \"e4616fa0f000af83247fd8796e5f0c82\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-57.ec2.internal" Jul 10 18:26:21.702485 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.632677 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4616fa0f000af83247fd8796e5f0c82-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-57.ec2.internal\" (UID: \"e4616fa0f000af83247fd8796e5f0c82\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-57.ec2.internal" Jul 10 18:26:21.702485 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.632731 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4616fa0f000af83247fd8796e5f0c82-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-57.ec2.internal\" (UID: \"e4616fa0f000af83247fd8796e5f0c82\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-57.ec2.internal" Jul 10 18:26:21.702485 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.632777 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f8d1abcbcf866db0239ee93f6a04f030-config\") pod \"kube-apiserver-proxy-ip-10-0-136-57.ec2.internal\" (UID: \"f8d1abcbcf866db0239ee93f6a04f030\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-57.ec2.internal" Jul 10 18:26:21.702485 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.632801 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e4616fa0f000af83247fd8796e5f0c82-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-57.ec2.internal\" (UID: \"e4616fa0f000af83247fd8796e5f0c82\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-57.ec2.internal" Jul 10 18:26:21.708360 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:21.706945 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-57.ec2.internal\" not found" Jul 10 18:26:21.826082 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:21.815382 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-57.ec2.internal\" not found" Jul 10 18:26:21.970996 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.846460 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-57.ec2.internal" Jul 10 18:26:21.970996 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:21.851368 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-57.ec2.internal" Jul 10 18:26:21.970996 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:21.915965 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-57.ec2.internal\" not found" Jul 10 18:26:22.124655 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:22.019125 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-57.ec2.internal\" not found" Jul 10 18:26:22.124655 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:22.057489 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 10 18:26:22.124655 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:22.057620 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 18:26:22.124655 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:22.119318 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-57.ec2.internal\" not found" Jul 10 18:26:22.131575 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:22.128054 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 18:26:22.131575 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:22.131357 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 18:21:21 +0000 UTC" deadline="2028-04-13 02:32:29.26707886 +0000 UTC" Jul 10 18:26:22.131575 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:22.131376 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15416h6m7.135704768s" Jul 10 18:26:22.220437 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:22.220412 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-57.ec2.internal\" not found" Jul 10 18:26:22.320983 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:22.320957 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-57.ec2.internal\" not found" Jul 10 18:26:22.421907 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:22.421854 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-57.ec2.internal\" not found" Jul 10 18:26:22.422457 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:22.422428 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 18:26:22.520237 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:22.520206 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-57.ec2.internal" Jul 10 18:26:22.528380 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:22.528357 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 18:26:22.529264 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:22.529251 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-57.ec2.internal" Jul 10 18:26:22.539896 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:22.539877 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 18:26:22.555507 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:22.555491 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 18:26:22.607418 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:22.607392 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d1abcbcf866db0239ee93f6a04f030.slice/crio-6888fc29edb812d12f6e0d5c5ec217651e628615195828cdae8258de127d4b9a WatchSource:0}: Error finding container 6888fc29edb812d12f6e0d5c5ec217651e628615195828cdae8258de127d4b9a: Status 404 returned error can't find the container with id 6888fc29edb812d12f6e0d5c5ec217651e628615195828cdae8258de127d4b9a Jul 10 18:26:22.609454 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:22.609427 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4616fa0f000af83247fd8796e5f0c82.slice/crio-e53988bba61147aec7e4fc317e251056bfb8a2e339c89ac1ae0a4c781008cd7f WatchSource:0}: Error finding container e53988bba61147aec7e4fc317e251056bfb8a2e339c89ac1ae0a4c781008cd7f: Status 404 returned error can't find the container with id e53988bba61147aec7e4fc317e251056bfb8a2e339c89ac1ae0a4c781008cd7f Jul 10 18:26:22.612929 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:22.612908 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 18:26:23.095978 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.095949 2564 apiserver.go:52] "Watching apiserver" Jul 10 18:26:23.103358 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.103338 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 10 18:26:23.103722 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.103701 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-5jm85","openshift-network-operator/iptables-alerter-2cclr","openshift-ovn-kubernetes/ovnkube-node-9gfnq","kube-system/global-pull-secret-syncer-6gtxh","kube-system/konnectivity-agent-h56zp","kube-system/kube-apiserver-proxy-ip-10-0-136-57.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf","openshift-dns/node-resolver-grgmt","openshift-multus/multus-additional-cni-plugins-vdspp","openshift-multus/multus-ww2gt","openshift-multus/network-metrics-daemon-l7l77","openshift-cluster-node-tuning-operator/tuned-kpclp","openshift-image-registry/node-ca-n95vc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-57.ec2.internal"] Jul 10 18:26:23.107819 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.107800 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" Jul 10 18:26:23.110110 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.110088 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 10 18:26:23.110110 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.110102 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n95vc" Jul 10 18:26:23.110439 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.110420 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 10 18:26:23.110585 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.110566 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 10 18:26:23.110704 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.110688 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lbtc8\"" Jul 10 18:26:23.112485 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.112319 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 10 18:26:23.112485 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.112327 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-57nsd\"" Jul 10 18:26:23.112485 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.112454 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 10 18:26:23.112695 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.112638 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.112775 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.112715 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 10 18:26:23.114992 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.114842 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 10 18:26:23.115092 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.115068 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 10 18:26:23.115217 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.115180 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 10 18:26:23.115279 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.115227 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-g5lc8\"" Jul 10 18:26:23.115434 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.115412 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:23.115565 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:23.115530 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtxh" podUID="94b9498d-bd74-4e9c-8177-c152abdacbb9" Jul 10 18:26:23.116139 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.116115 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 10 18:26:23.116223 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.116126 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 10 18:26:23.116452 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.116437 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 10 18:26:23.117745 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.117729 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h56zp" Jul 10 18:26:23.119991 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.119974 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 10 18:26:23.120316 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.120299 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 10 18:26:23.120450 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.120427 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-grgmt" Jul 10 18:26:23.120532 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.120494 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vcvjp\"" Jul 10 18:26:23.120670 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.120648 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 10 18:26:23.122629 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.122614 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m6n6f\"" Jul 10 18:26:23.122877 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.122863 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 10 18:26:23.122984 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.122966 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 10 18:26:23.123354 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.123337 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vdspp" Jul 10 18:26:23.126858 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.126578 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 10 18:26:23.126858 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.126604 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7ltt7\"" Jul 10 18:26:23.127582 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.127562 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 10 18:26:23.127651 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.127622 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 10 18:26:23.127788 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.127765 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 10 18:26:23.127874 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.127849 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 10 18:26:23.128499 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.128482 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:23.128597 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:23.128535 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jm85" podUID="476cc43e-40b1-48f7-98f7-9a02a5478743" Jul 10 18:26:23.130888 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.130860 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2cclr" Jul 10 18:26:23.133272 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.133246 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 10 18:26:23.133421 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.133299 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.133421 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.133378 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 10 18:26:23.133421 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.133395 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v5q9f\"" Jul 10 18:26:23.133421 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.133415 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 10 18:26:23.133631 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.133582 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 18:26:23.135763 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.135736 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:23.135847 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:23.135806 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7l77" podUID="f4443fb4-d9ef-4a8c-8268-0aacbd93ce13" Jul 10 18:26:23.136017 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.135895 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 10 18:26:23.136017 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.135988 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rlprg\"" Jul 10 18:26:23.138376 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.138356 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.140475 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.140453 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-host-cni-bin\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.140560 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.140501 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-host-cni-netd\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.140560 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.140518 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/873ff093-ab5b-412b-abad-220e0bb4acc3-env-overrides\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.140560 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.140536 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94b9498d-bd74-4e9c-8177-c152abdacbb9-original-pull-secret\") pod \"global-pull-secret-syncer-6gtxh\" (UID: \"94b9498d-bd74-4e9c-8177-c152abdacbb9\") " pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:23.140729 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.140575 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d31e7-11f6-4626-b77c-f551838de192-registration-dir\") pod \"aws-ebs-csi-driver-node-89lpf\" (UID: \"ad1d31e7-11f6-4626-b77c-f551838de192\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" Jul 10 18:26:23.140729 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.140600 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-log-socket\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.140729 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.140628 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3f2651c8-dc6e-49db-b2f4-b152113e0b78-hosts-file\") pod \"node-resolver-grgmt\" (UID: \"3f2651c8-dc6e-49db-b2f4-b152113e0b78\") " pod="openshift-dns/node-resolver-grgmt" Jul 10 18:26:23.140729 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.140654 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/779eaa9e-7637-4bcc-886a-81bd645c0956-system-cni-dir\") pod \"multus-additional-cni-plugins-vdspp\" (UID: \"779eaa9e-7637-4bcc-886a-81bd645c0956\") " pod="openshift-multus/multus-additional-cni-plugins-vdspp" Jul 10 18:26:23.140729 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.140683 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52t88\" (UniqueName: \"kubernetes.io/projected/9b8880de-adae-4ec1-93bd-fc39231ad6b0-kube-api-access-52t88\") pod \"node-ca-n95vc\" (UID: \"9b8880de-adae-4ec1-93bd-fc39231ad6b0\") " pod="openshift-image-registry/node-ca-n95vc" Jul 10 18:26:23.140729 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.140699 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 10 18:26:23.140729 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.140713 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 10 18:26:23.140729 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.140710 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-etc-openvswitch\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.141157 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.140713 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-67vwq\"" Jul 10 18:26:23.141157 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.140756 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-run-openvswitch\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.141157 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.140782 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.141157 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.140811 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/779eaa9e-7637-4bcc-886a-81bd645c0956-os-release\") pod \"multus-additional-cni-plugins-vdspp\" (UID: \"779eaa9e-7637-4bcc-886a-81bd645c0956\") " pod="openshift-multus/multus-additional-cni-plugins-vdspp" Jul 10 18:26:23.141157 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.140839 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k96qh\" (UniqueName: \"kubernetes.io/projected/779eaa9e-7637-4bcc-886a-81bd645c0956-kube-api-access-k96qh\") pod \"multus-additional-cni-plugins-vdspp\" (UID: \"779eaa9e-7637-4bcc-886a-81bd645c0956\") " pod="openshift-multus/multus-additional-cni-plugins-vdspp" Jul 10 18:26:23.141157 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.140864 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-run-ovn\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.141157 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.140887 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-host-run-ovn-kubernetes\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.141157 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.140935 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d31e7-11f6-4626-b77c-f551838de192-device-dir\") pod \"aws-ebs-csi-driver-node-89lpf\" (UID: \"ad1d31e7-11f6-4626-b77c-f551838de192\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" Jul 10 18:26:23.141157 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.140978 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b8880de-adae-4ec1-93bd-fc39231ad6b0-host\") pod \"node-ca-n95vc\" (UID: \"9b8880de-adae-4ec1-93bd-fc39231ad6b0\") " pod="openshift-image-registry/node-ca-n95vc" Jul 10 18:26:23.141157 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141009 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-node-log\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.141157 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141034 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/94b9498d-bd74-4e9c-8177-c152abdacbb9-dbus\") pod \"global-pull-secret-syncer-6gtxh\" (UID: \"94b9498d-bd74-4e9c-8177-c152abdacbb9\") " pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:23.141157 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141065 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad1d31e7-11f6-4626-b77c-f551838de192-sys-fs\") pod \"aws-ebs-csi-driver-node-89lpf\" (UID: \"ad1d31e7-11f6-4626-b77c-f551838de192\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" Jul 10 18:26:23.141157 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141093 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/779eaa9e-7637-4bcc-886a-81bd645c0956-cni-binary-copy\") pod \"multus-additional-cni-plugins-vdspp\" (UID: \"779eaa9e-7637-4bcc-886a-81bd645c0956\") " pod="openshift-multus/multus-additional-cni-plugins-vdspp" Jul 10 18:26:23.141157 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141121 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/779eaa9e-7637-4bcc-886a-81bd645c0956-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vdspp\" (UID: \"779eaa9e-7637-4bcc-886a-81bd645c0956\") " pod="openshift-multus/multus-additional-cni-plugins-vdspp" Jul 10 18:26:23.141823 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141148 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-host-slash\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.141823 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141170 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-var-lib-openvswitch\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.141823 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141195 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/873ff093-ab5b-412b-abad-220e0bb4acc3-ovnkube-script-lib\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.141823 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141220 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d31e7-11f6-4626-b77c-f551838de192-kubelet-dir\") pod \"aws-ebs-csi-driver-node-89lpf\" (UID: \"ad1d31e7-11f6-4626-b77c-f551838de192\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" Jul 10 18:26:23.141823 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141254 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdqgb\" (UniqueName: \"kubernetes.io/projected/ad1d31e7-11f6-4626-b77c-f551838de192-kube-api-access-bdqgb\") pod \"aws-ebs-csi-driver-node-89lpf\" (UID: \"ad1d31e7-11f6-4626-b77c-f551838de192\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" Jul 10 18:26:23.141823 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141281 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/779eaa9e-7637-4bcc-886a-81bd645c0956-cnibin\") pod \"multus-additional-cni-plugins-vdspp\" (UID: \"779eaa9e-7637-4bcc-886a-81bd645c0956\") " pod="openshift-multus/multus-additional-cni-plugins-vdspp" Jul 10 18:26:23.141823 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141307 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/94b9498d-bd74-4e9c-8177-c152abdacbb9-kubelet-config\") pod \"global-pull-secret-syncer-6gtxh\" (UID: \"94b9498d-bd74-4e9c-8177-c152abdacbb9\") " pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:23.141823 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141330 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad1d31e7-11f6-4626-b77c-f551838de192-etc-selinux\") pod \"aws-ebs-csi-driver-node-89lpf\" (UID: \"ad1d31e7-11f6-4626-b77c-f551838de192\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" Jul 10 18:26:23.141823 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141360 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fc310c5e-2173-456f-ad25-4c5f1d990dca-agent-certs\") pod \"konnectivity-agent-h56zp\" (UID: \"fc310c5e-2173-456f-ad25-4c5f1d990dca\") " pod="kube-system/konnectivity-agent-h56zp" Jul 10 18:26:23.141823 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141382 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b8880de-adae-4ec1-93bd-fc39231ad6b0-serviceca\") pod \"node-ca-n95vc\" (UID: \"9b8880de-adae-4ec1-93bd-fc39231ad6b0\") " pod="openshift-image-registry/node-ca-n95vc" Jul 10 18:26:23.141823 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141419 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-host-kubelet\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.141823 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141453 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-systemd-units\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.141823 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141486 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-run-systemd\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.142245 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141508 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/873ff093-ab5b-412b-abad-220e0bb4acc3-ovnkube-config\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.142245 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141534 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5nn7\" (UniqueName: \"kubernetes.io/projected/873ff093-ab5b-412b-abad-220e0bb4acc3-kube-api-access-t5nn7\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.142245 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141560 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fc310c5e-2173-456f-ad25-4c5f1d990dca-konnectivity-ca\") pod \"konnectivity-agent-h56zp\" (UID: \"fc310c5e-2173-456f-ad25-4c5f1d990dca\") " pod="kube-system/konnectivity-agent-h56zp" Jul 10 18:26:23.142245 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141583 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsqpd\" (UniqueName: \"kubernetes.io/projected/3f2651c8-dc6e-49db-b2f4-b152113e0b78-kube-api-access-hsqpd\") pod \"node-resolver-grgmt\" (UID: \"3f2651c8-dc6e-49db-b2f4-b152113e0b78\") " pod="openshift-dns/node-resolver-grgmt" Jul 10 18:26:23.142245 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141607 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/779eaa9e-7637-4bcc-886a-81bd645c0956-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vdspp\" (UID: \"779eaa9e-7637-4bcc-886a-81bd645c0956\") " pod="openshift-multus/multus-additional-cni-plugins-vdspp" Jul 10 18:26:23.142245 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141653 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-host-run-netns\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.142245 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141676 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/873ff093-ab5b-412b-abad-220e0bb4acc3-ovn-node-metrics-cert\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.142245 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141699 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d31e7-11f6-4626-b77c-f551838de192-socket-dir\") pod \"aws-ebs-csi-driver-node-89lpf\" (UID: \"ad1d31e7-11f6-4626-b77c-f551838de192\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" Jul 10 18:26:23.142245 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141722 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f2651c8-dc6e-49db-b2f4-b152113e0b78-tmp-dir\") pod \"node-resolver-grgmt\" (UID: \"3f2651c8-dc6e-49db-b2f4-b152113e0b78\") " pod="openshift-dns/node-resolver-grgmt" Jul 10 18:26:23.142245 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.141761 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/779eaa9e-7637-4bcc-886a-81bd645c0956-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vdspp\" (UID: \"779eaa9e-7637-4bcc-886a-81bd645c0956\") " pod="openshift-multus/multus-additional-cni-plugins-vdspp" Jul 10 18:26:23.167592 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.167574 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-97pr6" Jul 10 18:26:23.175449 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.175429 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-97pr6" Jul 10 18:26:23.222850 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.222826 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 10 18:26:23.242527 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.242501 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/873ff093-ab5b-412b-abad-220e0bb4acc3-ovnkube-config\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.242624 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.242541 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkl6p\" (UniqueName: \"kubernetes.io/projected/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-kube-api-access-kkl6p\") pod \"network-metrics-daemon-l7l77\" (UID: \"f4443fb4-d9ef-4a8c-8268-0aacbd93ce13\") " pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:23.242624 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.242570 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsqpd\" (UniqueName: \"kubernetes.io/projected/3f2651c8-dc6e-49db-b2f4-b152113e0b78-kube-api-access-hsqpd\") pod \"node-resolver-grgmt\" (UID: \"3f2651c8-dc6e-49db-b2f4-b152113e0b78\") " pod="openshift-dns/node-resolver-grgmt" Jul 10 18:26:23.242624 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.242596 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/873ff093-ab5b-412b-abad-220e0bb4acc3-ovn-node-metrics-cert\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.242831 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.242629 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-etc-sysconfig\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.242831 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.242663 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-run\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.242831 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.242696 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgh4q\" (UniqueName: \"kubernetes.io/projected/7de9ed6f-8bd3-4426-bfec-f269921f7920-kube-api-access-hgh4q\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.242831 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.242724 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-host-cni-bin\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.242831 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.242771 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-host-cni-netd\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.243073 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.242830 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-host-cni-netd\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.243073 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.242853 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-host-cni-bin\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.243073 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.242910 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-log-socket\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.243073 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.242944 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/779eaa9e-7637-4bcc-886a-81bd645c0956-system-cni-dir\") pod \"multus-additional-cni-plugins-vdspp\" (UID: \"779eaa9e-7637-4bcc-886a-81bd645c0956\") " pod="openshift-multus/multus-additional-cni-plugins-vdspp" Jul 10 18:26:23.243073 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.242982 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-run-openvswitch\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.243073 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.242994 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-log-socket\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.243073 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.243015 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d31e7-11f6-4626-b77c-f551838de192-device-dir\") pod \"aws-ebs-csi-driver-node-89lpf\" (UID: \"ad1d31e7-11f6-4626-b77c-f551838de192\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" Jul 10 18:26:23.243073 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.243043 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/779eaa9e-7637-4bcc-886a-81bd645c0956-system-cni-dir\") pod \"multus-additional-cni-plugins-vdspp\" (UID: \"779eaa9e-7637-4bcc-886a-81bd645c0956\") " pod="openshift-multus/multus-additional-cni-plugins-vdspp" Jul 10 18:26:23.243073 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.243061 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-run-openvswitch\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.243073 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.243053 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-multus-cni-dir\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.243603 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.243091 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 10 18:26:23.243603 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.243110 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-os-release\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.243603 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.243136 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d31e7-11f6-4626-b77c-f551838de192-device-dir\") pod \"aws-ebs-csi-driver-node-89lpf\" (UID: \"ad1d31e7-11f6-4626-b77c-f551838de192\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" Jul 10 18:26:23.243603 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.243137 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-hostroot\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.243603 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.243228 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/779eaa9e-7637-4bcc-886a-81bd645c0956-os-release\") pod \"multus-additional-cni-plugins-vdspp\" (UID: \"779eaa9e-7637-4bcc-886a-81bd645c0956\") " pod="openshift-multus/multus-additional-cni-plugins-vdspp" Jul 10 18:26:23.243603 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.243317 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k96qh\" (UniqueName: \"kubernetes.io/projected/779eaa9e-7637-4bcc-886a-81bd645c0956-kube-api-access-k96qh\") pod \"multus-additional-cni-plugins-vdspp\" (UID: \"779eaa9e-7637-4bcc-886a-81bd645c0956\") " pod="openshift-multus/multus-additional-cni-plugins-vdspp" Jul 10 18:26:23.244251 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.243377 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-run-ovn\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.244363 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.244312 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/873ff093-ab5b-412b-abad-220e0bb4acc3-ovnkube-config\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.244445 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.243364 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/779eaa9e-7637-4bcc-886a-81bd645c0956-os-release\") pod \"multus-additional-cni-plugins-vdspp\" (UID: \"779eaa9e-7637-4bcc-886a-81bd645c0956\") " pod="openshift-multus/multus-additional-cni-plugins-vdspp" Jul 10 18:26:23.244825 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.244803 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-run-ovn\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.244938 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.244864 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-host-run-ovn-kubernetes\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.244938 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.244904 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-sys\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.245123 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.244978 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-lib-modules\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.245123 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.245076 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b8880de-adae-4ec1-93bd-fc39231ad6b0-host\") pod \"node-ca-n95vc\" (UID: \"9b8880de-adae-4ec1-93bd-fc39231ad6b0\") " pod="openshift-image-registry/node-ca-n95vc" Jul 10 18:26:23.245123 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.245111 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/94b9498d-bd74-4e9c-8177-c152abdacbb9-dbus\") pod \"global-pull-secret-syncer-6gtxh\" (UID: \"94b9498d-bd74-4e9c-8177-c152abdacbb9\") " pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:23.245288 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.245144 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad1d31e7-11f6-4626-b77c-f551838de192-sys-fs\") pod \"aws-ebs-csi-driver-node-89lpf\" (UID: \"ad1d31e7-11f6-4626-b77c-f551838de192\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" Jul 10 18:26:23.245288 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.245259 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/779eaa9e-7637-4bcc-886a-81bd645c0956-cni-binary-copy\") pod \"multus-additional-cni-plugins-vdspp\" (UID: \"779eaa9e-7637-4bcc-886a-81bd645c0956\") " pod="openshift-multus/multus-additional-cni-plugins-vdspp" Jul 10 18:26:23.245397 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.245295 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-host-slash\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.245397 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.245366 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdqgb\" (UniqueName: \"kubernetes.io/projected/ad1d31e7-11f6-4626-b77c-f551838de192-kube-api-access-bdqgb\") pod \"aws-ebs-csi-driver-node-89lpf\" (UID: \"ad1d31e7-11f6-4626-b77c-f551838de192\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" Jul 10 18:26:23.245506 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.245424 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-cnibin\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.245506 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.245458 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-etc-kubernetes\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.245506 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.245463 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b8880de-adae-4ec1-93bd-fc39231ad6b0-host\") pod \"node-ca-n95vc\" (UID: \"9b8880de-adae-4ec1-93bd-fc39231ad6b0\") " pod="openshift-image-registry/node-ca-n95vc" Jul 10 18:26:23.245666 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.245509 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs\") pod \"network-metrics-daemon-l7l77\" (UID: \"f4443fb4-d9ef-4a8c-8268-0aacbd93ce13\") " pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:23.245666 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.245558 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/779eaa9e-7637-4bcc-886a-81bd645c0956-cnibin\") pod \"multus-additional-cni-plugins-vdspp\" (UID: \"779eaa9e-7637-4bcc-886a-81bd645c0956\") " pod="openshift-multus/multus-additional-cni-plugins-vdspp" Jul 10 18:26:23.245790 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.245682 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/94b9498d-bd74-4e9c-8177-c152abdacbb9-kubelet-config\") pod \"global-pull-secret-syncer-6gtxh\" (UID: \"94b9498d-bd74-4e9c-8177-c152abdacbb9\") " pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:23.245790 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.245740 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad1d31e7-11f6-4626-b77c-f551838de192-etc-selinux\") pod \"aws-ebs-csi-driver-node-89lpf\" (UID: \"ad1d31e7-11f6-4626-b77c-f551838de192\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" Jul 10 18:26:23.245905 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.245841 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fc310c5e-2173-456f-ad25-4c5f1d990dca-agent-certs\") pod \"konnectivity-agent-h56zp\" (UID: \"fc310c5e-2173-456f-ad25-4c5f1d990dca\") " pod="kube-system/konnectivity-agent-h56zp" Jul 10 18:26:23.246080 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.246056 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/94b9498d-bd74-4e9c-8177-c152abdacbb9-dbus\") pod \"global-pull-secret-syncer-6gtxh\" (UID: \"94b9498d-bd74-4e9c-8177-c152abdacbb9\") " pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:23.247625 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.246141 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-etc-systemd\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.247625 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.246200 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b8880de-adae-4ec1-93bd-fc39231ad6b0-serviceca\") pod \"node-ca-n95vc\" (UID: \"9b8880de-adae-4ec1-93bd-fc39231ad6b0\") " pod="openshift-image-registry/node-ca-n95vc" Jul 10 18:26:23.247625 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.246231 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-host-kubelet\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.247625 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.246278 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-systemd-units\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.247625 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.246313 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-run-systemd\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.247625 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.246347 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5nn7\" (UniqueName: \"kubernetes.io/projected/873ff093-ab5b-412b-abad-220e0bb4acc3-kube-api-access-t5nn7\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.247625 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.246405 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fc310c5e-2173-456f-ad25-4c5f1d990dca-konnectivity-ca\") pod \"konnectivity-agent-h56zp\" (UID: \"fc310c5e-2173-456f-ad25-4c5f1d990dca\") " pod="kube-system/konnectivity-agent-h56zp" Jul 10 18:26:23.247625 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.246446 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-etc-kubernetes\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.247625 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.246481 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7de9ed6f-8bd3-4426-bfec-f269921f7920-tmp\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.247625 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.246518 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/779eaa9e-7637-4bcc-886a-81bd645c0956-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vdspp\" (UID: \"779eaa9e-7637-4bcc-886a-81bd645c0956\") " pod="openshift-multus/multus-additional-cni-plugins-vdspp" Jul 10 18:26:23.247625 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.246656 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-host-run-netns\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.247625 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.246714 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d31e7-11f6-4626-b77c-f551838de192-socket-dir\") pod \"aws-ebs-csi-driver-node-89lpf\" (UID: \"ad1d31e7-11f6-4626-b77c-f551838de192\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" Jul 10 18:26:23.247625 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.246748 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-etc-sysctl-d\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.247625 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.246801 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f4e04b79-b3c5-47cb-8c7f-6e111641180b-iptables-alerter-script\") pod \"iptables-alerter-2cclr\" (UID: \"f4e04b79-b3c5-47cb-8c7f-6e111641180b\") " pod="openshift-network-operator/iptables-alerter-2cclr" Jul 10 18:26:23.248411 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.246856 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-system-cni-dir\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.248411 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.246896 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-cni-binary-copy\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.248411 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.247021 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad1d31e7-11f6-4626-b77c-f551838de192-sys-fs\") pod \"aws-ebs-csi-driver-node-89lpf\" (UID: \"ad1d31e7-11f6-4626-b77c-f551838de192\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" Jul 10 18:26:23.248411 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.247264 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-host-run-k8s-cni-cncf-io\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.248411 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.247637 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/779eaa9e-7637-4bcc-886a-81bd645c0956-cni-binary-copy\") pod \"multus-additional-cni-plugins-vdspp\" (UID: \"779eaa9e-7637-4bcc-886a-81bd645c0956\") " pod="openshift-multus/multus-additional-cni-plugins-vdspp" Jul 10 18:26:23.248411 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.247762 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-host-run-ovn-kubernetes\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.248411 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.247832 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/873ff093-ab5b-412b-abad-220e0bb4acc3-ovn-node-metrics-cert\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.248411 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.247979 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f2651c8-dc6e-49db-b2f4-b152113e0b78-tmp-dir\") pod \"node-resolver-grgmt\" (UID: \"3f2651c8-dc6e-49db-b2f4-b152113e0b78\") " pod="openshift-dns/node-resolver-grgmt" Jul 10 18:26:23.248411 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.248020 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/779eaa9e-7637-4bcc-886a-81bd645c0956-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vdspp\" (UID: \"779eaa9e-7637-4bcc-886a-81bd645c0956\") " pod="openshift-multus/multus-additional-cni-plugins-vdspp" Jul 10 18:26:23.248411 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.248054 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/873ff093-ab5b-412b-abad-220e0bb4acc3-env-overrides\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.248411 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.248121 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94b9498d-bd74-4e9c-8177-c152abdacbb9-original-pull-secret\") pod \"global-pull-secret-syncer-6gtxh\" (UID: \"94b9498d-bd74-4e9c-8177-c152abdacbb9\") " pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:23.248411 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.248170 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d31e7-11f6-4626-b77c-f551838de192-registration-dir\") pod \"aws-ebs-csi-driver-node-89lpf\" (UID: \"ad1d31e7-11f6-4626-b77c-f551838de192\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" Jul 10 18:26:23.248411 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.248222 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-etc-modprobe-d\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.248411 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.248267 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-var-lib-kubelet\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.249222 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.248300 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ngzx\" (UniqueName: \"kubernetes.io/projected/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-kube-api-access-2ngzx\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.249222 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.248348 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3f2651c8-dc6e-49db-b2f4-b152113e0b78-hosts-file\") pod \"node-resolver-grgmt\" (UID: \"3f2651c8-dc6e-49db-b2f4-b152113e0b78\") " pod="openshift-dns/node-resolver-grgmt" Jul 10 18:26:23.249222 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.248382 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52t88\" (UniqueName: \"kubernetes.io/projected/9b8880de-adae-4ec1-93bd-fc39231ad6b0-kube-api-access-52t88\") pod \"node-ca-n95vc\" (UID: \"9b8880de-adae-4ec1-93bd-fc39231ad6b0\") " pod="openshift-image-registry/node-ca-n95vc" Jul 10 18:26:23.249222 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.248389 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fc310c5e-2173-456f-ad25-4c5f1d990dca-konnectivity-ca\") pod \"konnectivity-agent-h56zp\" (UID: \"fc310c5e-2173-456f-ad25-4c5f1d990dca\") " pod="kube-system/konnectivity-agent-h56zp" Jul 10 18:26:23.249222 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.248415 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-etc-openvswitch\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.249222 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.248453 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.249222 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.248513 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-host\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.249222 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.248609 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-host-var-lib-cni-multus\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.249222 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.248743 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/779eaa9e-7637-4bcc-886a-81bd645c0956-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vdspp\" (UID: \"779eaa9e-7637-4bcc-886a-81bd645c0956\") " pod="openshift-multus/multus-additional-cni-plugins-vdspp" Jul 10 18:26:23.249222 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.248837 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-host-run-netns\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.249222 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.248856 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3f2651c8-dc6e-49db-b2f4-b152113e0b78-hosts-file\") pod \"node-resolver-grgmt\" (UID: \"3f2651c8-dc6e-49db-b2f4-b152113e0b78\") " pod="openshift-dns/node-resolver-grgmt" Jul 10 18:26:23.249222 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.248877 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d31e7-11f6-4626-b77c-f551838de192-socket-dir\") pod \"aws-ebs-csi-driver-node-89lpf\" (UID: \"ad1d31e7-11f6-4626-b77c-f551838de192\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" Jul 10 18:26:23.249222 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.248932 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-etc-openvswitch\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.249222 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.248969 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d31e7-11f6-4626-b77c-f551838de192-registration-dir\") pod \"aws-ebs-csi-driver-node-89lpf\" (UID: \"ad1d31e7-11f6-4626-b77c-f551838de192\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" Jul 10 18:26:23.249948 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.249166 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-systemd-units\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.249948 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.249157 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fc310c5e-2173-456f-ad25-4c5f1d990dca-agent-certs\") pod \"konnectivity-agent-h56zp\" (UID: \"fc310c5e-2173-456f-ad25-4c5f1d990dca\") " pod="kube-system/konnectivity-agent-h56zp" Jul 10 18:26:23.249948 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.249215 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-host-slash\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.249948 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.249276 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f2651c8-dc6e-49db-b2f4-b152113e0b78-tmp-dir\") pod \"node-resolver-grgmt\" (UID: \"3f2651c8-dc6e-49db-b2f4-b152113e0b78\") " pod="openshift-dns/node-resolver-grgmt" Jul 10 18:26:23.249948 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.249414 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/779eaa9e-7637-4bcc-886a-81bd645c0956-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vdspp\" (UID: \"779eaa9e-7637-4bcc-886a-81bd645c0956\") " pod="openshift-multus/multus-additional-cni-plugins-vdspp" Jul 10 18:26:23.249948 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.249400 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-multus-conf-dir\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.249948 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.249475 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-etc-sysctl-conf\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.249948 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.249517 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-multus-socket-dir-parent\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.249948 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.249561 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-host-run-netns\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.249948 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.249592 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-host-var-lib-cni-bin\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.249948 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.249594 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9b8880de-adae-4ec1-93bd-fc39231ad6b0-serviceca\") pod \"node-ca-n95vc\" (UID: \"9b8880de-adae-4ec1-93bd-fc39231ad6b0\") " pod="openshift-image-registry/node-ca-n95vc" Jul 10 18:26:23.249948 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.249634 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.249948 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.249697 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-host-kubelet\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.249948 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:23.249710 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:26:23.249948 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.249801 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad1d31e7-11f6-4626-b77c-f551838de192-etc-selinux\") pod \"aws-ebs-csi-driver-node-89lpf\" (UID: \"ad1d31e7-11f6-4626-b77c-f551838de192\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" Jul 10 18:26:23.250734 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.249853 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/779eaa9e-7637-4bcc-886a-81bd645c0956-cnibin\") pod \"multus-additional-cni-plugins-vdspp\" (UID: \"779eaa9e-7637-4bcc-886a-81bd645c0956\") " pod="openshift-multus/multus-additional-cni-plugins-vdspp" Jul 10 18:26:23.250734 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:23.249854 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94b9498d-bd74-4e9c-8177-c152abdacbb9-original-pull-secret podName:94b9498d-bd74-4e9c-8177-c152abdacbb9 nodeName:}" failed. No retries permitted until 2026-07-10 18:26:23.749826532 +0000 UTC m=+2.983030792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94b9498d-bd74-4e9c-8177-c152abdacbb9-original-pull-secret") pod "global-pull-secret-syncer-6gtxh" (UID: "94b9498d-bd74-4e9c-8177-c152abdacbb9") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:26:23.250734 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.249897 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/94b9498d-bd74-4e9c-8177-c152abdacbb9-kubelet-config\") pod \"global-pull-secret-syncer-6gtxh\" (UID: \"94b9498d-bd74-4e9c-8177-c152abdacbb9\") " pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:23.250734 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.249941 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-run-systemd\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.250734 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.249975 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-multus-daemon-config\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.250734 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.250006 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-host-run-multus-certs\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.250734 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.250035 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-node-log\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.250734 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.250075 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7de9ed6f-8bd3-4426-bfec-f269921f7920-etc-tuned\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.250734 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.250113 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-host-var-lib-kubelet\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.250734 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.250153 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/779eaa9e-7637-4bcc-886a-81bd645c0956-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vdspp\" (UID: \"779eaa9e-7637-4bcc-886a-81bd645c0956\") " pod="openshift-multus/multus-additional-cni-plugins-vdspp" Jul 10 18:26:23.250734 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.250207 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-var-lib-openvswitch\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.250734 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.250368 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-var-lib-openvswitch\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.250734 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.250384 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/873ff093-ab5b-412b-abad-220e0bb4acc3-node-log\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.251470 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.250425 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/873ff093-ab5b-412b-abad-220e0bb4acc3-ovnkube-script-lib\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.251470 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.250505 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d31e7-11f6-4626-b77c-f551838de192-kubelet-dir\") pod \"aws-ebs-csi-driver-node-89lpf\" (UID: \"ad1d31e7-11f6-4626-b77c-f551838de192\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" Jul 10 18:26:23.251470 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.250568 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4ksx\" (UniqueName: \"kubernetes.io/projected/476cc43e-40b1-48f7-98f7-9a02a5478743-kube-api-access-c4ksx\") pod \"network-check-target-5jm85\" (UID: \"476cc43e-40b1-48f7-98f7-9a02a5478743\") " pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:23.251470 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.250606 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4e04b79-b3c5-47cb-8c7f-6e111641180b-host-slash\") pod \"iptables-alerter-2cclr\" (UID: \"f4e04b79-b3c5-47cb-8c7f-6e111641180b\") " pod="openshift-network-operator/iptables-alerter-2cclr" Jul 10 18:26:23.251470 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.250657 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dpzp\" (UniqueName: \"kubernetes.io/projected/f4e04b79-b3c5-47cb-8c7f-6e111641180b-kube-api-access-6dpzp\") pod \"iptables-alerter-2cclr\" (UID: \"f4e04b79-b3c5-47cb-8c7f-6e111641180b\") " pod="openshift-network-operator/iptables-alerter-2cclr" Jul 10 18:26:23.251470 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.250804 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/873ff093-ab5b-412b-abad-220e0bb4acc3-env-overrides\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.251470 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.251074 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/873ff093-ab5b-412b-abad-220e0bb4acc3-ovnkube-script-lib\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.251470 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.250804 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad1d31e7-11f6-4626-b77c-f551838de192-kubelet-dir\") pod \"aws-ebs-csi-driver-node-89lpf\" (UID: \"ad1d31e7-11f6-4626-b77c-f551838de192\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" Jul 10 18:26:23.251470 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.251260 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/779eaa9e-7637-4bcc-886a-81bd645c0956-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vdspp\" (UID: \"779eaa9e-7637-4bcc-886a-81bd645c0956\") " pod="openshift-multus/multus-additional-cni-plugins-vdspp" Jul 10 18:26:23.252629 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.252595 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsqpd\" (UniqueName: \"kubernetes.io/projected/3f2651c8-dc6e-49db-b2f4-b152113e0b78-kube-api-access-hsqpd\") pod \"node-resolver-grgmt\" (UID: \"3f2651c8-dc6e-49db-b2f4-b152113e0b78\") " pod="openshift-dns/node-resolver-grgmt" Jul 10 18:26:23.254010 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.253981 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k96qh\" (UniqueName: \"kubernetes.io/projected/779eaa9e-7637-4bcc-886a-81bd645c0956-kube-api-access-k96qh\") pod \"multus-additional-cni-plugins-vdspp\" (UID: \"779eaa9e-7637-4bcc-886a-81bd645c0956\") " pod="openshift-multus/multus-additional-cni-plugins-vdspp" Jul 10 18:26:23.255222 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.255202 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdqgb\" (UniqueName: \"kubernetes.io/projected/ad1d31e7-11f6-4626-b77c-f551838de192-kube-api-access-bdqgb\") pod \"aws-ebs-csi-driver-node-89lpf\" (UID: \"ad1d31e7-11f6-4626-b77c-f551838de192\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" Jul 10 18:26:23.259988 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.259966 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52t88\" (UniqueName: \"kubernetes.io/projected/9b8880de-adae-4ec1-93bd-fc39231ad6b0-kube-api-access-52t88\") pod \"node-ca-n95vc\" (UID: \"9b8880de-adae-4ec1-93bd-fc39231ad6b0\") " pod="openshift-image-registry/node-ca-n95vc" Jul 10 18:26:23.260477 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.260460 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5nn7\" (UniqueName: \"kubernetes.io/projected/873ff093-ab5b-412b-abad-220e0bb4acc3-kube-api-access-t5nn7\") pod \"ovnkube-node-9gfnq\" (UID: \"873ff093-ab5b-412b-abad-220e0bb4acc3\") " pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.350938 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.350875 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-cnibin\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.350938 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.350912 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-etc-kubernetes\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.351107 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.350941 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs\") pod \"network-metrics-daemon-l7l77\" (UID: \"f4443fb4-d9ef-4a8c-8268-0aacbd93ce13\") " pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:23.351107 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.350967 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-etc-systemd\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.351107 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.350993 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-etc-kubernetes\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.351107 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.350997 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-etc-kubernetes\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.351107 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351014 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7de9ed6f-8bd3-4426-bfec-f269921f7920-tmp\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.351107 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351038 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-etc-systemd\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.351107 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351039 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-etc-sysctl-d\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.351107 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:23.351063 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:26:23.351107 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351090 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f4e04b79-b3c5-47cb-8c7f-6e111641180b-iptables-alerter-script\") pod \"iptables-alerter-2cclr\" (UID: \"f4e04b79-b3c5-47cb-8c7f-6e111641180b\") " pod="openshift-network-operator/iptables-alerter-2cclr" Jul 10 18:26:23.351532 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351115 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-system-cni-dir\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.351532 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351059 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-etc-kubernetes\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.351532 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351144 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-etc-sysctl-d\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.351532 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351144 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-cni-binary-copy\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.351532 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.350999 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-cnibin\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.351532 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:23.351172 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs podName:f4443fb4-d9ef-4a8c-8268-0aacbd93ce13 nodeName:}" failed. No retries permitted until 2026-07-10 18:26:23.851151973 +0000 UTC m=+3.084356224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs") pod "network-metrics-daemon-l7l77" (UID: "f4443fb4-d9ef-4a8c-8268-0aacbd93ce13") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:26:23.351532 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351272 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-host-run-k8s-cni-cncf-io\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.351532 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351300 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-system-cni-dir\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.351532 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351320 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-etc-modprobe-d\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.351532 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351425 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-host-run-k8s-cni-cncf-io\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.351532 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351430 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-var-lib-kubelet\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.351532 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351474 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-etc-modprobe-d\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.351532 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351477 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-var-lib-kubelet\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.351532 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351475 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ngzx\" (UniqueName: \"kubernetes.io/projected/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-kube-api-access-2ngzx\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.352190 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351532 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-host\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.352190 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351559 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-host-var-lib-cni-multus\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.352190 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351589 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-host\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.352190 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351598 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-multus-conf-dir\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.352190 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351624 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-etc-sysctl-conf\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.352190 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351648 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-multus-socket-dir-parent\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.352190 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351652 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f4e04b79-b3c5-47cb-8c7f-6e111641180b-iptables-alerter-script\") pod \"iptables-alerter-2cclr\" (UID: \"f4e04b79-b3c5-47cb-8c7f-6e111641180b\") " pod="openshift-network-operator/iptables-alerter-2cclr" Jul 10 18:26:23.352190 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351674 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-host-run-netns\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.352190 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351646 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-multus-conf-dir\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.352190 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351699 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-host-var-lib-cni-bin\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.352190 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351626 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-host-var-lib-cni-multus\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.352190 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351744 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-host-run-netns\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.352190 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351742 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-multus-socket-dir-parent\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.352190 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351741 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-multus-daemon-config\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.352190 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351788 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-host-var-lib-cni-bin\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.352812 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351799 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-host-run-multus-certs\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.352812 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351788 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-etc-sysctl-conf\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.352812 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351831 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7de9ed6f-8bd3-4426-bfec-f269921f7920-etc-tuned\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.352812 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351855 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-host-var-lib-kubelet\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.352812 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351854 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-host-run-multus-certs\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.352812 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351879 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-cni-binary-copy\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.352812 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351914 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4ksx\" (UniqueName: \"kubernetes.io/projected/476cc43e-40b1-48f7-98f7-9a02a5478743-kube-api-access-c4ksx\") pod \"network-check-target-5jm85\" (UID: \"476cc43e-40b1-48f7-98f7-9a02a5478743\") " pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:23.352812 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351919 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-host-var-lib-kubelet\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.352812 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351942 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4e04b79-b3c5-47cb-8c7f-6e111641180b-host-slash\") pod \"iptables-alerter-2cclr\" (UID: \"f4e04b79-b3c5-47cb-8c7f-6e111641180b\") " pod="openshift-network-operator/iptables-alerter-2cclr" Jul 10 18:26:23.352812 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351967 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dpzp\" (UniqueName: \"kubernetes.io/projected/f4e04b79-b3c5-47cb-8c7f-6e111641180b-kube-api-access-6dpzp\") pod \"iptables-alerter-2cclr\" (UID: \"f4e04b79-b3c5-47cb-8c7f-6e111641180b\") " pod="openshift-network-operator/iptables-alerter-2cclr" Jul 10 18:26:23.352812 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.351995 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkl6p\" (UniqueName: \"kubernetes.io/projected/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-kube-api-access-kkl6p\") pod \"network-metrics-daemon-l7l77\" (UID: \"f4443fb4-d9ef-4a8c-8268-0aacbd93ce13\") " pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:23.352812 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.352004 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4e04b79-b3c5-47cb-8c7f-6e111641180b-host-slash\") pod \"iptables-alerter-2cclr\" (UID: \"f4e04b79-b3c5-47cb-8c7f-6e111641180b\") " pod="openshift-network-operator/iptables-alerter-2cclr" Jul 10 18:26:23.352812 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.352025 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-etc-sysconfig\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.352812 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.352051 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-run\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.352812 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.352075 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgh4q\" (UniqueName: \"kubernetes.io/projected/7de9ed6f-8bd3-4426-bfec-f269921f7920-kube-api-access-hgh4q\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.353401 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.352107 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-multus-cni-dir\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.353401 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.352148 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-os-release\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.353401 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.352177 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-hostroot\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.353401 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.352186 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-multus-cni-dir\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.353401 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.352225 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-sys\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.353401 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.352236 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-multus-daemon-config\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.353401 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.352234 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-run\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.353401 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.352250 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-lib-modules\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.353401 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.352295 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-hostroot\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.353401 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.352311 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-os-release\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.353401 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.352345 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-etc-sysconfig\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.353401 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.352341 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-sys\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.353401 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.352447 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7de9ed6f-8bd3-4426-bfec-f269921f7920-lib-modules\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.354027 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.353534 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7de9ed6f-8bd3-4426-bfec-f269921f7920-tmp\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.354027 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.353916 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7de9ed6f-8bd3-4426-bfec-f269921f7920-etc-tuned\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.360507 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:23.360486 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:26:23.360597 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:23.360512 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:26:23.360597 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:23.360526 2564 projected.go:196] Error preparing data for projected volume kube-api-access-c4ksx for pod openshift-network-diagnostics/network-check-target-5jm85: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:26:23.360597 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:23.360585 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/476cc43e-40b1-48f7-98f7-9a02a5478743-kube-api-access-c4ksx podName:476cc43e-40b1-48f7-98f7-9a02a5478743 nodeName:}" failed. No retries permitted until 2026-07-10 18:26:23.860568101 +0000 UTC m=+3.093772357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c4ksx" (UniqueName: "kubernetes.io/projected/476cc43e-40b1-48f7-98f7-9a02a5478743-kube-api-access-c4ksx") pod "network-check-target-5jm85" (UID: "476cc43e-40b1-48f7-98f7-9a02a5478743") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:26:23.362060 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.362036 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ngzx\" (UniqueName: \"kubernetes.io/projected/5a7b8cfb-1da3-4510-b85b-21ce665d6c22-kube-api-access-2ngzx\") pod \"multus-ww2gt\" (UID: \"5a7b8cfb-1da3-4510-b85b-21ce665d6c22\") " pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.362583 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.362559 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dpzp\" (UniqueName: \"kubernetes.io/projected/f4e04b79-b3c5-47cb-8c7f-6e111641180b-kube-api-access-6dpzp\") pod \"iptables-alerter-2cclr\" (UID: \"f4e04b79-b3c5-47cb-8c7f-6e111641180b\") " pod="openshift-network-operator/iptables-alerter-2cclr" Jul 10 18:26:23.363846 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.363820 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkl6p\" (UniqueName: \"kubernetes.io/projected/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-kube-api-access-kkl6p\") pod \"network-metrics-daemon-l7l77\" (UID: \"f4443fb4-d9ef-4a8c-8268-0aacbd93ce13\") " pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:23.363846 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.363836 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgh4q\" (UniqueName: \"kubernetes.io/projected/7de9ed6f-8bd3-4426-bfec-f269921f7920-kube-api-access-hgh4q\") pod \"tuned-kpclp\" (UID: \"7de9ed6f-8bd3-4426-bfec-f269921f7920\") " pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.405403 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.405357 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-57.ec2.internal" event={"ID":"e4616fa0f000af83247fd8796e5f0c82","Type":"ContainerStarted","Data":"e53988bba61147aec7e4fc317e251056bfb8a2e339c89ac1ae0a4c781008cd7f"} Jul 10 18:26:23.406602 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.406578 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-57.ec2.internal" event={"ID":"f8d1abcbcf866db0239ee93f6a04f030","Type":"ContainerStarted","Data":"6888fc29edb812d12f6e0d5c5ec217651e628615195828cdae8258de127d4b9a"} Jul 10 18:26:23.417953 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.417931 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" Jul 10 18:26:23.425000 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.424940 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n95vc" Jul 10 18:26:23.428342 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:23.428308 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad1d31e7_11f6_4626_b77c_f551838de192.slice/crio-0a80e173097d7a655fb9ef08d81c044d08e4507def8e914592b2c92419a08837 WatchSource:0}: Error finding container 0a80e173097d7a655fb9ef08d81c044d08e4507def8e914592b2c92419a08837: Status 404 returned error can't find the container with id 0a80e173097d7a655fb9ef08d81c044d08e4507def8e914592b2c92419a08837 Jul 10 18:26:23.435413 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.435340 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:23.436096 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:23.436068 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b8880de_adae_4ec1_93bd_fc39231ad6b0.slice/crio-f5b2b504661e9d32e88869563c84eb3238d8529d8eff5295cc2489add84842e8 WatchSource:0}: Error finding container f5b2b504661e9d32e88869563c84eb3238d8529d8eff5295cc2489add84842e8: Status 404 returned error can't find the container with id f5b2b504661e9d32e88869563c84eb3238d8529d8eff5295cc2489add84842e8 Jul 10 18:26:23.438654 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.438637 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h56zp" Jul 10 18:26:23.445685 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.445542 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-grgmt" Jul 10 18:26:23.446972 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:23.446950 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod873ff093_ab5b_412b_abad_220e0bb4acc3.slice/crio-634ceda751a3da3d81c0e77948ad98a584195e03e3c3b8f5b6aea08fc65269fc WatchSource:0}: Error finding container 634ceda751a3da3d81c0e77948ad98a584195e03e3c3b8f5b6aea08fc65269fc: Status 404 returned error can't find the container with id 634ceda751a3da3d81c0e77948ad98a584195e03e3c3b8f5b6aea08fc65269fc Jul 10 18:26:23.450433 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.450413 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vdspp" Jul 10 18:26:23.452663 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:23.452637 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc310c5e_2173_456f_ad25_4c5f1d990dca.slice/crio-84dea45a0cf65c11c1b5006b6f940d8b3f9f047278516c951e4a37240ea136d1 WatchSource:0}: Error finding container 84dea45a0cf65c11c1b5006b6f940d8b3f9f047278516c951e4a37240ea136d1: Status 404 returned error can't find the container with id 84dea45a0cf65c11c1b5006b6f940d8b3f9f047278516c951e4a37240ea136d1 Jul 10 18:26:23.456768 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.456597 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2cclr" Jul 10 18:26:23.462123 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.462104 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ww2gt" Jul 10 18:26:23.467247 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.467100 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kpclp" Jul 10 18:26:23.471987 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:23.471824 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f2651c8_dc6e_49db_b2f4_b152113e0b78.slice/crio-f5d875e38f5013ddef60aa53f6b774ab3322844a4b90a877bc8c9a9a932fdb89 WatchSource:0}: Error finding container f5d875e38f5013ddef60aa53f6b774ab3322844a4b90a877bc8c9a9a932fdb89: Status 404 returned error can't find the container with id f5d875e38f5013ddef60aa53f6b774ab3322844a4b90a877bc8c9a9a932fdb89 Jul 10 18:26:23.472538 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:23.472511 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod779eaa9e_7637_4bcc_886a_81bd645c0956.slice/crio-c55de6a0afc2804e8314ced4f9f020295677ded35c24dbe61c14f1c7a572c09d WatchSource:0}: Error finding container c55de6a0afc2804e8314ced4f9f020295677ded35c24dbe61c14f1c7a572c09d: Status 404 returned error can't find the container with id c55de6a0afc2804e8314ced4f9f020295677ded35c24dbe61c14f1c7a572c09d Jul 10 18:26:23.483368 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:23.483262 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a7b8cfb_1da3_4510_b85b_21ce665d6c22.slice/crio-5fc33556a4564120be238804e426bc9153d62e5f060fb9fe34909e89c5b906eb WatchSource:0}: Error finding container 5fc33556a4564120be238804e426bc9153d62e5f060fb9fe34909e89c5b906eb: Status 404 returned error can't find the container with id 5fc33556a4564120be238804e426bc9153d62e5f060fb9fe34909e89c5b906eb Jul 10 18:26:23.488569 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:23.488533 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de9ed6f_8bd3_4426_bfec_f269921f7920.slice/crio-601860cee3b6e18efde87caa612d0bc142ab0096a2e770914cc2d6833ab7a82f WatchSource:0}: Error finding container 601860cee3b6e18efde87caa612d0bc142ab0096a2e770914cc2d6833ab7a82f: Status 404 returned error can't find the container with id 601860cee3b6e18efde87caa612d0bc142ab0096a2e770914cc2d6833ab7a82f Jul 10 18:26:23.502248 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.502226 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 18:26:23.754875 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.754796 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94b9498d-bd74-4e9c-8177-c152abdacbb9-original-pull-secret\") pod \"global-pull-secret-syncer-6gtxh\" (UID: \"94b9498d-bd74-4e9c-8177-c152abdacbb9\") " pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:23.755026 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:23.754938 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:26:23.755026 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:23.755000 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94b9498d-bd74-4e9c-8177-c152abdacbb9-original-pull-secret podName:94b9498d-bd74-4e9c-8177-c152abdacbb9 nodeName:}" failed. No retries permitted until 2026-07-10 18:26:24.754980094 +0000 UTC m=+3.988184346 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94b9498d-bd74-4e9c-8177-c152abdacbb9-original-pull-secret") pod "global-pull-secret-syncer-6gtxh" (UID: "94b9498d-bd74-4e9c-8177-c152abdacbb9") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:26:23.855384 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.855314 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs\") pod \"network-metrics-daemon-l7l77\" (UID: \"f4443fb4-d9ef-4a8c-8268-0aacbd93ce13\") " pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:23.855565 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:23.855495 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:26:23.855638 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:23.855571 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs podName:f4443fb4-d9ef-4a8c-8268-0aacbd93ce13 nodeName:}" failed. No retries permitted until 2026-07-10 18:26:24.85555039 +0000 UTC m=+4.088754646 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs") pod "network-metrics-daemon-l7l77" (UID: "f4443fb4-d9ef-4a8c-8268-0aacbd93ce13") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:26:23.956181 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:23.956147 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4ksx\" (UniqueName: \"kubernetes.io/projected/476cc43e-40b1-48f7-98f7-9a02a5478743-kube-api-access-c4ksx\") pod \"network-check-target-5jm85\" (UID: \"476cc43e-40b1-48f7-98f7-9a02a5478743\") " pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:23.956331 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:23.956299 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:26:23.956331 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:23.956322 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:26:23.956438 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:23.956336 2564 projected.go:196] Error preparing data for projected volume kube-api-access-c4ksx for pod openshift-network-diagnostics/network-check-target-5jm85: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:26:23.956438 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:23.956396 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/476cc43e-40b1-48f7-98f7-9a02a5478743-kube-api-access-c4ksx podName:476cc43e-40b1-48f7-98f7-9a02a5478743 nodeName:}" failed. No retries permitted until 2026-07-10 18:26:24.956381454 +0000 UTC m=+4.189585695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c4ksx" (UniqueName: "kubernetes.io/projected/476cc43e-40b1-48f7-98f7-9a02a5478743-kube-api-access-c4ksx") pod "network-check-target-5jm85" (UID: "476cc43e-40b1-48f7-98f7-9a02a5478743") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:26:24.179010 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:24.178869 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 18:21:23 +0000 UTC" deadline="2028-03-09 05:18:29.468091814 +0000 UTC" Jul 10 18:26:24.179010 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:24.178907 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14578h52m5.28918996s" Jul 10 18:26:24.402177 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:24.401309 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:24.402177 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:24.401431 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtxh" podUID="94b9498d-bd74-4e9c-8177-c152abdacbb9" Jul 10 18:26:24.402177 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:24.401881 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:24.402177 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:24.402018 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7l77" podUID="f4443fb4-d9ef-4a8c-8268-0aacbd93ce13" Jul 10 18:26:24.402177 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:24.402068 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:24.402177 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:24.402133 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jm85" podUID="476cc43e-40b1-48f7-98f7-9a02a5478743" Jul 10 18:26:24.413017 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:24.412946 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kpclp" event={"ID":"7de9ed6f-8bd3-4426-bfec-f269921f7920","Type":"ContainerStarted","Data":"601860cee3b6e18efde87caa612d0bc142ab0096a2e770914cc2d6833ab7a82f"} Jul 10 18:26:24.415308 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:24.415225 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2cclr" event={"ID":"f4e04b79-b3c5-47cb-8c7f-6e111641180b","Type":"ContainerStarted","Data":"b4fa6f953cf89735da5a480b175cf269622b52e8f20294911f52cfff8c4b1099"} Jul 10 18:26:24.418143 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:24.418073 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdspp" event={"ID":"779eaa9e-7637-4bcc-886a-81bd645c0956","Type":"ContainerStarted","Data":"c55de6a0afc2804e8314ced4f9f020295677ded35c24dbe61c14f1c7a572c09d"} Jul 10 18:26:24.420540 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:24.420447 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" event={"ID":"873ff093-ab5b-412b-abad-220e0bb4acc3","Type":"ContainerStarted","Data":"634ceda751a3da3d81c0e77948ad98a584195e03e3c3b8f5b6aea08fc65269fc"} Jul 10 18:26:24.423794 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:24.423724 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n95vc" event={"ID":"9b8880de-adae-4ec1-93bd-fc39231ad6b0","Type":"ContainerStarted","Data":"f5b2b504661e9d32e88869563c84eb3238d8529d8eff5295cc2489add84842e8"} Jul 10 18:26:24.425251 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:24.425166 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" event={"ID":"ad1d31e7-11f6-4626-b77c-f551838de192","Type":"ContainerStarted","Data":"0a80e173097d7a655fb9ef08d81c044d08e4507def8e914592b2c92419a08837"} Jul 10 18:26:24.427222 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:24.427150 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ww2gt" event={"ID":"5a7b8cfb-1da3-4510-b85b-21ce665d6c22","Type":"ContainerStarted","Data":"5fc33556a4564120be238804e426bc9153d62e5f060fb9fe34909e89c5b906eb"} Jul 10 18:26:24.429463 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:24.429383 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-grgmt" event={"ID":"3f2651c8-dc6e-49db-b2f4-b152113e0b78","Type":"ContainerStarted","Data":"f5d875e38f5013ddef60aa53f6b774ab3322844a4b90a877bc8c9a9a932fdb89"} Jul 10 18:26:24.437723 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:24.431665 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h56zp" event={"ID":"fc310c5e-2173-456f-ad25-4c5f1d990dca","Type":"ContainerStarted","Data":"84dea45a0cf65c11c1b5006b6f940d8b3f9f047278516c951e4a37240ea136d1"} Jul 10 18:26:24.763187 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:24.762538 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94b9498d-bd74-4e9c-8177-c152abdacbb9-original-pull-secret\") pod \"global-pull-secret-syncer-6gtxh\" (UID: \"94b9498d-bd74-4e9c-8177-c152abdacbb9\") " pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:24.763187 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:24.762743 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:26:24.763187 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:24.762806 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94b9498d-bd74-4e9c-8177-c152abdacbb9-original-pull-secret podName:94b9498d-bd74-4e9c-8177-c152abdacbb9 nodeName:}" failed. No retries permitted until 2026-07-10 18:26:26.762789647 +0000 UTC m=+5.995993890 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94b9498d-bd74-4e9c-8177-c152abdacbb9-original-pull-secret") pod "global-pull-secret-syncer-6gtxh" (UID: "94b9498d-bd74-4e9c-8177-c152abdacbb9") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:26:24.864228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:24.863686 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs\") pod \"network-metrics-daemon-l7l77\" (UID: \"f4443fb4-d9ef-4a8c-8268-0aacbd93ce13\") " pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:24.864228 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:24.863867 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:26:24.864228 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:24.863922 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs podName:f4443fb4-d9ef-4a8c-8268-0aacbd93ce13 nodeName:}" failed. No retries permitted until 2026-07-10 18:26:26.863905077 +0000 UTC m=+6.097109319 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs") pod "network-metrics-daemon-l7l77" (UID: "f4443fb4-d9ef-4a8c-8268-0aacbd93ce13") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:26:24.965408 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:24.964656 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4ksx\" (UniqueName: \"kubernetes.io/projected/476cc43e-40b1-48f7-98f7-9a02a5478743-kube-api-access-c4ksx\") pod \"network-check-target-5jm85\" (UID: \"476cc43e-40b1-48f7-98f7-9a02a5478743\") " pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:24.965408 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:24.964833 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:26:24.965408 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:24.964856 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:26:24.965408 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:24.964871 2564 projected.go:196] Error preparing data for projected volume kube-api-access-c4ksx for pod openshift-network-diagnostics/network-check-target-5jm85: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:26:24.965408 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:24.964943 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/476cc43e-40b1-48f7-98f7-9a02a5478743-kube-api-access-c4ksx podName:476cc43e-40b1-48f7-98f7-9a02a5478743 nodeName:}" failed. No retries permitted until 2026-07-10 18:26:26.964924291 +0000 UTC m=+6.198128546 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c4ksx" (UniqueName: "kubernetes.io/projected/476cc43e-40b1-48f7-98f7-9a02a5478743-kube-api-access-c4ksx") pod "network-check-target-5jm85" (UID: "476cc43e-40b1-48f7-98f7-9a02a5478743") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:26:25.179315 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:25.179169 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 18:21:23 +0000 UTC" deadline="2028-02-24 23:11:03.874407741 +0000 UTC" Jul 10 18:26:25.179315 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:25.179228 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14260h44m38.695184363s" Jul 10 18:26:26.402676 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:26.401561 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:26.402676 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:26.401983 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7l77" podUID="f4443fb4-d9ef-4a8c-8268-0aacbd93ce13" Jul 10 18:26:26.402676 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:26.402365 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:26.402676 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:26.402454 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtxh" podUID="94b9498d-bd74-4e9c-8177-c152abdacbb9" Jul 10 18:26:26.402676 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:26.402517 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:26.402676 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:26.402606 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jm85" podUID="476cc43e-40b1-48f7-98f7-9a02a5478743" Jul 10 18:26:26.442957 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:26.442925 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-57.ec2.internal" event={"ID":"e4616fa0f000af83247fd8796e5f0c82","Type":"ContainerStarted","Data":"56a758193cfc10c45b4947fefb9c19d454628ba32fe0057a66554625ee71a334"} Jul 10 18:26:26.780149 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:26.779475 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94b9498d-bd74-4e9c-8177-c152abdacbb9-original-pull-secret\") pod \"global-pull-secret-syncer-6gtxh\" (UID: \"94b9498d-bd74-4e9c-8177-c152abdacbb9\") " pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:26.780149 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:26.779642 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:26:26.780149 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:26.779716 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94b9498d-bd74-4e9c-8177-c152abdacbb9-original-pull-secret podName:94b9498d-bd74-4e9c-8177-c152abdacbb9 nodeName:}" failed. No retries permitted until 2026-07-10 18:26:30.77968459 +0000 UTC m=+10.012888835 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94b9498d-bd74-4e9c-8177-c152abdacbb9-original-pull-secret") pod "global-pull-secret-syncer-6gtxh" (UID: "94b9498d-bd74-4e9c-8177-c152abdacbb9") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:26:26.880211 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:26.880173 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs\") pod \"network-metrics-daemon-l7l77\" (UID: \"f4443fb4-d9ef-4a8c-8268-0aacbd93ce13\") " pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:26.880400 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:26.880382 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:26:26.880466 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:26.880441 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs podName:f4443fb4-d9ef-4a8c-8268-0aacbd93ce13 nodeName:}" failed. No retries permitted until 2026-07-10 18:26:30.880423154 +0000 UTC m=+10.113627397 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs") pod "network-metrics-daemon-l7l77" (UID: "f4443fb4-d9ef-4a8c-8268-0aacbd93ce13") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:26:26.981306 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:26.981266 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4ksx\" (UniqueName: \"kubernetes.io/projected/476cc43e-40b1-48f7-98f7-9a02a5478743-kube-api-access-c4ksx\") pod \"network-check-target-5jm85\" (UID: \"476cc43e-40b1-48f7-98f7-9a02a5478743\") " pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:26.981479 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:26.981439 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:26:26.981479 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:26.981458 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:26:26.981583 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:26.981518 2564 projected.go:196] Error preparing data for projected volume kube-api-access-c4ksx for pod openshift-network-diagnostics/network-check-target-5jm85: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:26:26.981583 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:26.981578 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/476cc43e-40b1-48f7-98f7-9a02a5478743-kube-api-access-c4ksx podName:476cc43e-40b1-48f7-98f7-9a02a5478743 nodeName:}" failed. No retries permitted until 2026-07-10 18:26:30.981559281 +0000 UTC m=+10.214763535 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c4ksx" (UniqueName: "kubernetes.io/projected/476cc43e-40b1-48f7-98f7-9a02a5478743-kube-api-access-c4ksx") pod "network-check-target-5jm85" (UID: "476cc43e-40b1-48f7-98f7-9a02a5478743") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:26:28.400941 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:28.400902 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:28.401395 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:28.401049 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:28.401395 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:28.401052 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jm85" podUID="476cc43e-40b1-48f7-98f7-9a02a5478743" Jul 10 18:26:28.401395 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:28.401090 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:28.401395 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:28.401203 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7l77" podUID="f4443fb4-d9ef-4a8c-8268-0aacbd93ce13" Jul 10 18:26:28.401395 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:28.401286 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtxh" podUID="94b9498d-bd74-4e9c-8177-c152abdacbb9" Jul 10 18:26:30.400625 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:30.400534 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:30.400625 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:30.400585 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:30.401127 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:30.400548 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:30.401127 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:30.400713 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7l77" podUID="f4443fb4-d9ef-4a8c-8268-0aacbd93ce13" Jul 10 18:26:30.401127 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:30.400795 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jm85" podUID="476cc43e-40b1-48f7-98f7-9a02a5478743" Jul 10 18:26:30.401127 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:30.400880 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtxh" podUID="94b9498d-bd74-4e9c-8177-c152abdacbb9" Jul 10 18:26:30.812054 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:30.811797 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94b9498d-bd74-4e9c-8177-c152abdacbb9-original-pull-secret\") pod \"global-pull-secret-syncer-6gtxh\" (UID: \"94b9498d-bd74-4e9c-8177-c152abdacbb9\") " pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:30.812054 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:30.811932 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:26:30.812054 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:30.811991 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94b9498d-bd74-4e9c-8177-c152abdacbb9-original-pull-secret podName:94b9498d-bd74-4e9c-8177-c152abdacbb9 nodeName:}" failed. No retries permitted until 2026-07-10 18:26:38.811973375 +0000 UTC m=+18.045177631 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94b9498d-bd74-4e9c-8177-c152abdacbb9-original-pull-secret") pod "global-pull-secret-syncer-6gtxh" (UID: "94b9498d-bd74-4e9c-8177-c152abdacbb9") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:26:30.913049 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:30.913016 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs\") pod \"network-metrics-daemon-l7l77\" (UID: \"f4443fb4-d9ef-4a8c-8268-0aacbd93ce13\") " pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:30.913220 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:30.913183 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:26:30.913288 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:30.913249 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs podName:f4443fb4-d9ef-4a8c-8268-0aacbd93ce13 nodeName:}" failed. No retries permitted until 2026-07-10 18:26:38.913229873 +0000 UTC m=+18.146434118 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs") pod "network-metrics-daemon-l7l77" (UID: "f4443fb4-d9ef-4a8c-8268-0aacbd93ce13") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:26:31.014558 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:31.013990 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4ksx\" (UniqueName: \"kubernetes.io/projected/476cc43e-40b1-48f7-98f7-9a02a5478743-kube-api-access-c4ksx\") pod \"network-check-target-5jm85\" (UID: \"476cc43e-40b1-48f7-98f7-9a02a5478743\") " pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:31.014558 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:31.014153 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:26:31.014558 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:31.014174 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:26:31.014558 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:31.014187 2564 projected.go:196] Error preparing data for projected volume kube-api-access-c4ksx for pod openshift-network-diagnostics/network-check-target-5jm85: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:26:31.014558 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:31.014240 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/476cc43e-40b1-48f7-98f7-9a02a5478743-kube-api-access-c4ksx podName:476cc43e-40b1-48f7-98f7-9a02a5478743 nodeName:}" failed. No retries permitted until 2026-07-10 18:26:39.01422104 +0000 UTC m=+18.247425294 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c4ksx" (UniqueName: "kubernetes.io/projected/476cc43e-40b1-48f7-98f7-9a02a5478743-kube-api-access-c4ksx") pod "network-check-target-5jm85" (UID: "476cc43e-40b1-48f7-98f7-9a02a5478743") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:26:31.453839 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:31.453803 2564 generic.go:356] "Generic (PLEG): container finished" podID="e4616fa0f000af83247fd8796e5f0c82" containerID="56a758193cfc10c45b4947fefb9c19d454628ba32fe0057a66554625ee71a334" exitCode=0 Jul 10 18:26:31.454281 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:31.453855 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-57.ec2.internal" event={"ID":"e4616fa0f000af83247fd8796e5f0c82","Type":"ContainerDied","Data":"56a758193cfc10c45b4947fefb9c19d454628ba32fe0057a66554625ee71a334"} Jul 10 18:26:32.400991 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:32.400953 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:32.400991 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:32.400975 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:32.401246 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:32.400953 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:32.401246 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:32.401085 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtxh" podUID="94b9498d-bd74-4e9c-8177-c152abdacbb9" Jul 10 18:26:32.401246 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:32.401176 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7l77" podUID="f4443fb4-d9ef-4a8c-8268-0aacbd93ce13" Jul 10 18:26:32.401410 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:32.401261 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jm85" podUID="476cc43e-40b1-48f7-98f7-9a02a5478743" Jul 10 18:26:34.400352 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:34.400275 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:34.400352 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:34.400309 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:34.400784 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:34.400275 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:34.400784 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:34.400413 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7l77" podUID="f4443fb4-d9ef-4a8c-8268-0aacbd93ce13" Jul 10 18:26:34.400784 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:34.400485 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jm85" podUID="476cc43e-40b1-48f7-98f7-9a02a5478743" Jul 10 18:26:34.400784 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:34.400552 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtxh" podUID="94b9498d-bd74-4e9c-8177-c152abdacbb9" Jul 10 18:26:36.400568 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:36.400538 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:36.401039 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:36.400579 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:36.401039 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:36.400630 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jm85" podUID="476cc43e-40b1-48f7-98f7-9a02a5478743" Jul 10 18:26:36.401039 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:36.400579 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:36.401039 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:36.400711 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7l77" podUID="f4443fb4-d9ef-4a8c-8268-0aacbd93ce13" Jul 10 18:26:36.401039 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:36.400767 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtxh" podUID="94b9498d-bd74-4e9c-8177-c152abdacbb9" Jul 10 18:26:38.400623 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:38.400587 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:38.401189 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:38.400639 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:38.401189 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:38.400721 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:38.401189 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:38.400737 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jm85" podUID="476cc43e-40b1-48f7-98f7-9a02a5478743" Jul 10 18:26:38.401189 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:38.400844 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7l77" podUID="f4443fb4-d9ef-4a8c-8268-0aacbd93ce13" Jul 10 18:26:38.401189 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:38.400914 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtxh" podUID="94b9498d-bd74-4e9c-8177-c152abdacbb9" Jul 10 18:26:38.879047 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:38.878952 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94b9498d-bd74-4e9c-8177-c152abdacbb9-original-pull-secret\") pod \"global-pull-secret-syncer-6gtxh\" (UID: \"94b9498d-bd74-4e9c-8177-c152abdacbb9\") " pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:38.879211 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:38.879113 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:26:38.879211 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:38.879185 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94b9498d-bd74-4e9c-8177-c152abdacbb9-original-pull-secret podName:94b9498d-bd74-4e9c-8177-c152abdacbb9 nodeName:}" failed. No retries permitted until 2026-07-10 18:26:54.879165209 +0000 UTC m=+34.112369459 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94b9498d-bd74-4e9c-8177-c152abdacbb9-original-pull-secret") pod "global-pull-secret-syncer-6gtxh" (UID: "94b9498d-bd74-4e9c-8177-c152abdacbb9") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:26:38.980183 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:38.980143 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs\") pod \"network-metrics-daemon-l7l77\" (UID: \"f4443fb4-d9ef-4a8c-8268-0aacbd93ce13\") " pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:38.980340 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:38.980271 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:26:38.980406 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:38.980342 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs podName:f4443fb4-d9ef-4a8c-8268-0aacbd93ce13 nodeName:}" failed. No retries permitted until 2026-07-10 18:26:54.980321344 +0000 UTC m=+34.213525605 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs") pod "network-metrics-daemon-l7l77" (UID: "f4443fb4-d9ef-4a8c-8268-0aacbd93ce13") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:26:39.081542 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:39.081505 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4ksx\" (UniqueName: \"kubernetes.io/projected/476cc43e-40b1-48f7-98f7-9a02a5478743-kube-api-access-c4ksx\") pod \"network-check-target-5jm85\" (UID: \"476cc43e-40b1-48f7-98f7-9a02a5478743\") " pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:39.081727 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:39.081653 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:26:39.081727 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:39.081671 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:26:39.081727 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:39.081681 2564 projected.go:196] Error preparing data for projected volume kube-api-access-c4ksx for pod openshift-network-diagnostics/network-check-target-5jm85: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:26:39.081903 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:39.081748 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/476cc43e-40b1-48f7-98f7-9a02a5478743-kube-api-access-c4ksx podName:476cc43e-40b1-48f7-98f7-9a02a5478743 nodeName:}" failed. No retries permitted until 2026-07-10 18:26:55.081735348 +0000 UTC m=+34.314939585 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-c4ksx" (UniqueName: "kubernetes.io/projected/476cc43e-40b1-48f7-98f7-9a02a5478743-kube-api-access-c4ksx") pod "network-check-target-5jm85" (UID: "476cc43e-40b1-48f7-98f7-9a02a5478743") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:26:40.401241 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:40.401209 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:40.401646 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:40.401263 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:40.401646 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:40.401210 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:40.401646 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:40.401341 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7l77" podUID="f4443fb4-d9ef-4a8c-8268-0aacbd93ce13" Jul 10 18:26:40.401646 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:40.401413 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jm85" podUID="476cc43e-40b1-48f7-98f7-9a02a5478743" Jul 10 18:26:40.401646 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:40.401510 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtxh" podUID="94b9498d-bd74-4e9c-8177-c152abdacbb9" Jul 10 18:26:42.400766 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:42.400585 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:42.400766 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:42.400750 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:42.401211 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:42.400694 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:42.401211 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:42.400901 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtxh" podUID="94b9498d-bd74-4e9c-8177-c152abdacbb9" Jul 10 18:26:42.401211 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:42.400951 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7l77" podUID="f4443fb4-d9ef-4a8c-8268-0aacbd93ce13" Jul 10 18:26:42.401211 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:42.401035 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jm85" podUID="476cc43e-40b1-48f7-98f7-9a02a5478743" Jul 10 18:26:42.472764 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:42.472731 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-57.ec2.internal" event={"ID":"f8d1abcbcf866db0239ee93f6a04f030","Type":"ContainerStarted","Data":"4eac66d8368e6e0dca6d8ff9d3df1fb9f8b894aaa91bcbbb089dc202b333a3b0"} Jul 10 18:26:42.476442 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:42.475645 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ww2gt" event={"ID":"5a7b8cfb-1da3-4510-b85b-21ce665d6c22","Type":"ContainerStarted","Data":"25bade3f52515bc3a69178e240b44db9c33f85da59cff1f00bdbb4737ea695d8"} Jul 10 18:26:42.480718 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:42.480672 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-grgmt" event={"ID":"3f2651c8-dc6e-49db-b2f4-b152113e0b78","Type":"ContainerStarted","Data":"6e10356f2628fd4a5927a01ad1fe3e4e860bf2e59e3a24b7a7ab4fa74efb58d8"} Jul 10 18:26:42.482734 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:42.482597 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h56zp" event={"ID":"fc310c5e-2173-456f-ad25-4c5f1d990dca","Type":"ContainerStarted","Data":"15a6c14a3099eb001574ad97ede7b152adeeb1177846853d67a1aafd90992f1e"} Jul 10 18:26:42.484803 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:42.484742 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-57.ec2.internal" event={"ID":"e4616fa0f000af83247fd8796e5f0c82","Type":"ContainerStarted","Data":"8eb91805ffee4cd6d79bac48519b8edd309f1a711df1809ffe37aa5ff90bbdd2"} Jul 10 18:26:42.486406 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:42.486354 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-57.ec2.internal" podStartSLOduration=20.486337789 podStartE2EDuration="20.486337789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:26:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:26:42.485971079 +0000 UTC m=+21.719175339" watchObservedRunningTime="2026-07-10 18:26:42.486337789 +0000 UTC m=+21.719542048" Jul 10 18:26:42.486539 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:42.486518 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kpclp" event={"ID":"7de9ed6f-8bd3-4426-bfec-f269921f7920","Type":"ContainerStarted","Data":"b4a0328b9a2cc7cd95694aa30b8ba2c5934dafdda8ac95dfb380a6f387788c71"} Jul 10 18:26:42.488498 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:42.488471 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdspp" event={"ID":"779eaa9e-7637-4bcc-886a-81bd645c0956","Type":"ContainerStarted","Data":"ff8e76c9dae4f040fad964973b9a5e632cc81c76dca722d1ebc03f074b10db4e"} Jul 10 18:26:42.490035 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:42.489998 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n95vc" event={"ID":"9b8880de-adae-4ec1-93bd-fc39231ad6b0","Type":"ContainerStarted","Data":"82206b9667d8d65e95542a7b4fcccaf3d6c30245707155d76678f1ea0e7b192a"} Jul 10 18:26:42.492127 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:42.492107 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" event={"ID":"ad1d31e7-11f6-4626-b77c-f551838de192","Type":"ContainerStarted","Data":"94a876e0a0b7f4464f10313ebd8ce59bde89d84f2cf23b57f03281d06a82b63f"} Jul 10 18:26:42.500980 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:42.500937 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-57.ec2.internal" podStartSLOduration=20.500924112 podStartE2EDuration="20.500924112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:26:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:26:42.500344396 +0000 UTC m=+21.733548656" watchObservedRunningTime="2026-07-10 18:26:42.500924112 +0000 UTC m=+21.734128370" Jul 10 18:26:42.514957 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:42.514913 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h56zp" podStartSLOduration=2.891080781 podStartE2EDuration="21.514895803s" totalImagesPullingTime="18.623815022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:26:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:26:42.514189452 +0000 UTC m=+21.747393711" watchObservedRunningTime="2026-07-10 18:26:42.514895803 +0000 UTC m=+21.748100063" Jul 10 18:26:42.527309 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:42.527273 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-grgmt" podStartSLOduration=2.88069758 podStartE2EDuration="21.527260271s" totalImagesPullingTime="18.646562691s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:26:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:26:42.526995267 +0000 UTC m=+21.760199525" watchObservedRunningTime="2026-07-10 18:26:42.527260271 +0000 UTC m=+21.760464529" Jul 10 18:26:42.543967 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:42.543931 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ww2gt" podStartSLOduration=2.868427266 podStartE2EDuration="21.543919145s" totalImagesPullingTime="18.675491879s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:26:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:26:42.543715712 +0000 UTC m=+21.776919963" watchObservedRunningTime="2026-07-10 18:26:42.543919145 +0000 UTC m=+21.777123403" Jul 10 18:26:42.579101 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:42.579045 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kpclp" podStartSLOduration=2.944107285 podStartE2EDuration="21.579025987s" totalImagesPullingTime="18.634918702s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:26:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:26:42.578819125 +0000 UTC m=+21.812023384" watchObservedRunningTime="2026-07-10 18:26:42.579025987 +0000 UTC m=+21.812230247" Jul 10 18:26:42.594195 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:42.593483 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-n95vc" podStartSLOduration=2.908572935 podStartE2EDuration="21.593460164s" totalImagesPullingTime="18.684887229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:26:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:26:42.593279499 +0000 UTC m=+21.826483758" watchObservedRunningTime="2026-07-10 18:26:42.593460164 +0000 UTC m=+21.826664424" Jul 10 18:26:43.496909 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:43.496664 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2cclr" event={"ID":"f4e04b79-b3c5-47cb-8c7f-6e111641180b","Type":"ContainerStarted","Data":"5fdcd0f50118e4433e92cf74f1d78ca912d33e48321bff11d99dd8437f16eb34"} Jul 10 18:26:43.498735 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:43.498687 2564 generic.go:356] "Generic (PLEG): container finished" podID="779eaa9e-7637-4bcc-886a-81bd645c0956" containerID="ff8e76c9dae4f040fad964973b9a5e632cc81c76dca722d1ebc03f074b10db4e" exitCode=0 Jul 10 18:26:43.498865 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:43.498731 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdspp" event={"ID":"779eaa9e-7637-4bcc-886a-81bd645c0956","Type":"ContainerDied","Data":"ff8e76c9dae4f040fad964973b9a5e632cc81c76dca722d1ebc03f074b10db4e"} Jul 10 18:26:43.501997 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:43.501978 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gfnq_873ff093-ab5b-412b-abad-220e0bb4acc3/ovn-acl-logging/0.log" Jul 10 18:26:43.502334 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:43.502308 2564 generic.go:356] "Generic (PLEG): container finished" podID="873ff093-ab5b-412b-abad-220e0bb4acc3" containerID="097fbcf4c365632bd4c9b11ef445d0f99da68fb37ec9b6e703d7a6c7c9b5218b" exitCode=1 Jul 10 18:26:43.502615 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:43.502588 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" event={"ID":"873ff093-ab5b-412b-abad-220e0bb4acc3","Type":"ContainerStarted","Data":"15a52d6cc6be393fc5bf4a8a796052aaafced2b7dcd4de8089da9bc8e29fead5"} Jul 10 18:26:43.502753 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:43.502684 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" event={"ID":"873ff093-ab5b-412b-abad-220e0bb4acc3","Type":"ContainerStarted","Data":"d0fd4db9eba676d766ed8ff5c7e0a688192ec0e9ef2fa2c9eb8aba4ad86d62cd"} Jul 10 18:26:43.502819 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:43.502800 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" event={"ID":"873ff093-ab5b-412b-abad-220e0bb4acc3","Type":"ContainerStarted","Data":"081166acc929e5dda9cfa92c6111b1afade79b47f6c2cfd39cdb60b19ae47fd1"} Jul 10 18:26:43.502868 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:43.502854 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" event={"ID":"873ff093-ab5b-412b-abad-220e0bb4acc3","Type":"ContainerStarted","Data":"417c87458adfeca4a7c9a911792e9eb8465fd4a939ab26643adf5e83fbe09e0f"} Jul 10 18:26:43.502922 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:43.502908 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" event={"ID":"873ff093-ab5b-412b-abad-220e0bb4acc3","Type":"ContainerDied","Data":"097fbcf4c365632bd4c9b11ef445d0f99da68fb37ec9b6e703d7a6c7c9b5218b"} Jul 10 18:26:43.502971 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:43.502963 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" event={"ID":"873ff093-ab5b-412b-abad-220e0bb4acc3","Type":"ContainerStarted","Data":"cadc9a01e72938c2bbbdf1a590f8d78be80f0142c5780b120b5b3847f56a3b5e"} Jul 10 18:26:43.516199 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:43.516156 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2cclr" podStartSLOduration=3.9152549199999997 podStartE2EDuration="22.516144077s" totalImagesPullingTime="18.600889157s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:26:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:26:43.51558247 +0000 UTC m=+22.748786731" watchObservedRunningTime="2026-07-10 18:26:43.516144077 +0000 UTC m=+22.749348335" Jul 10 18:26:44.027768 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:44.027745 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 10 18:26:44.192193 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:44.192080 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T18:26:44.027763597Z","UUID":"9554797f-95be-4163-b4f2-70f7ee63e845","Handler":null,"Name":"","Endpoint":""} Jul 10 18:26:44.193497 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:44.193479 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 10 18:26:44.193570 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:44.193515 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 10 18:26:44.400605 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:44.400507 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:44.400605 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:44.400552 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:44.400605 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:44.400552 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:44.400889 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:44.400640 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7l77" podUID="f4443fb4-d9ef-4a8c-8268-0aacbd93ce13" Jul 10 18:26:44.400889 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:44.400731 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtxh" podUID="94b9498d-bd74-4e9c-8177-c152abdacbb9" Jul 10 18:26:44.400889 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:44.400794 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jm85" podUID="476cc43e-40b1-48f7-98f7-9a02a5478743" Jul 10 18:26:44.506222 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:44.506156 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" event={"ID":"ad1d31e7-11f6-4626-b77c-f551838de192","Type":"ContainerStarted","Data":"e90dc8dcea62f44ec4b17671f15dc769fc8d19b4190a9d7b604c8060fd8de368"} Jul 10 18:26:45.513177 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:45.512922 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gfnq_873ff093-ab5b-412b-abad-220e0bb4acc3/ovn-acl-logging/0.log" Jul 10 18:26:45.513612 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:45.513588 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" event={"ID":"873ff093-ab5b-412b-abad-220e0bb4acc3","Type":"ContainerStarted","Data":"7bda7971ee18deda4b976a3aa610c63a6f938fcdb5d74786af25cf00fc4cebbc"} Jul 10 18:26:46.184805 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:46.184728 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h56zp" Jul 10 18:26:46.185329 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:46.185305 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h56zp" Jul 10 18:26:46.401254 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:46.401225 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:46.401422 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:46.401326 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:46.401422 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:46.401331 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jm85" podUID="476cc43e-40b1-48f7-98f7-9a02a5478743" Jul 10 18:26:46.401422 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:46.401356 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:46.401572 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:46.401440 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtxh" podUID="94b9498d-bd74-4e9c-8177-c152abdacbb9" Jul 10 18:26:46.401572 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:46.401520 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7l77" podUID="f4443fb4-d9ef-4a8c-8268-0aacbd93ce13" Jul 10 18:26:46.518536 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:46.518454 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" event={"ID":"ad1d31e7-11f6-4626-b77c-f551838de192","Type":"ContainerStarted","Data":"2798315611a99549e3bdc46d605939aaf791f1811f1f8214efcd6c670c843687"} Jul 10 18:26:46.519097 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:46.518673 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h56zp" Jul 10 18:26:46.519385 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:46.519355 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h56zp" Jul 10 18:26:46.540216 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:46.538553 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89lpf" podStartSLOduration=3.668572077 podStartE2EDuration="25.538532148s" totalImagesPullingTime="21.869960071s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:26:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:26:46.538445543 +0000 UTC m=+25.771649808" watchObservedRunningTime="2026-07-10 18:26:46.538532148 +0000 UTC m=+25.771736409" Jul 10 18:26:48.401202 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:48.401176 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:48.401614 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:48.401176 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:48.401614 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:48.401275 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7l77" podUID="f4443fb4-d9ef-4a8c-8268-0aacbd93ce13" Jul 10 18:26:48.401614 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:48.401185 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:48.401614 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:48.401348 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jm85" podUID="476cc43e-40b1-48f7-98f7-9a02a5478743" Jul 10 18:26:48.401614 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:48.401427 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtxh" podUID="94b9498d-bd74-4e9c-8177-c152abdacbb9" Jul 10 18:26:48.527764 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:48.527669 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gfnq_873ff093-ab5b-412b-abad-220e0bb4acc3/ovn-acl-logging/0.log" Jul 10 18:26:48.528232 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:48.528085 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" event={"ID":"873ff093-ab5b-412b-abad-220e0bb4acc3","Type":"ContainerStarted","Data":"b60c5cf9ff7551c6803219d539717e82b1c7f645b0843c9c9da1b57eb42339b3"} Jul 10 18:26:48.528949 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:48.528664 2564 scope.go:117] "RemoveContainer" containerID="097fbcf4c365632bd4c9b11ef445d0f99da68fb37ec9b6e703d7a6c7c9b5218b" Jul 10 18:26:49.531255 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:49.531097 2564 generic.go:356] "Generic (PLEG): container finished" podID="779eaa9e-7637-4bcc-886a-81bd645c0956" containerID="bd7375fd44f5ad03e9bd32828c117c7ec9dc622350f9daeef835f70f647bd7e6" exitCode=0 Jul 10 18:26:49.531846 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:49.531164 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdspp" event={"ID":"779eaa9e-7637-4bcc-886a-81bd645c0956","Type":"ContainerDied","Data":"bd7375fd44f5ad03e9bd32828c117c7ec9dc622350f9daeef835f70f647bd7e6"} Jul 10 18:26:49.535159 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:49.535139 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gfnq_873ff093-ab5b-412b-abad-220e0bb4acc3/ovn-acl-logging/0.log" Jul 10 18:26:49.535495 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:49.535476 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" event={"ID":"873ff093-ab5b-412b-abad-220e0bb4acc3","Type":"ContainerStarted","Data":"ce43c71749c575ab531374c94b462811be84eb9e89115b28f6484f977e682aea"} Jul 10 18:26:49.535738 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:49.535722 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:49.535809 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:49.535787 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:49.535872 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:49.535835 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:49.550987 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:49.550970 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:49.551088 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:49.551068 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:26:49.584845 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:49.584809 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" podStartSLOduration=9.602155144 podStartE2EDuration="28.584797226s" totalImagesPullingTime="18.982642082s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:26:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:26:49.583811337 +0000 UTC m=+28.817015596" watchObservedRunningTime="2026-07-10 18:26:49.584797226 +0000 UTC m=+28.818001485" Jul 10 18:26:50.400614 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:50.400583 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:50.400781 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:50.400683 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:50.400781 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:50.400689 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7l77" podUID="f4443fb4-d9ef-4a8c-8268-0aacbd93ce13" Jul 10 18:26:50.400781 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:50.400722 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:50.400905 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:50.400777 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtxh" podUID="94b9498d-bd74-4e9c-8177-c152abdacbb9" Jul 10 18:26:50.400905 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:50.400830 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jm85" podUID="476cc43e-40b1-48f7-98f7-9a02a5478743" Jul 10 18:26:50.539995 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:50.539864 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdspp" event={"ID":"779eaa9e-7637-4bcc-886a-81bd645c0956","Type":"ContainerStarted","Data":"c787bebe89a3e32c040b04a6b261bbecf10c54effc2a9d174ec4c680d1f838b5"} Jul 10 18:26:50.710117 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:50.710041 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6gtxh"] Jul 10 18:26:50.710257 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:50.710187 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:50.710323 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:50.710287 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtxh" podUID="94b9498d-bd74-4e9c-8177-c152abdacbb9" Jul 10 18:26:50.710794 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:50.710776 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5jm85"] Jul 10 18:26:50.710864 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:50.710854 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:50.710938 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:50.710920 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jm85" podUID="476cc43e-40b1-48f7-98f7-9a02a5478743" Jul 10 18:26:50.712587 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:50.712563 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l7l77"] Jul 10 18:26:50.712685 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:50.712647 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:50.712798 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:50.712746 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7l77" podUID="f4443fb4-d9ef-4a8c-8268-0aacbd93ce13" Jul 10 18:26:51.544644 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:51.544612 2564 generic.go:356] "Generic (PLEG): container finished" podID="779eaa9e-7637-4bcc-886a-81bd645c0956" containerID="c787bebe89a3e32c040b04a6b261bbecf10c54effc2a9d174ec4c680d1f838b5" exitCode=0 Jul 10 18:26:51.545090 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:51.544679 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdspp" event={"ID":"779eaa9e-7637-4bcc-886a-81bd645c0956","Type":"ContainerDied","Data":"c787bebe89a3e32c040b04a6b261bbecf10c54effc2a9d174ec4c680d1f838b5"} Jul 10 18:26:52.401033 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:52.401005 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:52.401198 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:52.401098 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:52.401198 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:52.401105 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:52.401198 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:52.401101 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jm85" podUID="476cc43e-40b1-48f7-98f7-9a02a5478743" Jul 10 18:26:52.401317 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:52.401209 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtxh" podUID="94b9498d-bd74-4e9c-8177-c152abdacbb9" Jul 10 18:26:52.401317 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:52.401274 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7l77" podUID="f4443fb4-d9ef-4a8c-8268-0aacbd93ce13" Jul 10 18:26:53.551468 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:53.551435 2564 generic.go:356] "Generic (PLEG): container finished" podID="779eaa9e-7637-4bcc-886a-81bd645c0956" containerID="b1365db64e39a8b73f2f9db6237113d4ff8da1bba72d662d6abe279dfe5caeae" exitCode=0 Jul 10 18:26:53.552127 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:53.551476 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdspp" event={"ID":"779eaa9e-7637-4bcc-886a-81bd645c0956","Type":"ContainerDied","Data":"b1365db64e39a8b73f2f9db6237113d4ff8da1bba72d662d6abe279dfe5caeae"} Jul 10 18:26:54.400516 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:54.400482 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:54.400516 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:54.400514 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:54.400788 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:54.400576 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gtxh" podUID="94b9498d-bd74-4e9c-8177-c152abdacbb9" Jul 10 18:26:54.400788 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:54.400606 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:54.400788 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:54.400681 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7l77" podUID="f4443fb4-d9ef-4a8c-8268-0aacbd93ce13" Jul 10 18:26:54.400788 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:54.400754 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jm85" podUID="476cc43e-40b1-48f7-98f7-9a02a5478743" Jul 10 18:26:54.901055 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:54.901025 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94b9498d-bd74-4e9c-8177-c152abdacbb9-original-pull-secret\") pod \"global-pull-secret-syncer-6gtxh\" (UID: \"94b9498d-bd74-4e9c-8177-c152abdacbb9\") " pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:54.901503 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:54.901162 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 18:26:54.901503 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:54.901210 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94b9498d-bd74-4e9c-8177-c152abdacbb9-original-pull-secret podName:94b9498d-bd74-4e9c-8177-c152abdacbb9 nodeName:}" failed. No retries permitted until 2026-07-10 18:27:26.901197046 +0000 UTC m=+66.134401283 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/94b9498d-bd74-4e9c-8177-c152abdacbb9-original-pull-secret") pod "global-pull-secret-syncer-6gtxh" (UID: "94b9498d-bd74-4e9c-8177-c152abdacbb9") : object "kube-system"/"original-pull-secret" not registered Jul 10 18:26:55.001493 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:55.001449 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs\") pod \"network-metrics-daemon-l7l77\" (UID: \"f4443fb4-d9ef-4a8c-8268-0aacbd93ce13\") " pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:55.001667 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:55.001576 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:26:55.001667 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:55.001645 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs podName:f4443fb4-d9ef-4a8c-8268-0aacbd93ce13 nodeName:}" failed. No retries permitted until 2026-07-10 18:27:27.001626251 +0000 UTC m=+66.234830523 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs") pod "network-metrics-daemon-l7l77" (UID: "f4443fb4-d9ef-4a8c-8268-0aacbd93ce13") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 18:26:55.102162 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:55.102124 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4ksx\" (UniqueName: \"kubernetes.io/projected/476cc43e-40b1-48f7-98f7-9a02a5478743-kube-api-access-c4ksx\") pod \"network-check-target-5jm85\" (UID: \"476cc43e-40b1-48f7-98f7-9a02a5478743\") " pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:55.102309 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:55.102256 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 18:26:55.102309 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:55.102272 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 18:26:55.102309 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:55.102280 2564 projected.go:196] Error preparing data for projected volume kube-api-access-c4ksx for pod openshift-network-diagnostics/network-check-target-5jm85: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:26:55.102404 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:55.102323 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/476cc43e-40b1-48f7-98f7-9a02a5478743-kube-api-access-c4ksx podName:476cc43e-40b1-48f7-98f7-9a02a5478743 nodeName:}" failed. No retries permitted until 2026-07-10 18:27:27.102311461 +0000 UTC m=+66.335515697 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-c4ksx" (UniqueName: "kubernetes.io/projected/476cc43e-40b1-48f7-98f7-9a02a5478743-kube-api-access-c4ksx") pod "network-check-target-5jm85" (UID: "476cc43e-40b1-48f7-98f7-9a02a5478743") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 18:26:56.074150 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.074079 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-57.ec2.internal" event="NodeReady" Jul 10 18:26:56.074653 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.074195 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 10 18:26:56.122306 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.122276 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6sg5z"] Jul 10 18:26:56.125899 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.125881 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6sg5z" Jul 10 18:26:56.128474 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.128409 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 10 18:26:56.128474 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.128413 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 10 18:26:56.128474 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.128438 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sxdkk"] Jul 10 18:26:56.128682 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.128441 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z2lbt\"" Jul 10 18:26:56.131897 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.131879 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sxdkk" Jul 10 18:26:56.134640 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.134426 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 10 18:26:56.134640 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.134512 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9bsdn\"" Jul 10 18:26:56.135524 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.135136 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 10 18:26:56.135524 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.135374 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 10 18:26:56.135914 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.135892 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6sg5z"] Jul 10 18:26:56.147381 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.147339 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sxdkk"] Jul 10 18:26:56.310428 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.310400 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls\") pod \"dns-default-6sg5z\" (UID: \"c2dcab33-d174-4c8e-92eb-c8a78b94080a\") " pod="openshift-dns/dns-default-6sg5z" Jul 10 18:26:56.310582 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.310457 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2dcab33-d174-4c8e-92eb-c8a78b94080a-tmp-dir\") pod \"dns-default-6sg5z\" (UID: \"c2dcab33-d174-4c8e-92eb-c8a78b94080a\") " pod="openshift-dns/dns-default-6sg5z" Jul 10 18:26:56.310582 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.310494 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qww7\" (UniqueName: \"kubernetes.io/projected/c2dcab33-d174-4c8e-92eb-c8a78b94080a-kube-api-access-4qww7\") pod \"dns-default-6sg5z\" (UID: \"c2dcab33-d174-4c8e-92eb-c8a78b94080a\") " pod="openshift-dns/dns-default-6sg5z" Jul 10 18:26:56.310582 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.310520 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2ef7c40-e1d7-4e54-abf6-59aa70f9a5eb-cert\") pod \"ingress-canary-sxdkk\" (UID: \"e2ef7c40-e1d7-4e54-abf6-59aa70f9a5eb\") " pod="openshift-ingress-canary/ingress-canary-sxdkk" Jul 10 18:26:56.310582 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.310544 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2dcab33-d174-4c8e-92eb-c8a78b94080a-config-volume\") pod \"dns-default-6sg5z\" (UID: \"c2dcab33-d174-4c8e-92eb-c8a78b94080a\") " pod="openshift-dns/dns-default-6sg5z" Jul 10 18:26:56.310823 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.310652 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgjzr\" (UniqueName: \"kubernetes.io/projected/e2ef7c40-e1d7-4e54-abf6-59aa70f9a5eb-kube-api-access-bgjzr\") pod \"ingress-canary-sxdkk\" (UID: \"e2ef7c40-e1d7-4e54-abf6-59aa70f9a5eb\") " pod="openshift-ingress-canary/ingress-canary-sxdkk" Jul 10 18:26:56.400743 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.400654 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:26:56.400879 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.400654 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:26:56.400879 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.400654 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:26:56.403470 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.403448 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 18:26:56.404383 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.404362 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 18:26:56.404383 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.404382 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fnqlf\"" Jul 10 18:26:56.404581 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.404393 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 18:26:56.404581 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.404403 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 18:26:56.404581 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.404393 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hnv2c\"" Jul 10 18:26:56.410949 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.410928 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgjzr\" (UniqueName: \"kubernetes.io/projected/e2ef7c40-e1d7-4e54-abf6-59aa70f9a5eb-kube-api-access-bgjzr\") pod \"ingress-canary-sxdkk\" (UID: \"e2ef7c40-e1d7-4e54-abf6-59aa70f9a5eb\") " pod="openshift-ingress-canary/ingress-canary-sxdkk" Jul 10 18:26:56.411059 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.410978 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls\") pod \"dns-default-6sg5z\" (UID: \"c2dcab33-d174-4c8e-92eb-c8a78b94080a\") " pod="openshift-dns/dns-default-6sg5z" Jul 10 18:26:56.411059 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.411013 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2dcab33-d174-4c8e-92eb-c8a78b94080a-tmp-dir\") pod \"dns-default-6sg5z\" (UID: \"c2dcab33-d174-4c8e-92eb-c8a78b94080a\") " pod="openshift-dns/dns-default-6sg5z" Jul 10 18:26:56.411059 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.411037 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qww7\" (UniqueName: \"kubernetes.io/projected/c2dcab33-d174-4c8e-92eb-c8a78b94080a-kube-api-access-4qww7\") pod \"dns-default-6sg5z\" (UID: \"c2dcab33-d174-4c8e-92eb-c8a78b94080a\") " pod="openshift-dns/dns-default-6sg5z" Jul 10 18:26:56.411228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.411059 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2ef7c40-e1d7-4e54-abf6-59aa70f9a5eb-cert\") pod \"ingress-canary-sxdkk\" (UID: \"e2ef7c40-e1d7-4e54-abf6-59aa70f9a5eb\") " pod="openshift-ingress-canary/ingress-canary-sxdkk" Jul 10 18:26:56.411228 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.411081 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2dcab33-d174-4c8e-92eb-c8a78b94080a-config-volume\") pod \"dns-default-6sg5z\" (UID: \"c2dcab33-d174-4c8e-92eb-c8a78b94080a\") " pod="openshift-dns/dns-default-6sg5z" Jul 10 18:26:56.411228 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:56.411139 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:26:56.411228 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:56.411193 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls podName:c2dcab33-d174-4c8e-92eb-c8a78b94080a nodeName:}" failed. No retries permitted until 2026-07-10 18:26:56.91117393 +0000 UTC m=+36.144378182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls") pod "dns-default-6sg5z" (UID: "c2dcab33-d174-4c8e-92eb-c8a78b94080a") : secret "dns-default-metrics-tls" not found Jul 10 18:26:56.411452 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.411342 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2dcab33-d174-4c8e-92eb-c8a78b94080a-tmp-dir\") pod \"dns-default-6sg5z\" (UID: \"c2dcab33-d174-4c8e-92eb-c8a78b94080a\") " pod="openshift-dns/dns-default-6sg5z" Jul 10 18:26:56.411552 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.411533 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2dcab33-d174-4c8e-92eb-c8a78b94080a-config-volume\") pod \"dns-default-6sg5z\" (UID: \"c2dcab33-d174-4c8e-92eb-c8a78b94080a\") " pod="openshift-dns/dns-default-6sg5z" Jul 10 18:26:56.415231 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.415214 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e2ef7c40-e1d7-4e54-abf6-59aa70f9a5eb-cert\") pod \"ingress-canary-sxdkk\" (UID: \"e2ef7c40-e1d7-4e54-abf6-59aa70f9a5eb\") " pod="openshift-ingress-canary/ingress-canary-sxdkk" Jul 10 18:26:56.418732 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.418695 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgjzr\" (UniqueName: \"kubernetes.io/projected/e2ef7c40-e1d7-4e54-abf6-59aa70f9a5eb-kube-api-access-bgjzr\") pod \"ingress-canary-sxdkk\" (UID: \"e2ef7c40-e1d7-4e54-abf6-59aa70f9a5eb\") " pod="openshift-ingress-canary/ingress-canary-sxdkk" Jul 10 18:26:56.419061 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.419042 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qww7\" (UniqueName: \"kubernetes.io/projected/c2dcab33-d174-4c8e-92eb-c8a78b94080a-kube-api-access-4qww7\") pod \"dns-default-6sg5z\" (UID: \"c2dcab33-d174-4c8e-92eb-c8a78b94080a\") " pod="openshift-dns/dns-default-6sg5z" Jul 10 18:26:56.445849 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.445827 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sxdkk" Jul 10 18:26:56.593981 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.593825 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sxdkk"] Jul 10 18:26:56.914620 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:56.914573 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls\") pod \"dns-default-6sg5z\" (UID: \"c2dcab33-d174-4c8e-92eb-c8a78b94080a\") " pod="openshift-dns/dns-default-6sg5z" Jul 10 18:26:56.914833 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:56.914773 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:26:56.914895 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:56.914851 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls podName:c2dcab33-d174-4c8e-92eb-c8a78b94080a nodeName:}" failed. No retries permitted until 2026-07-10 18:26:57.914826515 +0000 UTC m=+37.148030752 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls") pod "dns-default-6sg5z" (UID: "c2dcab33-d174-4c8e-92eb-c8a78b94080a") : secret "dns-default-metrics-tls" not found Jul 10 18:26:57.924492 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:57.924436 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls\") pod \"dns-default-6sg5z\" (UID: \"c2dcab33-d174-4c8e-92eb-c8a78b94080a\") " pod="openshift-dns/dns-default-6sg5z" Jul 10 18:26:57.924958 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:57.924613 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:26:57.924958 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:57.924727 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls podName:c2dcab33-d174-4c8e-92eb-c8a78b94080a nodeName:}" failed. No retries permitted until 2026-07-10 18:26:59.924684808 +0000 UTC m=+39.157889058 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls") pod "dns-default-6sg5z" (UID: "c2dcab33-d174-4c8e-92eb-c8a78b94080a") : secret "dns-default-metrics-tls" not found Jul 10 18:26:58.063680 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:26:58.063647 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2ef7c40_e1d7_4e54_abf6_59aa70f9a5eb.slice/crio-1f12f5dd11b8ac5f77be293b6ed6b359df8e1bc403d8580361f7aaa7aee46e04 WatchSource:0}: Error finding container 1f12f5dd11b8ac5f77be293b6ed6b359df8e1bc403d8580361f7aaa7aee46e04: Status 404 returned error can't find the container with id 1f12f5dd11b8ac5f77be293b6ed6b359df8e1bc403d8580361f7aaa7aee46e04 Jul 10 18:26:58.563802 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:58.563722 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sxdkk" event={"ID":"e2ef7c40-e1d7-4e54-abf6-59aa70f9a5eb","Type":"ContainerStarted","Data":"1f12f5dd11b8ac5f77be293b6ed6b359df8e1bc403d8580361f7aaa7aee46e04"} Jul 10 18:26:58.566327 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:58.566300 2564 generic.go:356] "Generic (PLEG): container finished" podID="779eaa9e-7637-4bcc-886a-81bd645c0956" containerID="bb383bd74d879e7383e00974caffc1514f68d1bfd49188c159016c85653ffdc0" exitCode=0 Jul 10 18:26:58.566423 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:58.566338 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdspp" event={"ID":"779eaa9e-7637-4bcc-886a-81bd645c0956","Type":"ContainerDied","Data":"bb383bd74d879e7383e00974caffc1514f68d1bfd49188c159016c85653ffdc0"} Jul 10 18:26:59.572272 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:59.572101 2564 generic.go:356] "Generic (PLEG): container finished" podID="779eaa9e-7637-4bcc-886a-81bd645c0956" containerID="b31d01f57418454da19e794f44527e26a646d79dd36fb71e63dddc7e9b6be4c6" exitCode=0 Jul 10 18:26:59.572272 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:59.572186 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdspp" event={"ID":"779eaa9e-7637-4bcc-886a-81bd645c0956","Type":"ContainerDied","Data":"b31d01f57418454da19e794f44527e26a646d79dd36fb71e63dddc7e9b6be4c6"} Jul 10 18:26:59.935038 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:26:59.934970 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls\") pod \"dns-default-6sg5z\" (UID: \"c2dcab33-d174-4c8e-92eb-c8a78b94080a\") " pod="openshift-dns/dns-default-6sg5z" Jul 10 18:26:59.935159 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:59.935078 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:26:59.935159 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:26:59.935125 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls podName:c2dcab33-d174-4c8e-92eb-c8a78b94080a nodeName:}" failed. No retries permitted until 2026-07-10 18:27:03.935112245 +0000 UTC m=+43.168316483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls") pod "dns-default-6sg5z" (UID: "c2dcab33-d174-4c8e-92eb-c8a78b94080a") : secret "dns-default-metrics-tls" not found Jul 10 18:27:00.592051 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:00.578995 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdspp" event={"ID":"779eaa9e-7637-4bcc-886a-81bd645c0956","Type":"ContainerStarted","Data":"8ed4df2075f19c9a5055d8eebc8bb1b7bbb996237443af4ecd9c51d960b0467f"} Jul 10 18:27:00.621295 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:00.619239 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vdspp" podStartSLOduration=9.204789934 podStartE2EDuration="39.619219041s" totalImagesPullingTime="30.414429107s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:26:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:27:00.616694417 +0000 UTC m=+39.849898677" watchObservedRunningTime="2026-07-10 18:27:00.619219041 +0000 UTC m=+39.852423303" Jul 10 18:27:01.582919 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:01.582883 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sxdkk" event={"ID":"e2ef7c40-e1d7-4e54-abf6-59aa70f9a5eb","Type":"ContainerStarted","Data":"bbb738b2bc6ed12090c135f3e35646dbb9c6e777e66dd997d50fc704f38357c4"} Jul 10 18:27:01.597924 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:01.597876 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sxdkk" podStartSLOduration=2.481089246 podStartE2EDuration="5.597862269s" totalImagesPullingTime="3.116773023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:26:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:27:01.597433602 +0000 UTC m=+40.830637860" watchObservedRunningTime="2026-07-10 18:27:01.597862269 +0000 UTC m=+40.831066585" Jul 10 18:27:03.963375 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:03.963337 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls\") pod \"dns-default-6sg5z\" (UID: \"c2dcab33-d174-4c8e-92eb-c8a78b94080a\") " pod="openshift-dns/dns-default-6sg5z" Jul 10 18:27:03.963812 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:27:03.963492 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:27:03.963812 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:27:03.963557 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls podName:c2dcab33-d174-4c8e-92eb-c8a78b94080a nodeName:}" failed. No retries permitted until 2026-07-10 18:27:11.963540928 +0000 UTC m=+51.196745165 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls") pod "dns-default-6sg5z" (UID: "c2dcab33-d174-4c8e-92eb-c8a78b94080a") : secret "dns-default-metrics-tls" not found Jul 10 18:27:12.016517 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:12.016484 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls\") pod \"dns-default-6sg5z\" (UID: \"c2dcab33-d174-4c8e-92eb-c8a78b94080a\") " pod="openshift-dns/dns-default-6sg5z" Jul 10 18:27:12.016953 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:27:12.016604 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:27:12.016953 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:27:12.016651 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls podName:c2dcab33-d174-4c8e-92eb-c8a78b94080a nodeName:}" failed. No retries permitted until 2026-07-10 18:27:28.016638318 +0000 UTC m=+67.249842555 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls") pod "dns-default-6sg5z" (UID: "c2dcab33-d174-4c8e-92eb-c8a78b94080a") : secret "dns-default-metrics-tls" not found Jul 10 18:27:14.521827 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:14.521790 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57f69478f8-mrwt5"] Jul 10 18:27:14.523528 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:14.523507 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57f69478f8-mrwt5" Jul 10 18:27:14.525898 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:14.525874 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-jksxs\"" Jul 10 18:27:14.526161 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:14.526147 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 10 18:27:14.527148 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:14.527128 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 10 18:27:14.527248 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:14.527136 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 10 18:27:14.527248 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:14.527186 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 10 18:27:14.534307 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:14.534288 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57f69478f8-mrwt5"] Jul 10 18:27:14.633970 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:14.633942 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scxp7\" (UniqueName: \"kubernetes.io/projected/f888a879-b380-4253-a0ec-ce3c87ed47e6-kube-api-access-scxp7\") pod \"managed-serviceaccount-addon-agent-57f69478f8-mrwt5\" (UID: \"f888a879-b380-4253-a0ec-ce3c87ed47e6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57f69478f8-mrwt5" Jul 10 18:27:14.634081 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:14.634065 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f888a879-b380-4253-a0ec-ce3c87ed47e6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57f69478f8-mrwt5\" (UID: \"f888a879-b380-4253-a0ec-ce3c87ed47e6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57f69478f8-mrwt5" Jul 10 18:27:14.734834 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:14.734812 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f888a879-b380-4253-a0ec-ce3c87ed47e6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57f69478f8-mrwt5\" (UID: \"f888a879-b380-4253-a0ec-ce3c87ed47e6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57f69478f8-mrwt5" Jul 10 18:27:14.734925 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:14.734841 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scxp7\" (UniqueName: \"kubernetes.io/projected/f888a879-b380-4253-a0ec-ce3c87ed47e6-kube-api-access-scxp7\") pod \"managed-serviceaccount-addon-agent-57f69478f8-mrwt5\" (UID: \"f888a879-b380-4253-a0ec-ce3c87ed47e6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57f69478f8-mrwt5" Jul 10 18:27:14.739055 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:14.739028 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f888a879-b380-4253-a0ec-ce3c87ed47e6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57f69478f8-mrwt5\" (UID: \"f888a879-b380-4253-a0ec-ce3c87ed47e6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57f69478f8-mrwt5" Jul 10 18:27:14.743036 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:14.743017 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scxp7\" (UniqueName: \"kubernetes.io/projected/f888a879-b380-4253-a0ec-ce3c87ed47e6-kube-api-access-scxp7\") pod \"managed-serviceaccount-addon-agent-57f69478f8-mrwt5\" (UID: \"f888a879-b380-4253-a0ec-ce3c87ed47e6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57f69478f8-mrwt5" Jul 10 18:27:14.844141 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:14.844092 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57f69478f8-mrwt5" Jul 10 18:27:14.960922 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:14.960896 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57f69478f8-mrwt5"] Jul 10 18:27:14.963794 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:27:14.963761 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf888a879_b380_4253_a0ec_ce3c87ed47e6.slice/crio-abb9786fcf59407fa9d379eefb76d1580a38ce74c8ce24a92a843712c2af22ba WatchSource:0}: Error finding container abb9786fcf59407fa9d379eefb76d1580a38ce74c8ce24a92a843712c2af22ba: Status 404 returned error can't find the container with id abb9786fcf59407fa9d379eefb76d1580a38ce74c8ce24a92a843712c2af22ba Jul 10 18:27:15.616394 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:15.616356 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57f69478f8-mrwt5" event={"ID":"f888a879-b380-4253-a0ec-ce3c87ed47e6","Type":"ContainerStarted","Data":"abb9786fcf59407fa9d379eefb76d1580a38ce74c8ce24a92a843712c2af22ba"} Jul 10 18:27:17.623084 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:17.622996 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57f69478f8-mrwt5" event={"ID":"f888a879-b380-4253-a0ec-ce3c87ed47e6","Type":"ContainerStarted","Data":"0507db56c0b35f880395d5f8493de9302deac39849d9d5f9a6b8ace3f42472bc"} Jul 10 18:27:17.637948 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:17.637895 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57f69478f8-mrwt5" podStartSLOduration=1.343235234 podStartE2EDuration="3.637878345s" totalImagesPullingTime="2.294643111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:27:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:27:17.637844114 +0000 UTC m=+56.871048375" watchObservedRunningTime="2026-07-10 18:27:17.637878345 +0000 UTC m=+56.871082606" Jul 10 18:27:21.560343 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:21.560309 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9gfnq" Jul 10 18:27:26.915441 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:26.915397 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94b9498d-bd74-4e9c-8177-c152abdacbb9-original-pull-secret\") pod \"global-pull-secret-syncer-6gtxh\" (UID: \"94b9498d-bd74-4e9c-8177-c152abdacbb9\") " pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:27:26.918298 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:26.918278 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 18:27:26.928496 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:26.928470 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/94b9498d-bd74-4e9c-8177-c152abdacbb9-original-pull-secret\") pod \"global-pull-secret-syncer-6gtxh\" (UID: \"94b9498d-bd74-4e9c-8177-c152abdacbb9\") " pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:27:27.015886 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:27.015861 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs\") pod \"network-metrics-daemon-l7l77\" (UID: \"f4443fb4-d9ef-4a8c-8268-0aacbd93ce13\") " pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:27:27.018441 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:27.018423 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 18:27:27.026540 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:27:27.026524 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 10 18:27:27.026605 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:27.026530 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gtxh" Jul 10 18:27:27.026605 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:27:27.026587 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs podName:f4443fb4-d9ef-4a8c-8268-0aacbd93ce13 nodeName:}" failed. No retries permitted until 2026-07-10 18:28:31.026572374 +0000 UTC m=+130.259776623 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs") pod "network-metrics-daemon-l7l77" (UID: "f4443fb4-d9ef-4a8c-8268-0aacbd93ce13") : secret "metrics-daemon-secret" not found Jul 10 18:27:27.117245 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:27.117201 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4ksx\" (UniqueName: \"kubernetes.io/projected/476cc43e-40b1-48f7-98f7-9a02a5478743-kube-api-access-c4ksx\") pod \"network-check-target-5jm85\" (UID: \"476cc43e-40b1-48f7-98f7-9a02a5478743\") " pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:27:27.120043 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:27.120018 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 18:27:27.130031 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:27.130012 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 18:27:27.141455 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:27.141431 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4ksx\" (UniqueName: \"kubernetes.io/projected/476cc43e-40b1-48f7-98f7-9a02a5478743-kube-api-access-c4ksx\") pod \"network-check-target-5jm85\" (UID: \"476cc43e-40b1-48f7-98f7-9a02a5478743\") " pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:27:27.149504 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:27.147411 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6gtxh"] Jul 10 18:27:27.150655 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:27:27.150632 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94b9498d_bd74_4e9c_8177_c152abdacbb9.slice/crio-ace11726bc05a7bac96809c8696ef8d0c0c4bfb323be473dfb838738a665aa06 WatchSource:0}: Error finding container ace11726bc05a7bac96809c8696ef8d0c0c4bfb323be473dfb838738a665aa06: Status 404 returned error can't find the container with id ace11726bc05a7bac96809c8696ef8d0c0c4bfb323be473dfb838738a665aa06 Jul 10 18:27:27.312679 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:27.312658 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hnv2c\"" Jul 10 18:27:27.321193 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:27.321168 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:27:27.437828 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:27.437801 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5jm85"] Jul 10 18:27:27.441921 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:27:27.441900 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod476cc43e_40b1_48f7_98f7_9a02a5478743.slice/crio-4e7506e129584c7d04aca6f8ad38cb5bc03382db3f570a9efbef037d135f3649 WatchSource:0}: Error finding container 4e7506e129584c7d04aca6f8ad38cb5bc03382db3f570a9efbef037d135f3649: Status 404 returned error can't find the container with id 4e7506e129584c7d04aca6f8ad38cb5bc03382db3f570a9efbef037d135f3649 Jul 10 18:27:27.645431 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:27.645354 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5jm85" event={"ID":"476cc43e-40b1-48f7-98f7-9a02a5478743","Type":"ContainerStarted","Data":"4e7506e129584c7d04aca6f8ad38cb5bc03382db3f570a9efbef037d135f3649"} Jul 10 18:27:27.646328 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:27.646305 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6gtxh" event={"ID":"94b9498d-bd74-4e9c-8177-c152abdacbb9","Type":"ContainerStarted","Data":"ace11726bc05a7bac96809c8696ef8d0c0c4bfb323be473dfb838738a665aa06"} Jul 10 18:27:28.023125 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:28.023081 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls\") pod \"dns-default-6sg5z\" (UID: \"c2dcab33-d174-4c8e-92eb-c8a78b94080a\") " pod="openshift-dns/dns-default-6sg5z" Jul 10 18:27:28.023547 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:27:28.023210 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:27:28.023547 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:27:28.023291 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls podName:c2dcab33-d174-4c8e-92eb-c8a78b94080a nodeName:}" failed. No retries permitted until 2026-07-10 18:28:00.02327246 +0000 UTC m=+99.256476712 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls") pod "dns-default-6sg5z" (UID: "c2dcab33-d174-4c8e-92eb-c8a78b94080a") : secret "dns-default-metrics-tls" not found Jul 10 18:27:31.658933 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:31.658867 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5jm85" event={"ID":"476cc43e-40b1-48f7-98f7-9a02a5478743","Type":"ContainerStarted","Data":"e100bea6a8c5977c96c999c45c0b2d02f8aa5db2e1df74b1b9a756ace1dcbdca"} Jul 10 18:27:31.659331 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:31.659081 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:27:31.675819 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:31.675771 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5jm85" podStartSLOduration=67.504430492 podStartE2EDuration="1m10.675757745s" totalImagesPullingTime="3.171327253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:26:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:27:31.674925784 +0000 UTC m=+70.908130044" watchObservedRunningTime="2026-07-10 18:27:31.675757745 +0000 UTC m=+70.908962003" Jul 10 18:27:32.662349 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:32.662319 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6gtxh" event={"ID":"94b9498d-bd74-4e9c-8177-c152abdacbb9","Type":"ContainerStarted","Data":"516342ac9fef53aab7eb9d9cda11ca7fbf4c141da2fb94487e2e02ffcfe51a78"} Jul 10 18:27:32.677543 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:27:32.677504 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6gtxh" podStartSLOduration=66.788668991 podStartE2EDuration="1m11.677468429s" totalImagesPullingTime="4.888799438s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:26:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:27:32.676772093 +0000 UTC m=+71.909976353" watchObservedRunningTime="2026-07-10 18:27:32.677468429 +0000 UTC m=+71.910672687" Jul 10 18:28:00.028213 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:28:00.028159 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls\") pod \"dns-default-6sg5z\" (UID: \"c2dcab33-d174-4c8e-92eb-c8a78b94080a\") " pod="openshift-dns/dns-default-6sg5z" Jul 10 18:28:00.028721 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:28:00.028306 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:28:00.028721 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:28:00.028368 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls podName:c2dcab33-d174-4c8e-92eb-c8a78b94080a nodeName:}" failed. No retries permitted until 2026-07-10 18:29:04.028353448 +0000 UTC m=+163.261557702 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls") pod "dns-default-6sg5z" (UID: "c2dcab33-d174-4c8e-92eb-c8a78b94080a") : secret "dns-default-metrics-tls" not found Jul 10 18:28:02.665186 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:28:02.665147 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5jm85" Jul 10 18:28:31.122682 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:28:31.122625 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs\") pod \"network-metrics-daemon-l7l77\" (UID: \"f4443fb4-d9ef-4a8c-8268-0aacbd93ce13\") " pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:28:31.123148 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:28:31.122795 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 10 18:28:31.123148 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:28:31.122856 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs podName:f4443fb4-d9ef-4a8c-8268-0aacbd93ce13 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:33.122841505 +0000 UTC m=+252.356045742 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs") pod "network-metrics-daemon-l7l77" (UID: "f4443fb4-d9ef-4a8c-8268-0aacbd93ce13") : secret "metrics-daemon-secret" not found Jul 10 18:28:59.139311 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:28:59.139270 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6sg5z" podUID="c2dcab33-d174-4c8e-92eb-c8a78b94080a" Jul 10 18:28:59.430834 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:28:59.430760 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-l7l77" podUID="f4443fb4-d9ef-4a8c-8268-0aacbd93ce13" Jul 10 18:28:59.856231 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:28:59.856203 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6sg5z" Jul 10 18:29:04.029594 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:29:04.029554 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls\") pod \"dns-default-6sg5z\" (UID: \"c2dcab33-d174-4c8e-92eb-c8a78b94080a\") " pod="openshift-dns/dns-default-6sg5z" Jul 10 18:29:04.030019 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:29:04.029730 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 18:29:04.030019 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:29:04.029804 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls podName:c2dcab33-d174-4c8e-92eb-c8a78b94080a nodeName:}" failed. No retries permitted until 2026-07-10 18:31:06.029788075 +0000 UTC m=+285.262992315 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls") pod "dns-default-6sg5z" (UID: "c2dcab33-d174-4c8e-92eb-c8a78b94080a") : secret "dns-default-metrics-tls" not found Jul 10 18:29:10.400899 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:29:10.400859 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:29:17.896272 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:29:17.896234 2564 generic.go:356] "Generic (PLEG): container finished" podID="f888a879-b380-4253-a0ec-ce3c87ed47e6" containerID="0507db56c0b35f880395d5f8493de9302deac39849d9d5f9a6b8ace3f42472bc" exitCode=255 Jul 10 18:29:17.896640 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:29:17.896312 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57f69478f8-mrwt5" event={"ID":"f888a879-b380-4253-a0ec-ce3c87ed47e6","Type":"ContainerDied","Data":"0507db56c0b35f880395d5f8493de9302deac39849d9d5f9a6b8ace3f42472bc"} Jul 10 18:29:17.901735 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:29:17.901720 2564 scope.go:117] "RemoveContainer" containerID="0507db56c0b35f880395d5f8493de9302deac39849d9d5f9a6b8ace3f42472bc" Jul 10 18:29:18.904746 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:29:18.904694 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57f69478f8-mrwt5" event={"ID":"f888a879-b380-4253-a0ec-ce3c87ed47e6","Type":"ContainerStarted","Data":"bd819927aef78d9dd02af8dfc5b3741bdb32389583315e00dbc736e2ddce8141"} Jul 10 18:30:12.880224 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.880192 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-869757d866-5g756"] Jul 10 18:30:12.882782 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.882760 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:12.889837 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.889818 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rc4ck\"" Jul 10 18:30:12.889967 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.889869 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 10 18:30:12.889967 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.889934 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 10 18:30:12.890484 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.890469 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 10 18:30:12.936333 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.936309 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 10 18:30:12.944895 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.944875 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/faedd4b7-8adc-44bd-81c8-fd54315965f9-ca-trust-extracted\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:12.944969 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.944901 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv2fg\" (UniqueName: \"kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-kube-api-access-fv2fg\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:12.944969 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.944921 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/faedd4b7-8adc-44bd-81c8-fd54315965f9-installation-pull-secrets\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:12.944969 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.944951 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-certificates\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:12.945084 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.944974 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/faedd4b7-8adc-44bd-81c8-fd54315965f9-trusted-ca\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:12.945084 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.945034 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-bound-sa-token\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:12.945084 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.945066 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/faedd4b7-8adc-44bd-81c8-fd54315965f9-image-registry-private-configuration\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:12.945176 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.945088 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-tls\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:12.962397 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.962378 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-869757d866-5g756"] Jul 10 18:30:12.975200 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.975179 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9tc8s"] Jul 10 18:30:12.977881 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.977859 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9tc8s" Jul 10 18:30:12.978786 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.978765 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-c5gqq"] Jul 10 18:30:12.980220 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.980204 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 10 18:30:12.980302 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.980263 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vjzkd\"" Jul 10 18:30:12.980348 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.980336 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 10 18:30:12.980429 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.980416 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 10 18:30:12.981469 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.981454 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-78fd8c8fc4-8wvsg"] Jul 10 18:30:12.981587 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.981573 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-c5gqq" Jul 10 18:30:12.984169 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.984158 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:12.985303 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.985284 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 10 18:30:12.985406 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.985382 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 10 18:30:12.985793 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.985774 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 10 18:30:12.985891 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.985774 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-92r2j\"" Jul 10 18:30:12.985891 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.985814 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 10 18:30:12.989296 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.989276 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 10 18:30:12.989546 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.989527 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 10 18:30:12.989656 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.989608 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 10 18:30:12.989656 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.989628 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 10 18:30:12.989795 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.989533 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-m2gr8\"" Jul 10 18:30:12.989893 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.989873 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 10 18:30:12.989956 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.989873 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 10 18:30:12.994822 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.994781 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9tc8s"] Jul 10 18:30:12.995080 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.995055 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 10 18:30:12.995689 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:12.995669 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-c5gqq"] Jul 10 18:30:13.000529 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.000508 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-78fd8c8fc4-8wvsg"] Jul 10 18:30:13.045749 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.045721 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfa37e72-ee06-4ff3-996e-d535b0d28d84-trusted-ca\") pod \"console-operator-7866497494-c5gqq\" (UID: \"cfa37e72-ee06-4ff3-996e-d535b0d28d84\") " pod="openshift-console-operator/console-operator-7866497494-c5gqq" Jul 10 18:30:13.045845 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.045754 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/96b5e2d3-67f8-4bef-a56e-a44799345c04-stats-auth\") pod \"router-default-78fd8c8fc4-8wvsg\" (UID: \"96b5e2d3-67f8-4bef-a56e-a44799345c04\") " pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:13.045845 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.045771 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96b5e2d3-67f8-4bef-a56e-a44799345c04-metrics-certs\") pod \"router-default-78fd8c8fc4-8wvsg\" (UID: \"96b5e2d3-67f8-4bef-a56e-a44799345c04\") " pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:13.045845 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.045791 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-tls\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:13.045845 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.045826 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8570c74-227e-4e5e-805f-9286c153690d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9tc8s\" (UID: \"c8570c74-227e-4e5e-805f-9286c153690d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9tc8s" Jul 10 18:30:13.046025 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:13.045896 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 18:30:13.046025 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.045903 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/faedd4b7-8adc-44bd-81c8-fd54315965f9-installation-pull-secrets\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:13.046025 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.045928 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txznf\" (UniqueName: \"kubernetes.io/projected/c8570c74-227e-4e5e-805f-9286c153690d-kube-api-access-txznf\") pod \"cluster-samples-operator-65db858894-9tc8s\" (UID: \"c8570c74-227e-4e5e-805f-9286c153690d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9tc8s" Jul 10 18:30:13.046025 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.045949 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96b5e2d3-67f8-4bef-a56e-a44799345c04-service-ca-bundle\") pod \"router-default-78fd8c8fc4-8wvsg\" (UID: \"96b5e2d3-67f8-4bef-a56e-a44799345c04\") " pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:13.046025 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.045966 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-certificates\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:13.046025 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:13.045907 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869757d866-5g756: secret "image-registry-tls" not found Jul 10 18:30:13.046025 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.046004 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/faedd4b7-8adc-44bd-81c8-fd54315965f9-trusted-ca\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:13.046025 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:13.046027 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-tls podName:faedd4b7-8adc-44bd-81c8-fd54315965f9 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:13.546011325 +0000 UTC m=+232.779215561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-tls") pod "image-registry-869757d866-5g756" (UID: "faedd4b7-8adc-44bd-81c8-fd54315965f9") : secret "image-registry-tls" not found Jul 10 18:30:13.046469 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.046056 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwzsm\" (UniqueName: \"kubernetes.io/projected/96b5e2d3-67f8-4bef-a56e-a44799345c04-kube-api-access-bwzsm\") pod \"router-default-78fd8c8fc4-8wvsg\" (UID: \"96b5e2d3-67f8-4bef-a56e-a44799345c04\") " pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:13.046469 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.046077 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-bound-sa-token\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:13.046469 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.046145 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv2fg\" (UniqueName: \"kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-kube-api-access-fv2fg\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:13.046469 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.046175 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cfa37e72-ee06-4ff3-996e-d535b0d28d84-config\") pod \"console-operator-7866497494-c5gqq\" (UID: \"cfa37e72-ee06-4ff3-996e-d535b0d28d84\") " pod="openshift-console-operator/console-operator-7866497494-c5gqq" Jul 10 18:30:13.046469 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.046224 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cfa37e72-ee06-4ff3-996e-d535b0d28d84-serving-cert\") pod \"console-operator-7866497494-c5gqq\" (UID: \"cfa37e72-ee06-4ff3-996e-d535b0d28d84\") " pod="openshift-console-operator/console-operator-7866497494-c5gqq" Jul 10 18:30:13.046469 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.046249 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s578f\" (UniqueName: \"kubernetes.io/projected/cfa37e72-ee06-4ff3-996e-d535b0d28d84-kube-api-access-s578f\") pod \"console-operator-7866497494-c5gqq\" (UID: \"cfa37e72-ee06-4ff3-996e-d535b0d28d84\") " pod="openshift-console-operator/console-operator-7866497494-c5gqq" Jul 10 18:30:13.046469 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.046272 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/faedd4b7-8adc-44bd-81c8-fd54315965f9-ca-trust-extracted\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:13.046469 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.046348 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/96b5e2d3-67f8-4bef-a56e-a44799345c04-default-certificate\") pod \"router-default-78fd8c8fc4-8wvsg\" (UID: \"96b5e2d3-67f8-4bef-a56e-a44799345c04\") " pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:13.046469 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.046390 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/faedd4b7-8adc-44bd-81c8-fd54315965f9-image-registry-private-configuration\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:13.046786 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.046565 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-certificates\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:13.046786 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.046648 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/faedd4b7-8adc-44bd-81c8-fd54315965f9-ca-trust-extracted\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:13.047066 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.047051 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/faedd4b7-8adc-44bd-81c8-fd54315965f9-trusted-ca\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:13.048231 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.048211 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/faedd4b7-8adc-44bd-81c8-fd54315965f9-installation-pull-secrets\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:13.048462 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.048445 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/faedd4b7-8adc-44bd-81c8-fd54315965f9-image-registry-private-configuration\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:13.054295 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.054275 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-bound-sa-token\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:13.054469 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.054453 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv2fg\" (UniqueName: \"kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-kube-api-access-fv2fg\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:13.147003 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.146946 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cfa37e72-ee06-4ff3-996e-d535b0d28d84-config\") pod \"console-operator-7866497494-c5gqq\" (UID: \"cfa37e72-ee06-4ff3-996e-d535b0d28d84\") " pod="openshift-console-operator/console-operator-7866497494-c5gqq" Jul 10 18:30:13.147003 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.146982 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cfa37e72-ee06-4ff3-996e-d535b0d28d84-serving-cert\") pod \"console-operator-7866497494-c5gqq\" (UID: \"cfa37e72-ee06-4ff3-996e-d535b0d28d84\") " pod="openshift-console-operator/console-operator-7866497494-c5gqq" Jul 10 18:30:13.147003 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.146998 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s578f\" (UniqueName: \"kubernetes.io/projected/cfa37e72-ee06-4ff3-996e-d535b0d28d84-kube-api-access-s578f\") pod \"console-operator-7866497494-c5gqq\" (UID: \"cfa37e72-ee06-4ff3-996e-d535b0d28d84\") " pod="openshift-console-operator/console-operator-7866497494-c5gqq" Jul 10 18:30:13.147210 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.147027 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/96b5e2d3-67f8-4bef-a56e-a44799345c04-default-certificate\") pod \"router-default-78fd8c8fc4-8wvsg\" (UID: \"96b5e2d3-67f8-4bef-a56e-a44799345c04\") " pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:13.147210 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.147046 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfa37e72-ee06-4ff3-996e-d535b0d28d84-trusted-ca\") pod \"console-operator-7866497494-c5gqq\" (UID: \"cfa37e72-ee06-4ff3-996e-d535b0d28d84\") " pod="openshift-console-operator/console-operator-7866497494-c5gqq" Jul 10 18:30:13.147210 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.147157 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/96b5e2d3-67f8-4bef-a56e-a44799345c04-stats-auth\") pod \"router-default-78fd8c8fc4-8wvsg\" (UID: \"96b5e2d3-67f8-4bef-a56e-a44799345c04\") " pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:13.147210 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.147188 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96b5e2d3-67f8-4bef-a56e-a44799345c04-metrics-certs\") pod \"router-default-78fd8c8fc4-8wvsg\" (UID: \"96b5e2d3-67f8-4bef-a56e-a44799345c04\") " pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:13.147565 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.147227 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8570c74-227e-4e5e-805f-9286c153690d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9tc8s\" (UID: \"c8570c74-227e-4e5e-805f-9286c153690d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9tc8s" Jul 10 18:30:13.147565 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:13.147313 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 18:30:13.147565 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.147339 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txznf\" (UniqueName: \"kubernetes.io/projected/c8570c74-227e-4e5e-805f-9286c153690d-kube-api-access-txznf\") pod \"cluster-samples-operator-65db858894-9tc8s\" (UID: \"c8570c74-227e-4e5e-805f-9286c153690d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9tc8s" Jul 10 18:30:13.147565 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:13.147369 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96b5e2d3-67f8-4bef-a56e-a44799345c04-metrics-certs podName:96b5e2d3-67f8-4bef-a56e-a44799345c04 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:13.647352176 +0000 UTC m=+232.880556437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96b5e2d3-67f8-4bef-a56e-a44799345c04-metrics-certs") pod "router-default-78fd8c8fc4-8wvsg" (UID: "96b5e2d3-67f8-4bef-a56e-a44799345c04") : secret "router-metrics-certs-default" not found Jul 10 18:30:13.147565 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:13.147318 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 18:30:13.147565 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.147412 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96b5e2d3-67f8-4bef-a56e-a44799345c04-service-ca-bundle\") pod \"router-default-78fd8c8fc4-8wvsg\" (UID: \"96b5e2d3-67f8-4bef-a56e-a44799345c04\") " pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:13.147565 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:13.147429 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8570c74-227e-4e5e-805f-9286c153690d-samples-operator-tls podName:c8570c74-227e-4e5e-805f-9286c153690d nodeName:}" failed. No retries permitted until 2026-07-10 18:30:13.647414209 +0000 UTC m=+232.880618454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c8570c74-227e-4e5e-805f-9286c153690d-samples-operator-tls") pod "cluster-samples-operator-65db858894-9tc8s" (UID: "c8570c74-227e-4e5e-805f-9286c153690d") : secret "samples-operator-tls" not found Jul 10 18:30:13.147565 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.147471 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwzsm\" (UniqueName: \"kubernetes.io/projected/96b5e2d3-67f8-4bef-a56e-a44799345c04-kube-api-access-bwzsm\") pod \"router-default-78fd8c8fc4-8wvsg\" (UID: \"96b5e2d3-67f8-4bef-a56e-a44799345c04\") " pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:13.147565 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:13.147481 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/96b5e2d3-67f8-4bef-a56e-a44799345c04-service-ca-bundle podName:96b5e2d3-67f8-4bef-a56e-a44799345c04 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:13.647469978 +0000 UTC m=+232.880674216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/96b5e2d3-67f8-4bef-a56e-a44799345c04-service-ca-bundle") pod "router-default-78fd8c8fc4-8wvsg" (UID: "96b5e2d3-67f8-4bef-a56e-a44799345c04") : configmap references non-existent config key: service-ca.crt Jul 10 18:30:13.147995 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.147694 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cfa37e72-ee06-4ff3-996e-d535b0d28d84-config\") pod \"console-operator-7866497494-c5gqq\" (UID: \"cfa37e72-ee06-4ff3-996e-d535b0d28d84\") " pod="openshift-console-operator/console-operator-7866497494-c5gqq" Jul 10 18:30:13.147995 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.147881 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfa37e72-ee06-4ff3-996e-d535b0d28d84-trusted-ca\") pod \"console-operator-7866497494-c5gqq\" (UID: \"cfa37e72-ee06-4ff3-996e-d535b0d28d84\") " pod="openshift-console-operator/console-operator-7866497494-c5gqq" Jul 10 18:30:13.149138 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.149121 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/96b5e2d3-67f8-4bef-a56e-a44799345c04-default-certificate\") pod \"router-default-78fd8c8fc4-8wvsg\" (UID: \"96b5e2d3-67f8-4bef-a56e-a44799345c04\") " pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:13.149334 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.149317 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cfa37e72-ee06-4ff3-996e-d535b0d28d84-serving-cert\") pod \"console-operator-7866497494-c5gqq\" (UID: \"cfa37e72-ee06-4ff3-996e-d535b0d28d84\") " pod="openshift-console-operator/console-operator-7866497494-c5gqq" Jul 10 18:30:13.149393 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.149355 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/96b5e2d3-67f8-4bef-a56e-a44799345c04-stats-auth\") pod \"router-default-78fd8c8fc4-8wvsg\" (UID: \"96b5e2d3-67f8-4bef-a56e-a44799345c04\") " pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:13.157880 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.157851 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwzsm\" (UniqueName: \"kubernetes.io/projected/96b5e2d3-67f8-4bef-a56e-a44799345c04-kube-api-access-bwzsm\") pod \"router-default-78fd8c8fc4-8wvsg\" (UID: \"96b5e2d3-67f8-4bef-a56e-a44799345c04\") " pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:13.157981 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.157916 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s578f\" (UniqueName: \"kubernetes.io/projected/cfa37e72-ee06-4ff3-996e-d535b0d28d84-kube-api-access-s578f\") pod \"console-operator-7866497494-c5gqq\" (UID: \"cfa37e72-ee06-4ff3-996e-d535b0d28d84\") " pod="openshift-console-operator/console-operator-7866497494-c5gqq" Jul 10 18:30:13.158049 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.157987 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txznf\" (UniqueName: \"kubernetes.io/projected/c8570c74-227e-4e5e-805f-9286c153690d-kube-api-access-txznf\") pod \"cluster-samples-operator-65db858894-9tc8s\" (UID: \"c8570c74-227e-4e5e-805f-9286c153690d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9tc8s" Jul 10 18:30:13.294988 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.294964 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-c5gqq" Jul 10 18:30:13.409946 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.409889 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-c5gqq"] Jul 10 18:30:13.412776 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:30:13.412751 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfa37e72_ee06_4ff3_996e_d535b0d28d84.slice/crio-e18c9c6e2e389e9cfb4bedecd54255f97db044b06676317d31352fa456eeafd4 WatchSource:0}: Error finding container e18c9c6e2e389e9cfb4bedecd54255f97db044b06676317d31352fa456eeafd4: Status 404 returned error can't find the container with id e18c9c6e2e389e9cfb4bedecd54255f97db044b06676317d31352fa456eeafd4 Jul 10 18:30:13.551717 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.551668 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-tls\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:13.551854 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:13.551833 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 18:30:13.551922 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:13.551858 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869757d866-5g756: secret "image-registry-tls" not found Jul 10 18:30:13.551974 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:13.551919 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-tls podName:faedd4b7-8adc-44bd-81c8-fd54315965f9 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:14.551900366 +0000 UTC m=+233.785104620 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-tls") pod "image-registry-869757d866-5g756" (UID: "faedd4b7-8adc-44bd-81c8-fd54315965f9") : secret "image-registry-tls" not found Jul 10 18:30:13.652297 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.652263 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96b5e2d3-67f8-4bef-a56e-a44799345c04-service-ca-bundle\") pod \"router-default-78fd8c8fc4-8wvsg\" (UID: \"96b5e2d3-67f8-4bef-a56e-a44799345c04\") " pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:13.652409 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.652392 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96b5e2d3-67f8-4bef-a56e-a44799345c04-metrics-certs\") pod \"router-default-78fd8c8fc4-8wvsg\" (UID: \"96b5e2d3-67f8-4bef-a56e-a44799345c04\") " pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:13.652409 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:13.652400 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/96b5e2d3-67f8-4bef-a56e-a44799345c04-service-ca-bundle podName:96b5e2d3-67f8-4bef-a56e-a44799345c04 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:14.652386312 +0000 UTC m=+233.885590548 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/96b5e2d3-67f8-4bef-a56e-a44799345c04-service-ca-bundle") pod "router-default-78fd8c8fc4-8wvsg" (UID: "96b5e2d3-67f8-4bef-a56e-a44799345c04") : configmap references non-existent config key: service-ca.crt Jul 10 18:30:13.652535 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:13.652440 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8570c74-227e-4e5e-805f-9286c153690d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9tc8s\" (UID: \"c8570c74-227e-4e5e-805f-9286c153690d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9tc8s" Jul 10 18:30:13.652535 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:13.652520 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 18:30:13.652630 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:13.652546 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 18:30:13.652630 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:13.652559 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96b5e2d3-67f8-4bef-a56e-a44799345c04-metrics-certs podName:96b5e2d3-67f8-4bef-a56e-a44799345c04 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:14.6525487 +0000 UTC m=+233.885752940 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96b5e2d3-67f8-4bef-a56e-a44799345c04-metrics-certs") pod "router-default-78fd8c8fc4-8wvsg" (UID: "96b5e2d3-67f8-4bef-a56e-a44799345c04") : secret "router-metrics-certs-default" not found Jul 10 18:30:13.652630 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:13.652602 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8570c74-227e-4e5e-805f-9286c153690d-samples-operator-tls podName:c8570c74-227e-4e5e-805f-9286c153690d nodeName:}" failed. No retries permitted until 2026-07-10 18:30:14.6525863 +0000 UTC m=+233.885790540 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c8570c74-227e-4e5e-805f-9286c153690d-samples-operator-tls") pod "cluster-samples-operator-65db858894-9tc8s" (UID: "c8570c74-227e-4e5e-805f-9286c153690d") : secret "samples-operator-tls" not found Jul 10 18:30:14.064813 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:14.064774 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-c5gqq" event={"ID":"cfa37e72-ee06-4ff3-996e-d535b0d28d84","Type":"ContainerStarted","Data":"e18c9c6e2e389e9cfb4bedecd54255f97db044b06676317d31352fa456eeafd4"} Jul 10 18:30:14.559150 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:14.559110 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-tls\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:14.559316 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:14.559256 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 18:30:14.559316 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:14.559276 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869757d866-5g756: secret "image-registry-tls" not found Jul 10 18:30:14.559397 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:14.559357 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-tls podName:faedd4b7-8adc-44bd-81c8-fd54315965f9 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:16.559335631 +0000 UTC m=+235.792539871 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-tls") pod "image-registry-869757d866-5g756" (UID: "faedd4b7-8adc-44bd-81c8-fd54315965f9") : secret "image-registry-tls" not found Jul 10 18:30:14.659504 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:14.659473 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96b5e2d3-67f8-4bef-a56e-a44799345c04-metrics-certs\") pod \"router-default-78fd8c8fc4-8wvsg\" (UID: \"96b5e2d3-67f8-4bef-a56e-a44799345c04\") " pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:14.659679 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:14.659513 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8570c74-227e-4e5e-805f-9286c153690d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9tc8s\" (UID: \"c8570c74-227e-4e5e-805f-9286c153690d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9tc8s" Jul 10 18:30:14.659679 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:14.659536 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96b5e2d3-67f8-4bef-a56e-a44799345c04-service-ca-bundle\") pod \"router-default-78fd8c8fc4-8wvsg\" (UID: \"96b5e2d3-67f8-4bef-a56e-a44799345c04\") " pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:14.659679 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:14.659625 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 18:30:14.659679 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:14.659631 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 18:30:14.659679 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:14.659682 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/96b5e2d3-67f8-4bef-a56e-a44799345c04-service-ca-bundle podName:96b5e2d3-67f8-4bef-a56e-a44799345c04 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:16.659669103 +0000 UTC m=+235.892873342 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/96b5e2d3-67f8-4bef-a56e-a44799345c04-service-ca-bundle") pod "router-default-78fd8c8fc4-8wvsg" (UID: "96b5e2d3-67f8-4bef-a56e-a44799345c04") : configmap references non-existent config key: service-ca.crt Jul 10 18:30:14.659889 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:14.659696 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8570c74-227e-4e5e-805f-9286c153690d-samples-operator-tls podName:c8570c74-227e-4e5e-805f-9286c153690d nodeName:}" failed. No retries permitted until 2026-07-10 18:30:16.659690168 +0000 UTC m=+235.892894405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c8570c74-227e-4e5e-805f-9286c153690d-samples-operator-tls") pod "cluster-samples-operator-65db858894-9tc8s" (UID: "c8570c74-227e-4e5e-805f-9286c153690d") : secret "samples-operator-tls" not found Jul 10 18:30:14.659889 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:14.659729 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96b5e2d3-67f8-4bef-a56e-a44799345c04-metrics-certs podName:96b5e2d3-67f8-4bef-a56e-a44799345c04 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:16.659720284 +0000 UTC m=+235.892924528 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96b5e2d3-67f8-4bef-a56e-a44799345c04-metrics-certs") pod "router-default-78fd8c8fc4-8wvsg" (UID: "96b5e2d3-67f8-4bef-a56e-a44799345c04") : secret "router-metrics-certs-default" not found Jul 10 18:30:16.072597 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:16.072567 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5gqq_cfa37e72-ee06-4ff3-996e-d535b0d28d84/console-operator/0.log" Jul 10 18:30:16.072974 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:16.072608 2564 generic.go:356] "Generic (PLEG): container finished" podID="cfa37e72-ee06-4ff3-996e-d535b0d28d84" containerID="b3d630f05e2cca73cffde65889b06e5ea9e88d6a4548561f3b7fedc71ee42e0c" exitCode=255 Jul 10 18:30:16.072974 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:16.072651 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-c5gqq" event={"ID":"cfa37e72-ee06-4ff3-996e-d535b0d28d84","Type":"ContainerDied","Data":"b3d630f05e2cca73cffde65889b06e5ea9e88d6a4548561f3b7fedc71ee42e0c"} Jul 10 18:30:16.072974 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:16.072872 2564 scope.go:117] "RemoveContainer" containerID="b3d630f05e2cca73cffde65889b06e5ea9e88d6a4548561f3b7fedc71ee42e0c" Jul 10 18:30:16.573565 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:16.573524 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-tls\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:16.573776 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:16.573648 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 18:30:16.573776 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:16.573660 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869757d866-5g756: secret "image-registry-tls" not found Jul 10 18:30:16.573776 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:16.573722 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-tls podName:faedd4b7-8adc-44bd-81c8-fd54315965f9 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:20.573691146 +0000 UTC m=+239.806895384 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-tls") pod "image-registry-869757d866-5g756" (UID: "faedd4b7-8adc-44bd-81c8-fd54315965f9") : secret "image-registry-tls" not found Jul 10 18:30:16.674375 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:16.674341 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96b5e2d3-67f8-4bef-a56e-a44799345c04-metrics-certs\") pod \"router-default-78fd8c8fc4-8wvsg\" (UID: \"96b5e2d3-67f8-4bef-a56e-a44799345c04\") " pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:16.674489 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:16.674387 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8570c74-227e-4e5e-805f-9286c153690d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9tc8s\" (UID: \"c8570c74-227e-4e5e-805f-9286c153690d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9tc8s" Jul 10 18:30:16.674489 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:16.674416 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96b5e2d3-67f8-4bef-a56e-a44799345c04-service-ca-bundle\") pod \"router-default-78fd8c8fc4-8wvsg\" (UID: \"96b5e2d3-67f8-4bef-a56e-a44799345c04\") " pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:16.674489 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:16.674454 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 18:30:16.674489 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:16.674489 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96b5e2d3-67f8-4bef-a56e-a44799345c04-metrics-certs podName:96b5e2d3-67f8-4bef-a56e-a44799345c04 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:20.674480254 +0000 UTC m=+239.907684491 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96b5e2d3-67f8-4bef-a56e-a44799345c04-metrics-certs") pod "router-default-78fd8c8fc4-8wvsg" (UID: "96b5e2d3-67f8-4bef-a56e-a44799345c04") : secret "router-metrics-certs-default" not found Jul 10 18:30:16.674644 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:16.674501 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 18:30:16.674644 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:16.674544 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8570c74-227e-4e5e-805f-9286c153690d-samples-operator-tls podName:c8570c74-227e-4e5e-805f-9286c153690d nodeName:}" failed. No retries permitted until 2026-07-10 18:30:20.674531983 +0000 UTC m=+239.907736224 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c8570c74-227e-4e5e-805f-9286c153690d-samples-operator-tls") pod "cluster-samples-operator-65db858894-9tc8s" (UID: "c8570c74-227e-4e5e-805f-9286c153690d") : secret "samples-operator-tls" not found Jul 10 18:30:16.674644 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:16.674582 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/96b5e2d3-67f8-4bef-a56e-a44799345c04-service-ca-bundle podName:96b5e2d3-67f8-4bef-a56e-a44799345c04 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:20.674570656 +0000 UTC m=+239.907774892 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/96b5e2d3-67f8-4bef-a56e-a44799345c04-service-ca-bundle") pod "router-default-78fd8c8fc4-8wvsg" (UID: "96b5e2d3-67f8-4bef-a56e-a44799345c04") : configmap references non-existent config key: service-ca.crt Jul 10 18:30:17.077198 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:17.077170 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5gqq_cfa37e72-ee06-4ff3-996e-d535b0d28d84/console-operator/1.log" Jul 10 18:30:17.077573 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:17.077557 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5gqq_cfa37e72-ee06-4ff3-996e-d535b0d28d84/console-operator/0.log" Jul 10 18:30:17.077612 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:17.077593 2564 generic.go:356] "Generic (PLEG): container finished" podID="cfa37e72-ee06-4ff3-996e-d535b0d28d84" containerID="02c58d570420e94cf604ac5609993bffa2ffa36ff0e18e9797dcc3e6537bd464" exitCode=255 Jul 10 18:30:17.077681 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:17.077666 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-c5gqq" event={"ID":"cfa37e72-ee06-4ff3-996e-d535b0d28d84","Type":"ContainerDied","Data":"02c58d570420e94cf604ac5609993bffa2ffa36ff0e18e9797dcc3e6537bd464"} Jul 10 18:30:17.077739 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:17.077728 2564 scope.go:117] "RemoveContainer" containerID="b3d630f05e2cca73cffde65889b06e5ea9e88d6a4548561f3b7fedc71ee42e0c" Jul 10 18:30:17.077997 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:17.077982 2564 scope.go:117] "RemoveContainer" containerID="02c58d570420e94cf604ac5609993bffa2ffa36ff0e18e9797dcc3e6537bd464" Jul 10 18:30:17.078156 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:17.078138 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-c5gqq_openshift-console-operator(cfa37e72-ee06-4ff3-996e-d535b0d28d84)\"" pod="openshift-console-operator/console-operator-7866497494-c5gqq" podUID="cfa37e72-ee06-4ff3-996e-d535b0d28d84" Jul 10 18:30:18.081422 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.081399 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5gqq_cfa37e72-ee06-4ff3-996e-d535b0d28d84/console-operator/1.log" Jul 10 18:30:18.081803 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.081722 2564 scope.go:117] "RemoveContainer" containerID="02c58d570420e94cf604ac5609993bffa2ffa36ff0e18e9797dcc3e6537bd464" Jul 10 18:30:18.081878 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:18.081860 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-c5gqq_openshift-console-operator(cfa37e72-ee06-4ff3-996e-d535b0d28d84)\"" pod="openshift-console-operator/console-operator-7866497494-c5gqq" podUID="cfa37e72-ee06-4ff3-996e-d535b0d28d84" Jul 10 18:30:18.101779 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.101756 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pbmhx"] Jul 10 18:30:18.105821 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.105805 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pbmhx" Jul 10 18:30:18.108141 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.108116 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 10 18:30:18.108255 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.108158 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 10 18:30:18.108255 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.108179 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-z4852\"" Jul 10 18:30:18.116861 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.116838 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pbmhx"] Jul 10 18:30:18.184069 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.184044 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkttw\" (UniqueName: \"kubernetes.io/projected/3469b86f-3416-42f1-a371-d35e4e31633f-kube-api-access-qkttw\") pod \"migrator-7f59b54f6c-pbmhx\" (UID: \"3469b86f-3416-42f1-a371-d35e4e31633f\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pbmhx" Jul 10 18:30:18.284898 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.284873 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkttw\" (UniqueName: \"kubernetes.io/projected/3469b86f-3416-42f1-a371-d35e4e31633f-kube-api-access-qkttw\") pod \"migrator-7f59b54f6c-pbmhx\" (UID: \"3469b86f-3416-42f1-a371-d35e4e31633f\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pbmhx" Jul 10 18:30:18.295484 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.295464 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nm5ph"] Jul 10 18:30:18.298419 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.298403 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:18.300835 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.300809 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 10 18:30:18.301747 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.301462 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q6ch7\"" Jul 10 18:30:18.301747 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.301510 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 10 18:30:18.301747 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.301728 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 10 18:30:18.302180 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.302156 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 10 18:30:18.306023 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.306004 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkttw\" (UniqueName: \"kubernetes.io/projected/3469b86f-3416-42f1-a371-d35e4e31633f-kube-api-access-qkttw\") pod \"migrator-7f59b54f6c-pbmhx\" (UID: \"3469b86f-3416-42f1-a371-d35e4e31633f\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pbmhx" Jul 10 18:30:18.308946 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.308923 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nm5ph"] Jul 10 18:30:18.385834 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.385782 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/442c9e87-d74f-457f-a8ee-e4321cdd9fff-crio-socket\") pod \"insights-runtime-extractor-nm5ph\" (UID: \"442c9e87-d74f-457f-a8ee-e4321cdd9fff\") " pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:18.385834 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.385827 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/442c9e87-d74f-457f-a8ee-e4321cdd9fff-data-volume\") pod \"insights-runtime-extractor-nm5ph\" (UID: \"442c9e87-d74f-457f-a8ee-e4321cdd9fff\") " pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:18.385961 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.385843 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxktk\" (UniqueName: \"kubernetes.io/projected/442c9e87-d74f-457f-a8ee-e4321cdd9fff-kube-api-access-cxktk\") pod \"insights-runtime-extractor-nm5ph\" (UID: \"442c9e87-d74f-457f-a8ee-e4321cdd9fff\") " pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:18.385961 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.385865 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/442c9e87-d74f-457f-a8ee-e4321cdd9fff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nm5ph\" (UID: \"442c9e87-d74f-457f-a8ee-e4321cdd9fff\") " pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:18.385961 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.385941 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/442c9e87-d74f-457f-a8ee-e4321cdd9fff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nm5ph\" (UID: \"442c9e87-d74f-457f-a8ee-e4321cdd9fff\") " pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:18.414360 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.414341 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pbmhx" Jul 10 18:30:18.487497 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.487075 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/442c9e87-d74f-457f-a8ee-e4321cdd9fff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nm5ph\" (UID: \"442c9e87-d74f-457f-a8ee-e4321cdd9fff\") " pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:18.487497 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.487119 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/442c9e87-d74f-457f-a8ee-e4321cdd9fff-crio-socket\") pod \"insights-runtime-extractor-nm5ph\" (UID: \"442c9e87-d74f-457f-a8ee-e4321cdd9fff\") " pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:18.487497 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.487152 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/442c9e87-d74f-457f-a8ee-e4321cdd9fff-data-volume\") pod \"insights-runtime-extractor-nm5ph\" (UID: \"442c9e87-d74f-457f-a8ee-e4321cdd9fff\") " pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:18.487497 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.487167 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxktk\" (UniqueName: \"kubernetes.io/projected/442c9e87-d74f-457f-a8ee-e4321cdd9fff-kube-api-access-cxktk\") pod \"insights-runtime-extractor-nm5ph\" (UID: \"442c9e87-d74f-457f-a8ee-e4321cdd9fff\") " pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:18.487497 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.487199 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/442c9e87-d74f-457f-a8ee-e4321cdd9fff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nm5ph\" (UID: \"442c9e87-d74f-457f-a8ee-e4321cdd9fff\") " pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:18.487497 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.487275 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/442c9e87-d74f-457f-a8ee-e4321cdd9fff-crio-socket\") pod \"insights-runtime-extractor-nm5ph\" (UID: \"442c9e87-d74f-457f-a8ee-e4321cdd9fff\") " pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:18.487497 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:18.487338 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 18:30:18.487497 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:18.487338 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 18:30:18.487497 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:18.487399 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/442c9e87-d74f-457f-a8ee-e4321cdd9fff-insights-runtime-extractor-tls podName:442c9e87-d74f-457f-a8ee-e4321cdd9fff nodeName:}" failed. No retries permitted until 2026-07-10 18:30:18.987378594 +0000 UTC m=+238.220582834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/442c9e87-d74f-457f-a8ee-e4321cdd9fff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nm5ph" (UID: "442c9e87-d74f-457f-a8ee-e4321cdd9fff") : secret "insights-runtime-extractor-tls" not found Jul 10 18:30:18.487497 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:18.487453 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/442c9e87-d74f-457f-a8ee-e4321cdd9fff-kube-rbac-proxy-cm podName:442c9e87-d74f-457f-a8ee-e4321cdd9fff nodeName:}" failed. No retries permitted until 2026-07-10 18:30:18.987431866 +0000 UTC m=+238.220636103 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/442c9e87-d74f-457f-a8ee-e4321cdd9fff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nm5ph" (UID: "442c9e87-d74f-457f-a8ee-e4321cdd9fff") : configmap "kube-rbac-proxy" not found Jul 10 18:30:18.487984 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.487646 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/442c9e87-d74f-457f-a8ee-e4321cdd9fff-data-volume\") pod \"insights-runtime-extractor-nm5ph\" (UID: \"442c9e87-d74f-457f-a8ee-e4321cdd9fff\") " pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:18.495661 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.495641 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxktk\" (UniqueName: \"kubernetes.io/projected/442c9e87-d74f-457f-a8ee-e4321cdd9fff-kube-api-access-cxktk\") pod \"insights-runtime-extractor-nm5ph\" (UID: \"442c9e87-d74f-457f-a8ee-e4321cdd9fff\") " pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:18.532048 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.532013 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pbmhx"] Jul 10 18:30:18.535148 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:30:18.535124 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3469b86f_3416_42f1_a371_d35e4e31633f.slice/crio-973d250d0863b28f04a6a71672bd6ddd4391583575e8282f7c2735bde33ac973 WatchSource:0}: Error finding container 973d250d0863b28f04a6a71672bd6ddd4391583575e8282f7c2735bde33ac973: Status 404 returned error can't find the container with id 973d250d0863b28f04a6a71672bd6ddd4391583575e8282f7c2735bde33ac973 Jul 10 18:30:18.990712 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.990679 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/442c9e87-d74f-457f-a8ee-e4321cdd9fff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nm5ph\" (UID: \"442c9e87-d74f-457f-a8ee-e4321cdd9fff\") " pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:18.990847 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:18.990765 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/442c9e87-d74f-457f-a8ee-e4321cdd9fff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nm5ph\" (UID: \"442c9e87-d74f-457f-a8ee-e4321cdd9fff\") " pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:18.990847 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:18.990812 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 18:30:18.990932 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:18.990849 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 18:30:18.990932 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:18.990879 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/442c9e87-d74f-457f-a8ee-e4321cdd9fff-insights-runtime-extractor-tls podName:442c9e87-d74f-457f-a8ee-e4321cdd9fff nodeName:}" failed. No retries permitted until 2026-07-10 18:30:19.990863511 +0000 UTC m=+239.224067770 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/442c9e87-d74f-457f-a8ee-e4321cdd9fff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nm5ph" (UID: "442c9e87-d74f-457f-a8ee-e4321cdd9fff") : secret "insights-runtime-extractor-tls" not found Jul 10 18:30:18.990932 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:18.990898 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/442c9e87-d74f-457f-a8ee-e4321cdd9fff-kube-rbac-proxy-cm podName:442c9e87-d74f-457f-a8ee-e4321cdd9fff nodeName:}" failed. No retries permitted until 2026-07-10 18:30:19.990886349 +0000 UTC m=+239.224090587 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/442c9e87-d74f-457f-a8ee-e4321cdd9fff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nm5ph" (UID: "442c9e87-d74f-457f-a8ee-e4321cdd9fff") : configmap "kube-rbac-proxy" not found Jul 10 18:30:19.085087 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:19.085058 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pbmhx" event={"ID":"3469b86f-3416-42f1-a371-d35e4e31633f","Type":"ContainerStarted","Data":"973d250d0863b28f04a6a71672bd6ddd4391583575e8282f7c2735bde33ac973"} Jul 10 18:30:19.998716 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:19.998673 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/442c9e87-d74f-457f-a8ee-e4321cdd9fff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nm5ph\" (UID: \"442c9e87-d74f-457f-a8ee-e4321cdd9fff\") " pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:19.998800 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:19.998781 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/442c9e87-d74f-457f-a8ee-e4321cdd9fff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nm5ph\" (UID: \"442c9e87-d74f-457f-a8ee-e4321cdd9fff\") " pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:19.998835 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:19.998807 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 18:30:19.998876 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:19.998857 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/442c9e87-d74f-457f-a8ee-e4321cdd9fff-insights-runtime-extractor-tls podName:442c9e87-d74f-457f-a8ee-e4321cdd9fff nodeName:}" failed. No retries permitted until 2026-07-10 18:30:21.998842315 +0000 UTC m=+241.232046556 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/442c9e87-d74f-457f-a8ee-e4321cdd9fff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nm5ph" (UID: "442c9e87-d74f-457f-a8ee-e4321cdd9fff") : secret "insights-runtime-extractor-tls" not found Jul 10 18:30:19.998876 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:19.998862 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 18:30:19.998949 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:19.998902 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/442c9e87-d74f-457f-a8ee-e4321cdd9fff-kube-rbac-proxy-cm podName:442c9e87-d74f-457f-a8ee-e4321cdd9fff nodeName:}" failed. No retries permitted until 2026-07-10 18:30:21.998889619 +0000 UTC m=+241.232093856 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/442c9e87-d74f-457f-a8ee-e4321cdd9fff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nm5ph" (UID: "442c9e87-d74f-457f-a8ee-e4321cdd9fff") : configmap "kube-rbac-proxy" not found Jul 10 18:30:20.090026 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:20.089964 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pbmhx" event={"ID":"3469b86f-3416-42f1-a371-d35e4e31633f","Type":"ContainerStarted","Data":"119b2b7966b10c67fecee87be33758e7a33a653931764a91012166f22fedfb8f"} Jul 10 18:30:20.090290 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:20.090028 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pbmhx" event={"ID":"3469b86f-3416-42f1-a371-d35e4e31633f","Type":"ContainerStarted","Data":"c1027bfd97babaa551592d96dc0486d762934e32449b38d79abe0945f8afa20d"} Jul 10 18:30:20.105406 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:20.105365 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-pbmhx" podStartSLOduration=0.811057073 podStartE2EDuration="2.105350318s" totalImagesPullingTime="1.294293245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:20.104546189 +0000 UTC m=+239.337750447" watchObservedRunningTime="2026-07-10 18:30:20.105350318 +0000 UTC m=+239.338554618" Jul 10 18:30:20.602565 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:20.602529 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-tls\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:20.602730 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:20.602650 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 18:30:20.602730 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:20.602667 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-869757d866-5g756: secret "image-registry-tls" not found Jul 10 18:30:20.602730 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:20.602725 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-tls podName:faedd4b7-8adc-44bd-81c8-fd54315965f9 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:28.602711767 +0000 UTC m=+247.835916016 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-tls") pod "image-registry-869757d866-5g756" (UID: "faedd4b7-8adc-44bd-81c8-fd54315965f9") : secret "image-registry-tls" not found Jul 10 18:30:20.703574 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:20.703547 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96b5e2d3-67f8-4bef-a56e-a44799345c04-metrics-certs\") pod \"router-default-78fd8c8fc4-8wvsg\" (UID: \"96b5e2d3-67f8-4bef-a56e-a44799345c04\") " pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:20.703733 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:20.703591 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8570c74-227e-4e5e-805f-9286c153690d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9tc8s\" (UID: \"c8570c74-227e-4e5e-805f-9286c153690d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9tc8s" Jul 10 18:30:20.703733 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:20.703620 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96b5e2d3-67f8-4bef-a56e-a44799345c04-service-ca-bundle\") pod \"router-default-78fd8c8fc4-8wvsg\" (UID: \"96b5e2d3-67f8-4bef-a56e-a44799345c04\") " pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:20.703733 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:20.703677 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 18:30:20.703733 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:20.703713 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 18:30:20.703871 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:20.703748 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96b5e2d3-67f8-4bef-a56e-a44799345c04-metrics-certs podName:96b5e2d3-67f8-4bef-a56e-a44799345c04 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:28.703735841 +0000 UTC m=+247.936940081 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/96b5e2d3-67f8-4bef-a56e-a44799345c04-metrics-certs") pod "router-default-78fd8c8fc4-8wvsg" (UID: "96b5e2d3-67f8-4bef-a56e-a44799345c04") : secret "router-metrics-certs-default" not found Jul 10 18:30:20.703871 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:20.703768 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/96b5e2d3-67f8-4bef-a56e-a44799345c04-service-ca-bundle podName:96b5e2d3-67f8-4bef-a56e-a44799345c04 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:28.703756686 +0000 UTC m=+247.936960923 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/96b5e2d3-67f8-4bef-a56e-a44799345c04-service-ca-bundle") pod "router-default-78fd8c8fc4-8wvsg" (UID: "96b5e2d3-67f8-4bef-a56e-a44799345c04") : configmap references non-existent config key: service-ca.crt Jul 10 18:30:20.703871 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:20.703784 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8570c74-227e-4e5e-805f-9286c153690d-samples-operator-tls podName:c8570c74-227e-4e5e-805f-9286c153690d nodeName:}" failed. No retries permitted until 2026-07-10 18:30:28.70377776 +0000 UTC m=+247.936981997 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c8570c74-227e-4e5e-805f-9286c153690d-samples-operator-tls") pod "cluster-samples-operator-65db858894-9tc8s" (UID: "c8570c74-227e-4e5e-805f-9286c153690d") : secret "samples-operator-tls" not found Jul 10 18:30:21.281491 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:21.281466 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-grgmt_3f2651c8-dc6e-49db-b2f4-b152113e0b78/dns-node-resolver/0.log" Jul 10 18:30:22.014245 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:22.014211 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/442c9e87-d74f-457f-a8ee-e4321cdd9fff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nm5ph\" (UID: \"442c9e87-d74f-457f-a8ee-e4321cdd9fff\") " pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:22.014408 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:22.014295 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/442c9e87-d74f-457f-a8ee-e4321cdd9fff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nm5ph\" (UID: \"442c9e87-d74f-457f-a8ee-e4321cdd9fff\") " pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:22.014408 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:22.014350 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 18:30:22.014408 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:22.014359 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 18:30:22.014502 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:22.014411 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/442c9e87-d74f-457f-a8ee-e4321cdd9fff-insights-runtime-extractor-tls podName:442c9e87-d74f-457f-a8ee-e4321cdd9fff nodeName:}" failed. No retries permitted until 2026-07-10 18:30:26.014396211 +0000 UTC m=+245.247600449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/442c9e87-d74f-457f-a8ee-e4321cdd9fff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nm5ph" (UID: "442c9e87-d74f-457f-a8ee-e4321cdd9fff") : secret "insights-runtime-extractor-tls" not found Jul 10 18:30:22.014502 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:22.014427 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/442c9e87-d74f-457f-a8ee-e4321cdd9fff-kube-rbac-proxy-cm podName:442c9e87-d74f-457f-a8ee-e4321cdd9fff nodeName:}" failed. No retries permitted until 2026-07-10 18:30:26.014420695 +0000 UTC m=+245.247624932 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/442c9e87-d74f-457f-a8ee-e4321cdd9fff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nm5ph" (UID: "442c9e87-d74f-457f-a8ee-e4321cdd9fff") : configmap "kube-rbac-proxy" not found Jul 10 18:30:22.083107 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:22.083085 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n95vc_9b8880de-adae-4ec1-93bd-fc39231ad6b0/node-ca/0.log" Jul 10 18:30:23.082292 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:23.082265 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sxdkk_e2ef7c40-e1d7-4e54-abf6-59aa70f9a5eb/serve-healthcheck-canary/0.log" Jul 10 18:30:23.282463 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:23.282398 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-pbmhx_3469b86f-3416-42f1-a371-d35e4e31633f/migrator/0.log" Jul 10 18:30:23.295205 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:23.295178 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-c5gqq" Jul 10 18:30:23.295311 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:23.295264 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-c5gqq" Jul 10 18:30:23.295608 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:23.295592 2564 scope.go:117] "RemoveContainer" containerID="02c58d570420e94cf604ac5609993bffa2ffa36ff0e18e9797dcc3e6537bd464" Jul 10 18:30:23.295793 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:23.295771 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-c5gqq_openshift-console-operator(cfa37e72-ee06-4ff3-996e-d535b0d28d84)\"" pod="openshift-console-operator/console-operator-7866497494-c5gqq" podUID="cfa37e72-ee06-4ff3-996e-d535b0d28d84" Jul 10 18:30:23.482017 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:23.481993 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-pbmhx_3469b86f-3416-42f1-a371-d35e4e31633f/graceful-termination/0.log" Jul 10 18:30:26.044164 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:26.044137 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/442c9e87-d74f-457f-a8ee-e4321cdd9fff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nm5ph\" (UID: \"442c9e87-d74f-457f-a8ee-e4321cdd9fff\") " pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:26.044506 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:26.044208 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/442c9e87-d74f-457f-a8ee-e4321cdd9fff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nm5ph\" (UID: \"442c9e87-d74f-457f-a8ee-e4321cdd9fff\") " pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:26.044506 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:26.044274 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 18:30:26.044506 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:26.044324 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 18:30:26.044506 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:26.044340 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/442c9e87-d74f-457f-a8ee-e4321cdd9fff-insights-runtime-extractor-tls podName:442c9e87-d74f-457f-a8ee-e4321cdd9fff nodeName:}" failed. No retries permitted until 2026-07-10 18:30:34.04432487 +0000 UTC m=+253.277529110 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/442c9e87-d74f-457f-a8ee-e4321cdd9fff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nm5ph" (UID: "442c9e87-d74f-457f-a8ee-e4321cdd9fff") : secret "insights-runtime-extractor-tls" not found Jul 10 18:30:26.044506 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:26.044404 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/442c9e87-d74f-457f-a8ee-e4321cdd9fff-kube-rbac-proxy-cm podName:442c9e87-d74f-457f-a8ee-e4321cdd9fff nodeName:}" failed. No retries permitted until 2026-07-10 18:30:34.04439307 +0000 UTC m=+253.277597311 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/442c9e87-d74f-457f-a8ee-e4321cdd9fff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nm5ph" (UID: "442c9e87-d74f-457f-a8ee-e4321cdd9fff") : configmap "kube-rbac-proxy" not found Jul 10 18:30:28.661105 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:28.661064 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-tls\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:28.663386 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:28.663369 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-tls\") pod \"image-registry-869757d866-5g756\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:28.762156 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:28.762126 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96b5e2d3-67f8-4bef-a56e-a44799345c04-metrics-certs\") pod \"router-default-78fd8c8fc4-8wvsg\" (UID: \"96b5e2d3-67f8-4bef-a56e-a44799345c04\") " pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:28.762156 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:28.762159 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8570c74-227e-4e5e-805f-9286c153690d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9tc8s\" (UID: \"c8570c74-227e-4e5e-805f-9286c153690d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9tc8s" Jul 10 18:30:28.762342 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:28.762190 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96b5e2d3-67f8-4bef-a56e-a44799345c04-service-ca-bundle\") pod \"router-default-78fd8c8fc4-8wvsg\" (UID: \"96b5e2d3-67f8-4bef-a56e-a44799345c04\") " pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:28.762342 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:28.762313 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/96b5e2d3-67f8-4bef-a56e-a44799345c04-service-ca-bundle podName:96b5e2d3-67f8-4bef-a56e-a44799345c04 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:44.762296242 +0000 UTC m=+263.995500484 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/96b5e2d3-67f8-4bef-a56e-a44799345c04-service-ca-bundle") pod "router-default-78fd8c8fc4-8wvsg" (UID: "96b5e2d3-67f8-4bef-a56e-a44799345c04") : configmap references non-existent config key: service-ca.crt Jul 10 18:30:28.764465 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:28.764437 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c8570c74-227e-4e5e-805f-9286c153690d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9tc8s\" (UID: \"c8570c74-227e-4e5e-805f-9286c153690d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9tc8s" Jul 10 18:30:28.764573 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:28.764451 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96b5e2d3-67f8-4bef-a56e-a44799345c04-metrics-certs\") pod \"router-default-78fd8c8fc4-8wvsg\" (UID: \"96b5e2d3-67f8-4bef-a56e-a44799345c04\") " pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:28.793804 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:28.793782 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rc4ck\"" Jul 10 18:30:28.802611 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:28.802598 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:28.892519 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:28.892490 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vjzkd\"" Jul 10 18:30:28.898611 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:28.898588 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9tc8s" Jul 10 18:30:28.924882 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:28.924823 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-869757d866-5g756"] Jul 10 18:30:28.928116 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:30:28.928094 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaedd4b7_8adc_44bd_81c8_fd54315965f9.slice/crio-2387893c216ae1d7bd0763a7650d102355a98b86a536281f31ae658b29be3236 WatchSource:0}: Error finding container 2387893c216ae1d7bd0763a7650d102355a98b86a536281f31ae658b29be3236: Status 404 returned error can't find the container with id 2387893c216ae1d7bd0763a7650d102355a98b86a536281f31ae658b29be3236 Jul 10 18:30:29.025368 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:29.025339 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9tc8s"] Jul 10 18:30:29.115980 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:29.115890 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-869757d866-5g756" event={"ID":"faedd4b7-8adc-44bd-81c8-fd54315965f9","Type":"ContainerStarted","Data":"4f8de06347c65a262a8a14f7ed57cf92c20dc5aeaa0ee9a24d83351aea8ba004"} Jul 10 18:30:29.115980 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:29.115945 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-869757d866-5g756" event={"ID":"faedd4b7-8adc-44bd-81c8-fd54315965f9","Type":"ContainerStarted","Data":"2387893c216ae1d7bd0763a7650d102355a98b86a536281f31ae658b29be3236"} Jul 10 18:30:29.115980 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:29.115974 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:30:29.117034 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:29.117014 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9tc8s" event={"ID":"c8570c74-227e-4e5e-805f-9286c153690d","Type":"ContainerStarted","Data":"291c9767b446c93187bcec5a0b64724bad0d17575cf3ec614dbb946a22a6a874"} Jul 10 18:30:29.135065 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:29.135019 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-869757d866-5g756" podStartSLOduration=17.135004934 podStartE2EDuration="17.135004934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:29.134383259 +0000 UTC m=+248.367587519" watchObservedRunningTime="2026-07-10 18:30:29.135004934 +0000 UTC m=+248.368209192" Jul 10 18:30:31.124639 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:31.124604 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9tc8s" event={"ID":"c8570c74-227e-4e5e-805f-9286c153690d","Type":"ContainerStarted","Data":"85fd1c6527ffbc2780bee07d48f8cc4d43e5e7449b7ba8f09024b63df5387e00"} Jul 10 18:30:31.125091 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:31.124660 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9tc8s" event={"ID":"c8570c74-227e-4e5e-805f-9286c153690d","Type":"ContainerStarted","Data":"e048662a36ac4f09a066367135e9baa83ff4b306bef69cb91ca88baaf61064e5"} Jul 10 18:30:31.142690 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:31.142643 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9tc8s" podStartSLOduration=17.668494402 podStartE2EDuration="19.142625987s" totalImagesPullingTime="1.474131585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:31.141810278 +0000 UTC m=+250.375014536" watchObservedRunningTime="2026-07-10 18:30:31.142625987 +0000 UTC m=+250.375830246" Jul 10 18:30:33.195924 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:33.195879 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs\") pod \"network-metrics-daemon-l7l77\" (UID: \"f4443fb4-d9ef-4a8c-8268-0aacbd93ce13\") " pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:30:33.198226 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:33.198206 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4443fb4-d9ef-4a8c-8268-0aacbd93ce13-metrics-certs\") pod \"network-metrics-daemon-l7l77\" (UID: \"f4443fb4-d9ef-4a8c-8268-0aacbd93ce13\") " pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:30:33.204498 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:33.204479 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fnqlf\"" Jul 10 18:30:33.212534 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:33.212518 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7l77" Jul 10 18:30:33.330303 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:33.330272 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l7l77"] Jul 10 18:30:33.332999 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:30:33.332968 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4443fb4_d9ef_4a8c_8268_0aacbd93ce13.slice/crio-4430c55aea20638c870fa8b1b3323da163fc65ca78433b4cac1d398214c312c9 WatchSource:0}: Error finding container 4430c55aea20638c870fa8b1b3323da163fc65ca78433b4cac1d398214c312c9: Status 404 returned error can't find the container with id 4430c55aea20638c870fa8b1b3323da163fc65ca78433b4cac1d398214c312c9 Jul 10 18:30:34.101770 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:34.101735 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/442c9e87-d74f-457f-a8ee-e4321cdd9fff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nm5ph\" (UID: \"442c9e87-d74f-457f-a8ee-e4321cdd9fff\") " pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:34.101935 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:34.101825 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/442c9e87-d74f-457f-a8ee-e4321cdd9fff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nm5ph\" (UID: \"442c9e87-d74f-457f-a8ee-e4321cdd9fff\") " pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:34.102259 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:34.102241 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/442c9e87-d74f-457f-a8ee-e4321cdd9fff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nm5ph\" (UID: \"442c9e87-d74f-457f-a8ee-e4321cdd9fff\") " pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:34.104081 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:34.104064 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/442c9e87-d74f-457f-a8ee-e4321cdd9fff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nm5ph\" (UID: \"442c9e87-d74f-457f-a8ee-e4321cdd9fff\") " pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:34.134491 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:34.134461 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l7l77" event={"ID":"f4443fb4-d9ef-4a8c-8268-0aacbd93ce13","Type":"ContainerStarted","Data":"4430c55aea20638c870fa8b1b3323da163fc65ca78433b4cac1d398214c312c9"} Jul 10 18:30:34.215140 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:34.215110 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q6ch7\"" Jul 10 18:30:34.223417 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:34.223390 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nm5ph" Jul 10 18:30:34.509966 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:34.509900 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nm5ph"] Jul 10 18:30:34.512313 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:30:34.512290 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod442c9e87_d74f_457f_a8ee_e4321cdd9fff.slice/crio-9d6984c94d49d9b69747e933941afe802603a34b0e0bb9fe3590e6162df834ae WatchSource:0}: Error finding container 9d6984c94d49d9b69747e933941afe802603a34b0e0bb9fe3590e6162df834ae: Status 404 returned error can't find the container with id 9d6984c94d49d9b69747e933941afe802603a34b0e0bb9fe3590e6162df834ae Jul 10 18:30:35.143565 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:35.143526 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l7l77" event={"ID":"f4443fb4-d9ef-4a8c-8268-0aacbd93ce13","Type":"ContainerStarted","Data":"fdbb079c07ac3316aebdab884bab8f7bfa38b7c6d60992f25a27139cf8467e52"} Jul 10 18:30:35.143778 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:35.143591 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l7l77" event={"ID":"f4443fb4-d9ef-4a8c-8268-0aacbd93ce13","Type":"ContainerStarted","Data":"a52e6473b7aca0e17121db103c7bf262fd4474d2881f48927bdd4f22ac5b6795"} Jul 10 18:30:35.145734 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:35.145634 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nm5ph" event={"ID":"442c9e87-d74f-457f-a8ee-e4321cdd9fff","Type":"ContainerStarted","Data":"9d6984c94d49d9b69747e933941afe802603a34b0e0bb9fe3590e6162df834ae"} Jul 10 18:30:36.401394 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:36.401357 2564 scope.go:117] "RemoveContainer" containerID="02c58d570420e94cf604ac5609993bffa2ffa36ff0e18e9797dcc3e6537bd464" Jul 10 18:30:39.161891 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:39.161866 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nm5ph" event={"ID":"442c9e87-d74f-457f-a8ee-e4321cdd9fff","Type":"ContainerStarted","Data":"0fc6ce2d19f7e887fba76f67eb1a23bf9080ed605b3fd674f38e3c5623bd16b2"} Jul 10 18:30:39.162234 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:39.161930 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nm5ph" event={"ID":"442c9e87-d74f-457f-a8ee-e4321cdd9fff","Type":"ContainerStarted","Data":"3aa6132d6b88bf3429e2f5467cfb20566480b82649148004c99b75a2a5e8bbb9"} Jul 10 18:30:39.163755 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:39.163737 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5gqq_cfa37e72-ee06-4ff3-996e-d535b0d28d84/console-operator/1.log" Jul 10 18:30:39.163836 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:39.163785 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-c5gqq" event={"ID":"cfa37e72-ee06-4ff3-996e-d535b0d28d84","Type":"ContainerStarted","Data":"83a39a92ffdba21f027244d2aa57e4d5dc955480957d64529f25c4903490e8c3"} Jul 10 18:30:39.164063 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:39.164046 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-c5gqq" Jul 10 18:30:39.180307 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:39.180266 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l7l77" podStartSLOduration=257.081218179 podStartE2EDuration="4m18.180253641s" totalImagesPullingTime="1.099035462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:26:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:35.163385475 +0000 UTC m=+254.396589732" watchObservedRunningTime="2026-07-10 18:30:39.180253641 +0000 UTC m=+258.413457960" Jul 10 18:30:39.180543 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:39.180525 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-c5gqq" podStartSLOduration=25.420258015 podStartE2EDuration="27.180521057s" totalImagesPullingTime="1.760263042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:39.179097512 +0000 UTC m=+258.412301774" watchObservedRunningTime="2026-07-10 18:30:39.180521057 +0000 UTC m=+258.413725317" Jul 10 18:30:39.293643 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:39.293587 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-c5gqq" Jul 10 18:30:42.176151 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:42.176110 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nm5ph" event={"ID":"442c9e87-d74f-457f-a8ee-e4321cdd9fff","Type":"ContainerStarted","Data":"f67e61ffa97afcd988e0240d238cc93c1cbc5e4bd95c24d801b5e011eb41bb98"} Jul 10 18:30:42.197789 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:42.197743 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nm5ph" podStartSLOduration=17.410071226 podStartE2EDuration="24.197729994s" totalImagesPullingTime="6.787658768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:30:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:42.19642872 +0000 UTC m=+261.429633003" watchObservedRunningTime="2026-07-10 18:30:42.197729994 +0000 UTC m=+261.430934253" Jul 10 18:30:44.200194 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:44.200122 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-869757d866-5g756"] Jul 10 18:30:44.204203 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:44.204175 2564 patch_prober.go:28] interesting pod/image-registry-869757d866-5g756 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 10 18:30:44.204330 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:44.204217 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-869757d866-5g756" podUID="faedd4b7-8adc-44bd-81c8-fd54315965f9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 18:30:44.777834 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:44.777805 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96b5e2d3-67f8-4bef-a56e-a44799345c04-service-ca-bundle\") pod \"router-default-78fd8c8fc4-8wvsg\" (UID: \"96b5e2d3-67f8-4bef-a56e-a44799345c04\") " pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:44.778407 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:44.778389 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96b5e2d3-67f8-4bef-a56e-a44799345c04-service-ca-bundle\") pod \"router-default-78fd8c8fc4-8wvsg\" (UID: \"96b5e2d3-67f8-4bef-a56e-a44799345c04\") " pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:44.802172 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:44.802152 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-m2gr8\"" Jul 10 18:30:44.810381 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:44.810366 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:44.939164 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:44.939136 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-78fd8c8fc4-8wvsg"] Jul 10 18:30:44.942027 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:30:44.941999 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96b5e2d3_67f8_4bef_a56e_a44799345c04.slice/crio-5e97cdf5e73522ddedebe4211b77acbac9fd16f4df24d70b2e038e17ad24ef71 WatchSource:0}: Error finding container 5e97cdf5e73522ddedebe4211b77acbac9fd16f4df24d70b2e038e17ad24ef71: Status 404 returned error can't find the container with id 5e97cdf5e73522ddedebe4211b77acbac9fd16f4df24d70b2e038e17ad24ef71 Jul 10 18:30:45.188075 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:45.188005 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" event={"ID":"96b5e2d3-67f8-4bef-a56e-a44799345c04","Type":"ContainerStarted","Data":"f603646f3ae1574d62139a59ba7ecc3e9aa16478d3d1921d3802c8459781d6b3"} Jul 10 18:30:45.188075 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:45.188049 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" event={"ID":"96b5e2d3-67f8-4bef-a56e-a44799345c04","Type":"ContainerStarted","Data":"5e97cdf5e73522ddedebe4211b77acbac9fd16f4df24d70b2e038e17ad24ef71"} Jul 10 18:30:45.207427 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:45.207382 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" podStartSLOduration=33.207367111 podStartE2EDuration="33.207367111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:45.20648278 +0000 UTC m=+264.439687038" watchObservedRunningTime="2026-07-10 18:30:45.207367111 +0000 UTC m=+264.440571370" Jul 10 18:30:45.810767 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:45.810735 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:45.813162 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:45.813138 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:46.190954 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:46.190886 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:46.192052 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:46.192030 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-78fd8c8fc4-8wvsg" Jul 10 18:30:53.582755 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:53.582723 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-676fbdc4f8-jmmjs"] Jul 10 18:30:53.802204 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:53.802169 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-676fbdc4f8-jmmjs"] Jul 10 18:30:53.802352 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:53.802259 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:30:53.804786 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:53.804760 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 10 18:30:53.804945 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:53.804800 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 10 18:30:53.804945 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:53.804767 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 10 18:30:53.805060 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:53.805041 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 10 18:30:53.805907 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:53.805888 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 10 18:30:53.806076 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:53.806051 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-grfkv\"" Jul 10 18:30:53.806249 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:53.806096 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 10 18:30:53.806973 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:53.806954 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 10 18:30:53.810239 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:53.810222 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 10 18:30:53.938252 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:53.938190 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44761921-21ce-483c-b6ea-d1afa48eb0f4-console-config\") pod \"console-676fbdc4f8-jmmjs\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:30:53.938346 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:53.938248 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44761921-21ce-483c-b6ea-d1afa48eb0f4-service-ca\") pod \"console-676fbdc4f8-jmmjs\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:30:53.938346 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:53.938305 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44761921-21ce-483c-b6ea-d1afa48eb0f4-console-serving-cert\") pod \"console-676fbdc4f8-jmmjs\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:30:53.938346 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:53.938326 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44761921-21ce-483c-b6ea-d1afa48eb0f4-oauth-serving-cert\") pod \"console-676fbdc4f8-jmmjs\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:30:53.938460 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:53.938347 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44761921-21ce-483c-b6ea-d1afa48eb0f4-trusted-ca-bundle\") pod \"console-676fbdc4f8-jmmjs\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:30:53.938460 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:53.938365 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44761921-21ce-483c-b6ea-d1afa48eb0f4-console-oauth-config\") pod \"console-676fbdc4f8-jmmjs\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:30:53.938460 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:53.938383 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5nck\" (UniqueName: \"kubernetes.io/projected/44761921-21ce-483c-b6ea-d1afa48eb0f4-kube-api-access-z5nck\") pod \"console-676fbdc4f8-jmmjs\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:30:54.038941 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:54.038919 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44761921-21ce-483c-b6ea-d1afa48eb0f4-console-config\") pod \"console-676fbdc4f8-jmmjs\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:30:54.039041 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:54.038958 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44761921-21ce-483c-b6ea-d1afa48eb0f4-service-ca\") pod \"console-676fbdc4f8-jmmjs\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:30:54.039041 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:54.038980 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44761921-21ce-483c-b6ea-d1afa48eb0f4-console-serving-cert\") pod \"console-676fbdc4f8-jmmjs\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:30:54.039160 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:54.039102 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44761921-21ce-483c-b6ea-d1afa48eb0f4-oauth-serving-cert\") pod \"console-676fbdc4f8-jmmjs\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:30:54.039160 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:54.039142 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44761921-21ce-483c-b6ea-d1afa48eb0f4-trusted-ca-bundle\") pod \"console-676fbdc4f8-jmmjs\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:30:54.039265 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:54.039172 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44761921-21ce-483c-b6ea-d1afa48eb0f4-console-oauth-config\") pod \"console-676fbdc4f8-jmmjs\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:30:54.039265 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:54.039201 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5nck\" (UniqueName: \"kubernetes.io/projected/44761921-21ce-483c-b6ea-d1afa48eb0f4-kube-api-access-z5nck\") pod \"console-676fbdc4f8-jmmjs\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:30:54.039734 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:54.039692 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44761921-21ce-483c-b6ea-d1afa48eb0f4-service-ca\") pod \"console-676fbdc4f8-jmmjs\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:30:54.039864 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:54.039773 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44761921-21ce-483c-b6ea-d1afa48eb0f4-console-config\") pod \"console-676fbdc4f8-jmmjs\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:30:54.039864 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:54.039798 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44761921-21ce-483c-b6ea-d1afa48eb0f4-oauth-serving-cert\") pod \"console-676fbdc4f8-jmmjs\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:30:54.040131 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:54.040109 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44761921-21ce-483c-b6ea-d1afa48eb0f4-trusted-ca-bundle\") pod \"console-676fbdc4f8-jmmjs\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:30:54.041467 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:54.041442 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44761921-21ce-483c-b6ea-d1afa48eb0f4-console-serving-cert\") pod \"console-676fbdc4f8-jmmjs\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:30:54.041651 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:54.041634 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44761921-21ce-483c-b6ea-d1afa48eb0f4-console-oauth-config\") pod \"console-676fbdc4f8-jmmjs\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:30:54.047664 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:54.047637 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5nck\" (UniqueName: \"kubernetes.io/projected/44761921-21ce-483c-b6ea-d1afa48eb0f4-kube-api-access-z5nck\") pod \"console-676fbdc4f8-jmmjs\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:30:54.111901 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:54.111881 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:30:54.204399 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:54.204371 2564 patch_prober.go:28] interesting pod/image-registry-869757d866-5g756 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 10 18:30:54.204556 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:54.204463 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-869757d866-5g756" podUID="faedd4b7-8adc-44bd-81c8-fd54315965f9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 18:30:54.251837 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:54.251808 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-676fbdc4f8-jmmjs"] Jul 10 18:30:54.254589 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:30:54.254564 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44761921_21ce_483c_b6ea_d1afa48eb0f4.slice/crio-71b34a7c6e4d459708ec0a8271269f9f6092ff266092f33cda2a7961ba136652 WatchSource:0}: Error finding container 71b34a7c6e4d459708ec0a8271269f9f6092ff266092f33cda2a7961ba136652: Status 404 returned error can't find the container with id 71b34a7c6e4d459708ec0a8271269f9f6092ff266092f33cda2a7961ba136652 Jul 10 18:30:55.222125 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.222084 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-676fbdc4f8-jmmjs" event={"ID":"44761921-21ce-483c-b6ea-d1afa48eb0f4","Type":"ContainerStarted","Data":"71b34a7c6e4d459708ec0a8271269f9f6092ff266092f33cda2a7961ba136652"} Jul 10 18:30:55.772637 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.772605 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-xrrzm"] Jul 10 18:30:55.775049 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.775002 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-xrrzm" Jul 10 18:30:55.777506 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.777470 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 10 18:30:55.777663 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.777629 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dfdcc\"" Jul 10 18:30:55.777769 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.777759 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 10 18:30:55.777890 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.777871 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 10 18:30:55.778849 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.778831 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 10 18:30:55.778935 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.778839 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 10 18:30:55.778935 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.778839 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 10 18:30:55.790647 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.790623 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-xrrzm"] Jul 10 18:30:55.791650 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.791632 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9gr8x"] Jul 10 18:30:55.793983 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.793963 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:55.796385 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.796358 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vg69v\"" Jul 10 18:30:55.796488 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.796463 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 10 18:30:55.796784 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.796711 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 10 18:30:55.796875 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.796720 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 10 18:30:55.854279 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.854250 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/da15b0c8-588c-4876-9c48-55c4ba22d317-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-xrrzm\" (UID: \"da15b0c8-588c-4876-9c48-55c4ba22d317\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrrzm" Jul 10 18:30:55.854398 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.854286 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da15b0c8-588c-4876-9c48-55c4ba22d317-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-xrrzm\" (UID: \"da15b0c8-588c-4876-9c48-55c4ba22d317\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrrzm" Jul 10 18:30:55.854398 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.854318 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j42dg\" (UniqueName: \"kubernetes.io/projected/da15b0c8-588c-4876-9c48-55c4ba22d317-kube-api-access-j42dg\") pod \"kube-state-metrics-785778ff74-xrrzm\" (UID: \"da15b0c8-588c-4876-9c48-55c4ba22d317\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrrzm" Jul 10 18:30:55.854511 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.854415 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da15b0c8-588c-4876-9c48-55c4ba22d317-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-xrrzm\" (UID: \"da15b0c8-588c-4876-9c48-55c4ba22d317\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrrzm" Jul 10 18:30:55.854511 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.854451 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/da15b0c8-588c-4876-9c48-55c4ba22d317-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-xrrzm\" (UID: \"da15b0c8-588c-4876-9c48-55c4ba22d317\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrrzm" Jul 10 18:30:55.854511 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.854481 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/da15b0c8-588c-4876-9c48-55c4ba22d317-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-xrrzm\" (UID: \"da15b0c8-588c-4876-9c48-55c4ba22d317\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrrzm" Jul 10 18:30:55.955614 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.955580 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-node-exporter-accelerators-collector-config\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:55.955780 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.955630 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-sys\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:55.955780 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.955713 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/da15b0c8-588c-4876-9c48-55c4ba22d317-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-xrrzm\" (UID: \"da15b0c8-588c-4876-9c48-55c4ba22d317\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrrzm" Jul 10 18:30:55.955780 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.955738 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da15b0c8-588c-4876-9c48-55c4ba22d317-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-xrrzm\" (UID: \"da15b0c8-588c-4876-9c48-55c4ba22d317\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrrzm" Jul 10 18:30:55.955780 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.955760 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j42dg\" (UniqueName: \"kubernetes.io/projected/da15b0c8-588c-4876-9c48-55c4ba22d317-kube-api-access-j42dg\") pod \"kube-state-metrics-785778ff74-xrrzm\" (UID: \"da15b0c8-588c-4876-9c48-55c4ba22d317\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrrzm" Jul 10 18:30:55.955780 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.955779 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-node-exporter-textfile\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:55.956057 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.955806 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:55.956057 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.955838 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-node-exporter-wtmp\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:55.956057 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.955863 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-metrics-client-ca\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:55.956057 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.955885 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ckfs\" (UniqueName: \"kubernetes.io/projected/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-kube-api-access-7ckfs\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:55.956057 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.955915 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da15b0c8-588c-4876-9c48-55c4ba22d317-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-xrrzm\" (UID: \"da15b0c8-588c-4876-9c48-55c4ba22d317\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrrzm" Jul 10 18:30:55.956057 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.955938 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/da15b0c8-588c-4876-9c48-55c4ba22d317-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-xrrzm\" (UID: \"da15b0c8-588c-4876-9c48-55c4ba22d317\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrrzm" Jul 10 18:30:55.956057 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.955958 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-node-exporter-tls\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:55.956057 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.955985 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/da15b0c8-588c-4876-9c48-55c4ba22d317-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-xrrzm\" (UID: \"da15b0c8-588c-4876-9c48-55c4ba22d317\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrrzm" Jul 10 18:30:55.956057 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.956012 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-root\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:55.956491 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.956087 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/da15b0c8-588c-4876-9c48-55c4ba22d317-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-xrrzm\" (UID: \"da15b0c8-588c-4876-9c48-55c4ba22d317\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrrzm" Jul 10 18:30:55.956491 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:55.956174 2564 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 10 18:30:55.956491 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:30:55.956239 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da15b0c8-588c-4876-9c48-55c4ba22d317-kube-state-metrics-tls podName:da15b0c8-588c-4876-9c48-55c4ba22d317 nodeName:}" failed. No retries permitted until 2026-07-10 18:30:56.456221014 +0000 UTC m=+275.689425258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/da15b0c8-588c-4876-9c48-55c4ba22d317-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-xrrzm" (UID: "da15b0c8-588c-4876-9c48-55c4ba22d317") : secret "kube-state-metrics-tls" not found Jul 10 18:30:55.956491 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.956449 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da15b0c8-588c-4876-9c48-55c4ba22d317-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-xrrzm\" (UID: \"da15b0c8-588c-4876-9c48-55c4ba22d317\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrrzm" Jul 10 18:30:55.956713 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.956656 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/da15b0c8-588c-4876-9c48-55c4ba22d317-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-xrrzm\" (UID: \"da15b0c8-588c-4876-9c48-55c4ba22d317\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrrzm" Jul 10 18:30:55.958781 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.958758 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da15b0c8-588c-4876-9c48-55c4ba22d317-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-xrrzm\" (UID: \"da15b0c8-588c-4876-9c48-55c4ba22d317\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrrzm" Jul 10 18:30:55.966850 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:55.966824 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j42dg\" (UniqueName: \"kubernetes.io/projected/da15b0c8-588c-4876-9c48-55c4ba22d317-kube-api-access-j42dg\") pod \"kube-state-metrics-785778ff74-xrrzm\" (UID: \"da15b0c8-588c-4876-9c48-55c4ba22d317\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrrzm" Jul 10 18:30:56.057475 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:56.057392 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-node-exporter-accelerators-collector-config\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:56.057475 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:56.057456 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-sys\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:56.057681 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:56.057525 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-node-exporter-textfile\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:56.057681 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:56.057555 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:56.057681 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:56.057583 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-node-exporter-wtmp\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:56.057681 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:56.057586 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-sys\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:56.057681 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:56.057607 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-metrics-client-ca\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:56.057990 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:56.057756 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ckfs\" (UniqueName: \"kubernetes.io/projected/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-kube-api-access-7ckfs\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:56.057990 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:56.057787 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-node-exporter-tls\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:56.057990 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:56.057830 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-root\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:56.057990 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:56.057866 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-node-exporter-wtmp\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:56.057990 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:56.057904 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-root\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:56.057990 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:56.057959 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-node-exporter-textfile\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:56.058237 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:56.058106 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-node-exporter-accelerators-collector-config\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:56.058291 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:56.058233 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-metrics-client-ca\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:56.060128 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:56.060108 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:56.060317 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:56.060297 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-node-exporter-tls\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:56.065518 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:56.065496 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ckfs\" (UniqueName: \"kubernetes.io/projected/0d83ab8e-ab03-4450-bd77-cc6c8c3df976-kube-api-access-7ckfs\") pod \"node-exporter-9gr8x\" (UID: \"0d83ab8e-ab03-4450-bd77-cc6c8c3df976\") " pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:56.104308 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:56.104283 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9gr8x" Jul 10 18:30:56.461008 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:56.460967 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/da15b0c8-588c-4876-9c48-55c4ba22d317-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-xrrzm\" (UID: \"da15b0c8-588c-4876-9c48-55c4ba22d317\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrrzm" Jul 10 18:30:56.463499 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:56.463473 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/da15b0c8-588c-4876-9c48-55c4ba22d317-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-xrrzm\" (UID: \"da15b0c8-588c-4876-9c48-55c4ba22d317\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xrrzm" Jul 10 18:30:56.685761 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:56.685727 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-xrrzm" Jul 10 18:30:56.740988 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:30:56.740961 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d83ab8e_ab03_4450_bd77_cc6c8c3df976.slice/crio-58d43894e163698bd74ea4a2c2bfb5a428726c68cc771b822c01e1c5317ac9bf WatchSource:0}: Error finding container 58d43894e163698bd74ea4a2c2bfb5a428726c68cc771b822c01e1c5317ac9bf: Status 404 returned error can't find the container with id 58d43894e163698bd74ea4a2c2bfb5a428726c68cc771b822c01e1c5317ac9bf Jul 10 18:30:56.865366 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:56.865330 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-xrrzm"] Jul 10 18:30:56.868635 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:30:56.868611 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda15b0c8_588c_4876_9c48_55c4ba22d317.slice/crio-81318a403e829ad14e8d291a8a873f760e360ed22a376e57dbba6d0f40fdeb00 WatchSource:0}: Error finding container 81318a403e829ad14e8d291a8a873f760e360ed22a376e57dbba6d0f40fdeb00: Status 404 returned error can't find the container with id 81318a403e829ad14e8d291a8a873f760e360ed22a376e57dbba6d0f40fdeb00 Jul 10 18:30:57.231264 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:57.231229 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-xrrzm" event={"ID":"da15b0c8-588c-4876-9c48-55c4ba22d317","Type":"ContainerStarted","Data":"81318a403e829ad14e8d291a8a873f760e360ed22a376e57dbba6d0f40fdeb00"} Jul 10 18:30:57.233018 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:57.232969 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-676fbdc4f8-jmmjs" event={"ID":"44761921-21ce-483c-b6ea-d1afa48eb0f4","Type":"ContainerStarted","Data":"03d0caf2e2c84a88248bfba1b53ad30f7cf67e7cf38c2b83aa010ff1616747ac"} Jul 10 18:30:57.234181 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:57.234157 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9gr8x" event={"ID":"0d83ab8e-ab03-4450-bd77-cc6c8c3df976","Type":"ContainerStarted","Data":"58d43894e163698bd74ea4a2c2bfb5a428726c68cc771b822c01e1c5317ac9bf"} Jul 10 18:30:57.252778 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:57.252724 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-676fbdc4f8-jmmjs" podStartSLOduration=1.742708675 podStartE2EDuration="4.252683401s" totalImagesPullingTime="2.509974726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:57.251366924 +0000 UTC m=+276.484571177" watchObservedRunningTime="2026-07-10 18:30:57.252683401 +0000 UTC m=+276.485887662" Jul 10 18:30:58.241107 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:58.241064 2564 generic.go:356] "Generic (PLEG): container finished" podID="0d83ab8e-ab03-4450-bd77-cc6c8c3df976" containerID="396bcf89978cc57c6cfe4e7a1277e548be1ac81d8f432d49c83dbefb4f4afd8a" exitCode=0 Jul 10 18:30:58.241507 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:58.241152 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9gr8x" event={"ID":"0d83ab8e-ab03-4450-bd77-cc6c8c3df976","Type":"ContainerDied","Data":"396bcf89978cc57c6cfe4e7a1277e548be1ac81d8f432d49c83dbefb4f4afd8a"} Jul 10 18:30:59.247162 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:59.247130 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-xrrzm" event={"ID":"da15b0c8-588c-4876-9c48-55c4ba22d317","Type":"ContainerStarted","Data":"00155922949d6281ed8d6c8b42159507eba9076afb7ecfa40ffe622172f8b9c9"} Jul 10 18:30:59.247587 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:59.247188 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-xrrzm" event={"ID":"da15b0c8-588c-4876-9c48-55c4ba22d317","Type":"ContainerStarted","Data":"fb897ad1bb46b12319eb248c981f6f1f455609886c7492ed5b8abec99f54c6ec"} Jul 10 18:30:59.247587 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:59.247213 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-xrrzm" event={"ID":"da15b0c8-588c-4876-9c48-55c4ba22d317","Type":"ContainerStarted","Data":"910906c284be645fd87c9bc3c1e64d8d1bd4b4932482277e403fa82528d99d57"} Jul 10 18:30:59.249165 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:59.249144 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9gr8x" event={"ID":"0d83ab8e-ab03-4450-bd77-cc6c8c3df976","Type":"ContainerStarted","Data":"bfdc94a128593eeb44bed08a1cbd7631e812f9da652e90566e3476bb5a3cf748"} Jul 10 18:30:59.249278 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:59.249180 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9gr8x" event={"ID":"0d83ab8e-ab03-4450-bd77-cc6c8c3df976","Type":"ContainerStarted","Data":"f1a66149c055d3f607cde1fd8d4b5ac359e14ea7bfa657b2307f0d2859663aa8"} Jul 10 18:30:59.286528 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:59.286485 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-xrrzm" podStartSLOduration=2.831610348 podStartE2EDuration="4.286467823s" totalImagesPullingTime="1.454857475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:59.268321197 +0000 UTC m=+278.501525455" watchObservedRunningTime="2026-07-10 18:30:59.286467823 +0000 UTC m=+278.519672083" Jul 10 18:30:59.287504 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:30:59.287476 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9gr8x" podStartSLOduration=3.236229106 podStartE2EDuration="4.28746687s" totalImagesPullingTime="979.454465ms" totalInitContainerRuntime="71.783299ms" isStatefulPod=true podCreationTimestamp="2026-07-10 18:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:30:59.28606977 +0000 UTC m=+278.519274028" watchObservedRunningTime="2026-07-10 18:30:59.28746687 +0000 UTC m=+278.520671128" Jul 10 18:31:00.542387 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:00.542359 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-4vvdt"] Jul 10 18:31:00.545585 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:00.545565 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4vvdt" Jul 10 18:31:00.547995 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:00.547979 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-vtvfl\"" Jul 10 18:31:00.548478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:00.548461 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 10 18:31:00.554130 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:00.554107 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-4vvdt"] Jul 10 18:31:00.696628 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:00.696601 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vz5l\" (UniqueName: \"kubernetes.io/projected/ea501729-9139-4744-85c4-2a1d19691f3f-kube-api-access-4vz5l\") pod \"monitoring-plugin-5f68df7f58-4vvdt\" (UID: \"ea501729-9139-4744-85c4-2a1d19691f3f\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4vvdt" Jul 10 18:31:00.696751 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:00.696644 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea501729-9139-4744-85c4-2a1d19691f3f-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-4vvdt\" (UID: \"ea501729-9139-4744-85c4-2a1d19691f3f\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4vvdt" Jul 10 18:31:00.797000 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:00.796943 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vz5l\" (UniqueName: \"kubernetes.io/projected/ea501729-9139-4744-85c4-2a1d19691f3f-kube-api-access-4vz5l\") pod \"monitoring-plugin-5f68df7f58-4vvdt\" (UID: \"ea501729-9139-4744-85c4-2a1d19691f3f\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4vvdt" Jul 10 18:31:00.797000 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:00.796984 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea501729-9139-4744-85c4-2a1d19691f3f-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-4vvdt\" (UID: \"ea501729-9139-4744-85c4-2a1d19691f3f\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4vvdt" Jul 10 18:31:00.799217 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:00.799197 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea501729-9139-4744-85c4-2a1d19691f3f-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-4vvdt\" (UID: \"ea501729-9139-4744-85c4-2a1d19691f3f\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4vvdt" Jul 10 18:31:00.805384 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:00.805364 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vz5l\" (UniqueName: \"kubernetes.io/projected/ea501729-9139-4744-85c4-2a1d19691f3f-kube-api-access-4vz5l\") pod \"monitoring-plugin-5f68df7f58-4vvdt\" (UID: \"ea501729-9139-4744-85c4-2a1d19691f3f\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4vvdt" Jul 10 18:31:00.855473 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:00.855440 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4vvdt" Jul 10 18:31:00.980292 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:00.980262 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-4vvdt"] Jul 10 18:31:00.982610 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:31:00.982581 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea501729_9139_4744_85c4_2a1d19691f3f.slice/crio-abe987cd024edf360c79944dca1ba0ecec44b8a4633894acbf5717c6deb6d00a WatchSource:0}: Error finding container abe987cd024edf360c79944dca1ba0ecec44b8a4633894acbf5717c6deb6d00a: Status 404 returned error can't find the container with id abe987cd024edf360c79944dca1ba0ecec44b8a4633894acbf5717c6deb6d00a Jul 10 18:31:01.001210 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.001187 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6687456d6c-scxpm"] Jul 10 18:31:01.005743 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.005725 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" Jul 10 18:31:01.008400 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.008381 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 10 18:31:01.008840 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.008824 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 10 18:31:01.009127 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.009111 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 10 18:31:01.009238 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.009222 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-zrf9w\"" Jul 10 18:31:01.009304 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.009285 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 10 18:31:01.009361 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.009303 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 10 18:31:01.015137 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.015118 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 10 18:31:01.020297 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.020276 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6687456d6c-scxpm"] Jul 10 18:31:01.099548 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.099498 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7a43ed7-470a-45fe-a90e-3465b1a29d9c-metrics-client-ca\") pod \"telemeter-client-6687456d6c-scxpm\" (UID: \"b7a43ed7-470a-45fe-a90e-3465b1a29d9c\") " pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" Jul 10 18:31:01.099548 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.099526 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b7a43ed7-470a-45fe-a90e-3465b1a29d9c-secret-telemeter-client\") pod \"telemeter-client-6687456d6c-scxpm\" (UID: \"b7a43ed7-470a-45fe-a90e-3465b1a29d9c\") " pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" Jul 10 18:31:01.099548 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.099548 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7a43ed7-470a-45fe-a90e-3465b1a29d9c-serving-certs-ca-bundle\") pod \"telemeter-client-6687456d6c-scxpm\" (UID: \"b7a43ed7-470a-45fe-a90e-3465b1a29d9c\") " pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" Jul 10 18:31:01.099696 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.099562 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7a43ed7-470a-45fe-a90e-3465b1a29d9c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6687456d6c-scxpm\" (UID: \"b7a43ed7-470a-45fe-a90e-3465b1a29d9c\") " pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" Jul 10 18:31:01.099696 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.099680 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzspj\" (UniqueName: \"kubernetes.io/projected/b7a43ed7-470a-45fe-a90e-3465b1a29d9c-kube-api-access-bzspj\") pod \"telemeter-client-6687456d6c-scxpm\" (UID: \"b7a43ed7-470a-45fe-a90e-3465b1a29d9c\") " pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" Jul 10 18:31:01.099777 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.099741 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b7a43ed7-470a-45fe-a90e-3465b1a29d9c-federate-client-tls\") pod \"telemeter-client-6687456d6c-scxpm\" (UID: \"b7a43ed7-470a-45fe-a90e-3465b1a29d9c\") " pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" Jul 10 18:31:01.099777 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.099762 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b7a43ed7-470a-45fe-a90e-3465b1a29d9c-telemeter-client-tls\") pod \"telemeter-client-6687456d6c-scxpm\" (UID: \"b7a43ed7-470a-45fe-a90e-3465b1a29d9c\") " pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" Jul 10 18:31:01.099839 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.099786 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7a43ed7-470a-45fe-a90e-3465b1a29d9c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6687456d6c-scxpm\" (UID: \"b7a43ed7-470a-45fe-a90e-3465b1a29d9c\") " pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" Jul 10 18:31:01.201052 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.201027 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7a43ed7-470a-45fe-a90e-3465b1a29d9c-metrics-client-ca\") pod \"telemeter-client-6687456d6c-scxpm\" (UID: \"b7a43ed7-470a-45fe-a90e-3465b1a29d9c\") " pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" Jul 10 18:31:01.201135 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.201056 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b7a43ed7-470a-45fe-a90e-3465b1a29d9c-secret-telemeter-client\") pod \"telemeter-client-6687456d6c-scxpm\" (UID: \"b7a43ed7-470a-45fe-a90e-3465b1a29d9c\") " pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" Jul 10 18:31:01.201135 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.201076 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7a43ed7-470a-45fe-a90e-3465b1a29d9c-serving-certs-ca-bundle\") pod \"telemeter-client-6687456d6c-scxpm\" (UID: \"b7a43ed7-470a-45fe-a90e-3465b1a29d9c\") " pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" Jul 10 18:31:01.201135 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.201094 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7a43ed7-470a-45fe-a90e-3465b1a29d9c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6687456d6c-scxpm\" (UID: \"b7a43ed7-470a-45fe-a90e-3465b1a29d9c\") " pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" Jul 10 18:31:01.201240 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.201146 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzspj\" (UniqueName: \"kubernetes.io/projected/b7a43ed7-470a-45fe-a90e-3465b1a29d9c-kube-api-access-bzspj\") pod \"telemeter-client-6687456d6c-scxpm\" (UID: \"b7a43ed7-470a-45fe-a90e-3465b1a29d9c\") " pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" Jul 10 18:31:01.201240 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.201169 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b7a43ed7-470a-45fe-a90e-3465b1a29d9c-federate-client-tls\") pod \"telemeter-client-6687456d6c-scxpm\" (UID: \"b7a43ed7-470a-45fe-a90e-3465b1a29d9c\") " pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" Jul 10 18:31:01.201240 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.201189 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b7a43ed7-470a-45fe-a90e-3465b1a29d9c-telemeter-client-tls\") pod \"telemeter-client-6687456d6c-scxpm\" (UID: \"b7a43ed7-470a-45fe-a90e-3465b1a29d9c\") " pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" Jul 10 18:31:01.201240 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.201224 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7a43ed7-470a-45fe-a90e-3465b1a29d9c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6687456d6c-scxpm\" (UID: \"b7a43ed7-470a-45fe-a90e-3465b1a29d9c\") " pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" Jul 10 18:31:01.201868 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.201840 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7a43ed7-470a-45fe-a90e-3465b1a29d9c-metrics-client-ca\") pod \"telemeter-client-6687456d6c-scxpm\" (UID: \"b7a43ed7-470a-45fe-a90e-3465b1a29d9c\") " pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" Jul 10 18:31:01.201955 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.201851 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7a43ed7-470a-45fe-a90e-3465b1a29d9c-serving-certs-ca-bundle\") pod \"telemeter-client-6687456d6c-scxpm\" (UID: \"b7a43ed7-470a-45fe-a90e-3465b1a29d9c\") " pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" Jul 10 18:31:01.202056 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.202035 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7a43ed7-470a-45fe-a90e-3465b1a29d9c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6687456d6c-scxpm\" (UID: \"b7a43ed7-470a-45fe-a90e-3465b1a29d9c\") " pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" Jul 10 18:31:01.203623 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.203604 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7a43ed7-470a-45fe-a90e-3465b1a29d9c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6687456d6c-scxpm\" (UID: \"b7a43ed7-470a-45fe-a90e-3465b1a29d9c\") " pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" Jul 10 18:31:01.203752 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.203734 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b7a43ed7-470a-45fe-a90e-3465b1a29d9c-federate-client-tls\") pod \"telemeter-client-6687456d6c-scxpm\" (UID: \"b7a43ed7-470a-45fe-a90e-3465b1a29d9c\") " pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" Jul 10 18:31:01.203999 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.203985 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b7a43ed7-470a-45fe-a90e-3465b1a29d9c-telemeter-client-tls\") pod \"telemeter-client-6687456d6c-scxpm\" (UID: \"b7a43ed7-470a-45fe-a90e-3465b1a29d9c\") " pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" Jul 10 18:31:01.204038 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.204012 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b7a43ed7-470a-45fe-a90e-3465b1a29d9c-secret-telemeter-client\") pod \"telemeter-client-6687456d6c-scxpm\" (UID: \"b7a43ed7-470a-45fe-a90e-3465b1a29d9c\") " pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" Jul 10 18:31:01.209735 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.209718 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzspj\" (UniqueName: \"kubernetes.io/projected/b7a43ed7-470a-45fe-a90e-3465b1a29d9c-kube-api-access-bzspj\") pod \"telemeter-client-6687456d6c-scxpm\" (UID: \"b7a43ed7-470a-45fe-a90e-3465b1a29d9c\") " pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" Jul 10 18:31:01.256185 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.256162 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4vvdt" event={"ID":"ea501729-9139-4744-85c4-2a1d19691f3f","Type":"ContainerStarted","Data":"abe987cd024edf360c79944dca1ba0ecec44b8a4633894acbf5717c6deb6d00a"} Jul 10 18:31:01.315532 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.315515 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" Jul 10 18:31:01.453939 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:01.450904 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6687456d6c-scxpm"] Jul 10 18:31:01.454210 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:31:01.454182 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7a43ed7_470a_45fe_a90e_3465b1a29d9c.slice/crio-259e84e6d2c212a07368e838cab85027ea6c4a5dffa6fec20367e99bb0b109ad WatchSource:0}: Error finding container 259e84e6d2c212a07368e838cab85027ea6c4a5dffa6fec20367e99bb0b109ad: Status 404 returned error can't find the container with id 259e84e6d2c212a07368e838cab85027ea6c4a5dffa6fec20367e99bb0b109ad Jul 10 18:31:02.261854 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:02.261820 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" event={"ID":"b7a43ed7-470a-45fe-a90e-3465b1a29d9c","Type":"ContainerStarted","Data":"259e84e6d2c212a07368e838cab85027ea6c4a5dffa6fec20367e99bb0b109ad"} Jul 10 18:31:02.857094 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:31:02.857058 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6sg5z" podUID="c2dcab33-d174-4c8e-92eb-c8a78b94080a" Jul 10 18:31:03.266976 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:03.266949 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6sg5z" Jul 10 18:31:03.266976 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:03.266970 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4vvdt" event={"ID":"ea501729-9139-4744-85c4-2a1d19691f3f","Type":"ContainerStarted","Data":"72315b073a33a46eeeaaf04cf6d9551eefd7266b991b68fef31aba9b734f5e94"} Jul 10 18:31:03.267380 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:03.267166 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4vvdt" Jul 10 18:31:03.272373 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:03.272350 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4vvdt" Jul 10 18:31:03.284560 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:03.284509 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-4vvdt" podStartSLOduration=1.641935175 podStartE2EDuration="3.284491493s" totalImagesPullingTime="1.642556318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:31:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:31:03.283316106 +0000 UTC m=+282.516520368" watchObservedRunningTime="2026-07-10 18:31:03.284491493 +0000 UTC m=+282.517695754" Jul 10 18:31:04.112622 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:04.112538 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:31:04.112843 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:04.112820 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:31:04.117455 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:04.117433 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:31:04.205671 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:04.205642 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:31:04.272211 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:04.272172 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" event={"ID":"b7a43ed7-470a-45fe-a90e-3465b1a29d9c","Type":"ContainerStarted","Data":"d20aaa32224ecd2a56d50a558e0f336bf946b68d31f9e421fc728154374edb26"} Jul 10 18:31:04.277621 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:04.277599 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:31:05.277401 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:05.277366 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" event={"ID":"b7a43ed7-470a-45fe-a90e-3465b1a29d9c","Type":"ContainerStarted","Data":"de3a05bad43d08783928b9b2dedb4b33cdf4a0efc8af8e0ac167a400d950974d"} Jul 10 18:31:05.277794 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:05.277422 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" event={"ID":"b7a43ed7-470a-45fe-a90e-3465b1a29d9c","Type":"ContainerStarted","Data":"55e5cc9c294e6b2bc6ae69c48d201c622b4e45275ffe9dc277f3f9c88e3cf325"} Jul 10 18:31:05.300999 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:05.300946 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6687456d6c-scxpm" podStartSLOduration=2.116341142 podStartE2EDuration="5.300928372s" totalImagesPullingTime="3.18458723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:31:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:31:05.300100869 +0000 UTC m=+284.533305139" watchObservedRunningTime="2026-07-10 18:31:05.300928372 +0000 UTC m=+284.534132632" Jul 10 18:31:06.041959 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:06.041926 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls\") pod \"dns-default-6sg5z\" (UID: \"c2dcab33-d174-4c8e-92eb-c8a78b94080a\") " pod="openshift-dns/dns-default-6sg5z" Jul 10 18:31:06.044218 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:06.044194 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2dcab33-d174-4c8e-92eb-c8a78b94080a-metrics-tls\") pod \"dns-default-6sg5z\" (UID: \"c2dcab33-d174-4c8e-92eb-c8a78b94080a\") " pod="openshift-dns/dns-default-6sg5z" Jul 10 18:31:06.269955 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:06.269923 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z2lbt\"" Jul 10 18:31:06.277847 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:06.277824 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6sg5z" Jul 10 18:31:06.406859 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:06.406817 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6sg5z"] Jul 10 18:31:06.410181 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:31:06.410151 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2dcab33_d174_4c8e_92eb_c8a78b94080a.slice/crio-6fbd2c4b2f3d466c1f470a5036fcc5e9dea6132fb8222860b04325c20945570b WatchSource:0}: Error finding container 6fbd2c4b2f3d466c1f470a5036fcc5e9dea6132fb8222860b04325c20945570b: Status 404 returned error can't find the container with id 6fbd2c4b2f3d466c1f470a5036fcc5e9dea6132fb8222860b04325c20945570b Jul 10 18:31:07.285779 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:07.285746 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6sg5z" event={"ID":"c2dcab33-d174-4c8e-92eb-c8a78b94080a","Type":"ContainerStarted","Data":"6fbd2c4b2f3d466c1f470a5036fcc5e9dea6132fb8222860b04325c20945570b"} Jul 10 18:31:09.219963 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.219922 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-869757d866-5g756" podUID="faedd4b7-8adc-44bd-81c8-fd54315965f9" containerName="registry" containerID="cri-o://4f8de06347c65a262a8a14f7ed57cf92c20dc5aeaa0ee9a24d83351aea8ba004" gracePeriod=30 Jul 10 18:31:09.295544 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.295510 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6sg5z" event={"ID":"c2dcab33-d174-4c8e-92eb-c8a78b94080a","Type":"ContainerStarted","Data":"e4fbcc315fe98116442b59ee451f0cadf1129d274e899d5bdffe04242378fb71"} Jul 10 18:31:09.295660 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.295569 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6sg5z" event={"ID":"c2dcab33-d174-4c8e-92eb-c8a78b94080a","Type":"ContainerStarted","Data":"9faf0e600e74ca660e8ea9c02b26c559309288a4007b991ea0b835b5d8927329"} Jul 10 18:31:09.295660 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.295598 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6sg5z" Jul 10 18:31:09.313161 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.313116 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6sg5z" podStartSLOduration=251.194165336 podStartE2EDuration="4m13.313101974s" totalImagesPullingTime="2.118936638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:26:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:31:09.31146951 +0000 UTC m=+288.544673793" watchObservedRunningTime="2026-07-10 18:31:09.313101974 +0000 UTC m=+288.546306234" Jul 10 18:31:09.466641 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.466619 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:31:09.569855 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.569791 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-tls\") pod \"faedd4b7-8adc-44bd-81c8-fd54315965f9\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " Jul 10 18:31:09.569855 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.569837 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fv2fg\" (UniqueName: \"kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-kube-api-access-fv2fg\") pod \"faedd4b7-8adc-44bd-81c8-fd54315965f9\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " Jul 10 18:31:09.570055 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.569865 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-bound-sa-token\") pod \"faedd4b7-8adc-44bd-81c8-fd54315965f9\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " Jul 10 18:31:09.570055 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.569931 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/faedd4b7-8adc-44bd-81c8-fd54315965f9-installation-pull-secrets\") pod \"faedd4b7-8adc-44bd-81c8-fd54315965f9\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " Jul 10 18:31:09.570055 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.569962 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-certificates\") pod \"faedd4b7-8adc-44bd-81c8-fd54315965f9\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " Jul 10 18:31:09.570055 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.569996 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/faedd4b7-8adc-44bd-81c8-fd54315965f9-trusted-ca\") pod \"faedd4b7-8adc-44bd-81c8-fd54315965f9\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " Jul 10 18:31:09.570055 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.570029 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/faedd4b7-8adc-44bd-81c8-fd54315965f9-ca-trust-extracted\") pod \"faedd4b7-8adc-44bd-81c8-fd54315965f9\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " Jul 10 18:31:09.570315 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.570061 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/faedd4b7-8adc-44bd-81c8-fd54315965f9-image-registry-private-configuration\") pod \"faedd4b7-8adc-44bd-81c8-fd54315965f9\" (UID: \"faedd4b7-8adc-44bd-81c8-fd54315965f9\") " Jul 10 18:31:09.570562 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.570508 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "faedd4b7-8adc-44bd-81c8-fd54315965f9" (UID: "faedd4b7-8adc-44bd-81c8-fd54315965f9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:31:09.570954 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.570926 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faedd4b7-8adc-44bd-81c8-fd54315965f9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "faedd4b7-8adc-44bd-81c8-fd54315965f9" (UID: "faedd4b7-8adc-44bd-81c8-fd54315965f9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:31:09.572080 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.572056 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-kube-api-access-fv2fg" (OuterVolumeSpecName: "kube-api-access-fv2fg") pod "faedd4b7-8adc-44bd-81c8-fd54315965f9" (UID: "faedd4b7-8adc-44bd-81c8-fd54315965f9"). InnerVolumeSpecName "kube-api-access-fv2fg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:31:09.572185 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.572123 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "faedd4b7-8adc-44bd-81c8-fd54315965f9" (UID: "faedd4b7-8adc-44bd-81c8-fd54315965f9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:31:09.572338 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.572319 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "faedd4b7-8adc-44bd-81c8-fd54315965f9" (UID: "faedd4b7-8adc-44bd-81c8-fd54315965f9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:31:09.572526 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.572500 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faedd4b7-8adc-44bd-81c8-fd54315965f9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "faedd4b7-8adc-44bd-81c8-fd54315965f9" (UID: "faedd4b7-8adc-44bd-81c8-fd54315965f9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:31:09.572526 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.572514 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faedd4b7-8adc-44bd-81c8-fd54315965f9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "faedd4b7-8adc-44bd-81c8-fd54315965f9" (UID: "faedd4b7-8adc-44bd-81c8-fd54315965f9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:31:09.578302 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.578280 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faedd4b7-8adc-44bd-81c8-fd54315965f9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "faedd4b7-8adc-44bd-81c8-fd54315965f9" (UID: "faedd4b7-8adc-44bd-81c8-fd54315965f9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:31:09.670831 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.670806 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/faedd4b7-8adc-44bd-81c8-fd54315965f9-trusted-ca\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:31:09.670831 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.670830 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/faedd4b7-8adc-44bd-81c8-fd54315965f9-ca-trust-extracted\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:31:09.670968 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.670840 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/faedd4b7-8adc-44bd-81c8-fd54315965f9-image-registry-private-configuration\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:31:09.670968 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.670850 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-tls\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:31:09.670968 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.670860 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fv2fg\" (UniqueName: \"kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-kube-api-access-fv2fg\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:31:09.670968 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.670869 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/faedd4b7-8adc-44bd-81c8-fd54315965f9-bound-sa-token\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:31:09.670968 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.670877 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/faedd4b7-8adc-44bd-81c8-fd54315965f9-installation-pull-secrets\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:31:09.670968 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:09.670885 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/faedd4b7-8adc-44bd-81c8-fd54315965f9-registry-certificates\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:31:10.301455 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:10.301418 2564 generic.go:356] "Generic (PLEG): container finished" podID="faedd4b7-8adc-44bd-81c8-fd54315965f9" containerID="4f8de06347c65a262a8a14f7ed57cf92c20dc5aeaa0ee9a24d83351aea8ba004" exitCode=0 Jul 10 18:31:10.301945 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:10.301469 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-869757d866-5g756" Jul 10 18:31:10.301945 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:10.301493 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-869757d866-5g756" event={"ID":"faedd4b7-8adc-44bd-81c8-fd54315965f9","Type":"ContainerDied","Data":"4f8de06347c65a262a8a14f7ed57cf92c20dc5aeaa0ee9a24d83351aea8ba004"} Jul 10 18:31:10.301945 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:10.301538 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-869757d866-5g756" event={"ID":"faedd4b7-8adc-44bd-81c8-fd54315965f9","Type":"ContainerDied","Data":"2387893c216ae1d7bd0763a7650d102355a98b86a536281f31ae658b29be3236"} Jul 10 18:31:10.301945 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:10.301558 2564 scope.go:117] "RemoveContainer" containerID="4f8de06347c65a262a8a14f7ed57cf92c20dc5aeaa0ee9a24d83351aea8ba004" Jul 10 18:31:10.310325 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:10.310308 2564 scope.go:117] "RemoveContainer" containerID="4f8de06347c65a262a8a14f7ed57cf92c20dc5aeaa0ee9a24d83351aea8ba004" Jul 10 18:31:10.310566 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:31:10.310544 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f8de06347c65a262a8a14f7ed57cf92c20dc5aeaa0ee9a24d83351aea8ba004\": container with ID starting with 4f8de06347c65a262a8a14f7ed57cf92c20dc5aeaa0ee9a24d83351aea8ba004 not found: ID does not exist" containerID="4f8de06347c65a262a8a14f7ed57cf92c20dc5aeaa0ee9a24d83351aea8ba004" Jul 10 18:31:10.310624 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:10.310572 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f8de06347c65a262a8a14f7ed57cf92c20dc5aeaa0ee9a24d83351aea8ba004"} err="failed to get container status \"4f8de06347c65a262a8a14f7ed57cf92c20dc5aeaa0ee9a24d83351aea8ba004\": rpc error: code = NotFound desc = could not find container \"4f8de06347c65a262a8a14f7ed57cf92c20dc5aeaa0ee9a24d83351aea8ba004\": container with ID starting with 4f8de06347c65a262a8a14f7ed57cf92c20dc5aeaa0ee9a24d83351aea8ba004 not found: ID does not exist" Jul 10 18:31:10.321930 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:10.321907 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-869757d866-5g756"] Jul 10 18:31:10.325775 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:10.325756 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-869757d866-5g756"] Jul 10 18:31:11.404938 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:11.404900 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faedd4b7-8adc-44bd-81c8-fd54315965f9" path="/var/lib/kubelet/pods/faedd4b7-8adc-44bd-81c8-fd54315965f9/volumes" Jul 10 18:31:19.304145 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:19.304111 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6sg5z" Jul 10 18:31:20.511360 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:20.511319 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-676fbdc4f8-jmmjs"] Jul 10 18:31:21.132364 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:21.132337 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5gqq_cfa37e72-ee06-4ff3-996e-d535b0d28d84/console-operator/1.log" Jul 10 18:31:21.134198 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:21.134172 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5gqq_cfa37e72-ee06-4ff3-996e-d535b0d28d84/console-operator/1.log" Jul 10 18:31:21.139198 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:21.139177 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gfnq_873ff093-ab5b-412b-abad-220e0bb4acc3/ovn-acl-logging/0.log" Jul 10 18:31:21.141274 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:21.141255 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gfnq_873ff093-ab5b-412b-abad-220e0bb4acc3/ovn-acl-logging/0.log" Jul 10 18:31:21.143394 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:21.143373 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 10 18:31:27.974368 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:27.974310 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6sg5z_c2dcab33-d174-4c8e-92eb-c8a78b94080a/dns/0.log" Jul 10 18:31:27.980471 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:27.980448 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6sg5z_c2dcab33-d174-4c8e-92eb-c8a78b94080a/kube-rbac-proxy/0.log" Jul 10 18:31:28.457615 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:28.457585 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-grgmt_3f2651c8-dc6e-49db-b2f4-b152113e0b78/dns-node-resolver/0.log" Jul 10 18:31:45.531068 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:45.531012 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-676fbdc4f8-jmmjs" podUID="44761921-21ce-483c-b6ea-d1afa48eb0f4" containerName="console" containerID="cri-o://03d0caf2e2c84a88248bfba1b53ad30f7cf67e7cf38c2b83aa010ff1616747ac" gracePeriod=15 Jul 10 18:31:45.774231 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:45.774200 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:31:45.826406 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:45.826350 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44761921-21ce-483c-b6ea-d1afa48eb0f4-service-ca\") pod \"44761921-21ce-483c-b6ea-d1afa48eb0f4\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " Jul 10 18:31:45.826508 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:45.826415 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44761921-21ce-483c-b6ea-d1afa48eb0f4-console-oauth-config\") pod \"44761921-21ce-483c-b6ea-d1afa48eb0f4\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " Jul 10 18:31:45.826508 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:45.826438 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44761921-21ce-483c-b6ea-d1afa48eb0f4-trusted-ca-bundle\") pod \"44761921-21ce-483c-b6ea-d1afa48eb0f4\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " Jul 10 18:31:45.826508 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:45.826457 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44761921-21ce-483c-b6ea-d1afa48eb0f4-console-serving-cert\") pod \"44761921-21ce-483c-b6ea-d1afa48eb0f4\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " Jul 10 18:31:45.826508 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:45.826474 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44761921-21ce-483c-b6ea-d1afa48eb0f4-oauth-serving-cert\") pod \"44761921-21ce-483c-b6ea-d1afa48eb0f4\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " Jul 10 18:31:45.826508 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:45.826496 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44761921-21ce-483c-b6ea-d1afa48eb0f4-console-config\") pod \"44761921-21ce-483c-b6ea-d1afa48eb0f4\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " Jul 10 18:31:45.826779 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:45.826524 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5nck\" (UniqueName: \"kubernetes.io/projected/44761921-21ce-483c-b6ea-d1afa48eb0f4-kube-api-access-z5nck\") pod \"44761921-21ce-483c-b6ea-d1afa48eb0f4\" (UID: \"44761921-21ce-483c-b6ea-d1afa48eb0f4\") " Jul 10 18:31:45.826835 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:45.826794 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44761921-21ce-483c-b6ea-d1afa48eb0f4-service-ca" (OuterVolumeSpecName: "service-ca") pod "44761921-21ce-483c-b6ea-d1afa48eb0f4" (UID: "44761921-21ce-483c-b6ea-d1afa48eb0f4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:31:45.826981 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:45.826957 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44761921-21ce-483c-b6ea-d1afa48eb0f4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "44761921-21ce-483c-b6ea-d1afa48eb0f4" (UID: "44761921-21ce-483c-b6ea-d1afa48eb0f4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:31:45.826981 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:45.826968 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44761921-21ce-483c-b6ea-d1afa48eb0f4-console-config" (OuterVolumeSpecName: "console-config") pod "44761921-21ce-483c-b6ea-d1afa48eb0f4" (UID: "44761921-21ce-483c-b6ea-d1afa48eb0f4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:31:45.827088 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:45.826978 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44761921-21ce-483c-b6ea-d1afa48eb0f4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "44761921-21ce-483c-b6ea-d1afa48eb0f4" (UID: "44761921-21ce-483c-b6ea-d1afa48eb0f4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:31:45.828652 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:45.828620 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44761921-21ce-483c-b6ea-d1afa48eb0f4-kube-api-access-z5nck" (OuterVolumeSpecName: "kube-api-access-z5nck") pod "44761921-21ce-483c-b6ea-d1afa48eb0f4" (UID: "44761921-21ce-483c-b6ea-d1afa48eb0f4"). InnerVolumeSpecName "kube-api-access-z5nck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:31:45.828768 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:45.828658 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44761921-21ce-483c-b6ea-d1afa48eb0f4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "44761921-21ce-483c-b6ea-d1afa48eb0f4" (UID: "44761921-21ce-483c-b6ea-d1afa48eb0f4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:31:45.828768 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:45.828679 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44761921-21ce-483c-b6ea-d1afa48eb0f4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "44761921-21ce-483c-b6ea-d1afa48eb0f4" (UID: "44761921-21ce-483c-b6ea-d1afa48eb0f4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:31:45.927743 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:45.927716 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44761921-21ce-483c-b6ea-d1afa48eb0f4-console-oauth-config\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:31:45.927743 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:45.927738 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44761921-21ce-483c-b6ea-d1afa48eb0f4-trusted-ca-bundle\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:31:45.927886 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:45.927751 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44761921-21ce-483c-b6ea-d1afa48eb0f4-console-serving-cert\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:31:45.927886 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:45.927763 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44761921-21ce-483c-b6ea-d1afa48eb0f4-oauth-serving-cert\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:31:45.927886 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:45.927775 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44761921-21ce-483c-b6ea-d1afa48eb0f4-console-config\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:31:45.927886 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:45.927789 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5nck\" (UniqueName: \"kubernetes.io/projected/44761921-21ce-483c-b6ea-d1afa48eb0f4-kube-api-access-z5nck\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:31:45.927886 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:45.927801 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44761921-21ce-483c-b6ea-d1afa48eb0f4-service-ca\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:31:46.435823 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:46.435786 2564 generic.go:356] "Generic (PLEG): container finished" podID="44761921-21ce-483c-b6ea-d1afa48eb0f4" containerID="03d0caf2e2c84a88248bfba1b53ad30f7cf67e7cf38c2b83aa010ff1616747ac" exitCode=0 Jul 10 18:31:46.435823 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:46.435821 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-676fbdc4f8-jmmjs" Jul 10 18:31:46.436064 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:46.435866 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-676fbdc4f8-jmmjs" event={"ID":"44761921-21ce-483c-b6ea-d1afa48eb0f4","Type":"ContainerDied","Data":"03d0caf2e2c84a88248bfba1b53ad30f7cf67e7cf38c2b83aa010ff1616747ac"} Jul 10 18:31:46.436064 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:46.435917 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-676fbdc4f8-jmmjs" event={"ID":"44761921-21ce-483c-b6ea-d1afa48eb0f4","Type":"ContainerDied","Data":"71b34a7c6e4d459708ec0a8271269f9f6092ff266092f33cda2a7961ba136652"} Jul 10 18:31:46.436064 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:46.435945 2564 scope.go:117] "RemoveContainer" containerID="03d0caf2e2c84a88248bfba1b53ad30f7cf67e7cf38c2b83aa010ff1616747ac" Jul 10 18:31:46.444617 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:46.444602 2564 scope.go:117] "RemoveContainer" containerID="03d0caf2e2c84a88248bfba1b53ad30f7cf67e7cf38c2b83aa010ff1616747ac" Jul 10 18:31:46.444868 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:31:46.444849 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03d0caf2e2c84a88248bfba1b53ad30f7cf67e7cf38c2b83aa010ff1616747ac\": container with ID starting with 03d0caf2e2c84a88248bfba1b53ad30f7cf67e7cf38c2b83aa010ff1616747ac not found: ID does not exist" containerID="03d0caf2e2c84a88248bfba1b53ad30f7cf67e7cf38c2b83aa010ff1616747ac" Jul 10 18:31:46.444940 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:46.444878 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03d0caf2e2c84a88248bfba1b53ad30f7cf67e7cf38c2b83aa010ff1616747ac"} err="failed to get container status \"03d0caf2e2c84a88248bfba1b53ad30f7cf67e7cf38c2b83aa010ff1616747ac\": rpc error: code = NotFound desc = could not find container \"03d0caf2e2c84a88248bfba1b53ad30f7cf67e7cf38c2b83aa010ff1616747ac\": container with ID starting with 03d0caf2e2c84a88248bfba1b53ad30f7cf67e7cf38c2b83aa010ff1616747ac not found: ID does not exist" Jul 10 18:31:46.457244 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:46.457220 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-676fbdc4f8-jmmjs"] Jul 10 18:31:46.461807 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:46.461788 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-676fbdc4f8-jmmjs"] Jul 10 18:31:47.406220 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:31:47.406179 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44761921-21ce-483c-b6ea-d1afa48eb0f4" path="/var/lib/kubelet/pods/44761921-21ce-483c-b6ea-d1afa48eb0f4/volumes" Jul 10 18:32:17.806154 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.806079 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:32:17.806585 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.806340 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faedd4b7-8adc-44bd-81c8-fd54315965f9" containerName="registry" Jul 10 18:32:17.806585 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.806350 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="faedd4b7-8adc-44bd-81c8-fd54315965f9" containerName="registry" Jul 10 18:32:17.806585 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.806369 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44761921-21ce-483c-b6ea-d1afa48eb0f4" containerName="console" Jul 10 18:32:17.806585 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.806375 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="44761921-21ce-483c-b6ea-d1afa48eb0f4" containerName="console" Jul 10 18:32:17.806585 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.806421 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="44761921-21ce-483c-b6ea-d1afa48eb0f4" containerName="console" Jul 10 18:32:17.806585 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.806429 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="faedd4b7-8adc-44bd-81c8-fd54315965f9" containerName="registry" Jul 10 18:32:17.809871 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.809851 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:17.815554 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.815530 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 10 18:32:17.815851 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.815822 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 10 18:32:17.815851 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.815821 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 10 18:32:17.816370 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.816134 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 10 18:32:17.816370 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.816168 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 10 18:32:17.816370 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.816326 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 10 18:32:17.816536 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.816455 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 10 18:32:17.816988 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.816972 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-79ndf\"" Jul 10 18:32:17.817262 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.817245 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 10 18:32:17.823991 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.823972 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 10 18:32:17.830670 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.830649 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:32:17.931272 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.931245 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5d53a302-033c-47ca-a20c-e4c141e039b8-config-volume\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:17.931272 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.931273 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d53a302-033c-47ca-a20c-e4c141e039b8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:17.931475 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.931311 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d53a302-033c-47ca-a20c-e4c141e039b8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:17.931475 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.931330 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5d53a302-033c-47ca-a20c-e4c141e039b8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:17.931475 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.931373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d53a302-033c-47ca-a20c-e4c141e039b8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:17.931475 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.931407 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d53a302-033c-47ca-a20c-e4c141e039b8-web-config\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:17.931475 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.931431 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d53a302-033c-47ca-a20c-e4c141e039b8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:17.931475 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.931463 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5d53a302-033c-47ca-a20c-e4c141e039b8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:17.931784 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.931499 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5d53a302-033c-47ca-a20c-e4c141e039b8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:17.931784 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.931532 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d53a302-033c-47ca-a20c-e4c141e039b8-config-out\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:17.931784 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.931555 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5d53a302-033c-47ca-a20c-e4c141e039b8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:17.931784 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.931586 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d53a302-033c-47ca-a20c-e4c141e039b8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:17.931784 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:17.931633 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vtbb\" (UniqueName: \"kubernetes.io/projected/5d53a302-033c-47ca-a20c-e4c141e039b8-kube-api-access-8vtbb\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.032656 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.032618 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d53a302-033c-47ca-a20c-e4c141e039b8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.032656 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.032656 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d53a302-033c-47ca-a20c-e4c141e039b8-web-config\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.032859 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.032675 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d53a302-033c-47ca-a20c-e4c141e039b8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.032859 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.032693 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5d53a302-033c-47ca-a20c-e4c141e039b8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.032859 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.032734 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5d53a302-033c-47ca-a20c-e4c141e039b8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.032992 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.032859 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d53a302-033c-47ca-a20c-e4c141e039b8-config-out\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.032992 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.032899 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5d53a302-033c-47ca-a20c-e4c141e039b8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.032992 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.032932 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d53a302-033c-47ca-a20c-e4c141e039b8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.032992 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.032970 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vtbb\" (UniqueName: \"kubernetes.io/projected/5d53a302-033c-47ca-a20c-e4c141e039b8-kube-api-access-8vtbb\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.033191 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.032996 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5d53a302-033c-47ca-a20c-e4c141e039b8-config-volume\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.033191 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.033019 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d53a302-033c-47ca-a20c-e4c141e039b8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.033191 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.033096 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d53a302-033c-47ca-a20c-e4c141e039b8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.033191 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.033119 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5d53a302-033c-47ca-a20c-e4c141e039b8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.033191 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.033121 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5d53a302-033c-47ca-a20c-e4c141e039b8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.033795 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.033743 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d53a302-033c-47ca-a20c-e4c141e039b8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.035611 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.035580 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d53a302-033c-47ca-a20c-e4c141e039b8-config-out\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.035945 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.035922 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5d53a302-033c-47ca-a20c-e4c141e039b8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.036192 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.036152 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5d53a302-033c-47ca-a20c-e4c141e039b8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.036192 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.036152 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d53a302-033c-47ca-a20c-e4c141e039b8-web-config\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.036336 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.036312 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d53a302-033c-47ca-a20c-e4c141e039b8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.036372 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.036348 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d53a302-033c-47ca-a20c-e4c141e039b8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.036436 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.036415 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5d53a302-033c-47ca-a20c-e4c141e039b8-config-volume\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.036548 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.036524 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d53a302-033c-47ca-a20c-e4c141e039b8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.036825 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.036808 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5d53a302-033c-47ca-a20c-e4c141e039b8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.038078 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.038056 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d53a302-033c-47ca-a20c-e4c141e039b8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.044003 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.043988 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vtbb\" (UniqueName: \"kubernetes.io/projected/5d53a302-033c-47ca-a20c-e4c141e039b8-kube-api-access-8vtbb\") pod \"alertmanager-main-0\" (UID: \"5d53a302-033c-47ca-a20c-e4c141e039b8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.119267 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.119217 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 18:32:18.256920 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.256891 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 18:32:18.259956 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:32:18.259933 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d53a302_033c_47ca_a20c_e4c141e039b8.slice/crio-894af14a7776f40f29c2352ef0e9db9449f6c315ef9e3fd7c7fe2b25c8817cd8 WatchSource:0}: Error finding container 894af14a7776f40f29c2352ef0e9db9449f6c315ef9e3fd7c7fe2b25c8817cd8: Status 404 returned error can't find the container with id 894af14a7776f40f29c2352ef0e9db9449f6c315ef9e3fd7c7fe2b25c8817cd8 Jul 10 18:32:18.545708 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.545668 2564 generic.go:356] "Generic (PLEG): container finished" podID="5d53a302-033c-47ca-a20c-e4c141e039b8" containerID="cdc9077a7216604d4afaca5af64c53af49e2b40d9f18dfa5b623f199df4b49f0" exitCode=0 Jul 10 18:32:18.545843 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.545764 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d53a302-033c-47ca-a20c-e4c141e039b8","Type":"ContainerDied","Data":"cdc9077a7216604d4afaca5af64c53af49e2b40d9f18dfa5b623f199df4b49f0"} Jul 10 18:32:18.545891 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.545847 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d53a302-033c-47ca-a20c-e4c141e039b8","Type":"ContainerStarted","Data":"894af14a7776f40f29c2352ef0e9db9449f6c315ef9e3fd7c7fe2b25c8817cd8"} Jul 10 18:32:18.546899 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:18.546880 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 18:32:20.556970 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:20.556887 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d53a302-033c-47ca-a20c-e4c141e039b8","Type":"ContainerStarted","Data":"9ff42bc009d7a340f8b1d649ca53b7ed3a54e774590921d0297edcbfd5d05fcf"} Jul 10 18:32:20.556970 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:20.556954 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d53a302-033c-47ca-a20c-e4c141e039b8","Type":"ContainerStarted","Data":"d22331600680dbd28cb7e77d297013b7b9dbeb53f705f157c2efec8ab827ae32"} Jul 10 18:32:20.557362 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:20.556980 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d53a302-033c-47ca-a20c-e4c141e039b8","Type":"ContainerStarted","Data":"cff527e17d9add520bb91656c74c5f929ab7c39ce7f4bf041726cd6123d7b9e1"} Jul 10 18:32:20.557362 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:20.557003 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d53a302-033c-47ca-a20c-e4c141e039b8","Type":"ContainerStarted","Data":"0f345e084a8b2bc7672be6b70e48f8706ea64e9163ef93e2e344e9baedca6bad"} Jul 10 18:32:20.557362 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:20.557026 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d53a302-033c-47ca-a20c-e4c141e039b8","Type":"ContainerStarted","Data":"66176098aac93069903ded085e43b4f873545351a41ec5b3335c55f792378544"} Jul 10 18:32:21.563680 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:21.563648 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5d53a302-033c-47ca-a20c-e4c141e039b8","Type":"ContainerStarted","Data":"0a0f8e177810862ed4502d3d8bc9e9f36f343618583fb05f25ba5c1b2349c23b"} Jul 10 18:32:21.601939 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:21.601883 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.241515404 podStartE2EDuration="4.601864077s" totalImagesPullingTime="2.342740834s" totalInitContainerRuntime="17.607839ms" isStatefulPod=false podCreationTimestamp="2026-07-10 18:32:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:32:21.598889101 +0000 UTC m=+360.832093359" watchObservedRunningTime="2026-07-10 18:32:21.601864077 +0000 UTC m=+360.835068336" Jul 10 18:32:28.731893 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.731858 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c976445c6-d4snx"] Jul 10 18:32:28.735447 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.735422 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:32:28.738163 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.738138 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 10 18:32:28.738286 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.738144 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 10 18:32:28.739680 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.739656 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 10 18:32:28.739799 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.739759 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 10 18:32:28.739909 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.739893 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 10 18:32:28.740237 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.740219 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 10 18:32:28.740531 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.740513 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-grfkv\"" Jul 10 18:32:28.740761 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.740743 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 10 18:32:28.748911 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.748891 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 10 18:32:28.749880 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.749860 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c976445c6-d4snx"] Jul 10 18:32:28.812979 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.812955 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22b8ef71-2c71-427a-80d4-4fac53ec43d3-console-oauth-config\") pod \"console-c976445c6-d4snx\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:32:28.813083 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.812983 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22b8ef71-2c71-427a-80d4-4fac53ec43d3-oauth-serving-cert\") pod \"console-c976445c6-d4snx\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:32:28.813083 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.813010 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22b8ef71-2c71-427a-80d4-4fac53ec43d3-console-serving-cert\") pod \"console-c976445c6-d4snx\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:32:28.813083 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.813032 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22b8ef71-2c71-427a-80d4-4fac53ec43d3-trusted-ca-bundle\") pod \"console-c976445c6-d4snx\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:32:28.813209 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.813107 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22b8ef71-2c71-427a-80d4-4fac53ec43d3-service-ca\") pod \"console-c976445c6-d4snx\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:32:28.813209 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.813155 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22b8ef71-2c71-427a-80d4-4fac53ec43d3-console-config\") pod \"console-c976445c6-d4snx\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:32:28.813209 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.813197 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfc9p\" (UniqueName: \"kubernetes.io/projected/22b8ef71-2c71-427a-80d4-4fac53ec43d3-kube-api-access-cfc9p\") pod \"console-c976445c6-d4snx\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:32:28.913803 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.913776 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22b8ef71-2c71-427a-80d4-4fac53ec43d3-console-config\") pod \"console-c976445c6-d4snx\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:32:28.913887 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.913809 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfc9p\" (UniqueName: \"kubernetes.io/projected/22b8ef71-2c71-427a-80d4-4fac53ec43d3-kube-api-access-cfc9p\") pod \"console-c976445c6-d4snx\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:32:28.913887 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.913838 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22b8ef71-2c71-427a-80d4-4fac53ec43d3-console-oauth-config\") pod \"console-c976445c6-d4snx\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:32:28.913964 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.913945 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22b8ef71-2c71-427a-80d4-4fac53ec43d3-oauth-serving-cert\") pod \"console-c976445c6-d4snx\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:32:28.914009 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.913996 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22b8ef71-2c71-427a-80d4-4fac53ec43d3-console-serving-cert\") pod \"console-c976445c6-d4snx\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:32:28.914060 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.914022 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22b8ef71-2c71-427a-80d4-4fac53ec43d3-trusted-ca-bundle\") pod \"console-c976445c6-d4snx\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:32:28.914164 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.914138 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22b8ef71-2c71-427a-80d4-4fac53ec43d3-service-ca\") pod \"console-c976445c6-d4snx\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:32:28.914515 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.914488 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22b8ef71-2c71-427a-80d4-4fac53ec43d3-console-config\") pod \"console-c976445c6-d4snx\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:32:28.914644 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.914607 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22b8ef71-2c71-427a-80d4-4fac53ec43d3-oauth-serving-cert\") pod \"console-c976445c6-d4snx\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:32:28.914746 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.914730 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22b8ef71-2c71-427a-80d4-4fac53ec43d3-trusted-ca-bundle\") pod \"console-c976445c6-d4snx\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:32:28.914812 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.914759 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22b8ef71-2c71-427a-80d4-4fac53ec43d3-service-ca\") pod \"console-c976445c6-d4snx\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:32:28.916315 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.916299 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22b8ef71-2c71-427a-80d4-4fac53ec43d3-console-serving-cert\") pod \"console-c976445c6-d4snx\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:32:28.916461 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.916441 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22b8ef71-2c71-427a-80d4-4fac53ec43d3-console-oauth-config\") pod \"console-c976445c6-d4snx\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:32:28.923041 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:28.923017 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfc9p\" (UniqueName: \"kubernetes.io/projected/22b8ef71-2c71-427a-80d4-4fac53ec43d3-kube-api-access-cfc9p\") pod \"console-c976445c6-d4snx\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:32:29.046553 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:29.046477 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:32:29.179593 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:29.179565 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c976445c6-d4snx"] Jul 10 18:32:29.182174 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:32:29.182144 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22b8ef71_2c71_427a_80d4_4fac53ec43d3.slice/crio-a3b9e0763629e65c1e2430b78109d7a4d1c9aa144280bcd3f362ab98592df5de WatchSource:0}: Error finding container a3b9e0763629e65c1e2430b78109d7a4d1c9aa144280bcd3f362ab98592df5de: Status 404 returned error can't find the container with id a3b9e0763629e65c1e2430b78109d7a4d1c9aa144280bcd3f362ab98592df5de Jul 10 18:32:29.594331 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:29.594300 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c976445c6-d4snx" event={"ID":"22b8ef71-2c71-427a-80d4-4fac53ec43d3","Type":"ContainerStarted","Data":"f0cd29953343e0a4ae8b85e87c6aa0cce6b702c54623d896415be519649a6172"} Jul 10 18:32:29.594480 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:29.594343 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c976445c6-d4snx" event={"ID":"22b8ef71-2c71-427a-80d4-4fac53ec43d3","Type":"ContainerStarted","Data":"a3b9e0763629e65c1e2430b78109d7a4d1c9aa144280bcd3f362ab98592df5de"} Jul 10 18:32:29.612864 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:29.612815 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c976445c6-d4snx" podStartSLOduration=1.612796203 podStartE2EDuration="1.612796203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:32:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:32:29.612784431 +0000 UTC m=+368.845988691" watchObservedRunningTime="2026-07-10 18:32:29.612796203 +0000 UTC m=+368.846000499" Jul 10 18:32:39.047528 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:39.047490 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:32:39.047941 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:39.047568 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:32:39.052035 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:39.052017 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:32:39.634579 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:32:39.634549 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:33:58.597485 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:33:58.597446 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-q8nb5"] Jul 10 18:33:58.600805 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:33:58.600782 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-q8nb5" Jul 10 18:33:58.603470 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:33:58.603448 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 10 18:33:58.603583 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:33:58.603447 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 10 18:33:58.604301 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:33:58.604285 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-fxkgb\"" Jul 10 18:33:58.610735 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:33:58.610716 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-q8nb5"] Jul 10 18:33:58.679103 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:33:58.679077 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62bf1a81-75c9-4220-af71-958baf06b27c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-q8nb5\" (UID: \"62bf1a81-75c9-4220-af71-958baf06b27c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q8nb5" Jul 10 18:33:58.679196 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:33:58.679121 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvhhz\" (UniqueName: \"kubernetes.io/projected/62bf1a81-75c9-4220-af71-958baf06b27c-kube-api-access-kvhhz\") pod \"cert-manager-cainjector-559cdd8c87-q8nb5\" (UID: \"62bf1a81-75c9-4220-af71-958baf06b27c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q8nb5" Jul 10 18:33:58.779813 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:33:58.779786 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62bf1a81-75c9-4220-af71-958baf06b27c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-q8nb5\" (UID: \"62bf1a81-75c9-4220-af71-958baf06b27c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q8nb5" Jul 10 18:33:58.779921 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:33:58.779836 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvhhz\" (UniqueName: \"kubernetes.io/projected/62bf1a81-75c9-4220-af71-958baf06b27c-kube-api-access-kvhhz\") pod \"cert-manager-cainjector-559cdd8c87-q8nb5\" (UID: \"62bf1a81-75c9-4220-af71-958baf06b27c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q8nb5" Jul 10 18:33:58.793900 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:33:58.793880 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvhhz\" (UniqueName: \"kubernetes.io/projected/62bf1a81-75c9-4220-af71-958baf06b27c-kube-api-access-kvhhz\") pod \"cert-manager-cainjector-559cdd8c87-q8nb5\" (UID: \"62bf1a81-75c9-4220-af71-958baf06b27c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q8nb5" Jul 10 18:33:58.794955 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:33:58.794935 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62bf1a81-75c9-4220-af71-958baf06b27c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-q8nb5\" (UID: \"62bf1a81-75c9-4220-af71-958baf06b27c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-q8nb5" Jul 10 18:33:58.910431 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:33:58.910373 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-q8nb5" Jul 10 18:33:59.037009 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:33:59.036976 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-q8nb5"] Jul 10 18:33:59.039995 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:33:59.039967 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62bf1a81_75c9_4220_af71_958baf06b27c.slice/crio-1cc1968ca07dd7bcdc391919a6e4a36d8d6982df6098a59afaf268b5a64c3f94 WatchSource:0}: Error finding container 1cc1968ca07dd7bcdc391919a6e4a36d8d6982df6098a59afaf268b5a64c3f94: Status 404 returned error can't find the container with id 1cc1968ca07dd7bcdc391919a6e4a36d8d6982df6098a59afaf268b5a64c3f94 Jul 10 18:33:59.923619 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:33:59.923579 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-q8nb5" event={"ID":"62bf1a81-75c9-4220-af71-958baf06b27c","Type":"ContainerStarted","Data":"1cc1968ca07dd7bcdc391919a6e4a36d8d6982df6098a59afaf268b5a64c3f94"} Jul 10 18:34:02.937397 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:02.937355 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-q8nb5" event={"ID":"62bf1a81-75c9-4220-af71-958baf06b27c","Type":"ContainerStarted","Data":"2dc9cee9cd9c56df3f5e87c9df707d1fa66b288eee255d6461ce847f5b3caab6"} Jul 10 18:34:02.954951 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:02.954896 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-q8nb5" podStartSLOduration=1.907405843 podStartE2EDuration="4.954880013s" totalImagesPullingTime="3.04747417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:33:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:34:02.953884561 +0000 UTC m=+462.187088820" watchObservedRunningTime="2026-07-10 18:34:02.954880013 +0000 UTC m=+462.188084272" Jul 10 18:34:07.312094 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:07.312060 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zlwp8"] Jul 10 18:34:07.315252 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:07.315232 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-zlwp8" Jul 10 18:34:07.317771 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:07.317745 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-bfr2v\"" Jul 10 18:34:07.324987 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:07.324965 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zlwp8"] Jul 10 18:34:07.451164 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:07.451139 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rqnt\" (UniqueName: \"kubernetes.io/projected/49bc47e9-36b0-4244-8520-9875ad6057c4-kube-api-access-8rqnt\") pod \"cert-manager-55b4d954d5-zlwp8\" (UID: \"49bc47e9-36b0-4244-8520-9875ad6057c4\") " pod="cert-manager/cert-manager-55b4d954d5-zlwp8" Jul 10 18:34:07.451283 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:07.451200 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49bc47e9-36b0-4244-8520-9875ad6057c4-bound-sa-token\") pod \"cert-manager-55b4d954d5-zlwp8\" (UID: \"49bc47e9-36b0-4244-8520-9875ad6057c4\") " pod="cert-manager/cert-manager-55b4d954d5-zlwp8" Jul 10 18:34:07.551923 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:07.551900 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rqnt\" (UniqueName: \"kubernetes.io/projected/49bc47e9-36b0-4244-8520-9875ad6057c4-kube-api-access-8rqnt\") pod \"cert-manager-55b4d954d5-zlwp8\" (UID: \"49bc47e9-36b0-4244-8520-9875ad6057c4\") " pod="cert-manager/cert-manager-55b4d954d5-zlwp8" Jul 10 18:34:07.552023 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:07.551961 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49bc47e9-36b0-4244-8520-9875ad6057c4-bound-sa-token\") pod \"cert-manager-55b4d954d5-zlwp8\" (UID: \"49bc47e9-36b0-4244-8520-9875ad6057c4\") " pod="cert-manager/cert-manager-55b4d954d5-zlwp8" Jul 10 18:34:07.560102 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:07.560074 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49bc47e9-36b0-4244-8520-9875ad6057c4-bound-sa-token\") pod \"cert-manager-55b4d954d5-zlwp8\" (UID: \"49bc47e9-36b0-4244-8520-9875ad6057c4\") " pod="cert-manager/cert-manager-55b4d954d5-zlwp8" Jul 10 18:34:07.560300 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:07.560279 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rqnt\" (UniqueName: \"kubernetes.io/projected/49bc47e9-36b0-4244-8520-9875ad6057c4-kube-api-access-8rqnt\") pod \"cert-manager-55b4d954d5-zlwp8\" (UID: \"49bc47e9-36b0-4244-8520-9875ad6057c4\") " pod="cert-manager/cert-manager-55b4d954d5-zlwp8" Jul 10 18:34:07.624582 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:07.624530 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-zlwp8" Jul 10 18:34:07.751289 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:07.751261 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zlwp8"] Jul 10 18:34:07.754378 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:34:07.754342 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49bc47e9_36b0_4244_8520_9875ad6057c4.slice/crio-4f0164244d485ffe302c94fcb79535f70904c4119449608ebe45c6181271b60f WatchSource:0}: Error finding container 4f0164244d485ffe302c94fcb79535f70904c4119449608ebe45c6181271b60f: Status 404 returned error can't find the container with id 4f0164244d485ffe302c94fcb79535f70904c4119449608ebe45c6181271b60f Jul 10 18:34:07.957069 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:07.957034 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-zlwp8" event={"ID":"49bc47e9-36b0-4244-8520-9875ad6057c4","Type":"ContainerStarted","Data":"6ab43f0896f070bd63d60fffd62629e87c43756e1eb87cac395b2a2ec0cfc2c3"} Jul 10 18:34:07.957220 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:07.957079 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-zlwp8" event={"ID":"49bc47e9-36b0-4244-8520-9875ad6057c4","Type":"ContainerStarted","Data":"4f0164244d485ffe302c94fcb79535f70904c4119449608ebe45c6181271b60f"} Jul 10 18:34:07.977210 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:07.977170 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-zlwp8" podStartSLOduration=0.97715587 podStartE2EDuration="977.15587ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:34:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:34:07.975519253 +0000 UTC m=+467.208723513" watchObservedRunningTime="2026-07-10 18:34:07.97715587 +0000 UTC m=+467.210360128" Jul 10 18:34:10.422126 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:10.422089 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwr9g"] Jul 10 18:34:10.425316 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:10.425299 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwr9g" Jul 10 18:34:10.427951 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:10.427904 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 10 18:34:10.428159 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:10.428146 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 10 18:34:10.429003 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:10.428987 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-bzgrb\"" Jul 10 18:34:10.436617 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:10.436593 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwr9g"] Jul 10 18:34:10.478202 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:10.478172 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4hgp\" (UniqueName: \"kubernetes.io/projected/25edbbfc-71c9-4fc9-b658-50fe99d180af-kube-api-access-t4hgp\") pod \"openshift-lws-operator-fd8ccff4c-vwr9g\" (UID: \"25edbbfc-71c9-4fc9-b658-50fe99d180af\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwr9g" Jul 10 18:34:10.478428 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:10.478211 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25edbbfc-71c9-4fc9-b658-50fe99d180af-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vwr9g\" (UID: \"25edbbfc-71c9-4fc9-b658-50fe99d180af\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwr9g" Jul 10 18:34:10.579301 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:10.579268 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4hgp\" (UniqueName: \"kubernetes.io/projected/25edbbfc-71c9-4fc9-b658-50fe99d180af-kube-api-access-t4hgp\") pod \"openshift-lws-operator-fd8ccff4c-vwr9g\" (UID: \"25edbbfc-71c9-4fc9-b658-50fe99d180af\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwr9g" Jul 10 18:34:10.579452 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:10.579308 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25edbbfc-71c9-4fc9-b658-50fe99d180af-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vwr9g\" (UID: \"25edbbfc-71c9-4fc9-b658-50fe99d180af\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwr9g" Jul 10 18:34:10.579641 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:10.579626 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25edbbfc-71c9-4fc9-b658-50fe99d180af-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vwr9g\" (UID: \"25edbbfc-71c9-4fc9-b658-50fe99d180af\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwr9g" Jul 10 18:34:10.589008 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:10.588986 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4hgp\" (UniqueName: \"kubernetes.io/projected/25edbbfc-71c9-4fc9-b658-50fe99d180af-kube-api-access-t4hgp\") pod \"openshift-lws-operator-fd8ccff4c-vwr9g\" (UID: \"25edbbfc-71c9-4fc9-b658-50fe99d180af\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwr9g" Jul 10 18:34:10.734626 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:10.734595 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwr9g" Jul 10 18:34:10.860418 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:10.860394 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwr9g"] Jul 10 18:34:10.862839 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:34:10.862806 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25edbbfc_71c9_4fc9_b658_50fe99d180af.slice/crio-2f0da8f4c2f204b71e0bd8343953e761b78861778ec897001f49ec43f047df3c WatchSource:0}: Error finding container 2f0da8f4c2f204b71e0bd8343953e761b78861778ec897001f49ec43f047df3c: Status 404 returned error can't find the container with id 2f0da8f4c2f204b71e0bd8343953e761b78861778ec897001f49ec43f047df3c Jul 10 18:34:10.969611 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:10.969586 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwr9g" event={"ID":"25edbbfc-71c9-4fc9-b658-50fe99d180af","Type":"ContainerStarted","Data":"2f0da8f4c2f204b71e0bd8343953e761b78861778ec897001f49ec43f047df3c"} Jul 10 18:34:13.989719 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:13.989665 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwr9g" event={"ID":"25edbbfc-71c9-4fc9-b658-50fe99d180af","Type":"ContainerStarted","Data":"694e39cd80b11188f7a273f546362f88f3ecae0ec57362afa227e50873c6a4fa"} Jul 10 18:34:14.005913 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:14.005847 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vwr9g" podStartSLOduration=1.515147188 podStartE2EDuration="4.005829667s" totalImagesPullingTime="2.490682479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:34:14.005548892 +0000 UTC m=+473.238753152" watchObservedRunningTime="2026-07-10 18:34:14.005829667 +0000 UTC m=+473.239033928" Jul 10 18:34:30.577372 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:30.577328 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm"] Jul 10 18:34:30.580803 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:30.580782 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm" Jul 10 18:34:30.583187 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:34:30.583160 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-webhook-cert\" is forbidden: User \"system:node:ip-10-0-136-57.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-57.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" type="*v1.Secret" Jul 10 18:34:30.583278 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:34:30.583235 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-136-57.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-57.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 10 18:34:30.583352 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:34:30.583331 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-service-cert\" is forbidden: User \"system:node:ip-10-0-136-57.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-57.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret" Jul 10 18:34:30.583409 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:34:30.583336 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-dockercfg-fkw6b\" is forbidden: User \"system:node:ip-10-0-136-57.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-57.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fkw6b\"" type="*v1.Secret" Jul 10 18:34:30.583409 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:34:30.583344 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-136-57.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-57.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 10 18:34:30.583547 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:34:30.583525 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"opendatahub-operator-controller-manager-5488d6dcc-xg8qm\" is forbidden: User \"system:node:ip-10-0-136-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-57.ec2.internal' and this object" podUID="a8e76c0a-f1ec-48fd-8562-d36abdbb10f7" pod="opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm" Jul 10 18:34:30.598447 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:30.598426 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm"] Jul 10 18:34:30.614329 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:30.614287 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a8e76c0a-f1ec-48fd-8562-d36abdbb10f7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5488d6dcc-xg8qm\" (UID: \"a8e76c0a-f1ec-48fd-8562-d36abdbb10f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm" Jul 10 18:34:30.614429 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:30.614328 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qhtq\" (UniqueName: \"kubernetes.io/projected/a8e76c0a-f1ec-48fd-8562-d36abdbb10f7-kube-api-access-2qhtq\") pod \"opendatahub-operator-controller-manager-5488d6dcc-xg8qm\" (UID: \"a8e76c0a-f1ec-48fd-8562-d36abdbb10f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm" Jul 10 18:34:30.614429 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:30.614396 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8e76c0a-f1ec-48fd-8562-d36abdbb10f7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5488d6dcc-xg8qm\" (UID: \"a8e76c0a-f1ec-48fd-8562-d36abdbb10f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm" Jul 10 18:34:30.614509 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:30.614428 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8e76c0a-f1ec-48fd-8562-d36abdbb10f7-tmp\") pod \"opendatahub-operator-controller-manager-5488d6dcc-xg8qm\" (UID: \"a8e76c0a-f1ec-48fd-8562-d36abdbb10f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm" Jul 10 18:34:30.614509 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:30.614489 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a8e76c0a-f1ec-48fd-8562-d36abdbb10f7-manifests\") pod \"opendatahub-operator-controller-manager-5488d6dcc-xg8qm\" (UID: \"a8e76c0a-f1ec-48fd-8562-d36abdbb10f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm" Jul 10 18:34:30.715804 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:30.715774 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8e76c0a-f1ec-48fd-8562-d36abdbb10f7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5488d6dcc-xg8qm\" (UID: \"a8e76c0a-f1ec-48fd-8562-d36abdbb10f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm" Jul 10 18:34:30.715913 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:30.715813 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8e76c0a-f1ec-48fd-8562-d36abdbb10f7-tmp\") pod \"opendatahub-operator-controller-manager-5488d6dcc-xg8qm\" (UID: \"a8e76c0a-f1ec-48fd-8562-d36abdbb10f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm" Jul 10 18:34:30.715974 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:30.715940 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a8e76c0a-f1ec-48fd-8562-d36abdbb10f7-manifests\") pod \"opendatahub-operator-controller-manager-5488d6dcc-xg8qm\" (UID: \"a8e76c0a-f1ec-48fd-8562-d36abdbb10f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm" Jul 10 18:34:30.716026 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:30.716016 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a8e76c0a-f1ec-48fd-8562-d36abdbb10f7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5488d6dcc-xg8qm\" (UID: \"a8e76c0a-f1ec-48fd-8562-d36abdbb10f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm" Jul 10 18:34:30.716083 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:30.716035 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qhtq\" (UniqueName: \"kubernetes.io/projected/a8e76c0a-f1ec-48fd-8562-d36abdbb10f7-kube-api-access-2qhtq\") pod \"opendatahub-operator-controller-manager-5488d6dcc-xg8qm\" (UID: \"a8e76c0a-f1ec-48fd-8562-d36abdbb10f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm" Jul 10 18:34:30.716259 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:30.716241 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a8e76c0a-f1ec-48fd-8562-d36abdbb10f7-manifests\") pod \"opendatahub-operator-controller-manager-5488d6dcc-xg8qm\" (UID: \"a8e76c0a-f1ec-48fd-8562-d36abdbb10f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm" Jul 10 18:34:30.717934 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:30.717916 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8e76c0a-f1ec-48fd-8562-d36abdbb10f7-tmp\") pod \"opendatahub-operator-controller-manager-5488d6dcc-xg8qm\" (UID: \"a8e76c0a-f1ec-48fd-8562-d36abdbb10f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm" Jul 10 18:34:31.562675 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:31.562641 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 10 18:34:31.569046 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:31.569018 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a8e76c0a-f1ec-48fd-8562-d36abdbb10f7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5488d6dcc-xg8qm\" (UID: \"a8e76c0a-f1ec-48fd-8562-d36abdbb10f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm" Jul 10 18:34:31.569046 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:31.569036 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8e76c0a-f1ec-48fd-8562-d36abdbb10f7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5488d6dcc-xg8qm\" (UID: \"a8e76c0a-f1ec-48fd-8562-d36abdbb10f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm" Jul 10 18:34:31.618443 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:31.618420 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 10 18:34:31.652048 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:31.652027 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 10 18:34:31.657153 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:31.657127 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qhtq\" (UniqueName: \"kubernetes.io/projected/a8e76c0a-f1ec-48fd-8562-d36abdbb10f7-kube-api-access-2qhtq\") pod \"opendatahub-operator-controller-manager-5488d6dcc-xg8qm\" (UID: \"a8e76c0a-f1ec-48fd-8562-d36abdbb10f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm" Jul 10 18:34:31.771420 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:31.771393 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fkw6b\"" Jul 10 18:34:31.790970 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:31.790950 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm" Jul 10 18:34:31.931501 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:31.931477 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm"] Jul 10 18:34:31.933604 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:34:31.933578 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e76c0a_f1ec_48fd_8562_d36abdbb10f7.slice/crio-2340373801a46a4732f028ecf8977f226a48f0be5d97a0cc67811d3e1c883c97 WatchSource:0}: Error finding container 2340373801a46a4732f028ecf8977f226a48f0be5d97a0cc67811d3e1c883c97: Status 404 returned error can't find the container with id 2340373801a46a4732f028ecf8977f226a48f0be5d97a0cc67811d3e1c883c97 Jul 10 18:34:32.059805 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:32.059773 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm" event={"ID":"a8e76c0a-f1ec-48fd-8562-d36abdbb10f7","Type":"ContainerStarted","Data":"2340373801a46a4732f028ecf8977f226a48f0be5d97a0cc67811d3e1c883c97"} Jul 10 18:34:32.076532 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:32.076513 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 10 18:34:35.077794 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:35.077753 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm" event={"ID":"a8e76c0a-f1ec-48fd-8562-d36abdbb10f7","Type":"ContainerStarted","Data":"1a98fe93d13d8fa3dc8954a83afa1385edc0e74593f07cdf5169c37bde0c2601"} Jul 10 18:34:36.083109 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:36.083072 2564 generic.go:356] "Generic (PLEG): container finished" podID="a8e76c0a-f1ec-48fd-8562-d36abdbb10f7" containerID="1a98fe93d13d8fa3dc8954a83afa1385edc0e74593f07cdf5169c37bde0c2601" exitCode=0 Jul 10 18:34:36.083469 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:36.083142 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm" event={"ID":"a8e76c0a-f1ec-48fd-8562-d36abdbb10f7","Type":"ContainerDied","Data":"1a98fe93d13d8fa3dc8954a83afa1385edc0e74593f07cdf5169c37bde0c2601"} Jul 10 18:34:37.089202 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:37.089172 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm" event={"ID":"a8e76c0a-f1ec-48fd-8562-d36abdbb10f7","Type":"ContainerStarted","Data":"5a720437adc3f97e52f5353269317e8b08e61068e27f8e0b825e3e1f1c5bea4d"} Jul 10 18:34:37.089571 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:37.089294 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm" Jul 10 18:34:37.123482 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:37.123428 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm" podStartSLOduration=2.756014176 podStartE2EDuration="7.123411794s" totalImagesPullingTime="3.348451497s" totalInitContainerRuntime="1.018946121s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:34:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:34:37.121541616 +0000 UTC m=+496.354745875" watchObservedRunningTime="2026-07-10 18:34:37.123411794 +0000 UTC m=+496.356616055" Jul 10 18:34:48.096396 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:48.096359 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5488d6dcc-xg8qm" Jul 10 18:34:50.819758 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:50.819724 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-75kc6"] Jul 10 18:34:50.824482 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:50.824460 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-75kc6" Jul 10 18:34:50.827871 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:50.827849 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-vcgmm\"" Jul 10 18:34:50.828066 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:50.828050 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 10 18:34:50.836843 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:50.836818 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-75kc6"] Jul 10 18:34:50.875446 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:50.875425 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29zn8\" (UniqueName: \"kubernetes.io/projected/5be58ed1-f611-49d7-baf4-5f7712cf5567-kube-api-access-29zn8\") pod \"odh-model-controller-7998c67dc4-75kc6\" (UID: \"5be58ed1-f611-49d7-baf4-5f7712cf5567\") " pod="opendatahub/odh-model-controller-7998c67dc4-75kc6" Jul 10 18:34:50.875564 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:50.875454 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5be58ed1-f611-49d7-baf4-5f7712cf5567-cert\") pod \"odh-model-controller-7998c67dc4-75kc6\" (UID: \"5be58ed1-f611-49d7-baf4-5f7712cf5567\") " pod="opendatahub/odh-model-controller-7998c67dc4-75kc6" Jul 10 18:34:50.975885 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:50.975860 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29zn8\" (UniqueName: \"kubernetes.io/projected/5be58ed1-f611-49d7-baf4-5f7712cf5567-kube-api-access-29zn8\") pod \"odh-model-controller-7998c67dc4-75kc6\" (UID: \"5be58ed1-f611-49d7-baf4-5f7712cf5567\") " pod="opendatahub/odh-model-controller-7998c67dc4-75kc6" Jul 10 18:34:50.975992 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:50.975892 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5be58ed1-f611-49d7-baf4-5f7712cf5567-cert\") pod \"odh-model-controller-7998c67dc4-75kc6\" (UID: \"5be58ed1-f611-49d7-baf4-5f7712cf5567\") " pod="opendatahub/odh-model-controller-7998c67dc4-75kc6" Jul 10 18:34:50.975992 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:34:50.975984 2564 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 10 18:34:50.976073 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:34:50.976037 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5be58ed1-f611-49d7-baf4-5f7712cf5567-cert podName:5be58ed1-f611-49d7-baf4-5f7712cf5567 nodeName:}" failed. No retries permitted until 2026-07-10 18:34:51.4760224 +0000 UTC m=+510.709226637 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5be58ed1-f611-49d7-baf4-5f7712cf5567-cert") pod "odh-model-controller-7998c67dc4-75kc6" (UID: "5be58ed1-f611-49d7-baf4-5f7712cf5567") : secret "odh-model-controller-webhook-cert" not found Jul 10 18:34:50.991252 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:50.991223 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29zn8\" (UniqueName: \"kubernetes.io/projected/5be58ed1-f611-49d7-baf4-5f7712cf5567-kube-api-access-29zn8\") pod \"odh-model-controller-7998c67dc4-75kc6\" (UID: \"5be58ed1-f611-49d7-baf4-5f7712cf5567\") " pod="opendatahub/odh-model-controller-7998c67dc4-75kc6" Jul 10 18:34:51.479021 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:51.478989 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5be58ed1-f611-49d7-baf4-5f7712cf5567-cert\") pod \"odh-model-controller-7998c67dc4-75kc6\" (UID: \"5be58ed1-f611-49d7-baf4-5f7712cf5567\") " pod="opendatahub/odh-model-controller-7998c67dc4-75kc6" Jul 10 18:34:51.481303 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:51.481283 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5be58ed1-f611-49d7-baf4-5f7712cf5567-cert\") pod \"odh-model-controller-7998c67dc4-75kc6\" (UID: \"5be58ed1-f611-49d7-baf4-5f7712cf5567\") " pod="opendatahub/odh-model-controller-7998c67dc4-75kc6" Jul 10 18:34:51.734637 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:51.734560 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-75kc6" Jul 10 18:34:51.826757 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:51.826719 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hxdqc"] Jul 10 18:34:51.834842 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:51.834602 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-hxdqc" Jul 10 18:34:51.837024 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:51.836994 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hxdqc"] Jul 10 18:34:51.837773 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:51.837747 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 10 18:34:51.837942 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:51.837920 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-5b8dr\"" Jul 10 18:34:51.868577 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:51.868548 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-75kc6"] Jul 10 18:34:51.871791 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:34:51.871745 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5be58ed1_f611_49d7_baf4_5f7712cf5567.slice/crio-1735d7e164a13a79eb660bbfee321f1fb4eb4e64baeb140f2a38a9821bb6e596 WatchSource:0}: Error finding container 1735d7e164a13a79eb660bbfee321f1fb4eb4e64baeb140f2a38a9821bb6e596: Status 404 returned error can't find the container with id 1735d7e164a13a79eb660bbfee321f1fb4eb4e64baeb140f2a38a9821bb6e596 Jul 10 18:34:51.882602 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:51.882575 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d5689f9-7294-4091-b141-014e66ebe175-tls-certs\") pod \"model-serving-api-54d89bd5fc-hxdqc\" (UID: \"8d5689f9-7294-4091-b141-014e66ebe175\") " pod="opendatahub/model-serving-api-54d89bd5fc-hxdqc" Jul 10 18:34:51.882682 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:51.882664 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkdkq\" (UniqueName: \"kubernetes.io/projected/8d5689f9-7294-4091-b141-014e66ebe175-kube-api-access-hkdkq\") pod \"model-serving-api-54d89bd5fc-hxdqc\" (UID: \"8d5689f9-7294-4091-b141-014e66ebe175\") " pod="opendatahub/model-serving-api-54d89bd5fc-hxdqc" Jul 10 18:34:51.983945 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:51.983918 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkdkq\" (UniqueName: \"kubernetes.io/projected/8d5689f9-7294-4091-b141-014e66ebe175-kube-api-access-hkdkq\") pod \"model-serving-api-54d89bd5fc-hxdqc\" (UID: \"8d5689f9-7294-4091-b141-014e66ebe175\") " pod="opendatahub/model-serving-api-54d89bd5fc-hxdqc" Jul 10 18:34:51.984079 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:51.983972 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d5689f9-7294-4091-b141-014e66ebe175-tls-certs\") pod \"model-serving-api-54d89bd5fc-hxdqc\" (UID: \"8d5689f9-7294-4091-b141-014e66ebe175\") " pod="opendatahub/model-serving-api-54d89bd5fc-hxdqc" Jul 10 18:34:51.984079 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:34:51.984068 2564 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 10 18:34:51.984191 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:34:51.984120 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d5689f9-7294-4091-b141-014e66ebe175-tls-certs podName:8d5689f9-7294-4091-b141-014e66ebe175 nodeName:}" failed. No retries permitted until 2026-07-10 18:34:52.484104764 +0000 UTC m=+511.717309001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/8d5689f9-7294-4091-b141-014e66ebe175-tls-certs") pod "model-serving-api-54d89bd5fc-hxdqc" (UID: "8d5689f9-7294-4091-b141-014e66ebe175") : secret "model-serving-api-tls" not found Jul 10 18:34:52.002739 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:52.002658 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkdkq\" (UniqueName: \"kubernetes.io/projected/8d5689f9-7294-4091-b141-014e66ebe175-kube-api-access-hkdkq\") pod \"model-serving-api-54d89bd5fc-hxdqc\" (UID: \"8d5689f9-7294-4091-b141-014e66ebe175\") " pod="opendatahub/model-serving-api-54d89bd5fc-hxdqc" Jul 10 18:34:52.151223 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:52.151191 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-75kc6" event={"ID":"5be58ed1-f611-49d7-baf4-5f7712cf5567","Type":"ContainerStarted","Data":"1735d7e164a13a79eb660bbfee321f1fb4eb4e64baeb140f2a38a9821bb6e596"} Jul 10 18:34:52.259240 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:52.259169 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5dd47df98c-wkh7n"] Jul 10 18:34:52.262163 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:52.262142 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dd47df98c-wkh7n" Jul 10 18:34:52.265090 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:52.265068 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 10 18:34:52.265395 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:52.265378 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 10 18:34:52.265486 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:52.265408 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-q8vp2\"" Jul 10 18:34:52.281679 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:52.281656 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dd47df98c-wkh7n"] Jul 10 18:34:52.387422 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:52.387388 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/246f3a19-773d-427c-bcba-c5bee68f4d76-tls-certs\") pod \"kube-auth-proxy-5dd47df98c-wkh7n\" (UID: \"246f3a19-773d-427c-bcba-c5bee68f4d76\") " pod="openshift-ingress/kube-auth-proxy-5dd47df98c-wkh7n" Jul 10 18:34:52.387422 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:52.387425 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-726sv\" (UniqueName: \"kubernetes.io/projected/246f3a19-773d-427c-bcba-c5bee68f4d76-kube-api-access-726sv\") pod \"kube-auth-proxy-5dd47df98c-wkh7n\" (UID: \"246f3a19-773d-427c-bcba-c5bee68f4d76\") " pod="openshift-ingress/kube-auth-proxy-5dd47df98c-wkh7n" Jul 10 18:34:52.387637 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:52.387504 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/246f3a19-773d-427c-bcba-c5bee68f4d76-tmp\") pod \"kube-auth-proxy-5dd47df98c-wkh7n\" (UID: \"246f3a19-773d-427c-bcba-c5bee68f4d76\") " pod="openshift-ingress/kube-auth-proxy-5dd47df98c-wkh7n" Jul 10 18:34:52.488679 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:52.488645 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d5689f9-7294-4091-b141-014e66ebe175-tls-certs\") pod \"model-serving-api-54d89bd5fc-hxdqc\" (UID: \"8d5689f9-7294-4091-b141-014e66ebe175\") " pod="opendatahub/model-serving-api-54d89bd5fc-hxdqc" Jul 10 18:34:52.488679 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:52.488683 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/246f3a19-773d-427c-bcba-c5bee68f4d76-tmp\") pod \"kube-auth-proxy-5dd47df98c-wkh7n\" (UID: \"246f3a19-773d-427c-bcba-c5bee68f4d76\") " pod="openshift-ingress/kube-auth-proxy-5dd47df98c-wkh7n" Jul 10 18:34:52.488924 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:52.488754 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/246f3a19-773d-427c-bcba-c5bee68f4d76-tls-certs\") pod \"kube-auth-proxy-5dd47df98c-wkh7n\" (UID: \"246f3a19-773d-427c-bcba-c5bee68f4d76\") " pod="openshift-ingress/kube-auth-proxy-5dd47df98c-wkh7n" Jul 10 18:34:52.488924 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:52.488781 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-726sv\" (UniqueName: \"kubernetes.io/projected/246f3a19-773d-427c-bcba-c5bee68f4d76-kube-api-access-726sv\") pod \"kube-auth-proxy-5dd47df98c-wkh7n\" (UID: \"246f3a19-773d-427c-bcba-c5bee68f4d76\") " pod="openshift-ingress/kube-auth-proxy-5dd47df98c-wkh7n" Jul 10 18:34:52.488924 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:34:52.488913 2564 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 10 18:34:52.489061 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:34:52.488979 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/246f3a19-773d-427c-bcba-c5bee68f4d76-tls-certs podName:246f3a19-773d-427c-bcba-c5bee68f4d76 nodeName:}" failed. No retries permitted until 2026-07-10 18:34:52.988960719 +0000 UTC m=+512.222164960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/246f3a19-773d-427c-bcba-c5bee68f4d76-tls-certs") pod "kube-auth-proxy-5dd47df98c-wkh7n" (UID: "246f3a19-773d-427c-bcba-c5bee68f4d76") : secret "kube-auth-proxy-tls" not found Jul 10 18:34:52.490972 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:52.490947 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/246f3a19-773d-427c-bcba-c5bee68f4d76-tmp\") pod \"kube-auth-proxy-5dd47df98c-wkh7n\" (UID: \"246f3a19-773d-427c-bcba-c5bee68f4d76\") " pod="openshift-ingress/kube-auth-proxy-5dd47df98c-wkh7n" Jul 10 18:34:52.491139 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:52.491114 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d5689f9-7294-4091-b141-014e66ebe175-tls-certs\") pod \"model-serving-api-54d89bd5fc-hxdqc\" (UID: \"8d5689f9-7294-4091-b141-014e66ebe175\") " pod="opendatahub/model-serving-api-54d89bd5fc-hxdqc" Jul 10 18:34:52.502493 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:52.502459 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-726sv\" (UniqueName: \"kubernetes.io/projected/246f3a19-773d-427c-bcba-c5bee68f4d76-kube-api-access-726sv\") pod \"kube-auth-proxy-5dd47df98c-wkh7n\" (UID: \"246f3a19-773d-427c-bcba-c5bee68f4d76\") " pod="openshift-ingress/kube-auth-proxy-5dd47df98c-wkh7n" Jul 10 18:34:52.747890 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:52.747854 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-hxdqc" Jul 10 18:34:52.904041 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:52.904016 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hxdqc"] Jul 10 18:34:52.995103 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:52.995069 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/246f3a19-773d-427c-bcba-c5bee68f4d76-tls-certs\") pod \"kube-auth-proxy-5dd47df98c-wkh7n\" (UID: \"246f3a19-773d-427c-bcba-c5bee68f4d76\") " pod="openshift-ingress/kube-auth-proxy-5dd47df98c-wkh7n" Jul 10 18:34:52.997623 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:52.997599 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/246f3a19-773d-427c-bcba-c5bee68f4d76-tls-certs\") pod \"kube-auth-proxy-5dd47df98c-wkh7n\" (UID: \"246f3a19-773d-427c-bcba-c5bee68f4d76\") " pod="openshift-ingress/kube-auth-proxy-5dd47df98c-wkh7n" Jul 10 18:34:53.159158 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.159070 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-hxdqc" event={"ID":"8d5689f9-7294-4091-b141-014e66ebe175","Type":"ContainerStarted","Data":"cf6c3d4c16ff0f08c4f665db7b0a44c7bc31e62f6b8cf3b9743dd89b31384499"} Jul 10 18:34:53.171499 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.171470 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5dd47df98c-wkh7n" Jul 10 18:34:53.331817 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.331728 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5dd47df98c-wkh7n"] Jul 10 18:34:53.343855 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:34:53.334580 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod246f3a19_773d_427c_bcba_c5bee68f4d76.slice/crio-bfe4a7264f170ed92bec48cd5ecb947113322f40834fe8ea4f9709e53244042b WatchSource:0}: Error finding container bfe4a7264f170ed92bec48cd5ecb947113322f40834fe8ea4f9709e53244042b: Status 404 returned error can't find the container with id bfe4a7264f170ed92bec48cd5ecb947113322f40834fe8ea4f9709e53244042b Jul 10 18:34:53.533555 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.533526 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2"] Jul 10 18:34:53.537831 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.537804 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:34:53.540423 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.540397 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 10 18:34:53.540537 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.540430 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 10 18:34:53.540537 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.540483 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 10 18:34:53.540537 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.540480 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 10 18:34:53.540673 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.540539 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6fm4r\"" Jul 10 18:34:53.550931 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.550890 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2"] Jul 10 18:34:53.601095 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.601068 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5bc569a6-b50d-42a9-9403-4f71139d67a5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-g9qz2\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:34:53.601229 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.601113 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bc569a6-b50d-42a9-9403-4f71139d67a5-local-certs\") pod \"istiod-openshift-gateway-7574459656-g9qz2\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:34:53.601229 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.601135 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5bc569a6-b50d-42a9-9403-4f71139d67a5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-g9qz2\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:34:53.601229 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.601165 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bc569a6-b50d-42a9-9403-4f71139d67a5-istio-token\") pod \"istiod-openshift-gateway-7574459656-g9qz2\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:34:53.601229 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.601194 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5bc569a6-b50d-42a9-9403-4f71139d67a5-cacerts\") pod \"istiod-openshift-gateway-7574459656-g9qz2\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:34:53.601229 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.601210 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5bc569a6-b50d-42a9-9403-4f71139d67a5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-g9qz2\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:34:53.601478 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.601277 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vczjv\" (UniqueName: \"kubernetes.io/projected/5bc569a6-b50d-42a9-9403-4f71139d67a5-kube-api-access-vczjv\") pod \"istiod-openshift-gateway-7574459656-g9qz2\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:34:53.702296 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.702267 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5bc569a6-b50d-42a9-9403-4f71139d67a5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-g9qz2\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:34:53.702433 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.702331 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bc569a6-b50d-42a9-9403-4f71139d67a5-local-certs\") pod \"istiod-openshift-gateway-7574459656-g9qz2\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:34:53.702433 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.702355 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5bc569a6-b50d-42a9-9403-4f71139d67a5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-g9qz2\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:34:53.702433 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.702388 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bc569a6-b50d-42a9-9403-4f71139d67a5-istio-token\") pod \"istiod-openshift-gateway-7574459656-g9qz2\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:34:53.702599 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.702435 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5bc569a6-b50d-42a9-9403-4f71139d67a5-cacerts\") pod \"istiod-openshift-gateway-7574459656-g9qz2\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:34:53.702599 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.702477 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5bc569a6-b50d-42a9-9403-4f71139d67a5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-g9qz2\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:34:53.702599 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.702512 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vczjv\" (UniqueName: \"kubernetes.io/projected/5bc569a6-b50d-42a9-9403-4f71139d67a5-kube-api-access-vczjv\") pod \"istiod-openshift-gateway-7574459656-g9qz2\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:34:53.703125 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.703096 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5bc569a6-b50d-42a9-9403-4f71139d67a5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-g9qz2\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:34:53.705342 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.705279 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bc569a6-b50d-42a9-9403-4f71139d67a5-local-certs\") pod \"istiod-openshift-gateway-7574459656-g9qz2\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:34:53.705342 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.705327 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5bc569a6-b50d-42a9-9403-4f71139d67a5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-g9qz2\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:34:53.705502 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.705339 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5bc569a6-b50d-42a9-9403-4f71139d67a5-cacerts\") pod \"istiod-openshift-gateway-7574459656-g9qz2\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:34:53.705502 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.705493 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5bc569a6-b50d-42a9-9403-4f71139d67a5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-g9qz2\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:34:53.713020 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.712995 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bc569a6-b50d-42a9-9403-4f71139d67a5-istio-token\") pod \"istiod-openshift-gateway-7574459656-g9qz2\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:34:53.713132 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.713022 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vczjv\" (UniqueName: \"kubernetes.io/projected/5bc569a6-b50d-42a9-9403-4f71139d67a5-kube-api-access-vczjv\") pod \"istiod-openshift-gateway-7574459656-g9qz2\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:34:53.850034 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:53.849964 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:34:54.165604 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:54.165530 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dd47df98c-wkh7n" event={"ID":"246f3a19-773d-427c-bcba-c5bee68f4d76","Type":"ContainerStarted","Data":"bfe4a7264f170ed92bec48cd5ecb947113322f40834fe8ea4f9709e53244042b"} Jul 10 18:34:55.685716 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:55.685463 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2"] Jul 10 18:34:55.687296 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:34:55.687261 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bc569a6_b50d_42a9_9403_4f71139d67a5.slice/crio-2ea821f160c32d3ce5b4c2b73081fcdc9bfd25dc09600b1f35209a5e4bdd408f WatchSource:0}: Error finding container 2ea821f160c32d3ce5b4c2b73081fcdc9bfd25dc09600b1f35209a5e4bdd408f: Status 404 returned error can't find the container with id 2ea821f160c32d3ce5b4c2b73081fcdc9bfd25dc09600b1f35209a5e4bdd408f Jul 10 18:34:56.181201 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:56.181160 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-75kc6" event={"ID":"5be58ed1-f611-49d7-baf4-5f7712cf5567","Type":"ContainerStarted","Data":"1bf9be679fdc56dd36b61cb8c83f3885940f2370644c7cce9caa3fa4a3e9ed49"} Jul 10 18:34:56.181436 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:56.181272 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-75kc6" Jul 10 18:34:56.182758 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:56.182732 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-hxdqc" event={"ID":"8d5689f9-7294-4091-b141-014e66ebe175","Type":"ContainerStarted","Data":"1d19e9da11dca643d667ef43d562121cecfbce8910404c069d82a1cc4a32f54c"} Jul 10 18:34:56.182885 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:56.182850 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-hxdqc" Jul 10 18:34:56.184132 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:56.184109 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" event={"ID":"5bc569a6-b50d-42a9-9403-4f71139d67a5","Type":"ContainerStarted","Data":"2ea821f160c32d3ce5b4c2b73081fcdc9bfd25dc09600b1f35209a5e4bdd408f"} Jul 10 18:34:56.200989 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:56.200920 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-75kc6" podStartSLOduration=2.578873985 podStartE2EDuration="6.200906665s" totalImagesPullingTime="3.62203268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:34:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:34:56.199748074 +0000 UTC m=+515.432952334" watchObservedRunningTime="2026-07-10 18:34:56.200906665 +0000 UTC m=+515.434110925" Jul 10 18:34:56.221936 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:56.221888 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-hxdqc" podStartSLOduration=2.638398874 podStartE2EDuration="5.221874795s" totalImagesPullingTime="2.583475921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:34:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:34:56.220421077 +0000 UTC m=+515.453625347" watchObservedRunningTime="2026-07-10 18:34:56.221874795 +0000 UTC m=+515.455079063" Jul 10 18:34:57.189880 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:57.189787 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5dd47df98c-wkh7n" event={"ID":"246f3a19-773d-427c-bcba-c5bee68f4d76","Type":"ContainerStarted","Data":"0cc9a5f92a83c61c2453fd8ef1f94b9329aef1589d2b0c318c4aa8b9abe381da"} Jul 10 18:34:57.206676 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:34:57.206628 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5dd47df98c-wkh7n" podStartSLOduration=1.613475025 podStartE2EDuration="5.206613396s" totalImagesPullingTime="3.593138371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:34:57.205506069 +0000 UTC m=+516.438710340" watchObservedRunningTime="2026-07-10 18:34:57.206613396 +0000 UTC m=+516.439817654" Jul 10 18:35:00.054281 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:00.054243 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 18:35:00.054641 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:00.054322 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 18:35:00.207003 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:00.206960 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" event={"ID":"5bc569a6-b50d-42a9-9403-4f71139d67a5","Type":"ContainerStarted","Data":"f13093f6b345b26a3eab41856968d751c20611b8ac280a812a99ac41324c42b9"} Jul 10 18:35:00.207176 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:00.207158 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:35:00.231146 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:00.231098 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" podStartSLOduration=2.867369438 podStartE2EDuration="7.231084249s" totalImagesPullingTime="4.363714811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:35:00.228736383 +0000 UTC m=+519.461940639" watchObservedRunningTime="2026-07-10 18:35:00.231084249 +0000 UTC m=+519.464288507" Jul 10 18:35:01.213078 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:01.213048 2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-g9qz2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 10 18:35:01.213532 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:01.213101 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" podUID="5bc569a6-b50d-42a9-9403-4f71139d67a5" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 18:35:01.944760 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:01.944721 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-55gjq"] Jul 10 18:35:01.948238 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:01.948214 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-55gjq" Jul 10 18:35:01.949166 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:01.949145 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2sxb9"] Jul 10 18:35:01.950858 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:01.950836 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 10 18:35:01.950935 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:01.950836 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-fzmr8\"" Jul 10 18:35:01.952285 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:01.952266 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sxb9" Jul 10 18:35:01.954477 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:01.954459 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 10 18:35:01.954713 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:01.954683 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-xvhqh\"" Jul 10 18:35:01.967606 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:01.967588 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2sxb9"] Jul 10 18:35:01.969357 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:01.969335 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-55gjq"] Jul 10 18:35:02.081108 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.081075 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/741d8beb-644b-4019-b357-c6aca1f0abfa-cert\") pod \"kserve-controller-manager-d6f4b65b8-55gjq\" (UID: \"741d8beb-644b-4019-b357-c6aca1f0abfa\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-55gjq" Jul 10 18:35:02.081108 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.081104 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e15eeeb-5bd4-42d7-8deb-b27f637d58cf-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2sxb9\" (UID: \"9e15eeeb-5bd4-42d7-8deb-b27f637d58cf\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sxb9" Jul 10 18:35:02.081317 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.081142 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpjth\" (UniqueName: \"kubernetes.io/projected/741d8beb-644b-4019-b357-c6aca1f0abfa-kube-api-access-cpjth\") pod \"kserve-controller-manager-d6f4b65b8-55gjq\" (UID: \"741d8beb-644b-4019-b357-c6aca1f0abfa\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-55gjq" Jul 10 18:35:02.081317 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.081202 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwdgt\" (UniqueName: \"kubernetes.io/projected/9e15eeeb-5bd4-42d7-8deb-b27f637d58cf-kube-api-access-jwdgt\") pod \"llmisvc-controller-manager-777c6bd7d5-2sxb9\" (UID: \"9e15eeeb-5bd4-42d7-8deb-b27f637d58cf\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sxb9" Jul 10 18:35:02.182298 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.182268 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/741d8beb-644b-4019-b357-c6aca1f0abfa-cert\") pod \"kserve-controller-manager-d6f4b65b8-55gjq\" (UID: \"741d8beb-644b-4019-b357-c6aca1f0abfa\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-55gjq" Jul 10 18:35:02.182465 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.182304 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e15eeeb-5bd4-42d7-8deb-b27f637d58cf-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2sxb9\" (UID: \"9e15eeeb-5bd4-42d7-8deb-b27f637d58cf\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sxb9" Jul 10 18:35:02.182465 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.182354 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpjth\" (UniqueName: \"kubernetes.io/projected/741d8beb-644b-4019-b357-c6aca1f0abfa-kube-api-access-cpjth\") pod \"kserve-controller-manager-d6f4b65b8-55gjq\" (UID: \"741d8beb-644b-4019-b357-c6aca1f0abfa\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-55gjq" Jul 10 18:35:02.182465 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.182419 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwdgt\" (UniqueName: \"kubernetes.io/projected/9e15eeeb-5bd4-42d7-8deb-b27f637d58cf-kube-api-access-jwdgt\") pod \"llmisvc-controller-manager-777c6bd7d5-2sxb9\" (UID: \"9e15eeeb-5bd4-42d7-8deb-b27f637d58cf\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sxb9" Jul 10 18:35:02.182621 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:35:02.182496 2564 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 10 18:35:02.182621 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:35:02.182584 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e15eeeb-5bd4-42d7-8deb-b27f637d58cf-cert podName:9e15eeeb-5bd4-42d7-8deb-b27f637d58cf nodeName:}" failed. No retries permitted until 2026-07-10 18:35:02.682561458 +0000 UTC m=+521.915765697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9e15eeeb-5bd4-42d7-8deb-b27f637d58cf-cert") pod "llmisvc-controller-manager-777c6bd7d5-2sxb9" (UID: "9e15eeeb-5bd4-42d7-8deb-b27f637d58cf") : secret "llmisvc-webhook-server-cert" not found Jul 10 18:35:02.184744 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.184715 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/741d8beb-644b-4019-b357-c6aca1f0abfa-cert\") pod \"kserve-controller-manager-d6f4b65b8-55gjq\" (UID: \"741d8beb-644b-4019-b357-c6aca1f0abfa\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-55gjq" Jul 10 18:35:02.211030 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.210955 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwdgt\" (UniqueName: \"kubernetes.io/projected/9e15eeeb-5bd4-42d7-8deb-b27f637d58cf-kube-api-access-jwdgt\") pod \"llmisvc-controller-manager-777c6bd7d5-2sxb9\" (UID: \"9e15eeeb-5bd4-42d7-8deb-b27f637d58cf\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sxb9" Jul 10 18:35:02.211242 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.211225 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpjth\" (UniqueName: \"kubernetes.io/projected/741d8beb-644b-4019-b357-c6aca1f0abfa-kube-api-access-cpjth\") pod \"kserve-controller-manager-d6f4b65b8-55gjq\" (UID: \"741d8beb-644b-4019-b357-c6aca1f0abfa\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-55gjq" Jul 10 18:35:02.228281 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.228254 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d"] Jul 10 18:35:02.232049 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.232029 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.235743 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.235726 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-xlwdd\"" Jul 10 18:35:02.260133 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.260114 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-55gjq" Jul 10 18:35:02.265572 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.265552 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d"] Jul 10 18:35:02.383386 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.383357 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2f90090-6b5d-469e-ad26-983000f794b4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.383533 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.383393 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2f90090-6b5d-469e-ad26-983000f794b4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.383533 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.383416 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8vg9\" (UniqueName: \"kubernetes.io/projected/f2f90090-6b5d-469e-ad26-983000f794b4-kube-api-access-f8vg9\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.383626 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.383534 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2f90090-6b5d-469e-ad26-983000f794b4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.383626 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.383576 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2f90090-6b5d-469e-ad26-983000f794b4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.383740 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.383640 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2f90090-6b5d-469e-ad26-983000f794b4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.383740 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.383683 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2f90090-6b5d-469e-ad26-983000f794b4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.383740 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.383732 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2f90090-6b5d-469e-ad26-983000f794b4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.383896 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.383844 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2f90090-6b5d-469e-ad26-983000f794b4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.409957 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.409933 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-55gjq"] Jul 10 18:35:02.412102 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:35:02.412079 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod741d8beb_644b_4019_b357_c6aca1f0abfa.slice/crio-dda18b3f6917d23333af13cc0dbe699d922d8708fe0377ec3769e63f0995c638 WatchSource:0}: Error finding container dda18b3f6917d23333af13cc0dbe699d922d8708fe0377ec3769e63f0995c638: Status 404 returned error can't find the container with id dda18b3f6917d23333af13cc0dbe699d922d8708fe0377ec3769e63f0995c638 Jul 10 18:35:02.484336 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.484258 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2f90090-6b5d-469e-ad26-983000f794b4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.484336 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.484300 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2f90090-6b5d-469e-ad26-983000f794b4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.484336 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.484322 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2f90090-6b5d-469e-ad26-983000f794b4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.484584 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.484340 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2f90090-6b5d-469e-ad26-983000f794b4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.484584 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.484534 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2f90090-6b5d-469e-ad26-983000f794b4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.484780 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.484660 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2f90090-6b5d-469e-ad26-983000f794b4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.484780 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.484731 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2f90090-6b5d-469e-ad26-983000f794b4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.484780 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.484749 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2f90090-6b5d-469e-ad26-983000f794b4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.484935 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.484798 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2f90090-6b5d-469e-ad26-983000f794b4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.484935 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.484818 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2f90090-6b5d-469e-ad26-983000f794b4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.484935 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.484839 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8vg9\" (UniqueName: \"kubernetes.io/projected/f2f90090-6b5d-469e-ad26-983000f794b4-kube-api-access-f8vg9\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.485088 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.484981 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2f90090-6b5d-469e-ad26-983000f794b4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.485088 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.485073 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2f90090-6b5d-469e-ad26-983000f794b4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.485253 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.485234 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2f90090-6b5d-469e-ad26-983000f794b4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.487023 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.487003 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2f90090-6b5d-469e-ad26-983000f794b4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.487153 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.487135 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2f90090-6b5d-469e-ad26-983000f794b4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.498400 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.498380 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2f90090-6b5d-469e-ad26-983000f794b4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.499999 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.499983 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8vg9\" (UniqueName: \"kubernetes.io/projected/f2f90090-6b5d-469e-ad26-983000f794b4-kube-api-access-f8vg9\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678ggg8d\" (UID: \"f2f90090-6b5d-469e-ad26-983000f794b4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.542795 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.542771 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:02.678573 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.678544 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d"] Jul 10 18:35:02.680692 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:35:02.680667 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2f90090_6b5d_469e_ad26_983000f794b4.slice/crio-518563d1853b13280a6334b6da9d37e134d3648622da7293670b0cf927a15040 WatchSource:0}: Error finding container 518563d1853b13280a6334b6da9d37e134d3648622da7293670b0cf927a15040: Status 404 returned error can't find the container with id 518563d1853b13280a6334b6da9d37e134d3648622da7293670b0cf927a15040 Jul 10 18:35:02.686403 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.686382 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e15eeeb-5bd4-42d7-8deb-b27f637d58cf-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2sxb9\" (UID: \"9e15eeeb-5bd4-42d7-8deb-b27f637d58cf\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sxb9" Jul 10 18:35:02.688510 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.688485 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9e15eeeb-5bd4-42d7-8deb-b27f637d58cf-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2sxb9\" (UID: \"9e15eeeb-5bd4-42d7-8deb-b27f637d58cf\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sxb9" Jul 10 18:35:02.865625 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:02.865527 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sxb9" Jul 10 18:35:03.021517 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:03.021492 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2sxb9"] Jul 10 18:35:03.023090 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:35:03.023057 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9e15eeeb_5bd4_42d7_8deb_b27f637d58cf.slice/crio-61d33c628324ab0ad4ae1b0efe48742ba00d290cc740b8f63d2f666882c79450 WatchSource:0}: Error finding container 61d33c628324ab0ad4ae1b0efe48742ba00d290cc740b8f63d2f666882c79450: Status 404 returned error can't find the container with id 61d33c628324ab0ad4ae1b0efe48742ba00d290cc740b8f63d2f666882c79450 Jul 10 18:35:03.221855 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:03.221814 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sxb9" event={"ID":"9e15eeeb-5bd4-42d7-8deb-b27f637d58cf","Type":"ContainerStarted","Data":"61d33c628324ab0ad4ae1b0efe48742ba00d290cc740b8f63d2f666882c79450"} Jul 10 18:35:03.223254 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:03.223229 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-55gjq" event={"ID":"741d8beb-644b-4019-b357-c6aca1f0abfa","Type":"ContainerStarted","Data":"dda18b3f6917d23333af13cc0dbe699d922d8708fe0377ec3769e63f0995c638"} Jul 10 18:35:03.224433 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:03.224400 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" event={"ID":"f2f90090-6b5d-469e-ad26-983000f794b4","Type":"ContainerStarted","Data":"518563d1853b13280a6334b6da9d37e134d3648622da7293670b0cf927a15040"} Jul 10 18:35:03.564665 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:03.564576 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2"] Jul 10 18:35:03.565137 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:03.564821 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" podUID="5bc569a6-b50d-42a9-9403-4f71139d67a5" containerName="discovery" containerID="cri-o://f13093f6b345b26a3eab41856968d751c20611b8ac280a812a99ac41324c42b9" gracePeriod=30 Jul 10 18:35:03.565980 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:03.565956 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:35:03.857891 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:03.857487 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:35:04.000932 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.000898 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bc569a6-b50d-42a9-9403-4f71139d67a5-local-certs\") pod \"5bc569a6-b50d-42a9-9403-4f71139d67a5\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " Jul 10 18:35:04.000932 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.000935 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vczjv\" (UniqueName: \"kubernetes.io/projected/5bc569a6-b50d-42a9-9403-4f71139d67a5-kube-api-access-vczjv\") pod \"5bc569a6-b50d-42a9-9403-4f71139d67a5\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " Jul 10 18:35:04.001184 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.000996 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5bc569a6-b50d-42a9-9403-4f71139d67a5-istio-csr-ca-configmap\") pod \"5bc569a6-b50d-42a9-9403-4f71139d67a5\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " Jul 10 18:35:04.001184 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.001048 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5bc569a6-b50d-42a9-9403-4f71139d67a5-istio-csr-dns-cert\") pod \"5bc569a6-b50d-42a9-9403-4f71139d67a5\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " Jul 10 18:35:04.001184 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.001070 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5bc569a6-b50d-42a9-9403-4f71139d67a5-istio-kubeconfig\") pod \"5bc569a6-b50d-42a9-9403-4f71139d67a5\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " Jul 10 18:35:04.001184 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.001135 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5bc569a6-b50d-42a9-9403-4f71139d67a5-cacerts\") pod \"5bc569a6-b50d-42a9-9403-4f71139d67a5\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " Jul 10 18:35:04.001184 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.001163 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bc569a6-b50d-42a9-9403-4f71139d67a5-istio-token\") pod \"5bc569a6-b50d-42a9-9403-4f71139d67a5\" (UID: \"5bc569a6-b50d-42a9-9403-4f71139d67a5\") " Jul 10 18:35:04.001438 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.001404 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bc569a6-b50d-42a9-9403-4f71139d67a5-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "5bc569a6-b50d-42a9-9403-4f71139d67a5" (UID: "5bc569a6-b50d-42a9-9403-4f71139d67a5"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:35:04.001503 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.001487 2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5bc569a6-b50d-42a9-9403-4f71139d67a5-istio-csr-ca-configmap\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:35:04.004047 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.004009 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bc569a6-b50d-42a9-9403-4f71139d67a5-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "5bc569a6-b50d-42a9-9403-4f71139d67a5" (UID: "5bc569a6-b50d-42a9-9403-4f71139d67a5"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:35:04.004189 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.004060 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bc569a6-b50d-42a9-9403-4f71139d67a5-local-certs" (OuterVolumeSpecName: "local-certs") pod "5bc569a6-b50d-42a9-9403-4f71139d67a5" (UID: "5bc569a6-b50d-42a9-9403-4f71139d67a5"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:35:04.004254 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.004183 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bc569a6-b50d-42a9-9403-4f71139d67a5-cacerts" (OuterVolumeSpecName: "cacerts") pod "5bc569a6-b50d-42a9-9403-4f71139d67a5" (UID: "5bc569a6-b50d-42a9-9403-4f71139d67a5"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:35:04.004293 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.004260 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bc569a6-b50d-42a9-9403-4f71139d67a5-istio-token" (OuterVolumeSpecName: "istio-token") pod "5bc569a6-b50d-42a9-9403-4f71139d67a5" (UID: "5bc569a6-b50d-42a9-9403-4f71139d67a5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:35:04.004830 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.004790 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bc569a6-b50d-42a9-9403-4f71139d67a5-kube-api-access-vczjv" (OuterVolumeSpecName: "kube-api-access-vczjv") pod "5bc569a6-b50d-42a9-9403-4f71139d67a5" (UID: "5bc569a6-b50d-42a9-9403-4f71139d67a5"). InnerVolumeSpecName "kube-api-access-vczjv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:35:04.004830 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.004803 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bc569a6-b50d-42a9-9403-4f71139d67a5-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "5bc569a6-b50d-42a9-9403-4f71139d67a5" (UID: "5bc569a6-b50d-42a9-9403-4f71139d67a5"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:35:04.103174 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.103091 2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5bc569a6-b50d-42a9-9403-4f71139d67a5-istio-csr-dns-cert\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:35:04.103174 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.103130 2564 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5bc569a6-b50d-42a9-9403-4f71139d67a5-istio-kubeconfig\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:35:04.103174 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.103144 2564 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5bc569a6-b50d-42a9-9403-4f71139d67a5-cacerts\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:35:04.103174 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.103161 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bc569a6-b50d-42a9-9403-4f71139d67a5-istio-token\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:35:04.103174 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.103175 2564 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bc569a6-b50d-42a9-9403-4f71139d67a5-local-certs\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:35:04.103531 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.103191 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vczjv\" (UniqueName: \"kubernetes.io/projected/5bc569a6-b50d-42a9-9403-4f71139d67a5-kube-api-access-vczjv\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:35:04.233158 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.232786 2564 generic.go:356] "Generic (PLEG): container finished" podID="5bc569a6-b50d-42a9-9403-4f71139d67a5" containerID="f13093f6b345b26a3eab41856968d751c20611b8ac280a812a99ac41324c42b9" exitCode=0 Jul 10 18:35:04.233158 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.232860 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" event={"ID":"5bc569a6-b50d-42a9-9403-4f71139d67a5","Type":"ContainerDied","Data":"f13093f6b345b26a3eab41856968d751c20611b8ac280a812a99ac41324c42b9"} Jul 10 18:35:04.233158 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.232907 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" event={"ID":"5bc569a6-b50d-42a9-9403-4f71139d67a5","Type":"ContainerDied","Data":"2ea821f160c32d3ce5b4c2b73081fcdc9bfd25dc09600b1f35209a5e4bdd408f"} Jul 10 18:35:04.233158 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.232933 2564 scope.go:117] "RemoveContainer" containerID="f13093f6b345b26a3eab41856968d751c20611b8ac280a812a99ac41324c42b9" Jul 10 18:35:04.233158 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.233087 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2" Jul 10 18:35:04.283507 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.283443 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2"] Jul 10 18:35:04.300207 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.299765 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-g9qz2"] Jul 10 18:35:04.425406 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.425366 2564 scope.go:117] "RemoveContainer" containerID="f13093f6b345b26a3eab41856968d751c20611b8ac280a812a99ac41324c42b9" Jul 10 18:35:04.425784 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:35:04.425745 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f13093f6b345b26a3eab41856968d751c20611b8ac280a812a99ac41324c42b9\": container with ID starting with f13093f6b345b26a3eab41856968d751c20611b8ac280a812a99ac41324c42b9 not found: ID does not exist" containerID="f13093f6b345b26a3eab41856968d751c20611b8ac280a812a99ac41324c42b9" Jul 10 18:35:04.425884 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:04.425800 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f13093f6b345b26a3eab41856968d751c20611b8ac280a812a99ac41324c42b9"} err="failed to get container status \"f13093f6b345b26a3eab41856968d751c20611b8ac280a812a99ac41324c42b9\": rpc error: code = NotFound desc = could not find container \"f13093f6b345b26a3eab41856968d751c20611b8ac280a812a99ac41324c42b9\": container with ID starting with f13093f6b345b26a3eab41856968d751c20611b8ac280a812a99ac41324c42b9 not found: ID does not exist" Jul 10 18:35:05.407782 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:05.407739 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bc569a6-b50d-42a9-9403-4f71139d67a5" path="/var/lib/kubelet/pods/5bc569a6-b50d-42a9-9403-4f71139d67a5/volumes" Jul 10 18:35:06.293827 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:06.293782 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 18:35:06.293950 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:06.293856 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 18:35:06.293950 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:06.293892 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 18:35:07.195014 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:07.194984 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-hxdqc" Jul 10 18:35:07.229215 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:07.229131 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-75kc6" Jul 10 18:35:07.254733 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:07.252994 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" event={"ID":"f2f90090-6b5d-469e-ad26-983000f794b4","Type":"ContainerStarted","Data":"2b7652b8c6a98f24d4256bc2ebc723855674a04a514923ab3374d2b92d8a87d5"} Jul 10 18:35:07.255154 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:07.255090 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sxb9" event={"ID":"9e15eeeb-5bd4-42d7-8deb-b27f637d58cf","Type":"ContainerStarted","Data":"04209b4dfb33becdaed7643e7ebc48aa8b66eedb0c61cbb1c98f777d90e1bc04"} Jul 10 18:35:07.255407 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:07.255344 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sxb9" Jul 10 18:35:07.256807 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:07.256782 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-55gjq" event={"ID":"741d8beb-644b-4019-b357-c6aca1f0abfa","Type":"ContainerStarted","Data":"c7f4ea61001f8c5a223b9f1668c6b864f64fd07780ec5218b5284a9f39dfa239"} Jul 10 18:35:07.256948 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:07.256920 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-55gjq" Jul 10 18:35:07.308435 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:07.308372 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sxb9" podStartSLOduration=2.332000119 podStartE2EDuration="6.308351738s" totalImagesPullingTime="3.976351619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:35:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:35:07.306238153 +0000 UTC m=+526.539442412" watchObservedRunningTime="2026-07-10 18:35:07.308351738 +0000 UTC m=+526.541555998" Jul 10 18:35:07.349629 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:07.349578 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-55gjq" podStartSLOduration=2.429325165 podStartE2EDuration="6.349561891s" totalImagesPullingTime="3.920236726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:35:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:35:07.346500551 +0000 UTC m=+526.579704809" watchObservedRunningTime="2026-07-10 18:35:07.349561891 +0000 UTC m=+526.582766154" Jul 10 18:35:07.416323 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:07.416269 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" podStartSLOduration=1.805425294 podStartE2EDuration="5.416253126s" totalImagesPullingTime="3.610827832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:35:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:35:07.414995428 +0000 UTC m=+526.648199686" watchObservedRunningTime="2026-07-10 18:35:07.416253126 +0000 UTC m=+526.649457386" Jul 10 18:35:07.543553 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:07.543481 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:08.548945 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:08.548913 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:09.266648 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:09.266616 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:09.267622 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:09.267604 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678ggg8d" Jul 10 18:35:38.264842 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:38.264807 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2sxb9" Jul 10 18:35:38.268060 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:38.268034 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-55gjq" Jul 10 18:35:51.621547 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:51.621516 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zj5vw"] Jul 10 18:35:51.621911 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:51.621874 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bc569a6-b50d-42a9-9403-4f71139d67a5" containerName="discovery" Jul 10 18:35:51.621911 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:51.621886 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bc569a6-b50d-42a9-9403-4f71139d67a5" containerName="discovery" Jul 10 18:35:51.621983 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:51.621943 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bc569a6-b50d-42a9-9403-4f71139d67a5" containerName="discovery" Jul 10 18:35:51.624803 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:51.624787 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zj5vw" Jul 10 18:35:51.628283 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:51.628260 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-qxlq8\"" Jul 10 18:35:51.628769 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:51.628751 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 10 18:35:51.628846 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:51.628822 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 10 18:35:51.637127 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:51.637099 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zj5vw"] Jul 10 18:35:51.672386 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:51.672365 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgj6x\" (UniqueName: \"kubernetes.io/projected/2c27eb51-dc64-49a2-9f18-c42a31072ebc-kube-api-access-rgj6x\") pod \"kuadrant-operator-catalog-zj5vw\" (UID: \"2c27eb51-dc64-49a2-9f18-c42a31072ebc\") " pod="kuadrant-system/kuadrant-operator-catalog-zj5vw" Jul 10 18:35:51.773519 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:51.773492 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgj6x\" (UniqueName: \"kubernetes.io/projected/2c27eb51-dc64-49a2-9f18-c42a31072ebc-kube-api-access-rgj6x\") pod \"kuadrant-operator-catalog-zj5vw\" (UID: \"2c27eb51-dc64-49a2-9f18-c42a31072ebc\") " pod="kuadrant-system/kuadrant-operator-catalog-zj5vw" Jul 10 18:35:51.781395 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:51.781374 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgj6x\" (UniqueName: \"kubernetes.io/projected/2c27eb51-dc64-49a2-9f18-c42a31072ebc-kube-api-access-rgj6x\") pod \"kuadrant-operator-catalog-zj5vw\" (UID: \"2c27eb51-dc64-49a2-9f18-c42a31072ebc\") " pod="kuadrant-system/kuadrant-operator-catalog-zj5vw" Jul 10 18:35:51.935000 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:51.934921 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zj5vw" Jul 10 18:35:51.970064 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:51.970032 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zj5vw"] Jul 10 18:35:52.068891 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:52.068583 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zj5vw"] Jul 10 18:35:52.181192 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:52.181161 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nl5np"] Jul 10 18:35:52.185594 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:52.185554 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nl5np" Jul 10 18:35:52.192801 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:52.192780 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nl5np"] Jul 10 18:35:52.278682 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:52.278652 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-228sz\" (UniqueName: \"kubernetes.io/projected/fa9a2be0-bbb7-48c7-94d8-754311222ff8-kube-api-access-228sz\") pod \"kuadrant-operator-catalog-nl5np\" (UID: \"fa9a2be0-bbb7-48c7-94d8-754311222ff8\") " pod="kuadrant-system/kuadrant-operator-catalog-nl5np" Jul 10 18:35:52.380103 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:52.380074 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-228sz\" (UniqueName: \"kubernetes.io/projected/fa9a2be0-bbb7-48c7-94d8-754311222ff8-kube-api-access-228sz\") pod \"kuadrant-operator-catalog-nl5np\" (UID: \"fa9a2be0-bbb7-48c7-94d8-754311222ff8\") " pod="kuadrant-system/kuadrant-operator-catalog-nl5np" Jul 10 18:35:52.388572 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:52.388541 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-228sz\" (UniqueName: \"kubernetes.io/projected/fa9a2be0-bbb7-48c7-94d8-754311222ff8-kube-api-access-228sz\") pod \"kuadrant-operator-catalog-nl5np\" (UID: \"fa9a2be0-bbb7-48c7-94d8-754311222ff8\") " pod="kuadrant-system/kuadrant-operator-catalog-nl5np" Jul 10 18:35:52.468298 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:52.468265 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zj5vw" event={"ID":"2c27eb51-dc64-49a2-9f18-c42a31072ebc","Type":"ContainerStarted","Data":"ec390045b75c07f7a8b6761e8c0a34e1c7256b4a525786303358b10a673d66dd"} Jul 10 18:35:52.495221 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:52.495199 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nl5np" Jul 10 18:35:52.635881 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:52.635828 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nl5np"] Jul 10 18:35:52.638146 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:35:52.638119 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa9a2be0_bbb7_48c7_94d8_754311222ff8.slice/crio-462ab614bfab778f0a4bf212163d595536cb4685aa58832578be3644b0f7b9d8 WatchSource:0}: Error finding container 462ab614bfab778f0a4bf212163d595536cb4685aa58832578be3644b0f7b9d8: Status 404 returned error can't find the container with id 462ab614bfab778f0a4bf212163d595536cb4685aa58832578be3644b0f7b9d8 Jul 10 18:35:53.475371 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:53.475341 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nl5np" event={"ID":"fa9a2be0-bbb7-48c7-94d8-754311222ff8","Type":"ContainerStarted","Data":"462ab614bfab778f0a4bf212163d595536cb4685aa58832578be3644b0f7b9d8"} Jul 10 18:35:55.490621 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:55.490583 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nl5np" event={"ID":"fa9a2be0-bbb7-48c7-94d8-754311222ff8","Type":"ContainerStarted","Data":"2aa3f6bb5ee11fc2f7326d00e9c33b0e79f4f6e8f8fe179147951ec98e350cda"} Jul 10 18:35:55.492000 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:55.491973 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zj5vw" event={"ID":"2c27eb51-dc64-49a2-9f18-c42a31072ebc","Type":"ContainerStarted","Data":"74167c6770d763f0d389966e5d333c781341e945b7558094bc9c83c1782e4edb"} Jul 10 18:35:55.492119 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:55.492030 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-zj5vw" podUID="2c27eb51-dc64-49a2-9f18-c42a31072ebc" containerName="registry-server" containerID="cri-o://74167c6770d763f0d389966e5d333c781341e945b7558094bc9c83c1782e4edb" gracePeriod=2 Jul 10 18:35:55.514590 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:55.514549 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-nl5np" podStartSLOduration=1.472019579 podStartE2EDuration="3.514534672s" totalImagesPullingTime="2.042515093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:35:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:35:55.513631185 +0000 UTC m=+574.746835458" watchObservedRunningTime="2026-07-10 18:35:55.514534672 +0000 UTC m=+574.747738945" Jul 10 18:35:55.536580 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:55.536540 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zj5vw" podStartSLOduration=1.920637257 podStartE2EDuration="4.536528362s" totalImagesPullingTime="2.615891105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:35:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:35:55.53545899 +0000 UTC m=+574.768663249" watchObservedRunningTime="2026-07-10 18:35:55.536528362 +0000 UTC m=+574.769732620" Jul 10 18:35:55.731080 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:55.731056 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zj5vw" Jul 10 18:35:55.808150 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:55.808089 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgj6x\" (UniqueName: \"kubernetes.io/projected/2c27eb51-dc64-49a2-9f18-c42a31072ebc-kube-api-access-rgj6x\") pod \"2c27eb51-dc64-49a2-9f18-c42a31072ebc\" (UID: \"2c27eb51-dc64-49a2-9f18-c42a31072ebc\") " Jul 10 18:35:55.810164 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:55.810131 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c27eb51-dc64-49a2-9f18-c42a31072ebc-kube-api-access-rgj6x" (OuterVolumeSpecName: "kube-api-access-rgj6x") pod "2c27eb51-dc64-49a2-9f18-c42a31072ebc" (UID: "2c27eb51-dc64-49a2-9f18-c42a31072ebc"). InnerVolumeSpecName "kube-api-access-rgj6x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:35:55.909260 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:55.909233 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgj6x\" (UniqueName: \"kubernetes.io/projected/2c27eb51-dc64-49a2-9f18-c42a31072ebc-kube-api-access-rgj6x\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:35:56.497843 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:56.497809 2564 generic.go:356] "Generic (PLEG): container finished" podID="2c27eb51-dc64-49a2-9f18-c42a31072ebc" containerID="74167c6770d763f0d389966e5d333c781341e945b7558094bc9c83c1782e4edb" exitCode=0 Jul 10 18:35:56.498284 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:56.497859 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zj5vw" Jul 10 18:35:56.498284 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:56.497892 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zj5vw" event={"ID":"2c27eb51-dc64-49a2-9f18-c42a31072ebc","Type":"ContainerDied","Data":"74167c6770d763f0d389966e5d333c781341e945b7558094bc9c83c1782e4edb"} Jul 10 18:35:56.498284 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:56.497945 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zj5vw" event={"ID":"2c27eb51-dc64-49a2-9f18-c42a31072ebc","Type":"ContainerDied","Data":"ec390045b75c07f7a8b6761e8c0a34e1c7256b4a525786303358b10a673d66dd"} Jul 10 18:35:56.498284 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:56.497965 2564 scope.go:117] "RemoveContainer" containerID="74167c6770d763f0d389966e5d333c781341e945b7558094bc9c83c1782e4edb" Jul 10 18:35:56.507540 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:56.507518 2564 scope.go:117] "RemoveContainer" containerID="74167c6770d763f0d389966e5d333c781341e945b7558094bc9c83c1782e4edb" Jul 10 18:35:56.507761 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:35:56.507743 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74167c6770d763f0d389966e5d333c781341e945b7558094bc9c83c1782e4edb\": container with ID starting with 74167c6770d763f0d389966e5d333c781341e945b7558094bc9c83c1782e4edb not found: ID does not exist" containerID="74167c6770d763f0d389966e5d333c781341e945b7558094bc9c83c1782e4edb" Jul 10 18:35:56.507842 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:56.507775 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74167c6770d763f0d389966e5d333c781341e945b7558094bc9c83c1782e4edb"} err="failed to get container status \"74167c6770d763f0d389966e5d333c781341e945b7558094bc9c83c1782e4edb\": rpc error: code = NotFound desc = could not find container \"74167c6770d763f0d389966e5d333c781341e945b7558094bc9c83c1782e4edb\": container with ID starting with 74167c6770d763f0d389966e5d333c781341e945b7558094bc9c83c1782e4edb not found: ID does not exist" Jul 10 18:35:56.519641 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:56.519616 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zj5vw"] Jul 10 18:35:56.525654 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:56.525632 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zj5vw"] Jul 10 18:35:57.406809 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:35:57.406779 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c27eb51-dc64-49a2-9f18-c42a31072ebc" path="/var/lib/kubelet/pods/2c27eb51-dc64-49a2-9f18-c42a31072ebc/volumes" Jul 10 18:36:02.496038 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:02.495998 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-nl5np" Jul 10 18:36:02.496453 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:02.496061 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-nl5np" Jul 10 18:36:02.518286 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:02.518260 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-nl5np" Jul 10 18:36:02.548408 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:02.548382 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-nl5np" Jul 10 18:36:14.611838 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.611806 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5959598658-v4qcv"] Jul 10 18:36:14.612347 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.612191 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c27eb51-dc64-49a2-9f18-c42a31072ebc" containerName="registry-server" Jul 10 18:36:14.612347 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.612204 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c27eb51-dc64-49a2-9f18-c42a31072ebc" containerName="registry-server" Jul 10 18:36:14.612347 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.612288 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c27eb51-dc64-49a2-9f18-c42a31072ebc" containerName="registry-server" Jul 10 18:36:14.616756 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.616736 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:14.628912 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.628888 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5959598658-v4qcv"] Jul 10 18:36:14.756115 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.756088 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fca142b2-ae40-47a0-ba7e-3023560eb010-oauth-serving-cert\") pod \"console-5959598658-v4qcv\" (UID: \"fca142b2-ae40-47a0-ba7e-3023560eb010\") " pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:14.756276 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.756130 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fca142b2-ae40-47a0-ba7e-3023560eb010-console-oauth-config\") pod \"console-5959598658-v4qcv\" (UID: \"fca142b2-ae40-47a0-ba7e-3023560eb010\") " pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:14.756276 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.756146 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7gl6\" (UniqueName: \"kubernetes.io/projected/fca142b2-ae40-47a0-ba7e-3023560eb010-kube-api-access-p7gl6\") pod \"console-5959598658-v4qcv\" (UID: \"fca142b2-ae40-47a0-ba7e-3023560eb010\") " pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:14.756276 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.756171 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fca142b2-ae40-47a0-ba7e-3023560eb010-console-serving-cert\") pod \"console-5959598658-v4qcv\" (UID: \"fca142b2-ae40-47a0-ba7e-3023560eb010\") " pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:14.756276 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.756228 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fca142b2-ae40-47a0-ba7e-3023560eb010-console-config\") pod \"console-5959598658-v4qcv\" (UID: \"fca142b2-ae40-47a0-ba7e-3023560eb010\") " pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:14.756276 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.756248 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fca142b2-ae40-47a0-ba7e-3023560eb010-service-ca\") pod \"console-5959598658-v4qcv\" (UID: \"fca142b2-ae40-47a0-ba7e-3023560eb010\") " pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:14.756276 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.756267 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca142b2-ae40-47a0-ba7e-3023560eb010-trusted-ca-bundle\") pod \"console-5959598658-v4qcv\" (UID: \"fca142b2-ae40-47a0-ba7e-3023560eb010\") " pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:14.857247 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.857213 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fca142b2-ae40-47a0-ba7e-3023560eb010-oauth-serving-cert\") pod \"console-5959598658-v4qcv\" (UID: \"fca142b2-ae40-47a0-ba7e-3023560eb010\") " pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:14.857401 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.857255 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fca142b2-ae40-47a0-ba7e-3023560eb010-console-oauth-config\") pod \"console-5959598658-v4qcv\" (UID: \"fca142b2-ae40-47a0-ba7e-3023560eb010\") " pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:14.857401 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.857271 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7gl6\" (UniqueName: \"kubernetes.io/projected/fca142b2-ae40-47a0-ba7e-3023560eb010-kube-api-access-p7gl6\") pod \"console-5959598658-v4qcv\" (UID: \"fca142b2-ae40-47a0-ba7e-3023560eb010\") " pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:14.857401 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.857301 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fca142b2-ae40-47a0-ba7e-3023560eb010-console-serving-cert\") pod \"console-5959598658-v4qcv\" (UID: \"fca142b2-ae40-47a0-ba7e-3023560eb010\") " pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:14.857401 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.857340 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fca142b2-ae40-47a0-ba7e-3023560eb010-console-config\") pod \"console-5959598658-v4qcv\" (UID: \"fca142b2-ae40-47a0-ba7e-3023560eb010\") " pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:14.857401 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.857356 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fca142b2-ae40-47a0-ba7e-3023560eb010-service-ca\") pod \"console-5959598658-v4qcv\" (UID: \"fca142b2-ae40-47a0-ba7e-3023560eb010\") " pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:14.857401 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.857384 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca142b2-ae40-47a0-ba7e-3023560eb010-trusted-ca-bundle\") pod \"console-5959598658-v4qcv\" (UID: \"fca142b2-ae40-47a0-ba7e-3023560eb010\") " pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:14.858126 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.858098 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fca142b2-ae40-47a0-ba7e-3023560eb010-oauth-serving-cert\") pod \"console-5959598658-v4qcv\" (UID: \"fca142b2-ae40-47a0-ba7e-3023560eb010\") " pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:14.858252 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.858145 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fca142b2-ae40-47a0-ba7e-3023560eb010-console-config\") pod \"console-5959598658-v4qcv\" (UID: \"fca142b2-ae40-47a0-ba7e-3023560eb010\") " pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:14.858252 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.858207 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fca142b2-ae40-47a0-ba7e-3023560eb010-service-ca\") pod \"console-5959598658-v4qcv\" (UID: \"fca142b2-ae40-47a0-ba7e-3023560eb010\") " pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:14.858252 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.858218 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca142b2-ae40-47a0-ba7e-3023560eb010-trusted-ca-bundle\") pod \"console-5959598658-v4qcv\" (UID: \"fca142b2-ae40-47a0-ba7e-3023560eb010\") " pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:14.859748 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.859696 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fca142b2-ae40-47a0-ba7e-3023560eb010-console-serving-cert\") pod \"console-5959598658-v4qcv\" (UID: \"fca142b2-ae40-47a0-ba7e-3023560eb010\") " pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:14.859837 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.859788 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fca142b2-ae40-47a0-ba7e-3023560eb010-console-oauth-config\") pod \"console-5959598658-v4qcv\" (UID: \"fca142b2-ae40-47a0-ba7e-3023560eb010\") " pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:14.868750 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.868671 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7gl6\" (UniqueName: \"kubernetes.io/projected/fca142b2-ae40-47a0-ba7e-3023560eb010-kube-api-access-p7gl6\") pod \"console-5959598658-v4qcv\" (UID: \"fca142b2-ae40-47a0-ba7e-3023560eb010\") " pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:14.926674 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:14.926651 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:15.066982 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:15.066944 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5959598658-v4qcv"] Jul 10 18:36:15.069197 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:36:15.069168 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfca142b2_ae40_47a0_ba7e_3023560eb010.slice/crio-4e9816a0ebce4c8d906dca6dc5a1a91a7ff47ad2d25975711ab24388fa96543b WatchSource:0}: Error finding container 4e9816a0ebce4c8d906dca6dc5a1a91a7ff47ad2d25975711ab24388fa96543b: Status 404 returned error can't find the container with id 4e9816a0ebce4c8d906dca6dc5a1a91a7ff47ad2d25975711ab24388fa96543b Jul 10 18:36:15.584059 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:15.584018 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5959598658-v4qcv" event={"ID":"fca142b2-ae40-47a0-ba7e-3023560eb010","Type":"ContainerStarted","Data":"86d0b11d16e442d2d65e551fe88cf219bde5534986cb9340081b5f01aace3673"} Jul 10 18:36:15.584197 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:15.584106 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5959598658-v4qcv" event={"ID":"fca142b2-ae40-47a0-ba7e-3023560eb010","Type":"ContainerStarted","Data":"4e9816a0ebce4c8d906dca6dc5a1a91a7ff47ad2d25975711ab24388fa96543b"} Jul 10 18:36:15.608342 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:15.608289 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5959598658-v4qcv" podStartSLOduration=1.60827553 podStartE2EDuration="1.60827553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:36:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:36:15.607592904 +0000 UTC m=+594.840797163" watchObservedRunningTime="2026-07-10 18:36:15.60827553 +0000 UTC m=+594.841479871" Jul 10 18:36:21.005366 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:21.005332 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh"] Jul 10 18:36:21.008906 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:21.008865 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh" Jul 10 18:36:21.014723 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:21.014677 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bwhwp\"" Jul 10 18:36:21.026496 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:21.026464 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh"] Jul 10 18:36:21.107005 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:21.106976 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9a2b82e-1332-4970-9124-1b5168e2c4ee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jvkfh\" (UID: \"f9a2b82e-1332-4970-9124-1b5168e2c4ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh" Jul 10 18:36:21.107112 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:21.107090 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grhs4\" (UniqueName: \"kubernetes.io/projected/f9a2b82e-1332-4970-9124-1b5168e2c4ee-kube-api-access-grhs4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jvkfh\" (UID: \"f9a2b82e-1332-4970-9124-1b5168e2c4ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh" Jul 10 18:36:21.174896 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:21.174870 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5gqq_cfa37e72-ee06-4ff3-996e-d535b0d28d84/console-operator/1.log" Jul 10 18:36:21.175022 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:21.174875 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5gqq_cfa37e72-ee06-4ff3-996e-d535b0d28d84/console-operator/1.log" Jul 10 18:36:21.181649 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:21.181632 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gfnq_873ff093-ab5b-412b-abad-220e0bb4acc3/ovn-acl-logging/0.log" Jul 10 18:36:21.181782 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:21.181635 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gfnq_873ff093-ab5b-412b-abad-220e0bb4acc3/ovn-acl-logging/0.log" Jul 10 18:36:21.208272 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:21.208247 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grhs4\" (UniqueName: \"kubernetes.io/projected/f9a2b82e-1332-4970-9124-1b5168e2c4ee-kube-api-access-grhs4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jvkfh\" (UID: \"f9a2b82e-1332-4970-9124-1b5168e2c4ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh" Jul 10 18:36:21.208362 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:21.208288 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9a2b82e-1332-4970-9124-1b5168e2c4ee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jvkfh\" (UID: \"f9a2b82e-1332-4970-9124-1b5168e2c4ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh" Jul 10 18:36:21.208571 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:21.208557 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9a2b82e-1332-4970-9124-1b5168e2c4ee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jvkfh\" (UID: \"f9a2b82e-1332-4970-9124-1b5168e2c4ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh" Jul 10 18:36:21.219589 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:21.219559 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grhs4\" (UniqueName: \"kubernetes.io/projected/f9a2b82e-1332-4970-9124-1b5168e2c4ee-kube-api-access-grhs4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jvkfh\" (UID: \"f9a2b82e-1332-4970-9124-1b5168e2c4ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh" Jul 10 18:36:21.321751 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:21.321676 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bwhwp\"" Jul 10 18:36:21.329866 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:21.329844 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh" Jul 10 18:36:21.468018 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:21.467994 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh"] Jul 10 18:36:21.470198 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:36:21.470170 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9a2b82e_1332_4970_9124_1b5168e2c4ee.slice/crio-677e712966c5931f9f4fbe9b676bdf9fe72ddb74197aed59931659f71931ce13 WatchSource:0}: Error finding container 677e712966c5931f9f4fbe9b676bdf9fe72ddb74197aed59931659f71931ce13: Status 404 returned error can't find the container with id 677e712966c5931f9f4fbe9b676bdf9fe72ddb74197aed59931659f71931ce13 Jul 10 18:36:21.613720 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:21.613638 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh" event={"ID":"f9a2b82e-1332-4970-9124-1b5168e2c4ee","Type":"ContainerStarted","Data":"677e712966c5931f9f4fbe9b676bdf9fe72ddb74197aed59931659f71931ce13"} Jul 10 18:36:24.926866 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:24.926835 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:24.929358 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:24.926920 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:24.932742 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:24.932719 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:25.637914 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:25.637885 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5959598658-v4qcv" Jul 10 18:36:25.689875 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:25.689837 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c976445c6-d4snx"] Jul 10 18:36:25.993454 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:25.993418 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-qwfcp"] Jul 10 18:36:25.996926 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:25.996909 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qwfcp" Jul 10 18:36:26.007052 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:26.007032 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-gsrwl\"" Jul 10 18:36:26.011527 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:26.011504 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-qwfcp"] Jul 10 18:36:26.050488 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:26.050461 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t56qs\" (UniqueName: \"kubernetes.io/projected/17c957ee-d78e-4661-8d63-9c1c310d45af-kube-api-access-t56qs\") pod \"authorino-operator-75cc8d5cb7-qwfcp\" (UID: \"17c957ee-d78e-4661-8d63-9c1c310d45af\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-qwfcp" Jul 10 18:36:26.151769 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:26.151744 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t56qs\" (UniqueName: \"kubernetes.io/projected/17c957ee-d78e-4661-8d63-9c1c310d45af-kube-api-access-t56qs\") pod \"authorino-operator-75cc8d5cb7-qwfcp\" (UID: \"17c957ee-d78e-4661-8d63-9c1c310d45af\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-qwfcp" Jul 10 18:36:26.161320 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:26.161276 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t56qs\" (UniqueName: \"kubernetes.io/projected/17c957ee-d78e-4661-8d63-9c1c310d45af-kube-api-access-t56qs\") pod \"authorino-operator-75cc8d5cb7-qwfcp\" (UID: \"17c957ee-d78e-4661-8d63-9c1c310d45af\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-qwfcp" Jul 10 18:36:26.306886 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:26.306822 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qwfcp" Jul 10 18:36:26.450420 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:26.450389 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-qwfcp"] Jul 10 18:36:26.453825 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:36:26.453782 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17c957ee_d78e_4661_8d63_9c1c310d45af.slice/crio-4dd19e62129f224db64a1858c26e33d11b9b6f476410b78a6c36f83fcadb0fa4 WatchSource:0}: Error finding container 4dd19e62129f224db64a1858c26e33d11b9b6f476410b78a6c36f83fcadb0fa4: Status 404 returned error can't find the container with id 4dd19e62129f224db64a1858c26e33d11b9b6f476410b78a6c36f83fcadb0fa4 Jul 10 18:36:26.640205 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:26.640135 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qwfcp" event={"ID":"17c957ee-d78e-4661-8d63-9c1c310d45af","Type":"ContainerStarted","Data":"4dd19e62129f224db64a1858c26e33d11b9b6f476410b78a6c36f83fcadb0fa4"} Jul 10 18:36:30.664520 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:30.664437 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh" event={"ID":"f9a2b82e-1332-4970-9124-1b5168e2c4ee","Type":"ContainerStarted","Data":"6d894164b327db71078299da3dc9e82227216e1719fb40e89fe083eb9259d60f"} Jul 10 18:36:30.664970 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:30.664642 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh" Jul 10 18:36:30.666131 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:30.666105 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qwfcp" event={"ID":"17c957ee-d78e-4661-8d63-9c1c310d45af","Type":"ContainerStarted","Data":"f1d9205ff4451e6f954eef44cf4ddf1b9ba2c5d8f6af95c2fdbf8e3e8d3dd59e"} Jul 10 18:36:30.666258 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:30.666232 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qwfcp" Jul 10 18:36:30.688269 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:30.688222 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh" podStartSLOduration=1.9143938010000001 podStartE2EDuration="10.68821039s" totalImagesPullingTime="8.773816589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:36:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:36:30.68558922 +0000 UTC m=+609.918793479" watchObservedRunningTime="2026-07-10 18:36:30.68821039 +0000 UTC m=+609.921414648" Jul 10 18:36:30.706149 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:30.706102 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qwfcp" podStartSLOduration=1.9251777479999999 podStartE2EDuration="5.706087538s" totalImagesPullingTime="3.78090979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:36:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:36:30.704302045 +0000 UTC m=+609.937506313" watchObservedRunningTime="2026-07-10 18:36:30.706087538 +0000 UTC m=+609.939291796" Jul 10 18:36:32.986988 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:32.986957 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5xb65"] Jul 10 18:36:32.989298 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:32.989277 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xb65" Jul 10 18:36:32.991722 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:32.991685 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 10 18:36:32.991722 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:32.991716 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 10 18:36:32.991872 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:32.991734 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jl9r5\"" Jul 10 18:36:33.000748 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:33.000724 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5xb65"] Jul 10 18:36:33.009235 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:33.009212 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ebecdd62-f455-4a5b-a04c-01435ce434b3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5xb65\" (UID: \"ebecdd62-f455-4a5b-a04c-01435ce434b3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xb65" Jul 10 18:36:33.009332 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:33.009256 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx4fr\" (UniqueName: \"kubernetes.io/projected/ebecdd62-f455-4a5b-a04c-01435ce434b3-kube-api-access-rx4fr\") pod \"kuadrant-console-plugin-66b5774985-5xb65\" (UID: \"ebecdd62-f455-4a5b-a04c-01435ce434b3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xb65" Jul 10 18:36:33.009393 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:33.009365 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ebecdd62-f455-4a5b-a04c-01435ce434b3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5xb65\" (UID: \"ebecdd62-f455-4a5b-a04c-01435ce434b3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xb65" Jul 10 18:36:33.110065 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:33.110034 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ebecdd62-f455-4a5b-a04c-01435ce434b3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5xb65\" (UID: \"ebecdd62-f455-4a5b-a04c-01435ce434b3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xb65" Jul 10 18:36:33.110225 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:33.110084 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx4fr\" (UniqueName: \"kubernetes.io/projected/ebecdd62-f455-4a5b-a04c-01435ce434b3-kube-api-access-rx4fr\") pod \"kuadrant-console-plugin-66b5774985-5xb65\" (UID: \"ebecdd62-f455-4a5b-a04c-01435ce434b3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xb65" Jul 10 18:36:33.110225 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:33.110157 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ebecdd62-f455-4a5b-a04c-01435ce434b3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5xb65\" (UID: \"ebecdd62-f455-4a5b-a04c-01435ce434b3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xb65" Jul 10 18:36:33.110225 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:36:33.110176 2564 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 10 18:36:33.110389 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:36:33.110237 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebecdd62-f455-4a5b-a04c-01435ce434b3-plugin-serving-cert podName:ebecdd62-f455-4a5b-a04c-01435ce434b3 nodeName:}" failed. No retries permitted until 2026-07-10 18:36:33.610220317 +0000 UTC m=+612.843424554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/ebecdd62-f455-4a5b-a04c-01435ce434b3-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-5xb65" (UID: "ebecdd62-f455-4a5b-a04c-01435ce434b3") : secret "plugin-serving-cert" not found Jul 10 18:36:33.110838 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:33.110819 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ebecdd62-f455-4a5b-a04c-01435ce434b3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5xb65\" (UID: \"ebecdd62-f455-4a5b-a04c-01435ce434b3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xb65" Jul 10 18:36:33.128268 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:33.128244 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx4fr\" (UniqueName: \"kubernetes.io/projected/ebecdd62-f455-4a5b-a04c-01435ce434b3-kube-api-access-rx4fr\") pod \"kuadrant-console-plugin-66b5774985-5xb65\" (UID: \"ebecdd62-f455-4a5b-a04c-01435ce434b3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xb65" Jul 10 18:36:33.614990 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:33.614957 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ebecdd62-f455-4a5b-a04c-01435ce434b3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5xb65\" (UID: \"ebecdd62-f455-4a5b-a04c-01435ce434b3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xb65" Jul 10 18:36:33.617266 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:33.617243 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ebecdd62-f455-4a5b-a04c-01435ce434b3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5xb65\" (UID: \"ebecdd62-f455-4a5b-a04c-01435ce434b3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xb65" Jul 10 18:36:33.897968 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:33.897890 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xb65" Jul 10 18:36:34.034353 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:34.034327 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5xb65"] Jul 10 18:36:34.036502 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:36:34.036473 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podebecdd62_f455_4a5b_a04c_01435ce434b3.slice/crio-bc0cb5ac6f1018fdd0dd18f925d7e269f944ee2200b89ea4b0cf0130d5e9f02d WatchSource:0}: Error finding container bc0cb5ac6f1018fdd0dd18f925d7e269f944ee2200b89ea4b0cf0130d5e9f02d: Status 404 returned error can't find the container with id bc0cb5ac6f1018fdd0dd18f925d7e269f944ee2200b89ea4b0cf0130d5e9f02d Jul 10 18:36:34.685886 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:34.685846 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xb65" event={"ID":"ebecdd62-f455-4a5b-a04c-01435ce434b3","Type":"ContainerStarted","Data":"bc0cb5ac6f1018fdd0dd18f925d7e269f944ee2200b89ea4b0cf0130d5e9f02d"} Jul 10 18:36:41.674285 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:41.674249 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-qwfcp" Jul 10 18:36:41.674716 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:41.674442 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh" Jul 10 18:36:43.477784 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.477680 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2tnd"] Jul 10 18:36:43.483741 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.483693 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2tnd" Jul 10 18:36:43.495047 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.495018 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2tnd"] Jul 10 18:36:43.567522 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.567486 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh"] Jul 10 18:36:43.567773 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.567725 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh" podUID="f9a2b82e-1332-4970-9124-1b5168e2c4ee" containerName="manager" containerID="cri-o://6d894164b327db71078299da3dc9e82227216e1719fb40e89fe083eb9259d60f" gracePeriod=2 Jul 10 18:36:43.576214 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.576153 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh"] Jul 10 18:36:43.582417 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:36:43.582313 2564 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f9a2b82e-1332-4970-9124-1b5168e2c4ee\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-jvkfh\": pods \"kuadrant-operator-controller-manager-8684c9ff49-jvkfh\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh" Jul 10 18:36:43.592246 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.592208 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2tnd"] Jul 10 18:36:43.592607 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:36:43.592576 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-42vnp], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2tnd" podUID="07210afb-94ed-4cb0-8b49-70eba553f4b9" Jul 10 18:36:43.594199 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.594179 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhpbt"] Jul 10 18:36:43.594645 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.594629 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9a2b82e-1332-4970-9124-1b5168e2c4ee" containerName="manager" Jul 10 18:36:43.594645 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.594646 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9a2b82e-1332-4970-9124-1b5168e2c4ee" containerName="manager" Jul 10 18:36:43.594817 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.594745 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9a2b82e-1332-4970-9124-1b5168e2c4ee" containerName="manager" Jul 10 18:36:43.597015 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.596994 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhpbt" Jul 10 18:36:43.602496 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.602449 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2tnd"] Jul 10 18:36:43.603417 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:36:43.603377 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jvkfh\" is forbidden: User \"system:node:ip-10-0-136-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-57.ec2.internal' and this object" podUID="f9a2b82e-1332-4970-9124-1b5168e2c4ee" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh" Jul 10 18:36:43.614212 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.614156 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhpbt"] Jul 10 18:36:43.616431 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.616405 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42vnp\" (UniqueName: \"kubernetes.io/projected/07210afb-94ed-4cb0-8b49-70eba553f4b9-kube-api-access-42vnp\") pod \"kuadrant-operator-controller-manager-86878c769f-l2tnd\" (UID: \"07210afb-94ed-4cb0-8b49-70eba553f4b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2tnd" Jul 10 18:36:43.616534 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.616464 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07210afb-94ed-4cb0-8b49-70eba553f4b9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-l2tnd\" (UID: \"07210afb-94ed-4cb0-8b49-70eba553f4b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2tnd" Jul 10 18:36:43.629052 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.629027 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5h2k"] Jul 10 18:36:43.631908 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.631885 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5h2k" Jul 10 18:36:43.634534 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:36:43.634355 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jvkfh\" is forbidden: User \"system:node:ip-10-0-136-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-57.ec2.internal' and this object" podUID="f9a2b82e-1332-4970-9124-1b5168e2c4ee" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh" Jul 10 18:36:43.651124 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.651096 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5h2k"] Jul 10 18:36:43.717318 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.717281 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42vnp\" (UniqueName: \"kubernetes.io/projected/07210afb-94ed-4cb0-8b49-70eba553f4b9-kube-api-access-42vnp\") pod \"kuadrant-operator-controller-manager-86878c769f-l2tnd\" (UID: \"07210afb-94ed-4cb0-8b49-70eba553f4b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2tnd" Jul 10 18:36:43.717481 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.717331 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgjh4\" (UniqueName: \"kubernetes.io/projected/6838b025-bfb1-4fe9-8f63-4a00bd8328ca-kube-api-access-jgjh4\") pod \"kuadrant-operator-controller-manager-86878c769f-n5h2k\" (UID: \"6838b025-bfb1-4fe9-8f63-4a00bd8328ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5h2k" Jul 10 18:36:43.717481 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.717368 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd548e75-d2a2-47db-bbd1-9a942f7f8a3b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xhpbt\" (UID: \"fd548e75-d2a2-47db-bbd1-9a942f7f8a3b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhpbt" Jul 10 18:36:43.717481 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.717400 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt2sg\" (UniqueName: \"kubernetes.io/projected/fd548e75-d2a2-47db-bbd1-9a942f7f8a3b-kube-api-access-mt2sg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xhpbt\" (UID: \"fd548e75-d2a2-47db-bbd1-9a942f7f8a3b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhpbt" Jul 10 18:36:43.717481 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.717426 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6838b025-bfb1-4fe9-8f63-4a00bd8328ca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n5h2k\" (UID: \"6838b025-bfb1-4fe9-8f63-4a00bd8328ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5h2k" Jul 10 18:36:43.717481 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.717472 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07210afb-94ed-4cb0-8b49-70eba553f4b9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-l2tnd\" (UID: \"07210afb-94ed-4cb0-8b49-70eba553f4b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2tnd" Jul 10 18:36:43.717877 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.717854 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07210afb-94ed-4cb0-8b49-70eba553f4b9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-l2tnd\" (UID: \"07210afb-94ed-4cb0-8b49-70eba553f4b9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2tnd" Jul 10 18:36:43.721945 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:36:43.721915 2564 projected.go:196] Error preparing data for projected volume kube-api-access-42vnp for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2tnd: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-l2tnd" not found Jul 10 18:36:43.722068 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:36:43.722001 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07210afb-94ed-4cb0-8b49-70eba553f4b9-kube-api-access-42vnp podName:07210afb-94ed-4cb0-8b49-70eba553f4b9 nodeName:}" failed. No retries permitted until 2026-07-10 18:36:44.221982497 +0000 UTC m=+623.455186734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-42vnp" (UniqueName: "kubernetes.io/projected/07210afb-94ed-4cb0-8b49-70eba553f4b9-kube-api-access-42vnp") pod "kuadrant-operator-controller-manager-86878c769f-l2tnd" (UID: "07210afb-94ed-4cb0-8b49-70eba553f4b9") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-l2tnd" not found Jul 10 18:36:43.735503 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.735441 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2tnd" Jul 10 18:36:43.737918 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:36:43.737886 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-l2tnd\" is forbidden: User \"system:node:ip-10-0-136-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-57.ec2.internal' and this object" podUID="07210afb-94ed-4cb0-8b49-70eba553f4b9" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2tnd" Jul 10 18:36:43.739903 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:36:43.739878 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jvkfh\" is forbidden: User \"system:node:ip-10-0-136-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-57.ec2.internal' and this object" podUID="f9a2b82e-1332-4970-9124-1b5168e2c4ee" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh" Jul 10 18:36:43.742008 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.741989 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2tnd" Jul 10 18:36:43.744039 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:36:43.744011 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-l2tnd\" is forbidden: User \"system:node:ip-10-0-136-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-57.ec2.internal' and this object" podUID="07210afb-94ed-4cb0-8b49-70eba553f4b9" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2tnd" Jul 10 18:36:43.745860 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:36:43.745835 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jvkfh\" is forbidden: User \"system:node:ip-10-0-136-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-57.ec2.internal' and this object" podUID="f9a2b82e-1332-4970-9124-1b5168e2c4ee" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh" Jul 10 18:36:43.818524 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.818494 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07210afb-94ed-4cb0-8b49-70eba553f4b9-extensions-socket-volume\") pod \"07210afb-94ed-4cb0-8b49-70eba553f4b9\" (UID: \"07210afb-94ed-4cb0-8b49-70eba553f4b9\") " Jul 10 18:36:43.818773 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.818748 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgjh4\" (UniqueName: \"kubernetes.io/projected/6838b025-bfb1-4fe9-8f63-4a00bd8328ca-kube-api-access-jgjh4\") pod \"kuadrant-operator-controller-manager-86878c769f-n5h2k\" (UID: \"6838b025-bfb1-4fe9-8f63-4a00bd8328ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5h2k" Jul 10 18:36:43.818912 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.818791 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd548e75-d2a2-47db-bbd1-9a942f7f8a3b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xhpbt\" (UID: \"fd548e75-d2a2-47db-bbd1-9a942f7f8a3b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhpbt" Jul 10 18:36:43.818912 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.818804 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07210afb-94ed-4cb0-8b49-70eba553f4b9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "07210afb-94ed-4cb0-8b49-70eba553f4b9" (UID: "07210afb-94ed-4cb0-8b49-70eba553f4b9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:36:43.818912 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.818822 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt2sg\" (UniqueName: \"kubernetes.io/projected/fd548e75-d2a2-47db-bbd1-9a942f7f8a3b-kube-api-access-mt2sg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xhpbt\" (UID: \"fd548e75-d2a2-47db-bbd1-9a942f7f8a3b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhpbt" Jul 10 18:36:43.818912 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.818865 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6838b025-bfb1-4fe9-8f63-4a00bd8328ca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n5h2k\" (UID: \"6838b025-bfb1-4fe9-8f63-4a00bd8328ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5h2k" Jul 10 18:36:43.819132 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.818971 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42vnp\" (UniqueName: \"kubernetes.io/projected/07210afb-94ed-4cb0-8b49-70eba553f4b9-kube-api-access-42vnp\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:36:43.819132 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.818987 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07210afb-94ed-4cb0-8b49-70eba553f4b9-extensions-socket-volume\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:36:43.819263 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.819240 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd548e75-d2a2-47db-bbd1-9a942f7f8a3b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xhpbt\" (UID: \"fd548e75-d2a2-47db-bbd1-9a942f7f8a3b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhpbt" Jul 10 18:36:43.819335 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.819315 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6838b025-bfb1-4fe9-8f63-4a00bd8328ca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n5h2k\" (UID: \"6838b025-bfb1-4fe9-8f63-4a00bd8328ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5h2k" Jul 10 18:36:43.831219 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.831193 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt2sg\" (UniqueName: \"kubernetes.io/projected/fd548e75-d2a2-47db-bbd1-9a942f7f8a3b-kube-api-access-mt2sg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xhpbt\" (UID: \"fd548e75-d2a2-47db-bbd1-9a942f7f8a3b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhpbt" Jul 10 18:36:43.831352 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.831232 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgjh4\" (UniqueName: \"kubernetes.io/projected/6838b025-bfb1-4fe9-8f63-4a00bd8328ca-kube-api-access-jgjh4\") pod \"kuadrant-operator-controller-manager-86878c769f-n5h2k\" (UID: \"6838b025-bfb1-4fe9-8f63-4a00bd8328ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5h2k" Jul 10 18:36:43.943679 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.943644 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhpbt" Jul 10 18:36:43.953634 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:43.953601 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5h2k" Jul 10 18:36:44.741288 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:44.741257 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2tnd" Jul 10 18:36:44.744456 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:36:44.744421 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-l2tnd\" is forbidden: User \"system:node:ip-10-0-136-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-57.ec2.internal' and this object" podUID="07210afb-94ed-4cb0-8b49-70eba553f4b9" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2tnd" Jul 10 18:36:44.747313 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:36:44.747281 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jvkfh\" is forbidden: User \"system:node:ip-10-0-136-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-57.ec2.internal' and this object" podUID="f9a2b82e-1332-4970-9124-1b5168e2c4ee" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh" Jul 10 18:36:44.751308 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:36:44.751275 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jvkfh\" is forbidden: User \"system:node:ip-10-0-136-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-57.ec2.internal' and this object" podUID="f9a2b82e-1332-4970-9124-1b5168e2c4ee" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh" Jul 10 18:36:44.753646 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:36:44.753606 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-l2tnd\" is forbidden: User \"system:node:ip-10-0-136-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-57.ec2.internal' and this object" podUID="07210afb-94ed-4cb0-8b49-70eba553f4b9" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l2tnd" Jul 10 18:36:45.413448 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:45.413407 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07210afb-94ed-4cb0-8b49-70eba553f4b9" path="/var/lib/kubelet/pods/07210afb-94ed-4cb0-8b49-70eba553f4b9/volumes" Jul 10 18:36:50.715844 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:50.715801 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c976445c6-d4snx" podUID="22b8ef71-2c71-427a-80d4-4fac53ec43d3" containerName="console" containerID="cri-o://f0cd29953343e0a4ae8b85e87c6aa0cce6b702c54623d896415be519649a6172" gracePeriod=15 Jul 10 18:36:56.456942 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.456918 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:36:56.470183 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.470119 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhpbt"] Jul 10 18:36:56.471987 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.471962 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh" Jul 10 18:36:56.472833 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:36:56.472809 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd548e75_d2a2_47db_bbd1_9a942f7f8a3b.slice/crio-f52c38fbf9d769872853df45d96ce19989bfb5b9d483a1bde27d1a3f693d7f14 WatchSource:0}: Error finding container f52c38fbf9d769872853df45d96ce19989bfb5b9d483a1bde27d1a3f693d7f14: Status 404 returned error can't find the container with id f52c38fbf9d769872853df45d96ce19989bfb5b9d483a1bde27d1a3f693d7f14 Jul 10 18:36:56.480285 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:36:56.480246 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jvkfh\" is forbidden: User \"system:node:ip-10-0-136-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-57.ec2.internal' and this object" podUID="f9a2b82e-1332-4970-9124-1b5168e2c4ee" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh" Jul 10 18:36:56.502007 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.501984 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5h2k"] Jul 10 18:36:56.503654 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:36:56.503633 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6838b025_bfb1_4fe9_8f63_4a00bd8328ca.slice/crio-66cf17771e387b819135e9db00c59e12f7eae11da18584540aec984157295a2b WatchSource:0}: Error finding container 66cf17771e387b819135e9db00c59e12f7eae11da18584540aec984157295a2b: Status 404 returned error can't find the container with id 66cf17771e387b819135e9db00c59e12f7eae11da18584540aec984157295a2b Jul 10 18:36:56.538881 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.538853 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22b8ef71-2c71-427a-80d4-4fac53ec43d3-trusted-ca-bundle\") pod \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " Jul 10 18:36:56.538969 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.538913 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22b8ef71-2c71-427a-80d4-4fac53ec43d3-console-config\") pod \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " Jul 10 18:36:56.539031 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.538967 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfc9p\" (UniqueName: \"kubernetes.io/projected/22b8ef71-2c71-427a-80d4-4fac53ec43d3-kube-api-access-cfc9p\") pod \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " Jul 10 18:36:56.539087 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.539049 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22b8ef71-2c71-427a-80d4-4fac53ec43d3-console-oauth-config\") pod \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " Jul 10 18:36:56.539141 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.539099 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22b8ef71-2c71-427a-80d4-4fac53ec43d3-console-serving-cert\") pod \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " Jul 10 18:36:56.539193 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.539163 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22b8ef71-2c71-427a-80d4-4fac53ec43d3-oauth-serving-cert\") pod \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " Jul 10 18:36:56.539193 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.539187 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22b8ef71-2c71-427a-80d4-4fac53ec43d3-service-ca\") pod \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\" (UID: \"22b8ef71-2c71-427a-80d4-4fac53ec43d3\") " Jul 10 18:36:56.539296 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.539224 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22b8ef71-2c71-427a-80d4-4fac53ec43d3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "22b8ef71-2c71-427a-80d4-4fac53ec43d3" (UID: "22b8ef71-2c71-427a-80d4-4fac53ec43d3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:36:56.539395 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.539323 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22b8ef71-2c71-427a-80d4-4fac53ec43d3-console-config" (OuterVolumeSpecName: "console-config") pod "22b8ef71-2c71-427a-80d4-4fac53ec43d3" (UID: "22b8ef71-2c71-427a-80d4-4fac53ec43d3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:36:56.539562 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.539520 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22b8ef71-2c71-427a-80d4-4fac53ec43d3-trusted-ca-bundle\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:36:56.539562 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.539544 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22b8ef71-2c71-427a-80d4-4fac53ec43d3-console-config\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:36:56.539689 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.539656 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22b8ef71-2c71-427a-80d4-4fac53ec43d3-service-ca" (OuterVolumeSpecName: "service-ca") pod "22b8ef71-2c71-427a-80d4-4fac53ec43d3" (UID: "22b8ef71-2c71-427a-80d4-4fac53ec43d3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:36:56.539689 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.539662 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22b8ef71-2c71-427a-80d4-4fac53ec43d3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "22b8ef71-2c71-427a-80d4-4fac53ec43d3" (UID: "22b8ef71-2c71-427a-80d4-4fac53ec43d3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 18:36:56.541270 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.541245 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22b8ef71-2c71-427a-80d4-4fac53ec43d3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "22b8ef71-2c71-427a-80d4-4fac53ec43d3" (UID: "22b8ef71-2c71-427a-80d4-4fac53ec43d3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:36:56.541462 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.541445 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22b8ef71-2c71-427a-80d4-4fac53ec43d3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "22b8ef71-2c71-427a-80d4-4fac53ec43d3" (UID: "22b8ef71-2c71-427a-80d4-4fac53ec43d3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:36:56.541926 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.541909 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22b8ef71-2c71-427a-80d4-4fac53ec43d3-kube-api-access-cfc9p" (OuterVolumeSpecName: "kube-api-access-cfc9p") pod "22b8ef71-2c71-427a-80d4-4fac53ec43d3" (UID: "22b8ef71-2c71-427a-80d4-4fac53ec43d3"). InnerVolumeSpecName "kube-api-access-cfc9p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:36:56.640825 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.640798 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9a2b82e-1332-4970-9124-1b5168e2c4ee-extensions-socket-volume\") pod \"f9a2b82e-1332-4970-9124-1b5168e2c4ee\" (UID: \"f9a2b82e-1332-4970-9124-1b5168e2c4ee\") " Jul 10 18:36:56.640983 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.640917 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grhs4\" (UniqueName: \"kubernetes.io/projected/f9a2b82e-1332-4970-9124-1b5168e2c4ee-kube-api-access-grhs4\") pod \"f9a2b82e-1332-4970-9124-1b5168e2c4ee\" (UID: \"f9a2b82e-1332-4970-9124-1b5168e2c4ee\") " Jul 10 18:36:56.641194 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.641174 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22b8ef71-2c71-427a-80d4-4fac53ec43d3-service-ca\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:36:56.641287 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.641196 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfc9p\" (UniqueName: \"kubernetes.io/projected/22b8ef71-2c71-427a-80d4-4fac53ec43d3-kube-api-access-cfc9p\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:36:56.641287 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.641214 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22b8ef71-2c71-427a-80d4-4fac53ec43d3-console-oauth-config\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:36:56.641287 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.641226 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22b8ef71-2c71-427a-80d4-4fac53ec43d3-console-serving-cert\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:36:56.641287 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.641238 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22b8ef71-2c71-427a-80d4-4fac53ec43d3-oauth-serving-cert\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:36:56.641448 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.641331 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9a2b82e-1332-4970-9124-1b5168e2c4ee-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f9a2b82e-1332-4970-9124-1b5168e2c4ee" (UID: "f9a2b82e-1332-4970-9124-1b5168e2c4ee"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:36:56.643208 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.643183 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9a2b82e-1332-4970-9124-1b5168e2c4ee-kube-api-access-grhs4" (OuterVolumeSpecName: "kube-api-access-grhs4") pod "f9a2b82e-1332-4970-9124-1b5168e2c4ee" (UID: "f9a2b82e-1332-4970-9124-1b5168e2c4ee"). InnerVolumeSpecName "kube-api-access-grhs4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:36:56.742264 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.742230 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9a2b82e-1332-4970-9124-1b5168e2c4ee-extensions-socket-volume\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:36:56.742264 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.742265 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grhs4\" (UniqueName: \"kubernetes.io/projected/f9a2b82e-1332-4970-9124-1b5168e2c4ee-kube-api-access-grhs4\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:36:56.807520 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.807434 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhpbt" event={"ID":"fd548e75-d2a2-47db-bbd1-9a942f7f8a3b","Type":"ContainerStarted","Data":"eb7d9263b8a67e21ecf1d1ee6224a3d4082ab8742223ece9389c2e6edba2cbef"} Jul 10 18:36:56.807520 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.807491 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhpbt" event={"ID":"fd548e75-d2a2-47db-bbd1-9a942f7f8a3b","Type":"ContainerStarted","Data":"f52c38fbf9d769872853df45d96ce19989bfb5b9d483a1bde27d1a3f693d7f14"} Jul 10 18:36:56.807735 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.807554 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhpbt" Jul 10 18:36:56.808930 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.808904 2564 generic.go:356] "Generic (PLEG): container finished" podID="22b8ef71-2c71-427a-80d4-4fac53ec43d3" containerID="f0cd29953343e0a4ae8b85e87c6aa0cce6b702c54623d896415be519649a6172" exitCode=0 Jul 10 18:36:56.809066 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.808947 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c976445c6-d4snx" Jul 10 18:36:56.809066 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.808978 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c976445c6-d4snx" event={"ID":"22b8ef71-2c71-427a-80d4-4fac53ec43d3","Type":"ContainerDied","Data":"f0cd29953343e0a4ae8b85e87c6aa0cce6b702c54623d896415be519649a6172"} Jul 10 18:36:56.809066 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.809024 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c976445c6-d4snx" event={"ID":"22b8ef71-2c71-427a-80d4-4fac53ec43d3","Type":"ContainerDied","Data":"a3b9e0763629e65c1e2430b78109d7a4d1c9aa144280bcd3f362ab98592df5de"} Jul 10 18:36:56.809066 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.809049 2564 scope.go:117] "RemoveContainer" containerID="f0cd29953343e0a4ae8b85e87c6aa0cce6b702c54623d896415be519649a6172" Jul 10 18:36:56.810853 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.810829 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5h2k" event={"ID":"6838b025-bfb1-4fe9-8f63-4a00bd8328ca","Type":"ContainerStarted","Data":"44c078b7fcbafb17a563db29f8a241cdf980a82032e862a49e7840671d4c6dd6"} Jul 10 18:36:56.810981 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.810888 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5h2k" Jul 10 18:36:56.810981 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.810912 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5h2k" event={"ID":"6838b025-bfb1-4fe9-8f63-4a00bd8328ca","Type":"ContainerStarted","Data":"66cf17771e387b819135e9db00c59e12f7eae11da18584540aec984157295a2b"} Jul 10 18:36:56.812267 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.812246 2564 generic.go:356] "Generic (PLEG): container finished" podID="f9a2b82e-1332-4970-9124-1b5168e2c4ee" containerID="6d894164b327db71078299da3dc9e82227216e1719fb40e89fe083eb9259d60f" exitCode=0 Jul 10 18:36:56.812391 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.812289 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh" Jul 10 18:36:56.813885 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.813863 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xb65" event={"ID":"ebecdd62-f455-4a5b-a04c-01435ce434b3","Type":"ContainerStarted","Data":"ff77e843a3fb3fb97a8dba30a7f43fe19c3f9db24ffb3aefd51cec5731fb1f70"} Jul 10 18:36:56.818600 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.818583 2564 scope.go:117] "RemoveContainer" containerID="f0cd29953343e0a4ae8b85e87c6aa0cce6b702c54623d896415be519649a6172" Jul 10 18:36:56.818912 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:36:56.818883 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0cd29953343e0a4ae8b85e87c6aa0cce6b702c54623d896415be519649a6172\": container with ID starting with f0cd29953343e0a4ae8b85e87c6aa0cce6b702c54623d896415be519649a6172 not found: ID does not exist" containerID="f0cd29953343e0a4ae8b85e87c6aa0cce6b702c54623d896415be519649a6172" Jul 10 18:36:56.819011 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.818919 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0cd29953343e0a4ae8b85e87c6aa0cce6b702c54623d896415be519649a6172"} err="failed to get container status \"f0cd29953343e0a4ae8b85e87c6aa0cce6b702c54623d896415be519649a6172\": rpc error: code = NotFound desc = could not find container \"f0cd29953343e0a4ae8b85e87c6aa0cce6b702c54623d896415be519649a6172\": container with ID starting with f0cd29953343e0a4ae8b85e87c6aa0cce6b702c54623d896415be519649a6172 not found: ID does not exist" Jul 10 18:36:56.819011 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.818944 2564 scope.go:117] "RemoveContainer" containerID="6d894164b327db71078299da3dc9e82227216e1719fb40e89fe083eb9259d60f" Jul 10 18:36:56.826792 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.826774 2564 scope.go:117] "RemoveContainer" containerID="6d894164b327db71078299da3dc9e82227216e1719fb40e89fe083eb9259d60f" Jul 10 18:36:56.827064 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:36:56.827044 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d894164b327db71078299da3dc9e82227216e1719fb40e89fe083eb9259d60f\": container with ID starting with 6d894164b327db71078299da3dc9e82227216e1719fb40e89fe083eb9259d60f not found: ID does not exist" containerID="6d894164b327db71078299da3dc9e82227216e1719fb40e89fe083eb9259d60f" Jul 10 18:36:56.827140 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.827067 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d894164b327db71078299da3dc9e82227216e1719fb40e89fe083eb9259d60f"} err="failed to get container status \"6d894164b327db71078299da3dc9e82227216e1719fb40e89fe083eb9259d60f\": rpc error: code = NotFound desc = could not find container \"6d894164b327db71078299da3dc9e82227216e1719fb40e89fe083eb9259d60f\": container with ID starting with 6d894164b327db71078299da3dc9e82227216e1719fb40e89fe083eb9259d60f not found: ID does not exist" Jul 10 18:36:56.835394 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.835346 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhpbt" podStartSLOduration=13.835328588 podStartE2EDuration="13.835328588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:36:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:36:56.834253688 +0000 UTC m=+636.067458038" watchObservedRunningTime="2026-07-10 18:36:56.835328588 +0000 UTC m=+636.068532848" Jul 10 18:36:56.836494 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:36:56.836468 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jvkfh\" is forbidden: User \"system:node:ip-10-0-136-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-57.ec2.internal' and this object" podUID="f9a2b82e-1332-4970-9124-1b5168e2c4ee" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh" Jul 10 18:36:56.856898 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.856868 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c976445c6-d4snx"] Jul 10 18:36:56.862214 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.862186 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c976445c6-d4snx"] Jul 10 18:36:56.862300 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:36:56.862220 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jvkfh\" is forbidden: User \"system:node:ip-10-0-136-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-57.ec2.internal' and this object" podUID="f9a2b82e-1332-4970-9124-1b5168e2c4ee" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jvkfh" Jul 10 18:36:56.882385 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.882348 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5xb65" podStartSLOduration=2.5708056409999998 podStartE2EDuration="24.88233607s" totalImagesPullingTime="22.311530429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:36:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:36:56.880355747 +0000 UTC m=+636.113560023" watchObservedRunningTime="2026-07-10 18:36:56.88233607 +0000 UTC m=+636.115540330" Jul 10 18:36:56.905657 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:56.905613 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5h2k" podStartSLOduration=13.905600886 podStartE2EDuration="13.905600886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:36:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:36:56.905306463 +0000 UTC m=+636.138510722" watchObservedRunningTime="2026-07-10 18:36:56.905600886 +0000 UTC m=+636.138805146" Jul 10 18:36:57.406732 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:57.406685 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22b8ef71-2c71-427a-80d4-4fac53ec43d3" path="/var/lib/kubelet/pods/22b8ef71-2c71-427a-80d4-4fac53ec43d3/volumes" Jul 10 18:36:57.407111 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:36:57.407097 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9a2b82e-1332-4970-9124-1b5168e2c4ee" path="/var/lib/kubelet/pods/f9a2b82e-1332-4970-9124-1b5168e2c4ee/volumes" Jul 10 18:37:07.823053 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:07.823024 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhpbt" Jul 10 18:37:07.823541 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:07.823177 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5h2k" Jul 10 18:37:07.889594 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:07.889558 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhpbt"] Jul 10 18:37:07.889833 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:07.889771 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhpbt" podUID="fd548e75-d2a2-47db-bbd1-9a942f7f8a3b" containerName="manager" containerID="cri-o://eb7d9263b8a67e21ecf1d1ee6224a3d4082ab8742223ece9389c2e6edba2cbef" gracePeriod=10 Jul 10 18:37:08.194243 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:08.194215 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhpbt" Jul 10 18:37:08.238089 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:08.238055 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mt2sg\" (UniqueName: \"kubernetes.io/projected/fd548e75-d2a2-47db-bbd1-9a942f7f8a3b-kube-api-access-mt2sg\") pod \"fd548e75-d2a2-47db-bbd1-9a942f7f8a3b\" (UID: \"fd548e75-d2a2-47db-bbd1-9a942f7f8a3b\") " Jul 10 18:37:08.238232 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:08.238165 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd548e75-d2a2-47db-bbd1-9a942f7f8a3b-extensions-socket-volume\") pod \"fd548e75-d2a2-47db-bbd1-9a942f7f8a3b\" (UID: \"fd548e75-d2a2-47db-bbd1-9a942f7f8a3b\") " Jul 10 18:37:08.238572 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:08.238542 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd548e75-d2a2-47db-bbd1-9a942f7f8a3b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fd548e75-d2a2-47db-bbd1-9a942f7f8a3b" (UID: "fd548e75-d2a2-47db-bbd1-9a942f7f8a3b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:37:08.240233 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:08.240213 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd548e75-d2a2-47db-bbd1-9a942f7f8a3b-kube-api-access-mt2sg" (OuterVolumeSpecName: "kube-api-access-mt2sg") pod "fd548e75-d2a2-47db-bbd1-9a942f7f8a3b" (UID: "fd548e75-d2a2-47db-bbd1-9a942f7f8a3b"). InnerVolumeSpecName "kube-api-access-mt2sg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:37:08.339048 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:08.339024 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mt2sg\" (UniqueName: \"kubernetes.io/projected/fd548e75-d2a2-47db-bbd1-9a942f7f8a3b-kube-api-access-mt2sg\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:37:08.339048 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:08.339046 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fd548e75-d2a2-47db-bbd1-9a942f7f8a3b-extensions-socket-volume\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:37:08.875061 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:08.875024 2564 generic.go:356] "Generic (PLEG): container finished" podID="fd548e75-d2a2-47db-bbd1-9a942f7f8a3b" containerID="eb7d9263b8a67e21ecf1d1ee6224a3d4082ab8742223ece9389c2e6edba2cbef" exitCode=0 Jul 10 18:37:08.875432 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:08.875072 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhpbt" Jul 10 18:37:08.875432 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:08.875110 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhpbt" event={"ID":"fd548e75-d2a2-47db-bbd1-9a942f7f8a3b","Type":"ContainerDied","Data":"eb7d9263b8a67e21ecf1d1ee6224a3d4082ab8742223ece9389c2e6edba2cbef"} Jul 10 18:37:08.875432 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:08.875167 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhpbt" event={"ID":"fd548e75-d2a2-47db-bbd1-9a942f7f8a3b","Type":"ContainerDied","Data":"f52c38fbf9d769872853df45d96ce19989bfb5b9d483a1bde27d1a3f693d7f14"} Jul 10 18:37:08.875432 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:08.875195 2564 scope.go:117] "RemoveContainer" containerID="eb7d9263b8a67e21ecf1d1ee6224a3d4082ab8742223ece9389c2e6edba2cbef" Jul 10 18:37:08.884168 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:08.884146 2564 scope.go:117] "RemoveContainer" containerID="eb7d9263b8a67e21ecf1d1ee6224a3d4082ab8742223ece9389c2e6edba2cbef" Jul 10 18:37:08.884398 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:37:08.884381 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb7d9263b8a67e21ecf1d1ee6224a3d4082ab8742223ece9389c2e6edba2cbef\": container with ID starting with eb7d9263b8a67e21ecf1d1ee6224a3d4082ab8742223ece9389c2e6edba2cbef not found: ID does not exist" containerID="eb7d9263b8a67e21ecf1d1ee6224a3d4082ab8742223ece9389c2e6edba2cbef" Jul 10 18:37:08.884449 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:08.884407 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb7d9263b8a67e21ecf1d1ee6224a3d4082ab8742223ece9389c2e6edba2cbef"} err="failed to get container status \"eb7d9263b8a67e21ecf1d1ee6224a3d4082ab8742223ece9389c2e6edba2cbef\": rpc error: code = NotFound desc = could not find container \"eb7d9263b8a67e21ecf1d1ee6224a3d4082ab8742223ece9389c2e6edba2cbef\": container with ID starting with eb7d9263b8a67e21ecf1d1ee6224a3d4082ab8742223ece9389c2e6edba2cbef not found: ID does not exist" Jul 10 18:37:08.897313 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:08.897291 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhpbt"] Jul 10 18:37:08.901653 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:08.901630 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xhpbt"] Jul 10 18:37:09.406517 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:09.406483 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd548e75-d2a2-47db-bbd1-9a942f7f8a3b" path="/var/lib/kubelet/pods/fd548e75-d2a2-47db-bbd1-9a942f7f8a3b/volumes" Jul 10 18:37:24.203754 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.203714 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f"] Jul 10 18:37:24.204269 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.204252 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd548e75-d2a2-47db-bbd1-9a942f7f8a3b" containerName="manager" Jul 10 18:37:24.204343 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.204272 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd548e75-d2a2-47db-bbd1-9a942f7f8a3b" containerName="manager" Jul 10 18:37:24.204343 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.204299 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22b8ef71-2c71-427a-80d4-4fac53ec43d3" containerName="console" Jul 10 18:37:24.204343 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.204308 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="22b8ef71-2c71-427a-80d4-4fac53ec43d3" containerName="console" Jul 10 18:37:24.204492 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.204414 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd548e75-d2a2-47db-bbd1-9a942f7f8a3b" containerName="manager" Jul 10 18:37:24.204492 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.204426 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="22b8ef71-2c71-427a-80d4-4fac53ec43d3" containerName="console" Jul 10 18:37:24.209069 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.209049 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.211321 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.211296 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-hv8gr\"" Jul 10 18:37:24.218096 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.218074 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f"] Jul 10 18:37:24.271091 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.271061 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e8a7446-6687-4c74-b561-02347f6148ef-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.271229 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.271100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e8a7446-6687-4c74-b561-02347f6148ef-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.271229 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.271120 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e8a7446-6687-4c74-b561-02347f6148ef-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.271229 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.271181 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e8a7446-6687-4c74-b561-02347f6148ef-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.271334 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.271241 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hgd4\" (UniqueName: \"kubernetes.io/projected/5e8a7446-6687-4c74-b561-02347f6148ef-kube-api-access-5hgd4\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.271334 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.271265 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e8a7446-6687-4c74-b561-02347f6148ef-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.271334 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.271301 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e8a7446-6687-4c74-b561-02347f6148ef-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.271334 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.271329 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e8a7446-6687-4c74-b561-02347f6148ef-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.271447 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.271366 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e8a7446-6687-4c74-b561-02347f6148ef-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.372282 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.372249 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hgd4\" (UniqueName: \"kubernetes.io/projected/5e8a7446-6687-4c74-b561-02347f6148ef-kube-api-access-5hgd4\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.372282 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.372286 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e8a7446-6687-4c74-b561-02347f6148ef-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.372508 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.372316 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e8a7446-6687-4c74-b561-02347f6148ef-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.372508 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.372363 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e8a7446-6687-4c74-b561-02347f6148ef-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.372508 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.372386 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e8a7446-6687-4c74-b561-02347f6148ef-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.372508 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.372463 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e8a7446-6687-4c74-b561-02347f6148ef-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.372727 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.372638 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e8a7446-6687-4c74-b561-02347f6148ef-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.372727 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.372693 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e8a7446-6687-4c74-b561-02347f6148ef-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.372842 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.372752 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e8a7446-6687-4c74-b561-02347f6148ef-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.372842 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.372828 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e8a7446-6687-4c74-b561-02347f6148ef-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.372958 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.372934 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e8a7446-6687-4c74-b561-02347f6148ef-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.373086 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.373067 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e8a7446-6687-4c74-b561-02347f6148ef-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.373141 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.373086 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e8a7446-6687-4c74-b561-02347f6148ef-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.373252 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.373231 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e8a7446-6687-4c74-b561-02347f6148ef-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.374744 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.374713 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e8a7446-6687-4c74-b561-02347f6148ef-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.374869 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.374853 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e8a7446-6687-4c74-b561-02347f6148ef-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.380026 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.380001 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hgd4\" (UniqueName: \"kubernetes.io/projected/5e8a7446-6687-4c74-b561-02347f6148ef-kube-api-access-5hgd4\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.380123 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.380068 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e8a7446-6687-4c74-b561-02347f6148ef-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-gdj7f\" (UID: \"5e8a7446-6687-4c74-b561-02347f6148ef\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.519687 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.519624 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:24.662158 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.662129 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f"] Jul 10 18:37:24.664373 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:37:24.664339 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e8a7446_6687_4c74_b561_02347f6148ef.slice/crio-bab6948467cd171df55cc505d065a8bd9d87da04927b5a1388c254742764b830 WatchSource:0}: Error finding container bab6948467cd171df55cc505d065a8bd9d87da04927b5a1388c254742764b830: Status 404 returned error can't find the container with id bab6948467cd171df55cc505d065a8bd9d87da04927b5a1388c254742764b830 Jul 10 18:37:24.666879 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.666842 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 18:37:24.666971 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.666908 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 18:37:24.666971 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.666938 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 18:37:24.955559 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.955518 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" event={"ID":"5e8a7446-6687-4c74-b561-02347f6148ef","Type":"ContainerStarted","Data":"c21cae7bdcedaa769aafc92331ef73d0ec0f6d533034b96b39016c742c09f097"} Jul 10 18:37:24.955742 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.955599 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" event={"ID":"5e8a7446-6687-4c74-b561-02347f6148ef","Type":"ContainerStarted","Data":"bab6948467cd171df55cc505d065a8bd9d87da04927b5a1388c254742764b830"} Jul 10 18:37:24.976488 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:24.976432 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" podStartSLOduration=0.976416866 podStartE2EDuration="976.416866ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:37:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:37:24.974549895 +0000 UTC m=+664.207754180" watchObservedRunningTime="2026-07-10 18:37:24.976416866 +0000 UTC m=+664.209621125" Jul 10 18:37:25.520345 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:25.520311 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:25.524688 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:25.524661 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:25.960481 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:25.960447 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:25.961414 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:25.961393 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:37:26.829501 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:26.829459 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-nggtj"] Jul 10 18:37:26.833235 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:26.833211 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-nggtj" Jul 10 18:37:26.835751 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:26.835728 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dshtt\"" Jul 10 18:37:26.839365 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:26.839345 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-nggtj"] Jul 10 18:37:26.892493 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:26.892465 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff86c\" (UniqueName: \"kubernetes.io/projected/53fab04f-a9a8-4e42-80a0-6507a5b897b9-kube-api-access-ff86c\") pod \"authorino-58cd955675-nggtj\" (UID: \"53fab04f-a9a8-4e42-80a0-6507a5b897b9\") " pod="kuadrant-system/authorino-58cd955675-nggtj" Jul 10 18:37:26.951813 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:26.951780 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-sxz6g"] Jul 10 18:37:26.955206 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:26.955186 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sxz6g" Jul 10 18:37:26.964797 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:26.964765 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sxz6g"] Jul 10 18:37:26.993315 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:26.993294 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff86c\" (UniqueName: \"kubernetes.io/projected/53fab04f-a9a8-4e42-80a0-6507a5b897b9-kube-api-access-ff86c\") pod \"authorino-58cd955675-nggtj\" (UID: \"53fab04f-a9a8-4e42-80a0-6507a5b897b9\") " pod="kuadrant-system/authorino-58cd955675-nggtj" Jul 10 18:37:26.993440 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:26.993402 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqsz2\" (UniqueName: \"kubernetes.io/projected/3d079dc0-a258-4163-a26e-60450a6f7775-kube-api-access-bqsz2\") pod \"authorino-75d556bd77-sxz6g\" (UID: \"3d079dc0-a258-4163-a26e-60450a6f7775\") " pod="kuadrant-system/authorino-75d556bd77-sxz6g" Jul 10 18:37:27.001219 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:27.001197 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff86c\" (UniqueName: \"kubernetes.io/projected/53fab04f-a9a8-4e42-80a0-6507a5b897b9-kube-api-access-ff86c\") pod \"authorino-58cd955675-nggtj\" (UID: \"53fab04f-a9a8-4e42-80a0-6507a5b897b9\") " pod="kuadrant-system/authorino-58cd955675-nggtj" Jul 10 18:37:27.094588 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:27.094528 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqsz2\" (UniqueName: \"kubernetes.io/projected/3d079dc0-a258-4163-a26e-60450a6f7775-kube-api-access-bqsz2\") pod \"authorino-75d556bd77-sxz6g\" (UID: \"3d079dc0-a258-4163-a26e-60450a6f7775\") " pod="kuadrant-system/authorino-75d556bd77-sxz6g" Jul 10 18:37:27.102559 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:27.102532 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqsz2\" (UniqueName: \"kubernetes.io/projected/3d079dc0-a258-4163-a26e-60450a6f7775-kube-api-access-bqsz2\") pod \"authorino-75d556bd77-sxz6g\" (UID: \"3d079dc0-a258-4163-a26e-60450a6f7775\") " pod="kuadrant-system/authorino-75d556bd77-sxz6g" Jul 10 18:37:27.144295 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:27.144271 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-nggtj" Jul 10 18:37:27.265578 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:27.265551 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sxz6g" Jul 10 18:37:27.277196 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:27.277169 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-nggtj"] Jul 10 18:37:27.279997 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:37:27.279961 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53fab04f_a9a8_4e42_80a0_6507a5b897b9.slice/crio-204c8e3b66b7d2a4f69020ce3b4ca86512e83944245147d8cfc95cb792d685a1 WatchSource:0}: Error finding container 204c8e3b66b7d2a4f69020ce3b4ca86512e83944245147d8cfc95cb792d685a1: Status 404 returned error can't find the container with id 204c8e3b66b7d2a4f69020ce3b4ca86512e83944245147d8cfc95cb792d685a1 Jul 10 18:37:27.282385 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:27.282219 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 18:37:27.399776 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:27.399751 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sxz6g"] Jul 10 18:37:27.402458 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:37:27.402434 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d079dc0_a258_4163_a26e_60450a6f7775.slice/crio-a998a85e8ee32fd55f844516259fe5c8e3c10816eec96e754ea3d5a5b5d0aae7 WatchSource:0}: Error finding container a998a85e8ee32fd55f844516259fe5c8e3c10816eec96e754ea3d5a5b5d0aae7: Status 404 returned error can't find the container with id a998a85e8ee32fd55f844516259fe5c8e3c10816eec96e754ea3d5a5b5d0aae7 Jul 10 18:37:27.971742 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:27.971710 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sxz6g" event={"ID":"3d079dc0-a258-4163-a26e-60450a6f7775","Type":"ContainerStarted","Data":"a998a85e8ee32fd55f844516259fe5c8e3c10816eec96e754ea3d5a5b5d0aae7"} Jul 10 18:37:27.972764 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:27.972733 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-nggtj" event={"ID":"53fab04f-a9a8-4e42-80a0-6507a5b897b9","Type":"ContainerStarted","Data":"204c8e3b66b7d2a4f69020ce3b4ca86512e83944245147d8cfc95cb792d685a1"} Jul 10 18:37:32.002209 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:32.002169 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sxz6g" event={"ID":"3d079dc0-a258-4163-a26e-60450a6f7775","Type":"ContainerStarted","Data":"b58f20d7efc173810721c4a2e539fcb3916a72f246af2176bc227d4d5502d200"} Jul 10 18:37:32.003657 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:32.003633 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-nggtj" event={"ID":"53fab04f-a9a8-4e42-80a0-6507a5b897b9","Type":"ContainerStarted","Data":"52a6c870eb85f3a9456d197c6a5e8cae0ce4d5167ca4a0edd7f957059fa4a672"} Jul 10 18:37:32.017801 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:32.017756 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-sxz6g" podStartSLOduration=2.452741705 podStartE2EDuration="6.017741975s" totalImagesPullingTime="3.56500027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:37:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:37:32.016064928 +0000 UTC m=+671.249269188" watchObservedRunningTime="2026-07-10 18:37:32.017741975 +0000 UTC m=+671.250946287" Jul 10 18:37:32.031278 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:32.031235 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-nggtj" podStartSLOduration=2.356283734 podStartE2EDuration="6.031220959s" totalImagesPullingTime="3.674937225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:37:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:37:32.029970594 +0000 UTC m=+671.263174849" watchObservedRunningTime="2026-07-10 18:37:32.031220959 +0000 UTC m=+671.264425217" Jul 10 18:37:32.058596 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:32.058546 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-nggtj"] Jul 10 18:37:34.018432 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:34.018364 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-nggtj" podUID="53fab04f-a9a8-4e42-80a0-6507a5b897b9" containerName="authorino" containerID="cri-o://52a6c870eb85f3a9456d197c6a5e8cae0ce4d5167ca4a0edd7f957059fa4a672" gracePeriod=30 Jul 10 18:37:34.282126 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:34.282068 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-nggtj" Jul 10 18:37:34.361960 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:34.361924 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ff86c\" (UniqueName: \"kubernetes.io/projected/53fab04f-a9a8-4e42-80a0-6507a5b897b9-kube-api-access-ff86c\") pod \"53fab04f-a9a8-4e42-80a0-6507a5b897b9\" (UID: \"53fab04f-a9a8-4e42-80a0-6507a5b897b9\") " Jul 10 18:37:34.363995 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:34.363968 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53fab04f-a9a8-4e42-80a0-6507a5b897b9-kube-api-access-ff86c" (OuterVolumeSpecName: "kube-api-access-ff86c") pod "53fab04f-a9a8-4e42-80a0-6507a5b897b9" (UID: "53fab04f-a9a8-4e42-80a0-6507a5b897b9"). InnerVolumeSpecName "kube-api-access-ff86c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:37:34.463461 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:34.463430 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ff86c\" (UniqueName: \"kubernetes.io/projected/53fab04f-a9a8-4e42-80a0-6507a5b897b9-kube-api-access-ff86c\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:37:35.023614 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:35.023580 2564 generic.go:356] "Generic (PLEG): container finished" podID="53fab04f-a9a8-4e42-80a0-6507a5b897b9" containerID="52a6c870eb85f3a9456d197c6a5e8cae0ce4d5167ca4a0edd7f957059fa4a672" exitCode=0 Jul 10 18:37:35.024018 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:35.023624 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-nggtj" Jul 10 18:37:35.024018 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:35.023668 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-nggtj" event={"ID":"53fab04f-a9a8-4e42-80a0-6507a5b897b9","Type":"ContainerDied","Data":"52a6c870eb85f3a9456d197c6a5e8cae0ce4d5167ca4a0edd7f957059fa4a672"} Jul 10 18:37:35.024018 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:35.023737 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-nggtj" event={"ID":"53fab04f-a9a8-4e42-80a0-6507a5b897b9","Type":"ContainerDied","Data":"204c8e3b66b7d2a4f69020ce3b4ca86512e83944245147d8cfc95cb792d685a1"} Jul 10 18:37:35.024018 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:35.023760 2564 scope.go:117] "RemoveContainer" containerID="52a6c870eb85f3a9456d197c6a5e8cae0ce4d5167ca4a0edd7f957059fa4a672" Jul 10 18:37:35.032828 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:35.032808 2564 scope.go:117] "RemoveContainer" containerID="52a6c870eb85f3a9456d197c6a5e8cae0ce4d5167ca4a0edd7f957059fa4a672" Jul 10 18:37:35.033058 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:37:35.033043 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52a6c870eb85f3a9456d197c6a5e8cae0ce4d5167ca4a0edd7f957059fa4a672\": container with ID starting with 52a6c870eb85f3a9456d197c6a5e8cae0ce4d5167ca4a0edd7f957059fa4a672 not found: ID does not exist" containerID="52a6c870eb85f3a9456d197c6a5e8cae0ce4d5167ca4a0edd7f957059fa4a672" Jul 10 18:37:35.033100 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:35.033065 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52a6c870eb85f3a9456d197c6a5e8cae0ce4d5167ca4a0edd7f957059fa4a672"} err="failed to get container status \"52a6c870eb85f3a9456d197c6a5e8cae0ce4d5167ca4a0edd7f957059fa4a672\": rpc error: code = NotFound desc = could not find container \"52a6c870eb85f3a9456d197c6a5e8cae0ce4d5167ca4a0edd7f957059fa4a672\": container with ID starting with 52a6c870eb85f3a9456d197c6a5e8cae0ce4d5167ca4a0edd7f957059fa4a672 not found: ID does not exist" Jul 10 18:37:35.045213 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:35.045111 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-nggtj"] Jul 10 18:37:35.047249 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:35.047227 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-nggtj"] Jul 10 18:37:35.407170 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:37:35.407091 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53fab04f-a9a8-4e42-80a0-6507a5b897b9" path="/var/lib/kubelet/pods/53fab04f-a9a8-4e42-80a0-6507a5b897b9/volumes" Jul 10 18:38:02.875634 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:02.875599 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gvpbn"] Jul 10 18:38:02.876162 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:02.875992 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53fab04f-a9a8-4e42-80a0-6507a5b897b9" containerName="authorino" Jul 10 18:38:02.876162 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:02.876004 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="53fab04f-a9a8-4e42-80a0-6507a5b897b9" containerName="authorino" Jul 10 18:38:02.876162 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:02.876069 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="53fab04f-a9a8-4e42-80a0-6507a5b897b9" containerName="authorino" Jul 10 18:38:02.879960 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:02.879941 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gvpbn" Jul 10 18:38:02.884990 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:02.884968 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gvpbn"] Jul 10 18:38:02.997044 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:02.997015 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7bbg\" (UniqueName: \"kubernetes.io/projected/f6e0df1a-5e14-43a0-ba15-3cfc17b834ce-kube-api-access-m7bbg\") pod \"authorino-5d4b67c446-gvpbn\" (UID: \"f6e0df1a-5e14-43a0-ba15-3cfc17b834ce\") " pod="kuadrant-system/authorino-5d4b67c446-gvpbn" Jul 10 18:38:03.098508 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:03.098479 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7bbg\" (UniqueName: \"kubernetes.io/projected/f6e0df1a-5e14-43a0-ba15-3cfc17b834ce-kube-api-access-m7bbg\") pod \"authorino-5d4b67c446-gvpbn\" (UID: \"f6e0df1a-5e14-43a0-ba15-3cfc17b834ce\") " pod="kuadrant-system/authorino-5d4b67c446-gvpbn" Jul 10 18:38:03.108765 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:03.108736 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7bbg\" (UniqueName: \"kubernetes.io/projected/f6e0df1a-5e14-43a0-ba15-3cfc17b834ce-kube-api-access-m7bbg\") pod \"authorino-5d4b67c446-gvpbn\" (UID: \"f6e0df1a-5e14-43a0-ba15-3cfc17b834ce\") " pod="kuadrant-system/authorino-5d4b67c446-gvpbn" Jul 10 18:38:03.112141 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:03.112113 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gvpbn"] Jul 10 18:38:03.112402 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:03.112385 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gvpbn" Jul 10 18:38:03.244861 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:03.244834 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gvpbn"] Jul 10 18:38:03.246859 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:38:03.246828 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6e0df1a_5e14_43a0_ba15_3cfc17b834ce.slice/crio-81e15b1ce1c029c5ff7775a148055d41687520bfe1ec0aeb8f1a5a1d2040c095 WatchSource:0}: Error finding container 81e15b1ce1c029c5ff7775a148055d41687520bfe1ec0aeb8f1a5a1d2040c095: Status 404 returned error can't find the container with id 81e15b1ce1c029c5ff7775a148055d41687520bfe1ec0aeb8f1a5a1d2040c095 Jul 10 18:38:04.173134 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:04.173101 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-gvpbn" podUID="f6e0df1a-5e14-43a0-ba15-3cfc17b834ce" containerName="authorino" containerID="cri-o://fc7012d32dfa77ea92408b2de050c452fc978873a60f0e9a88ba773a04d89666" gracePeriod=30 Jul 10 18:38:04.173463 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:04.173108 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-gvpbn" event={"ID":"f6e0df1a-5e14-43a0-ba15-3cfc17b834ce","Type":"ContainerStarted","Data":"fc7012d32dfa77ea92408b2de050c452fc978873a60f0e9a88ba773a04d89666"} Jul 10 18:38:04.173463 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:04.173234 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-gvpbn" event={"ID":"f6e0df1a-5e14-43a0-ba15-3cfc17b834ce","Type":"ContainerStarted","Data":"81e15b1ce1c029c5ff7775a148055d41687520bfe1ec0aeb8f1a5a1d2040c095"} Jul 10 18:38:04.188752 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:04.188566 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-gvpbn" podStartSLOduration=1.352240216 podStartE2EDuration="2.18855099s" totalImagesPullingTime="836.310774ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:38:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:38:04.187903183 +0000 UTC m=+703.421107445" watchObservedRunningTime="2026-07-10 18:38:04.18855099 +0000 UTC m=+703.421755250" Jul 10 18:38:04.432854 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:04.432830 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gvpbn" Jul 10 18:38:04.611627 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:04.611561 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7bbg\" (UniqueName: \"kubernetes.io/projected/f6e0df1a-5e14-43a0-ba15-3cfc17b834ce-kube-api-access-m7bbg\") pod \"f6e0df1a-5e14-43a0-ba15-3cfc17b834ce\" (UID: \"f6e0df1a-5e14-43a0-ba15-3cfc17b834ce\") " Jul 10 18:38:04.613519 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:04.613490 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6e0df1a-5e14-43a0-ba15-3cfc17b834ce-kube-api-access-m7bbg" (OuterVolumeSpecName: "kube-api-access-m7bbg") pod "f6e0df1a-5e14-43a0-ba15-3cfc17b834ce" (UID: "f6e0df1a-5e14-43a0-ba15-3cfc17b834ce"). InnerVolumeSpecName "kube-api-access-m7bbg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:38:04.712554 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:04.712531 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7bbg\" (UniqueName: \"kubernetes.io/projected/f6e0df1a-5e14-43a0-ba15-3cfc17b834ce-kube-api-access-m7bbg\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:38:05.184497 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:05.184460 2564 generic.go:356] "Generic (PLEG): container finished" podID="f6e0df1a-5e14-43a0-ba15-3cfc17b834ce" containerID="fc7012d32dfa77ea92408b2de050c452fc978873a60f0e9a88ba773a04d89666" exitCode=0 Jul 10 18:38:05.184922 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:05.184504 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gvpbn" Jul 10 18:38:05.184922 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:05.184544 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-gvpbn" event={"ID":"f6e0df1a-5e14-43a0-ba15-3cfc17b834ce","Type":"ContainerDied","Data":"fc7012d32dfa77ea92408b2de050c452fc978873a60f0e9a88ba773a04d89666"} Jul 10 18:38:05.184922 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:05.184587 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-gvpbn" event={"ID":"f6e0df1a-5e14-43a0-ba15-3cfc17b834ce","Type":"ContainerDied","Data":"81e15b1ce1c029c5ff7775a148055d41687520bfe1ec0aeb8f1a5a1d2040c095"} Jul 10 18:38:05.184922 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:05.184602 2564 scope.go:117] "RemoveContainer" containerID="fc7012d32dfa77ea92408b2de050c452fc978873a60f0e9a88ba773a04d89666" Jul 10 18:38:05.193563 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:05.193547 2564 scope.go:117] "RemoveContainer" containerID="fc7012d32dfa77ea92408b2de050c452fc978873a60f0e9a88ba773a04d89666" Jul 10 18:38:05.193910 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:38:05.193891 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc7012d32dfa77ea92408b2de050c452fc978873a60f0e9a88ba773a04d89666\": container with ID starting with fc7012d32dfa77ea92408b2de050c452fc978873a60f0e9a88ba773a04d89666 not found: ID does not exist" containerID="fc7012d32dfa77ea92408b2de050c452fc978873a60f0e9a88ba773a04d89666" Jul 10 18:38:05.193983 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:05.193914 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc7012d32dfa77ea92408b2de050c452fc978873a60f0e9a88ba773a04d89666"} err="failed to get container status \"fc7012d32dfa77ea92408b2de050c452fc978873a60f0e9a88ba773a04d89666\": rpc error: code = NotFound desc = could not find container \"fc7012d32dfa77ea92408b2de050c452fc978873a60f0e9a88ba773a04d89666\": container with ID starting with fc7012d32dfa77ea92408b2de050c452fc978873a60f0e9a88ba773a04d89666 not found: ID does not exist" Jul 10 18:38:05.205893 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:05.205869 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gvpbn"] Jul 10 18:38:05.209746 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:05.209726 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gvpbn"] Jul 10 18:38:05.406395 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:05.406371 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6e0df1a-5e14-43a0-ba15-3cfc17b834ce" path="/var/lib/kubelet/pods/f6e0df1a-5e14-43a0-ba15-3cfc17b834ce/volumes" Jul 10 18:38:09.400160 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:09.400118 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sxz6g"] Jul 10 18:38:09.400758 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:09.400361 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-sxz6g" podUID="3d079dc0-a258-4163-a26e-60450a6f7775" containerName="authorino" containerID="cri-o://b58f20d7efc173810721c4a2e539fcb3916a72f246af2176bc227d4d5502d200" gracePeriod=30 Jul 10 18:38:09.658025 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:09.657974 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sxz6g" Jul 10 18:38:09.752241 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:09.752209 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqsz2\" (UniqueName: \"kubernetes.io/projected/3d079dc0-a258-4163-a26e-60450a6f7775-kube-api-access-bqsz2\") pod \"3d079dc0-a258-4163-a26e-60450a6f7775\" (UID: \"3d079dc0-a258-4163-a26e-60450a6f7775\") " Jul 10 18:38:09.754223 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:09.754198 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d079dc0-a258-4163-a26e-60450a6f7775-kube-api-access-bqsz2" (OuterVolumeSpecName: "kube-api-access-bqsz2") pod "3d079dc0-a258-4163-a26e-60450a6f7775" (UID: "3d079dc0-a258-4163-a26e-60450a6f7775"). InnerVolumeSpecName "kube-api-access-bqsz2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:38:09.853506 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:09.853474 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqsz2\" (UniqueName: \"kubernetes.io/projected/3d079dc0-a258-4163-a26e-60450a6f7775-kube-api-access-bqsz2\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:38:10.211159 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:10.211128 2564 generic.go:356] "Generic (PLEG): container finished" podID="3d079dc0-a258-4163-a26e-60450a6f7775" containerID="b58f20d7efc173810721c4a2e539fcb3916a72f246af2176bc227d4d5502d200" exitCode=0 Jul 10 18:38:10.211328 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:10.211170 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-sxz6g" Jul 10 18:38:10.211328 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:10.211220 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sxz6g" event={"ID":"3d079dc0-a258-4163-a26e-60450a6f7775","Type":"ContainerDied","Data":"b58f20d7efc173810721c4a2e539fcb3916a72f246af2176bc227d4d5502d200"} Jul 10 18:38:10.211328 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:10.211266 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-sxz6g" event={"ID":"3d079dc0-a258-4163-a26e-60450a6f7775","Type":"ContainerDied","Data":"a998a85e8ee32fd55f844516259fe5c8e3c10816eec96e754ea3d5a5b5d0aae7"} Jul 10 18:38:10.211328 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:10.211287 2564 scope.go:117] "RemoveContainer" containerID="b58f20d7efc173810721c4a2e539fcb3916a72f246af2176bc227d4d5502d200" Jul 10 18:38:10.222921 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:10.222879 2564 scope.go:117] "RemoveContainer" containerID="b58f20d7efc173810721c4a2e539fcb3916a72f246af2176bc227d4d5502d200" Jul 10 18:38:10.223573 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:38:10.223544 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b58f20d7efc173810721c4a2e539fcb3916a72f246af2176bc227d4d5502d200\": container with ID starting with b58f20d7efc173810721c4a2e539fcb3916a72f246af2176bc227d4d5502d200 not found: ID does not exist" containerID="b58f20d7efc173810721c4a2e539fcb3916a72f246af2176bc227d4d5502d200" Jul 10 18:38:10.223749 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:10.223722 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b58f20d7efc173810721c4a2e539fcb3916a72f246af2176bc227d4d5502d200"} err="failed to get container status \"b58f20d7efc173810721c4a2e539fcb3916a72f246af2176bc227d4d5502d200\": rpc error: code = NotFound desc = could not find container \"b58f20d7efc173810721c4a2e539fcb3916a72f246af2176bc227d4d5502d200\": container with ID starting with b58f20d7efc173810721c4a2e539fcb3916a72f246af2176bc227d4d5502d200 not found: ID does not exist" Jul 10 18:38:10.237512 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:10.237487 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sxz6g"] Jul 10 18:38:10.243115 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:10.243092 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-sxz6g"] Jul 10 18:38:11.406215 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:11.406180 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d079dc0-a258-4163-a26e-60450a6f7775" path="/var/lib/kubelet/pods/3d079dc0-a258-4163-a26e-60450a6f7775/volumes" Jul 10 18:38:13.746656 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:13.746584 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f586fdfd-mh9w5"] Jul 10 18:38:13.747026 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:13.747000 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d079dc0-a258-4163-a26e-60450a6f7775" containerName="authorino" Jul 10 18:38:13.747026 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:13.747012 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d079dc0-a258-4163-a26e-60450a6f7775" containerName="authorino" Jul 10 18:38:13.747093 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:13.747028 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6e0df1a-5e14-43a0-ba15-3cfc17b834ce" containerName="authorino" Jul 10 18:38:13.747093 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:13.747036 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6e0df1a-5e14-43a0-ba15-3cfc17b834ce" containerName="authorino" Jul 10 18:38:13.747182 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:13.747093 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d079dc0-a258-4163-a26e-60450a6f7775" containerName="authorino" Jul 10 18:38:13.747182 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:13.747101 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6e0df1a-5e14-43a0-ba15-3cfc17b834ce" containerName="authorino" Jul 10 18:38:13.751509 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:13.751490 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f586fdfd-mh9w5" Jul 10 18:38:13.755751 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:13.755732 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 10 18:38:13.756289 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:13.756272 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 10 18:38:13.756350 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:13.756322 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-d762t\"" Jul 10 18:38:13.764008 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:13.763988 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f586fdfd-mh9w5"] Jul 10 18:38:13.785287 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:13.785265 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a11070d-5738-43cb-b2ad-e87ebb6520b0-webhook-cert\") pod \"maas-controller-7f586fdfd-mh9w5\" (UID: \"2a11070d-5738-43cb-b2ad-e87ebb6520b0\") " pod="opendatahub/maas-controller-7f586fdfd-mh9w5" Jul 10 18:38:13.785386 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:13.785322 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkf6b\" (UniqueName: \"kubernetes.io/projected/2a11070d-5738-43cb-b2ad-e87ebb6520b0-kube-api-access-dkf6b\") pod \"maas-controller-7f586fdfd-mh9w5\" (UID: \"2a11070d-5738-43cb-b2ad-e87ebb6520b0\") " pod="opendatahub/maas-controller-7f586fdfd-mh9w5" Jul 10 18:38:13.886752 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:13.886722 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a11070d-5738-43cb-b2ad-e87ebb6520b0-webhook-cert\") pod \"maas-controller-7f586fdfd-mh9w5\" (UID: \"2a11070d-5738-43cb-b2ad-e87ebb6520b0\") " pod="opendatahub/maas-controller-7f586fdfd-mh9w5" Jul 10 18:38:13.886887 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:13.886794 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkf6b\" (UniqueName: \"kubernetes.io/projected/2a11070d-5738-43cb-b2ad-e87ebb6520b0-kube-api-access-dkf6b\") pod \"maas-controller-7f586fdfd-mh9w5\" (UID: \"2a11070d-5738-43cb-b2ad-e87ebb6520b0\") " pod="opendatahub/maas-controller-7f586fdfd-mh9w5" Jul 10 18:38:13.886887 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:38:13.886845 2564 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 10 18:38:13.886958 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:38:13.886908 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a11070d-5738-43cb-b2ad-e87ebb6520b0-webhook-cert podName:2a11070d-5738-43cb-b2ad-e87ebb6520b0 nodeName:}" failed. No retries permitted until 2026-07-10 18:38:14.386893482 +0000 UTC m=+713.620097738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/2a11070d-5738-43cb-b2ad-e87ebb6520b0-webhook-cert") pod "maas-controller-7f586fdfd-mh9w5" (UID: "2a11070d-5738-43cb-b2ad-e87ebb6520b0") : secret "maas-controller-webhook-cert" not found Jul 10 18:38:13.895452 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:13.895425 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkf6b\" (UniqueName: \"kubernetes.io/projected/2a11070d-5738-43cb-b2ad-e87ebb6520b0-kube-api-access-dkf6b\") pod \"maas-controller-7f586fdfd-mh9w5\" (UID: \"2a11070d-5738-43cb-b2ad-e87ebb6520b0\") " pod="opendatahub/maas-controller-7f586fdfd-mh9w5" Jul 10 18:38:13.931406 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:13.931378 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-548fc9658c-tpqz9"] Jul 10 18:38:13.934960 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:13.934943 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-548fc9658c-tpqz9" Jul 10 18:38:13.943233 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:13.943211 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-548fc9658c-tpqz9"] Jul 10 18:38:13.987717 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:13.987671 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b121ba8-63f6-41c3-96e1-75e248272e04-webhook-cert\") pod \"maas-controller-548fc9658c-tpqz9\" (UID: \"8b121ba8-63f6-41c3-96e1-75e248272e04\") " pod="opendatahub/maas-controller-548fc9658c-tpqz9" Jul 10 18:38:13.987830 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:13.987723 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpn8j\" (UniqueName: \"kubernetes.io/projected/8b121ba8-63f6-41c3-96e1-75e248272e04-kube-api-access-jpn8j\") pod \"maas-controller-548fc9658c-tpqz9\" (UID: \"8b121ba8-63f6-41c3-96e1-75e248272e04\") " pod="opendatahub/maas-controller-548fc9658c-tpqz9" Jul 10 18:38:14.088621 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:14.088547 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b121ba8-63f6-41c3-96e1-75e248272e04-webhook-cert\") pod \"maas-controller-548fc9658c-tpqz9\" (UID: \"8b121ba8-63f6-41c3-96e1-75e248272e04\") " pod="opendatahub/maas-controller-548fc9658c-tpqz9" Jul 10 18:38:14.088621 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:14.088576 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpn8j\" (UniqueName: \"kubernetes.io/projected/8b121ba8-63f6-41c3-96e1-75e248272e04-kube-api-access-jpn8j\") pod \"maas-controller-548fc9658c-tpqz9\" (UID: \"8b121ba8-63f6-41c3-96e1-75e248272e04\") " pod="opendatahub/maas-controller-548fc9658c-tpqz9" Jul 10 18:38:14.091010 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:14.090981 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b121ba8-63f6-41c3-96e1-75e248272e04-webhook-cert\") pod \"maas-controller-548fc9658c-tpqz9\" (UID: \"8b121ba8-63f6-41c3-96e1-75e248272e04\") " pod="opendatahub/maas-controller-548fc9658c-tpqz9" Jul 10 18:38:14.097832 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:14.097805 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpn8j\" (UniqueName: \"kubernetes.io/projected/8b121ba8-63f6-41c3-96e1-75e248272e04-kube-api-access-jpn8j\") pod \"maas-controller-548fc9658c-tpqz9\" (UID: \"8b121ba8-63f6-41c3-96e1-75e248272e04\") " pod="opendatahub/maas-controller-548fc9658c-tpqz9" Jul 10 18:38:14.246072 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:14.246042 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-548fc9658c-tpqz9" Jul 10 18:38:14.391220 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:14.391155 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a11070d-5738-43cb-b2ad-e87ebb6520b0-webhook-cert\") pod \"maas-controller-7f586fdfd-mh9w5\" (UID: \"2a11070d-5738-43cb-b2ad-e87ebb6520b0\") " pod="opendatahub/maas-controller-7f586fdfd-mh9w5" Jul 10 18:38:14.393434 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:14.393415 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a11070d-5738-43cb-b2ad-e87ebb6520b0-webhook-cert\") pod \"maas-controller-7f586fdfd-mh9w5\" (UID: \"2a11070d-5738-43cb-b2ad-e87ebb6520b0\") " pod="opendatahub/maas-controller-7f586fdfd-mh9w5" Jul 10 18:38:14.585984 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:14.585958 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-548fc9658c-tpqz9"] Jul 10 18:38:14.587380 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:38:14.587358 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b121ba8_63f6_41c3_96e1_75e248272e04.slice/crio-d63e255f98177501c2a504ecab99bcda2daa11ce2081ca49a400595e9593c3c5 WatchSource:0}: Error finding container d63e255f98177501c2a504ecab99bcda2daa11ce2081ca49a400595e9593c3c5: Status 404 returned error can't find the container with id d63e255f98177501c2a504ecab99bcda2daa11ce2081ca49a400595e9593c3c5 Jul 10 18:38:14.662342 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:14.662286 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f586fdfd-mh9w5" Jul 10 18:38:14.791930 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:14.791907 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f586fdfd-mh9w5"] Jul 10 18:38:14.793889 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:38:14.793863 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a11070d_5738_43cb_b2ad_e87ebb6520b0.slice/crio-853ad81048f04876c354f93ab403f4aa8dba465118ce88e0a812c61f268dd1c6 WatchSource:0}: Error finding container 853ad81048f04876c354f93ab403f4aa8dba465118ce88e0a812c61f268dd1c6: Status 404 returned error can't find the container with id 853ad81048f04876c354f93ab403f4aa8dba465118ce88e0a812c61f268dd1c6 Jul 10 18:38:15.239739 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:15.239689 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-548fc9658c-tpqz9" event={"ID":"8b121ba8-63f6-41c3-96e1-75e248272e04","Type":"ContainerStarted","Data":"d63e255f98177501c2a504ecab99bcda2daa11ce2081ca49a400595e9593c3c5"} Jul 10 18:38:15.241131 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:15.241105 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f586fdfd-mh9w5" event={"ID":"2a11070d-5738-43cb-b2ad-e87ebb6520b0","Type":"ContainerStarted","Data":"853ad81048f04876c354f93ab403f4aa8dba465118ce88e0a812c61f268dd1c6"} Jul 10 18:38:17.252616 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:17.252577 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-548fc9658c-tpqz9" event={"ID":"8b121ba8-63f6-41c3-96e1-75e248272e04","Type":"ContainerStarted","Data":"5d64aa648627ff14198a6ad0c5242fbfced9bc972a7386aaee9b54771d42248f"} Jul 10 18:38:17.253052 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:17.252735 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-548fc9658c-tpqz9" Jul 10 18:38:17.254096 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:17.254073 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f586fdfd-mh9w5" event={"ID":"2a11070d-5738-43cb-b2ad-e87ebb6520b0","Type":"ContainerStarted","Data":"dfc43613d9a85a29b88982c88b70ac93631569108504bb717a4ee7417876b9d0"} Jul 10 18:38:17.254201 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:17.254170 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f586fdfd-mh9w5" Jul 10 18:38:17.271757 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:17.271675 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-548fc9658c-tpqz9" podStartSLOduration=1.983801237 podStartE2EDuration="4.271660591s" totalImagesPullingTime="2.287859354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:38:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:38:17.271364646 +0000 UTC m=+716.504568904" watchObservedRunningTime="2026-07-10 18:38:17.271660591 +0000 UTC m=+716.504864852" Jul 10 18:38:17.293562 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:17.293530 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f586fdfd-mh9w5" podStartSLOduration=2.222679234 podStartE2EDuration="4.293518924s" totalImagesPullingTime="2.07083969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:38:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:38:17.29200276 +0000 UTC m=+716.525207018" watchObservedRunningTime="2026-07-10 18:38:17.293518924 +0000 UTC m=+716.526723201" Jul 10 18:38:28.265326 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:28.265290 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-548fc9658c-tpqz9" Jul 10 18:38:28.265808 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:28.265611 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f586fdfd-mh9w5" Jul 10 18:38:28.331518 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:28.331486 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f586fdfd-mh9w5"] Jul 10 18:38:28.331741 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:28.331671 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7f586fdfd-mh9w5" podUID="2a11070d-5738-43cb-b2ad-e87ebb6520b0" containerName="manager" containerID="cri-o://dfc43613d9a85a29b88982c88b70ac93631569108504bb717a4ee7417876b9d0" gracePeriod=30 Jul 10 18:38:28.582529 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:28.582507 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f586fdfd-mh9w5" Jul 10 18:38:28.719773 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:28.719739 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a11070d-5738-43cb-b2ad-e87ebb6520b0-webhook-cert\") pod \"2a11070d-5738-43cb-b2ad-e87ebb6520b0\" (UID: \"2a11070d-5738-43cb-b2ad-e87ebb6520b0\") " Jul 10 18:38:28.719920 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:28.719803 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkf6b\" (UniqueName: \"kubernetes.io/projected/2a11070d-5738-43cb-b2ad-e87ebb6520b0-kube-api-access-dkf6b\") pod \"2a11070d-5738-43cb-b2ad-e87ebb6520b0\" (UID: \"2a11070d-5738-43cb-b2ad-e87ebb6520b0\") " Jul 10 18:38:28.721979 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:28.721947 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a11070d-5738-43cb-b2ad-e87ebb6520b0-kube-api-access-dkf6b" (OuterVolumeSpecName: "kube-api-access-dkf6b") pod "2a11070d-5738-43cb-b2ad-e87ebb6520b0" (UID: "2a11070d-5738-43cb-b2ad-e87ebb6520b0"). InnerVolumeSpecName "kube-api-access-dkf6b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:38:28.722056 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:28.722017 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a11070d-5738-43cb-b2ad-e87ebb6520b0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2a11070d-5738-43cb-b2ad-e87ebb6520b0" (UID: "2a11070d-5738-43cb-b2ad-e87ebb6520b0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:38:28.821277 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:28.821212 2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a11070d-5738-43cb-b2ad-e87ebb6520b0-webhook-cert\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:38:28.821277 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:28.821237 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkf6b\" (UniqueName: \"kubernetes.io/projected/2a11070d-5738-43cb-b2ad-e87ebb6520b0-kube-api-access-dkf6b\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:38:29.315502 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:29.315467 2564 generic.go:356] "Generic (PLEG): container finished" podID="2a11070d-5738-43cb-b2ad-e87ebb6520b0" containerID="dfc43613d9a85a29b88982c88b70ac93631569108504bb717a4ee7417876b9d0" exitCode=0 Jul 10 18:38:29.315937 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:29.315507 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f586fdfd-mh9w5" Jul 10 18:38:29.315937 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:29.315556 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f586fdfd-mh9w5" event={"ID":"2a11070d-5738-43cb-b2ad-e87ebb6520b0","Type":"ContainerDied","Data":"dfc43613d9a85a29b88982c88b70ac93631569108504bb717a4ee7417876b9d0"} Jul 10 18:38:29.315937 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:29.315608 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f586fdfd-mh9w5" event={"ID":"2a11070d-5738-43cb-b2ad-e87ebb6520b0","Type":"ContainerDied","Data":"853ad81048f04876c354f93ab403f4aa8dba465118ce88e0a812c61f268dd1c6"} Jul 10 18:38:29.315937 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:29.315630 2564 scope.go:117] "RemoveContainer" containerID="dfc43613d9a85a29b88982c88b70ac93631569108504bb717a4ee7417876b9d0" Jul 10 18:38:29.324359 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:29.324342 2564 scope.go:117] "RemoveContainer" containerID="dfc43613d9a85a29b88982c88b70ac93631569108504bb717a4ee7417876b9d0" Jul 10 18:38:29.324608 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:38:29.324591 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfc43613d9a85a29b88982c88b70ac93631569108504bb717a4ee7417876b9d0\": container with ID starting with dfc43613d9a85a29b88982c88b70ac93631569108504bb717a4ee7417876b9d0 not found: ID does not exist" containerID="dfc43613d9a85a29b88982c88b70ac93631569108504bb717a4ee7417876b9d0" Jul 10 18:38:29.324654 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:29.324615 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfc43613d9a85a29b88982c88b70ac93631569108504bb717a4ee7417876b9d0"} err="failed to get container status \"dfc43613d9a85a29b88982c88b70ac93631569108504bb717a4ee7417876b9d0\": rpc error: code = NotFound desc = could not find container \"dfc43613d9a85a29b88982c88b70ac93631569108504bb717a4ee7417876b9d0\": container with ID starting with dfc43613d9a85a29b88982c88b70ac93631569108504bb717a4ee7417876b9d0 not found: ID does not exist" Jul 10 18:38:29.336633 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:29.336611 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f586fdfd-mh9w5"] Jul 10 18:38:29.340738 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:29.340719 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f586fdfd-mh9w5"] Jul 10 18:38:29.406999 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:29.406973 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a11070d-5738-43cb-b2ad-e87ebb6520b0" path="/var/lib/kubelet/pods/2a11070d-5738-43cb-b2ad-e87ebb6520b0/volumes" Jul 10 18:38:50.173966 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.173922 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-65ccc6b695-22xmh"] Jul 10 18:38:50.174588 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.174330 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a11070d-5738-43cb-b2ad-e87ebb6520b0" containerName="manager" Jul 10 18:38:50.174588 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.174344 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a11070d-5738-43cb-b2ad-e87ebb6520b0" containerName="manager" Jul 10 18:38:50.174588 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.174443 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a11070d-5738-43cb-b2ad-e87ebb6520b0" containerName="manager" Jul 10 18:38:50.178864 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.178839 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65ccc6b695-22xmh" Jul 10 18:38:50.181430 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.181406 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 10 18:38:50.181550 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.181442 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 10 18:38:50.181550 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.181450 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 10 18:38:50.182241 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.182221 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fnrm2\"" Jul 10 18:38:50.188873 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.188852 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-65ccc6b695-22xmh"] Jul 10 18:38:50.304914 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.304878 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67ede1b6-441a-4316-818a-c15d4abe3cd4-maas-api-tls\") pod \"maas-api-65ccc6b695-22xmh\" (UID: \"67ede1b6-441a-4316-818a-c15d4abe3cd4\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-22xmh" Jul 10 18:38:50.305080 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.304989 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkhh8\" (UniqueName: \"kubernetes.io/projected/67ede1b6-441a-4316-818a-c15d4abe3cd4-kube-api-access-nkhh8\") pod \"maas-api-65ccc6b695-22xmh\" (UID: \"67ede1b6-441a-4316-818a-c15d4abe3cd4\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-22xmh" Jul 10 18:38:50.305080 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.305027 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67ede1b6-441a-4316-818a-c15d4abe3cd4-openshift-service-ca\") pod \"maas-api-65ccc6b695-22xmh\" (UID: \"67ede1b6-441a-4316-818a-c15d4abe3cd4\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-22xmh" Jul 10 18:38:50.406239 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.406208 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67ede1b6-441a-4316-818a-c15d4abe3cd4-maas-api-tls\") pod \"maas-api-65ccc6b695-22xmh\" (UID: \"67ede1b6-441a-4316-818a-c15d4abe3cd4\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-22xmh" Jul 10 18:38:50.406371 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.406262 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkhh8\" (UniqueName: \"kubernetes.io/projected/67ede1b6-441a-4316-818a-c15d4abe3cd4-kube-api-access-nkhh8\") pod \"maas-api-65ccc6b695-22xmh\" (UID: \"67ede1b6-441a-4316-818a-c15d4abe3cd4\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-22xmh" Jul 10 18:38:50.406371 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.406302 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67ede1b6-441a-4316-818a-c15d4abe3cd4-openshift-service-ca\") pod \"maas-api-65ccc6b695-22xmh\" (UID: \"67ede1b6-441a-4316-818a-c15d4abe3cd4\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-22xmh" Jul 10 18:38:50.406448 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:38:50.406370 2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 10 18:38:50.406448 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:38:50.406443 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67ede1b6-441a-4316-818a-c15d4abe3cd4-maas-api-tls podName:67ede1b6-441a-4316-818a-c15d4abe3cd4 nodeName:}" failed. No retries permitted until 2026-07-10 18:38:50.906422469 +0000 UTC m=+750.139626713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/67ede1b6-441a-4316-818a-c15d4abe3cd4-maas-api-tls") pod "maas-api-65ccc6b695-22xmh" (UID: "67ede1b6-441a-4316-818a-c15d4abe3cd4") : secret "maas-api-serving-cert" not found Jul 10 18:38:50.407042 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.407025 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67ede1b6-441a-4316-818a-c15d4abe3cd4-openshift-service-ca\") pod \"maas-api-65ccc6b695-22xmh\" (UID: \"67ede1b6-441a-4316-818a-c15d4abe3cd4\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-22xmh" Jul 10 18:38:50.416129 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.416071 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkhh8\" (UniqueName: \"kubernetes.io/projected/67ede1b6-441a-4316-818a-c15d4abe3cd4-kube-api-access-nkhh8\") pod \"maas-api-65ccc6b695-22xmh\" (UID: \"67ede1b6-441a-4316-818a-c15d4abe3cd4\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-22xmh" Jul 10 18:38:50.759214 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.756326 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-jgkjx"] Jul 10 18:38:50.763328 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.763296 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-jgkjx" Jul 10 18:38:50.765322 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.765286 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-jgkjx"] Jul 10 18:38:50.765566 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.765551 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 10 18:38:50.765658 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.765609 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-2tnpp\"" Jul 10 18:38:50.912059 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.912023 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrlcm\" (UniqueName: \"kubernetes.io/projected/8926f5ea-7724-49e2-8855-29e4512fb196-kube-api-access-jrlcm\") pod \"payload-processing-58f86c7798-jgkjx\" (UID: \"8926f5ea-7724-49e2-8855-29e4512fb196\") " pod="openshift-ingress/payload-processing-58f86c7798-jgkjx" Jul 10 18:38:50.912242 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.912070 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67ede1b6-441a-4316-818a-c15d4abe3cd4-maas-api-tls\") pod \"maas-api-65ccc6b695-22xmh\" (UID: \"67ede1b6-441a-4316-818a-c15d4abe3cd4\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-22xmh" Jul 10 18:38:50.912242 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.912148 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8926f5ea-7724-49e2-8855-29e4512fb196-plugins-config-volume\") pod \"payload-processing-58f86c7798-jgkjx\" (UID: \"8926f5ea-7724-49e2-8855-29e4512fb196\") " pod="openshift-ingress/payload-processing-58f86c7798-jgkjx" Jul 10 18:38:50.914503 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:50.914480 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67ede1b6-441a-4316-818a-c15d4abe3cd4-maas-api-tls\") pod \"maas-api-65ccc6b695-22xmh\" (UID: \"67ede1b6-441a-4316-818a-c15d4abe3cd4\") " pod="odh-ai-gateway-infra/maas-api-65ccc6b695-22xmh" Jul 10 18:38:51.013547 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:51.013472 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8926f5ea-7724-49e2-8855-29e4512fb196-plugins-config-volume\") pod \"payload-processing-58f86c7798-jgkjx\" (UID: \"8926f5ea-7724-49e2-8855-29e4512fb196\") " pod="openshift-ingress/payload-processing-58f86c7798-jgkjx" Jul 10 18:38:51.013677 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:51.013576 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrlcm\" (UniqueName: \"kubernetes.io/projected/8926f5ea-7724-49e2-8855-29e4512fb196-kube-api-access-jrlcm\") pod \"payload-processing-58f86c7798-jgkjx\" (UID: \"8926f5ea-7724-49e2-8855-29e4512fb196\") " pod="openshift-ingress/payload-processing-58f86c7798-jgkjx" Jul 10 18:38:51.014172 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:51.014153 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8926f5ea-7724-49e2-8855-29e4512fb196-plugins-config-volume\") pod \"payload-processing-58f86c7798-jgkjx\" (UID: \"8926f5ea-7724-49e2-8855-29e4512fb196\") " pod="openshift-ingress/payload-processing-58f86c7798-jgkjx" Jul 10 18:38:51.021055 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:51.021029 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrlcm\" (UniqueName: \"kubernetes.io/projected/8926f5ea-7724-49e2-8855-29e4512fb196-kube-api-access-jrlcm\") pod \"payload-processing-58f86c7798-jgkjx\" (UID: \"8926f5ea-7724-49e2-8855-29e4512fb196\") " pod="openshift-ingress/payload-processing-58f86c7798-jgkjx" Jul 10 18:38:51.074567 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:51.074540 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-jgkjx" Jul 10 18:38:51.090695 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:51.090643 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-65ccc6b695-22xmh" Jul 10 18:38:51.224759 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:51.224723 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-jgkjx"] Jul 10 18:38:51.229951 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:38:51.229812 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8926f5ea_7724_49e2_8855_29e4512fb196.slice/crio-299c28fb9fabb7da4de995359f8d8f6828368fd1daaefaf11a47e3a39092cb58 WatchSource:0}: Error finding container 299c28fb9fabb7da4de995359f8d8f6828368fd1daaefaf11a47e3a39092cb58: Status 404 returned error can't find the container with id 299c28fb9fabb7da4de995359f8d8f6828368fd1daaefaf11a47e3a39092cb58 Jul 10 18:38:51.256774 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:51.256746 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-65ccc6b695-22xmh"] Jul 10 18:38:51.260120 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:38:51.260097 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67ede1b6_441a_4316_818a_c15d4abe3cd4.slice/crio-260f6e4fb9658395a68ced66d471d4a187aa4bb016bfafd61c01abd07d2fcf58 WatchSource:0}: Error finding container 260f6e4fb9658395a68ced66d471d4a187aa4bb016bfafd61c01abd07d2fcf58: Status 404 returned error can't find the container with id 260f6e4fb9658395a68ced66d471d4a187aa4bb016bfafd61c01abd07d2fcf58 Jul 10 18:38:51.424801 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:51.424720 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-jgkjx" event={"ID":"8926f5ea-7724-49e2-8855-29e4512fb196","Type":"ContainerStarted","Data":"299c28fb9fabb7da4de995359f8d8f6828368fd1daaefaf11a47e3a39092cb58"} Jul 10 18:38:51.426188 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:51.426159 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65ccc6b695-22xmh" event={"ID":"67ede1b6-441a-4316-818a-c15d4abe3cd4","Type":"ContainerStarted","Data":"260f6e4fb9658395a68ced66d471d4a187aa4bb016bfafd61c01abd07d2fcf58"} Jul 10 18:38:53.457569 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:53.457522 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-jgkjx" event={"ID":"8926f5ea-7724-49e2-8855-29e4512fb196","Type":"ContainerStarted","Data":"efe1d8182964fbe7c56d4d12ed7d0d2eabeb82b56682dbbd1dc9237806dcef25"} Jul 10 18:38:53.461721 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:53.458314 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-jgkjx" Jul 10 18:38:53.461721 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:53.460731 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-65ccc6b695-22xmh" event={"ID":"67ede1b6-441a-4316-818a-c15d4abe3cd4","Type":"ContainerStarted","Data":"718faa0bd34705a7a40e7ec3460afd393cbe74d6dceb5d7fde4365bc417edcf3"} Jul 10 18:38:53.461721 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:53.461030 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-65ccc6b695-22xmh" Jul 10 18:38:53.477050 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:53.477000 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-jgkjx" podStartSLOduration=1.425027895 podStartE2EDuration="3.47698269s" totalImagesPullingTime="2.051954795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:38:53.474475702 +0000 UTC m=+752.707679972" watchObservedRunningTime="2026-07-10 18:38:53.47698269 +0000 UTC m=+752.710186950" Jul 10 18:38:53.493310 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:53.493270 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-65ccc6b695-22xmh" podStartSLOduration=1.465914316 podStartE2EDuration="3.493248493s" totalImagesPullingTime="2.027334177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:38:53.491417732 +0000 UTC m=+752.724621992" watchObservedRunningTime="2026-07-10 18:38:53.493248493 +0000 UTC m=+752.726452752" Jul 10 18:38:57.002887 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:57.002846 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-gdj7f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 10 18:38:57.003264 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:57.002907 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" podUID="5e8a7446-6687-4c74-b561-02347f6148ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 10 18:38:58.489160 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:58.489131 2564 generic.go:356] "Generic (PLEG): container finished" podID="5e8a7446-6687-4c74-b561-02347f6148ef" containerID="c21cae7bdcedaa769aafc92331ef73d0ec0f6d533034b96b39016c742c09f097" exitCode=0 Jul 10 18:38:58.489498 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:58.489185 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" event={"ID":"5e8a7446-6687-4c74-b561-02347f6148ef","Type":"ContainerDied","Data":"c21cae7bdcedaa769aafc92331ef73d0ec0f6d533034b96b39016c742c09f097"} Jul 10 18:38:58.489611 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:58.489588 2564 scope.go:117] "RemoveContainer" containerID="c21cae7bdcedaa769aafc92331ef73d0ec0f6d533034b96b39016c742c09f097" Jul 10 18:38:58.490714 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:58.490674 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 18:38:58.490778 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:58.490759 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 18:38:58.490828 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:58.490791 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 18:38:59.472753 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:59.472724 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-65ccc6b695-22xmh" Jul 10 18:38:59.495726 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:59.495679 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" event={"ID":"5e8a7446-6687-4c74-b561-02347f6148ef","Type":"ContainerStarted","Data":"dd9c76a9bd807d605d66554c911749459bd0c85927e2828ac9e929f0ddb03d87"} Jul 10 18:38:59.520300 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:59.520272 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:38:59.520448 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:59.520428 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-gdj7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 10 18:38:59.520496 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:38:59.520474 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" podUID="5e8a7446-6687-4c74-b561-02347f6148ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 10 18:39:00.520596 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:00.520568 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-gdj7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 10 18:39:00.520980 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:00.520648 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" podUID="5e8a7446-6687-4c74-b561-02347f6148ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 10 18:39:01.520218 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:01.520186 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-gdj7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 10 18:39:01.520415 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:01.520237 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" podUID="5e8a7446-6687-4c74-b561-02347f6148ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 10 18:39:02.520903 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:02.520871 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-gdj7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 10 18:39:02.521258 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:02.520928 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" podUID="5e8a7446-6687-4c74-b561-02347f6148ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 10 18:39:03.520942 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:03.520908 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-gdj7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 10 18:39:03.521311 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:03.520969 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" podUID="5e8a7446-6687-4c74-b561-02347f6148ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 10 18:39:04.523239 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:04.523211 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:39:04.523603 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:04.523546 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:39:04.524162 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:04.524142 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-gdj7f" Jul 10 18:39:05.476239 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:05.476207 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-jgkjx" Jul 10 18:39:10.786278 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:10.786245 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc"] Jul 10 18:39:10.790374 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:10.790352 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" Jul 10 18:39:10.794260 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:10.794237 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fr6kk\"" Jul 10 18:39:10.794359 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:10.794245 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 10 18:39:10.794359 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:10.794345 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 10 18:39:10.794471 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:10.794370 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 10 18:39:10.800512 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:10.800486 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc"] Jul 10 18:39:10.937782 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:10.937741 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hbxg\" (UniqueName: \"kubernetes.io/projected/10ed6a9d-75e6-4af9-8ae2-2428e724e620-kube-api-access-6hbxg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc\" (UID: \"10ed6a9d-75e6-4af9-8ae2-2428e724e620\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" Jul 10 18:39:10.937960 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:10.937789 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10ed6a9d-75e6-4af9-8ae2-2428e724e620-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc\" (UID: \"10ed6a9d-75e6-4af9-8ae2-2428e724e620\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" Jul 10 18:39:10.937960 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:10.937823 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10ed6a9d-75e6-4af9-8ae2-2428e724e620-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc\" (UID: \"10ed6a9d-75e6-4af9-8ae2-2428e724e620\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" Jul 10 18:39:10.937960 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:10.937871 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10ed6a9d-75e6-4af9-8ae2-2428e724e620-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc\" (UID: \"10ed6a9d-75e6-4af9-8ae2-2428e724e620\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" Jul 10 18:39:10.938094 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:10.937992 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10ed6a9d-75e6-4af9-8ae2-2428e724e620-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc\" (UID: \"10ed6a9d-75e6-4af9-8ae2-2428e724e620\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" Jul 10 18:39:10.938094 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:10.938020 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10ed6a9d-75e6-4af9-8ae2-2428e724e620-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc\" (UID: \"10ed6a9d-75e6-4af9-8ae2-2428e724e620\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" Jul 10 18:39:11.039173 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:11.039096 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10ed6a9d-75e6-4af9-8ae2-2428e724e620-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc\" (UID: \"10ed6a9d-75e6-4af9-8ae2-2428e724e620\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" Jul 10 18:39:11.039173 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:11.039126 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10ed6a9d-75e6-4af9-8ae2-2428e724e620-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc\" (UID: \"10ed6a9d-75e6-4af9-8ae2-2428e724e620\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" Jul 10 18:39:11.039173 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:11.039171 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hbxg\" (UniqueName: \"kubernetes.io/projected/10ed6a9d-75e6-4af9-8ae2-2428e724e620-kube-api-access-6hbxg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc\" (UID: \"10ed6a9d-75e6-4af9-8ae2-2428e724e620\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" Jul 10 18:39:11.039430 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:11.039189 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10ed6a9d-75e6-4af9-8ae2-2428e724e620-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc\" (UID: \"10ed6a9d-75e6-4af9-8ae2-2428e724e620\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" Jul 10 18:39:11.039430 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:11.039205 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10ed6a9d-75e6-4af9-8ae2-2428e724e620-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc\" (UID: \"10ed6a9d-75e6-4af9-8ae2-2428e724e620\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" Jul 10 18:39:11.039430 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:11.039238 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10ed6a9d-75e6-4af9-8ae2-2428e724e620-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc\" (UID: \"10ed6a9d-75e6-4af9-8ae2-2428e724e620\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" Jul 10 18:39:11.039586 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:11.039566 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10ed6a9d-75e6-4af9-8ae2-2428e724e620-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc\" (UID: \"10ed6a9d-75e6-4af9-8ae2-2428e724e620\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" Jul 10 18:39:11.039642 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:11.039588 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10ed6a9d-75e6-4af9-8ae2-2428e724e620-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc\" (UID: \"10ed6a9d-75e6-4af9-8ae2-2428e724e620\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" Jul 10 18:39:11.039685 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:11.039641 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10ed6a9d-75e6-4af9-8ae2-2428e724e620-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc\" (UID: \"10ed6a9d-75e6-4af9-8ae2-2428e724e620\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" Jul 10 18:39:11.041550 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:11.041521 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10ed6a9d-75e6-4af9-8ae2-2428e724e620-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc\" (UID: \"10ed6a9d-75e6-4af9-8ae2-2428e724e620\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" Jul 10 18:39:11.041749 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:11.041662 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10ed6a9d-75e6-4af9-8ae2-2428e724e620-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc\" (UID: \"10ed6a9d-75e6-4af9-8ae2-2428e724e620\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" Jul 10 18:39:11.047468 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:11.047441 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hbxg\" (UniqueName: \"kubernetes.io/projected/10ed6a9d-75e6-4af9-8ae2-2428e724e620-kube-api-access-6hbxg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc\" (UID: \"10ed6a9d-75e6-4af9-8ae2-2428e724e620\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" Jul 10 18:39:11.102507 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:11.102483 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" Jul 10 18:39:11.247202 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:11.247176 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc"] Jul 10 18:39:11.249177 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:39:11.249149 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10ed6a9d_75e6_4af9_8ae2_2428e724e620.slice/crio-df849e99abffc5664f555403f68474c79654d7e465969d04f9ffafcc018f4631 WatchSource:0}: Error finding container df849e99abffc5664f555403f68474c79654d7e465969d04f9ffafcc018f4631: Status 404 returned error can't find the container with id df849e99abffc5664f555403f68474c79654d7e465969d04f9ffafcc018f4631 Jul 10 18:39:11.561523 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:11.561458 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" event={"ID":"10ed6a9d-75e6-4af9-8ae2-2428e724e620","Type":"ContainerStarted","Data":"df849e99abffc5664f555403f68474c79654d7e465969d04f9ffafcc018f4631"} Jul 10 18:39:13.594671 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:13.594634 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" event={"ID":"10ed6a9d-75e6-4af9-8ae2-2428e724e620","Type":"ContainerStarted","Data":"66ab13f7f1fdb790aead0ba14f85f7f0671cd0efabf3305b4bae8b0e7390bf54"} Jul 10 18:39:13.622168 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:13.622115 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" podStartSLOduration=2.230123225 podStartE2EDuration="3.622101813s" totalImagesPullingTime="1.391978588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:39:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:39:13.61907883 +0000 UTC m=+772.852283089" watchObservedRunningTime="2026-07-10 18:39:13.622101813 +0000 UTC m=+772.855306071" Jul 10 18:39:21.103521 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:21.103483 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" Jul 10 18:39:21.104006 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:21.103535 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" Jul 10 18:39:21.116171 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:21.116145 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" Jul 10 18:39:21.645661 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:21.645634 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc" Jul 10 18:39:31.686561 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:31.686526 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw"] Jul 10 18:39:31.693214 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:31.693178 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" Jul 10 18:39:31.696383 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:31.696357 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 10 18:39:31.700896 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:31.700870 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw"] Jul 10 18:39:31.718963 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:31.718941 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5000dfac-bd52-4882-9534-200d28192a2a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2vdrw\" (UID: \"5000dfac-bd52-4882-9534-200d28192a2a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" Jul 10 18:39:31.719054 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:31.718987 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4gvb\" (UniqueName: \"kubernetes.io/projected/5000dfac-bd52-4882-9534-200d28192a2a-kube-api-access-l4gvb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2vdrw\" (UID: \"5000dfac-bd52-4882-9534-200d28192a2a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" Jul 10 18:39:31.719054 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:31.719019 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5000dfac-bd52-4882-9534-200d28192a2a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2vdrw\" (UID: \"5000dfac-bd52-4882-9534-200d28192a2a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" Jul 10 18:39:31.719126 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:31.719088 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5000dfac-bd52-4882-9534-200d28192a2a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2vdrw\" (UID: \"5000dfac-bd52-4882-9534-200d28192a2a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" Jul 10 18:39:31.719164 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:31.719125 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5000dfac-bd52-4882-9534-200d28192a2a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2vdrw\" (UID: \"5000dfac-bd52-4882-9534-200d28192a2a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" Jul 10 18:39:31.719164 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:31.719149 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5000dfac-bd52-4882-9534-200d28192a2a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2vdrw\" (UID: \"5000dfac-bd52-4882-9534-200d28192a2a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" Jul 10 18:39:31.820292 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:31.820266 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5000dfac-bd52-4882-9534-200d28192a2a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2vdrw\" (UID: \"5000dfac-bd52-4882-9534-200d28192a2a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" Jul 10 18:39:31.820417 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:31.820320 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4gvb\" (UniqueName: \"kubernetes.io/projected/5000dfac-bd52-4882-9534-200d28192a2a-kube-api-access-l4gvb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2vdrw\" (UID: \"5000dfac-bd52-4882-9534-200d28192a2a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" Jul 10 18:39:31.820417 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:31.820356 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5000dfac-bd52-4882-9534-200d28192a2a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2vdrw\" (UID: \"5000dfac-bd52-4882-9534-200d28192a2a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" Jul 10 18:39:31.820417 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:31.820396 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5000dfac-bd52-4882-9534-200d28192a2a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2vdrw\" (UID: \"5000dfac-bd52-4882-9534-200d28192a2a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" Jul 10 18:39:31.820545 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:31.820419 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5000dfac-bd52-4882-9534-200d28192a2a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2vdrw\" (UID: \"5000dfac-bd52-4882-9534-200d28192a2a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" Jul 10 18:39:31.820545 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:31.820451 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5000dfac-bd52-4882-9534-200d28192a2a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2vdrw\" (UID: \"5000dfac-bd52-4882-9534-200d28192a2a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" Jul 10 18:39:31.820722 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:31.820677 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5000dfac-bd52-4882-9534-200d28192a2a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2vdrw\" (UID: \"5000dfac-bd52-4882-9534-200d28192a2a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" Jul 10 18:39:31.820802 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:31.820776 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5000dfac-bd52-4882-9534-200d28192a2a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2vdrw\" (UID: \"5000dfac-bd52-4882-9534-200d28192a2a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" Jul 10 18:39:31.820863 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:31.820785 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5000dfac-bd52-4882-9534-200d28192a2a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2vdrw\" (UID: \"5000dfac-bd52-4882-9534-200d28192a2a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" Jul 10 18:39:31.822670 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:31.822648 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5000dfac-bd52-4882-9534-200d28192a2a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2vdrw\" (UID: \"5000dfac-bd52-4882-9534-200d28192a2a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" Jul 10 18:39:31.822968 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:31.822950 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5000dfac-bd52-4882-9534-200d28192a2a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2vdrw\" (UID: \"5000dfac-bd52-4882-9534-200d28192a2a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" Jul 10 18:39:31.829631 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:31.829604 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4gvb\" (UniqueName: \"kubernetes.io/projected/5000dfac-bd52-4882-9534-200d28192a2a-kube-api-access-l4gvb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2vdrw\" (UID: \"5000dfac-bd52-4882-9534-200d28192a2a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" Jul 10 18:39:32.006292 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:32.006254 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" Jul 10 18:39:32.143973 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:32.143947 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw"] Jul 10 18:39:32.146217 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:39:32.146187 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5000dfac_bd52_4882_9534_200d28192a2a.slice/crio-35daabaf402a4f0e6f31e4b9314536483c4e55d076918a764709ffe9aecad4aa WatchSource:0}: Error finding container 35daabaf402a4f0e6f31e4b9314536483c4e55d076918a764709ffe9aecad4aa: Status 404 returned error can't find the container with id 35daabaf402a4f0e6f31e4b9314536483c4e55d076918a764709ffe9aecad4aa Jul 10 18:39:32.690414 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:32.690334 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" event={"ID":"5000dfac-bd52-4882-9534-200d28192a2a","Type":"ContainerStarted","Data":"578ac2392986b1a95a61bd262e36b0124c0721e1e56fb8df25bf051eb7aae676"} Jul 10 18:39:32.690414 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:32.690389 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" event={"ID":"5000dfac-bd52-4882-9534-200d28192a2a","Type":"ContainerStarted","Data":"35daabaf402a4f0e6f31e4b9314536483c4e55d076918a764709ffe9aecad4aa"} Jul 10 18:39:32.709597 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:32.709555 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" podStartSLOduration=1.518709487 podStartE2EDuration="1.70954079s" totalImagesPullingTime="190.831303ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:39:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:39:32.708208795 +0000 UTC m=+791.941413078" watchObservedRunningTime="2026-07-10 18:39:32.70954079 +0000 UTC m=+791.942745049" Jul 10 18:39:42.006660 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:42.006632 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" Jul 10 18:39:42.007062 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:42.006921 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" Jul 10 18:39:42.019221 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:42.019199 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" Jul 10 18:39:42.755724 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:42.755673 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2vdrw" Jul 10 18:39:51.016843 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.016809 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb"] Jul 10 18:39:51.020740 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.020717 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" Jul 10 18:39:51.023157 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.023130 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 10 18:39:51.032085 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.032057 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb"] Jul 10 18:39:51.090221 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.090189 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ada87a1-169f-4758-a6ff-3e265854a600-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9dvfb\" (UID: \"1ada87a1-169f-4758-a6ff-3e265854a600\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" Jul 10 18:39:51.090346 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.090242 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ada87a1-169f-4758-a6ff-3e265854a600-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9dvfb\" (UID: \"1ada87a1-169f-4758-a6ff-3e265854a600\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" Jul 10 18:39:51.090346 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.090260 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ada87a1-169f-4758-a6ff-3e265854a600-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9dvfb\" (UID: \"1ada87a1-169f-4758-a6ff-3e265854a600\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" Jul 10 18:39:51.090346 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.090332 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ada87a1-169f-4758-a6ff-3e265854a600-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9dvfb\" (UID: \"1ada87a1-169f-4758-a6ff-3e265854a600\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" Jul 10 18:39:51.090449 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.090388 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ada87a1-169f-4758-a6ff-3e265854a600-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9dvfb\" (UID: \"1ada87a1-169f-4758-a6ff-3e265854a600\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" Jul 10 18:39:51.090490 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.090448 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tddlb\" (UniqueName: \"kubernetes.io/projected/1ada87a1-169f-4758-a6ff-3e265854a600-kube-api-access-tddlb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9dvfb\" (UID: \"1ada87a1-169f-4758-a6ff-3e265854a600\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" Jul 10 18:39:51.191457 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.191427 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ada87a1-169f-4758-a6ff-3e265854a600-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9dvfb\" (UID: \"1ada87a1-169f-4758-a6ff-3e265854a600\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" Jul 10 18:39:51.191641 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.191482 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ada87a1-169f-4758-a6ff-3e265854a600-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9dvfb\" (UID: \"1ada87a1-169f-4758-a6ff-3e265854a600\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" Jul 10 18:39:51.191641 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.191504 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ada87a1-169f-4758-a6ff-3e265854a600-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9dvfb\" (UID: \"1ada87a1-169f-4758-a6ff-3e265854a600\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" Jul 10 18:39:51.191641 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.191524 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ada87a1-169f-4758-a6ff-3e265854a600-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9dvfb\" (UID: \"1ada87a1-169f-4758-a6ff-3e265854a600\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" Jul 10 18:39:51.191641 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.191549 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ada87a1-169f-4758-a6ff-3e265854a600-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9dvfb\" (UID: \"1ada87a1-169f-4758-a6ff-3e265854a600\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" Jul 10 18:39:51.191641 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.191616 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tddlb\" (UniqueName: \"kubernetes.io/projected/1ada87a1-169f-4758-a6ff-3e265854a600-kube-api-access-tddlb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9dvfb\" (UID: \"1ada87a1-169f-4758-a6ff-3e265854a600\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" Jul 10 18:39:51.192020 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.191997 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ada87a1-169f-4758-a6ff-3e265854a600-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9dvfb\" (UID: \"1ada87a1-169f-4758-a6ff-3e265854a600\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" Jul 10 18:39:51.192080 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.192040 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ada87a1-169f-4758-a6ff-3e265854a600-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9dvfb\" (UID: \"1ada87a1-169f-4758-a6ff-3e265854a600\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" Jul 10 18:39:51.192080 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.192052 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ada87a1-169f-4758-a6ff-3e265854a600-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9dvfb\" (UID: \"1ada87a1-169f-4758-a6ff-3e265854a600\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" Jul 10 18:39:51.193847 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.193825 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ada87a1-169f-4758-a6ff-3e265854a600-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9dvfb\" (UID: \"1ada87a1-169f-4758-a6ff-3e265854a600\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" Jul 10 18:39:51.194040 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.194025 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ada87a1-169f-4758-a6ff-3e265854a600-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9dvfb\" (UID: \"1ada87a1-169f-4758-a6ff-3e265854a600\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" Jul 10 18:39:51.201596 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.201575 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tddlb\" (UniqueName: \"kubernetes.io/projected/1ada87a1-169f-4758-a6ff-3e265854a600-kube-api-access-tddlb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9dvfb\" (UID: \"1ada87a1-169f-4758-a6ff-3e265854a600\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" Jul 10 18:39:51.333439 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.333371 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" Jul 10 18:39:51.475018 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.474993 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb"] Jul 10 18:39:51.476507 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:39:51.476489 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ada87a1_169f_4758_a6ff_3e265854a600.slice/crio-cd1d80421b1f8384e305a21bc14d73a281058e4658c8e02a514788ff038cd383 WatchSource:0}: Error finding container cd1d80421b1f8384e305a21bc14d73a281058e4658c8e02a514788ff038cd383: Status 404 returned error can't find the container with id cd1d80421b1f8384e305a21bc14d73a281058e4658c8e02a514788ff038cd383 Jul 10 18:39:51.794627 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.794593 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" event={"ID":"1ada87a1-169f-4758-a6ff-3e265854a600","Type":"ContainerStarted","Data":"ad666a5b2f0f9f793331cb3eaa7eea09e9c5486ae0aa92dea6e1e0611e36d51e"} Jul 10 18:39:51.794801 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.794658 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" event={"ID":"1ada87a1-169f-4758-a6ff-3e265854a600","Type":"ContainerStarted","Data":"cd1d80421b1f8384e305a21bc14d73a281058e4658c8e02a514788ff038cd383"} Jul 10 18:39:51.812403 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:39:51.812354 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" podStartSLOduration=1.652884829 podStartE2EDuration="1.812336122s" totalImagesPullingTime="159.451293ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:39:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:39:51.810754173 +0000 UTC m=+811.043958432" watchObservedRunningTime="2026-07-10 18:39:51.812336122 +0000 UTC m=+811.045540426" Jul 10 18:40:01.334060 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:40:01.334025 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" Jul 10 18:40:01.334627 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:40:01.334215 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" Jul 10 18:40:01.346461 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:40:01.346438 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" Jul 10 18:40:01.858969 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:40:01.858940 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9dvfb" Jul 10 18:41:21.214650 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:41:21.214576 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5gqq_cfa37e72-ee06-4ff3-996e-d535b0d28d84/console-operator/1.log" Jul 10 18:41:21.215818 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:41:21.215794 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5gqq_cfa37e72-ee06-4ff3-996e-d535b0d28d84/console-operator/1.log" Jul 10 18:41:21.220998 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:41:21.220982 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gfnq_873ff093-ab5b-412b-abad-220e0bb4acc3/ovn-acl-logging/0.log" Jul 10 18:41:21.221982 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:41:21.221962 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gfnq_873ff093-ab5b-412b-abad-220e0bb4acc3/ovn-acl-logging/0.log" Jul 10 18:42:29.327079 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:29.327041 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-548fc9658c-tpqz9"] Jul 10 18:42:29.327632 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:29.327248 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-548fc9658c-tpqz9" podUID="8b121ba8-63f6-41c3-96e1-75e248272e04" containerName="manager" containerID="cri-o://5d64aa648627ff14198a6ad0c5242fbfced9bc972a7386aaee9b54771d42248f" gracePeriod=30 Jul 10 18:42:29.576235 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:29.576205 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-548fc9658c-tpqz9" Jul 10 18:42:29.608016 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:29.607949 2564 generic.go:356] "Generic (PLEG): container finished" podID="8b121ba8-63f6-41c3-96e1-75e248272e04" containerID="5d64aa648627ff14198a6ad0c5242fbfced9bc972a7386aaee9b54771d42248f" exitCode=0 Jul 10 18:42:29.608016 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:29.608003 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-548fc9658c-tpqz9" Jul 10 18:42:29.608191 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:29.608035 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-548fc9658c-tpqz9" event={"ID":"8b121ba8-63f6-41c3-96e1-75e248272e04","Type":"ContainerDied","Data":"5d64aa648627ff14198a6ad0c5242fbfced9bc972a7386aaee9b54771d42248f"} Jul 10 18:42:29.608191 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:29.608108 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-548fc9658c-tpqz9" event={"ID":"8b121ba8-63f6-41c3-96e1-75e248272e04","Type":"ContainerDied","Data":"d63e255f98177501c2a504ecab99bcda2daa11ce2081ca49a400595e9593c3c5"} Jul 10 18:42:29.608191 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:29.608144 2564 scope.go:117] "RemoveContainer" containerID="5d64aa648627ff14198a6ad0c5242fbfced9bc972a7386aaee9b54771d42248f" Jul 10 18:42:29.617926 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:29.617882 2564 scope.go:117] "RemoveContainer" containerID="5d64aa648627ff14198a6ad0c5242fbfced9bc972a7386aaee9b54771d42248f" Jul 10 18:42:29.618212 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:42:29.618191 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d64aa648627ff14198a6ad0c5242fbfced9bc972a7386aaee9b54771d42248f\": container with ID starting with 5d64aa648627ff14198a6ad0c5242fbfced9bc972a7386aaee9b54771d42248f not found: ID does not exist" containerID="5d64aa648627ff14198a6ad0c5242fbfced9bc972a7386aaee9b54771d42248f" Jul 10 18:42:29.618323 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:29.618219 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d64aa648627ff14198a6ad0c5242fbfced9bc972a7386aaee9b54771d42248f"} err="failed to get container status \"5d64aa648627ff14198a6ad0c5242fbfced9bc972a7386aaee9b54771d42248f\": rpc error: code = NotFound desc = could not find container \"5d64aa648627ff14198a6ad0c5242fbfced9bc972a7386aaee9b54771d42248f\": container with ID starting with 5d64aa648627ff14198a6ad0c5242fbfced9bc972a7386aaee9b54771d42248f not found: ID does not exist" Jul 10 18:42:29.681579 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:29.681556 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b121ba8-63f6-41c3-96e1-75e248272e04-webhook-cert\") pod \"8b121ba8-63f6-41c3-96e1-75e248272e04\" (UID: \"8b121ba8-63f6-41c3-96e1-75e248272e04\") " Jul 10 18:42:29.681685 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:29.681671 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpn8j\" (UniqueName: \"kubernetes.io/projected/8b121ba8-63f6-41c3-96e1-75e248272e04-kube-api-access-jpn8j\") pod \"8b121ba8-63f6-41c3-96e1-75e248272e04\" (UID: \"8b121ba8-63f6-41c3-96e1-75e248272e04\") " Jul 10 18:42:29.683612 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:29.683585 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b121ba8-63f6-41c3-96e1-75e248272e04-kube-api-access-jpn8j" (OuterVolumeSpecName: "kube-api-access-jpn8j") pod "8b121ba8-63f6-41c3-96e1-75e248272e04" (UID: "8b121ba8-63f6-41c3-96e1-75e248272e04"). InnerVolumeSpecName "kube-api-access-jpn8j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:42:29.683725 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:29.683589 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b121ba8-63f6-41c3-96e1-75e248272e04-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8b121ba8-63f6-41c3-96e1-75e248272e04" (UID: "8b121ba8-63f6-41c3-96e1-75e248272e04"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 18:42:29.783230 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:29.783205 2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b121ba8-63f6-41c3-96e1-75e248272e04-webhook-cert\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:42:29.783230 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:29.783229 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpn8j\" (UniqueName: \"kubernetes.io/projected/8b121ba8-63f6-41c3-96e1-75e248272e04-kube-api-access-jpn8j\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:42:29.929843 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:29.929814 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-548fc9658c-tpqz9"] Jul 10 18:42:29.934138 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:29.934118 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-548fc9658c-tpqz9"] Jul 10 18:42:30.685714 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:30.685674 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-548fc9658c-qkwf9"] Jul 10 18:42:30.686139 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:30.686124 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b121ba8-63f6-41c3-96e1-75e248272e04" containerName="manager" Jul 10 18:42:30.686183 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:30.686140 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b121ba8-63f6-41c3-96e1-75e248272e04" containerName="manager" Jul 10 18:42:30.686218 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:30.686199 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b121ba8-63f6-41c3-96e1-75e248272e04" containerName="manager" Jul 10 18:42:30.690645 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:30.690628 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-548fc9658c-qkwf9" Jul 10 18:42:30.693964 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:30.693939 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 10 18:42:30.694093 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:30.693940 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 10 18:42:30.694093 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:30.693994 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-d762t\"" Jul 10 18:42:30.697625 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:30.697604 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-548fc9658c-qkwf9"] Jul 10 18:42:30.792555 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:30.792526 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e80b2b1-83e2-4eea-ac8f-af6c36c6c78c-webhook-cert\") pod \"maas-controller-548fc9658c-qkwf9\" (UID: \"1e80b2b1-83e2-4eea-ac8f-af6c36c6c78c\") " pod="opendatahub/maas-controller-548fc9658c-qkwf9" Jul 10 18:42:30.792672 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:30.792568 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcgpt\" (UniqueName: \"kubernetes.io/projected/1e80b2b1-83e2-4eea-ac8f-af6c36c6c78c-kube-api-access-fcgpt\") pod \"maas-controller-548fc9658c-qkwf9\" (UID: \"1e80b2b1-83e2-4eea-ac8f-af6c36c6c78c\") " pod="opendatahub/maas-controller-548fc9658c-qkwf9" Jul 10 18:42:30.893964 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:30.893927 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e80b2b1-83e2-4eea-ac8f-af6c36c6c78c-webhook-cert\") pod \"maas-controller-548fc9658c-qkwf9\" (UID: \"1e80b2b1-83e2-4eea-ac8f-af6c36c6c78c\") " pod="opendatahub/maas-controller-548fc9658c-qkwf9" Jul 10 18:42:30.894081 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:30.893986 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcgpt\" (UniqueName: \"kubernetes.io/projected/1e80b2b1-83e2-4eea-ac8f-af6c36c6c78c-kube-api-access-fcgpt\") pod \"maas-controller-548fc9658c-qkwf9\" (UID: \"1e80b2b1-83e2-4eea-ac8f-af6c36c6c78c\") " pod="opendatahub/maas-controller-548fc9658c-qkwf9" Jul 10 18:42:30.896275 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:30.896253 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e80b2b1-83e2-4eea-ac8f-af6c36c6c78c-webhook-cert\") pod \"maas-controller-548fc9658c-qkwf9\" (UID: \"1e80b2b1-83e2-4eea-ac8f-af6c36c6c78c\") " pod="opendatahub/maas-controller-548fc9658c-qkwf9" Jul 10 18:42:30.903341 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:30.903317 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcgpt\" (UniqueName: \"kubernetes.io/projected/1e80b2b1-83e2-4eea-ac8f-af6c36c6c78c-kube-api-access-fcgpt\") pod \"maas-controller-548fc9658c-qkwf9\" (UID: \"1e80b2b1-83e2-4eea-ac8f-af6c36c6c78c\") " pod="opendatahub/maas-controller-548fc9658c-qkwf9" Jul 10 18:42:31.003502 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:31.003464 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-548fc9658c-qkwf9" Jul 10 18:42:31.139712 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:31.139676 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-548fc9658c-qkwf9"] Jul 10 18:42:31.142300 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:42:31.142270 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e80b2b1_83e2_4eea_ac8f_af6c36c6c78c.slice/crio-1528f68cd3dbf0bf8cec33df372c75d9004c541af18d7bbfb8f9e4c829a602d1 WatchSource:0}: Error finding container 1528f68cd3dbf0bf8cec33df372c75d9004c541af18d7bbfb8f9e4c829a602d1: Status 404 returned error can't find the container with id 1528f68cd3dbf0bf8cec33df372c75d9004c541af18d7bbfb8f9e4c829a602d1 Jul 10 18:42:31.143732 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:31.143689 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 18:42:31.409154 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:31.409067 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b121ba8-63f6-41c3-96e1-75e248272e04" path="/var/lib/kubelet/pods/8b121ba8-63f6-41c3-96e1-75e248272e04/volumes" Jul 10 18:42:31.626915 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:31.626882 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-548fc9658c-qkwf9" event={"ID":"1e80b2b1-83e2-4eea-ac8f-af6c36c6c78c","Type":"ContainerStarted","Data":"1528f68cd3dbf0bf8cec33df372c75d9004c541af18d7bbfb8f9e4c829a602d1"} Jul 10 18:42:32.633740 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:32.633681 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-548fc9658c-qkwf9" event={"ID":"1e80b2b1-83e2-4eea-ac8f-af6c36c6c78c","Type":"ContainerStarted","Data":"562f06cb98c6e78c6fbcb6571b781da367396543ba20ee81675bab1040db2a65"} Jul 10 18:42:32.634121 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:32.633814 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-548fc9658c-qkwf9" Jul 10 18:42:32.656921 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:32.656874 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-548fc9658c-qkwf9" podStartSLOduration=2.123562084 podStartE2EDuration="2.656835234s" totalImagesPullingTime="533.27315ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:42:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:42:32.654565912 +0000 UTC m=+971.887770183" watchObservedRunningTime="2026-07-10 18:42:32.656835234 +0000 UTC m=+971.890039493" Jul 10 18:42:43.644691 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:42:43.644614 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-548fc9658c-qkwf9" Jul 10 18:46:21.247600 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:46:21.247572 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5gqq_cfa37e72-ee06-4ff3-996e-d535b0d28d84/console-operator/1.log" Jul 10 18:46:21.250465 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:46:21.250444 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5gqq_cfa37e72-ee06-4ff3-996e-d535b0d28d84/console-operator/1.log" Jul 10 18:46:21.254407 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:46:21.254386 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gfnq_873ff093-ab5b-412b-abad-220e0bb4acc3/ovn-acl-logging/0.log" Jul 10 18:46:21.257059 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:46:21.257043 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gfnq_873ff093-ab5b-412b-abad-220e0bb4acc3/ovn-acl-logging/0.log" Jul 10 18:47:05.557728 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:47:05.557673 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5h2k"] Jul 10 18:47:05.558313 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:47:05.557886 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5h2k" podUID="6838b025-bfb1-4fe9-8f63-4a00bd8328ca" containerName="manager" containerID="cri-o://44c078b7fcbafb17a563db29f8a241cdf980a82032e862a49e7840671d4c6dd6" gracePeriod=10 Jul 10 18:47:08.519406 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:47:08.519383 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5h2k" Jul 10 18:47:08.702994 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:47:08.702971 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgjh4\" (UniqueName: \"kubernetes.io/projected/6838b025-bfb1-4fe9-8f63-4a00bd8328ca-kube-api-access-jgjh4\") pod \"6838b025-bfb1-4fe9-8f63-4a00bd8328ca\" (UID: \"6838b025-bfb1-4fe9-8f63-4a00bd8328ca\") " Jul 10 18:47:08.703152 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:47:08.703035 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6838b025-bfb1-4fe9-8f63-4a00bd8328ca-extensions-socket-volume\") pod \"6838b025-bfb1-4fe9-8f63-4a00bd8328ca\" (UID: \"6838b025-bfb1-4fe9-8f63-4a00bd8328ca\") " Jul 10 18:47:08.703347 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:47:08.703321 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6838b025-bfb1-4fe9-8f63-4a00bd8328ca-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6838b025-bfb1-4fe9-8f63-4a00bd8328ca" (UID: "6838b025-bfb1-4fe9-8f63-4a00bd8328ca"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 18:47:08.705025 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:47:08.705005 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6838b025-bfb1-4fe9-8f63-4a00bd8328ca-kube-api-access-jgjh4" (OuterVolumeSpecName: "kube-api-access-jgjh4") pod "6838b025-bfb1-4fe9-8f63-4a00bd8328ca" (UID: "6838b025-bfb1-4fe9-8f63-4a00bd8328ca"). InnerVolumeSpecName "kube-api-access-jgjh4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 18:47:08.804596 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:47:08.804572 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgjh4\" (UniqueName: \"kubernetes.io/projected/6838b025-bfb1-4fe9-8f63-4a00bd8328ca-kube-api-access-jgjh4\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:47:08.804596 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:47:08.804593 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6838b025-bfb1-4fe9-8f63-4a00bd8328ca-extensions-socket-volume\") on node \"ip-10-0-136-57.ec2.internal\" DevicePath \"\"" Jul 10 18:47:09.048431 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:47:09.048346 2564 generic.go:356] "Generic (PLEG): container finished" podID="6838b025-bfb1-4fe9-8f63-4a00bd8328ca" containerID="44c078b7fcbafb17a563db29f8a241cdf980a82032e862a49e7840671d4c6dd6" exitCode=0 Jul 10 18:47:09.048431 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:47:09.048396 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5h2k" Jul 10 18:47:09.048605 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:47:09.048427 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5h2k" event={"ID":"6838b025-bfb1-4fe9-8f63-4a00bd8328ca","Type":"ContainerDied","Data":"44c078b7fcbafb17a563db29f8a241cdf980a82032e862a49e7840671d4c6dd6"} Jul 10 18:47:09.048605 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:47:09.048476 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5h2k" event={"ID":"6838b025-bfb1-4fe9-8f63-4a00bd8328ca","Type":"ContainerDied","Data":"66cf17771e387b819135e9db00c59e12f7eae11da18584540aec984157295a2b"} Jul 10 18:47:09.048605 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:47:09.048500 2564 scope.go:117] "RemoveContainer" containerID="44c078b7fcbafb17a563db29f8a241cdf980a82032e862a49e7840671d4c6dd6" Jul 10 18:47:09.058562 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:47:09.058546 2564 scope.go:117] "RemoveContainer" containerID="44c078b7fcbafb17a563db29f8a241cdf980a82032e862a49e7840671d4c6dd6" Jul 10 18:47:09.058809 ip-10-0-136-57 kubenswrapper[2564]: E0710 18:47:09.058791 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44c078b7fcbafb17a563db29f8a241cdf980a82032e862a49e7840671d4c6dd6\": container with ID starting with 44c078b7fcbafb17a563db29f8a241cdf980a82032e862a49e7840671d4c6dd6 not found: ID does not exist" containerID="44c078b7fcbafb17a563db29f8a241cdf980a82032e862a49e7840671d4c6dd6" Jul 10 18:47:09.058860 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:47:09.058818 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44c078b7fcbafb17a563db29f8a241cdf980a82032e862a49e7840671d4c6dd6"} err="failed to get container status \"44c078b7fcbafb17a563db29f8a241cdf980a82032e862a49e7840671d4c6dd6\": rpc error: code = NotFound desc = could not find container \"44c078b7fcbafb17a563db29f8a241cdf980a82032e862a49e7840671d4c6dd6\": container with ID starting with 44c078b7fcbafb17a563db29f8a241cdf980a82032e862a49e7840671d4c6dd6 not found: ID does not exist" Jul 10 18:47:09.071243 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:47:09.071219 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5h2k"] Jul 10 18:47:09.075204 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:47:09.075180 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5h2k"] Jul 10 18:47:09.414438 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:47:09.414347 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6838b025-bfb1-4fe9-8f63-4a00bd8328ca" path="/var/lib/kubelet/pods/6838b025-bfb1-4fe9-8f63-4a00bd8328ca/volumes" Jul 10 18:48:06.700621 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:48:06.700583 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpzms"] Jul 10 18:48:06.701108 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:48:06.701002 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6838b025-bfb1-4fe9-8f63-4a00bd8328ca" containerName="manager" Jul 10 18:48:06.701108 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:48:06.701013 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6838b025-bfb1-4fe9-8f63-4a00bd8328ca" containerName="manager" Jul 10 18:48:06.701108 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:48:06.701089 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6838b025-bfb1-4fe9-8f63-4a00bd8328ca" containerName="manager" Jul 10 18:48:06.704136 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:48:06.704120 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpzms" Jul 10 18:48:06.706946 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:48:06.706926 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bwhwp\"" Jul 10 18:48:06.717930 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:48:06.717906 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpzms"] Jul 10 18:48:06.803427 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:48:06.803400 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6658p\" (UniqueName: \"kubernetes.io/projected/35dde09a-0335-4d16-8176-f32f4042610c-kube-api-access-6658p\") pod \"kuadrant-operator-controller-manager-86878c769f-kpzms\" (UID: \"35dde09a-0335-4d16-8176-f32f4042610c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpzms" Jul 10 18:48:06.803544 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:48:06.803454 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35dde09a-0335-4d16-8176-f32f4042610c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kpzms\" (UID: \"35dde09a-0335-4d16-8176-f32f4042610c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpzms" Jul 10 18:48:06.904464 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:48:06.904438 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6658p\" (UniqueName: \"kubernetes.io/projected/35dde09a-0335-4d16-8176-f32f4042610c-kube-api-access-6658p\") pod \"kuadrant-operator-controller-manager-86878c769f-kpzms\" (UID: \"35dde09a-0335-4d16-8176-f32f4042610c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpzms" Jul 10 18:48:06.904607 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:48:06.904508 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35dde09a-0335-4d16-8176-f32f4042610c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kpzms\" (UID: \"35dde09a-0335-4d16-8176-f32f4042610c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpzms" Jul 10 18:48:06.904894 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:48:06.904876 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35dde09a-0335-4d16-8176-f32f4042610c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kpzms\" (UID: \"35dde09a-0335-4d16-8176-f32f4042610c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpzms" Jul 10 18:48:06.912967 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:48:06.912940 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6658p\" (UniqueName: \"kubernetes.io/projected/35dde09a-0335-4d16-8176-f32f4042610c-kube-api-access-6658p\") pod \"kuadrant-operator-controller-manager-86878c769f-kpzms\" (UID: \"35dde09a-0335-4d16-8176-f32f4042610c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpzms" Jul 10 18:48:07.014919 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:48:07.014861 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpzms" Jul 10 18:48:07.158592 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:48:07.158570 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpzms"] Jul 10 18:48:07.160472 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:48:07.160438 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35dde09a_0335_4d16_8176_f32f4042610c.slice/crio-81942b8f0407b19b8d7c53637dad58cb59a636a1bffa541dde27c80928e6dc4f WatchSource:0}: Error finding container 81942b8f0407b19b8d7c53637dad58cb59a636a1bffa541dde27c80928e6dc4f: Status 404 returned error can't find the container with id 81942b8f0407b19b8d7c53637dad58cb59a636a1bffa541dde27c80928e6dc4f Jul 10 18:48:07.348872 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:48:07.348797 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpzms" event={"ID":"35dde09a-0335-4d16-8176-f32f4042610c","Type":"ContainerStarted","Data":"f74cb4ca0713d03d9bdca19e2473a8b6496e9257e3eac0fddf4e909775012660"} Jul 10 18:48:07.348872 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:48:07.348848 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpzms" event={"ID":"35dde09a-0335-4d16-8176-f32f4042610c","Type":"ContainerStarted","Data":"81942b8f0407b19b8d7c53637dad58cb59a636a1bffa541dde27c80928e6dc4f"} Jul 10 18:48:07.349066 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:48:07.348915 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpzms" Jul 10 18:48:07.378866 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:48:07.378813 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpzms" podStartSLOduration=1.378796776 podStartE2EDuration="1.378796776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 18:48:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:48:07.368572798 +0000 UTC m=+1306.601777069" watchObservedRunningTime="2026-07-10 18:48:07.378796776 +0000 UTC m=+1306.612001036" Jul 10 18:48:18.357331 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:48:18.357301 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kpzms" Jul 10 18:51:21.281211 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:51:21.281184 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5gqq_cfa37e72-ee06-4ff3-996e-d535b0d28d84/console-operator/1.log" Jul 10 18:51:21.285626 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:51:21.285600 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5gqq_cfa37e72-ee06-4ff3-996e-d535b0d28d84/console-operator/1.log" Jul 10 18:51:21.288067 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:51:21.288048 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gfnq_873ff093-ab5b-412b-abad-220e0bb4acc3/ovn-acl-logging/0.log" Jul 10 18:51:21.292239 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:51:21.292221 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gfnq_873ff093-ab5b-412b-abad-220e0bb4acc3/ovn-acl-logging/0.log" Jul 10 18:56:21.313766 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:56:21.313648 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5gqq_cfa37e72-ee06-4ff3-996e-d535b0d28d84/console-operator/1.log" Jul 10 18:56:21.320474 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:56:21.320448 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5gqq_cfa37e72-ee06-4ff3-996e-d535b0d28d84/console-operator/1.log" Jul 10 18:56:21.320474 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:56:21.320462 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gfnq_873ff093-ab5b-412b-abad-220e0bb4acc3/ovn-acl-logging/0.log" Jul 10 18:56:21.337420 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:56:21.337398 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9gfnq_873ff093-ab5b-412b-abad-220e0bb4acc3/ovn-acl-logging/0.log" Jul 10 18:57:21.945004 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:21.944975 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-55gjq_741d8beb-644b-4019-b357-c6aca1f0abfa/manager/0.log" Jul 10 18:57:22.064336 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:22.064305 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-2sxb9_9e15eeeb-5bd4-42d7-8deb-b27f637d58cf/manager/0.log" Jul 10 18:57:22.187567 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:22.187539 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-548fc9658c-qkwf9_1e80b2b1-83e2-4eea-ac8f-af6c36c6c78c/manager/0.log" Jul 10 18:57:22.295002 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:22.294939 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-hxdqc_8d5689f9-7294-4091-b141-014e66ebe175/server/0.log" Jul 10 18:57:22.413075 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:22.413047 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-75kc6_5be58ed1-f611-49d7-baf4-5f7712cf5567/manager/0.log" Jul 10 18:57:22.795826 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:22.795799 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5488d6dcc-xg8qm_a8e76c0a-f1ec-48fd-8562-d36abdbb10f7/manager/0.log" Jul 10 18:57:22.802689 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:22.802669 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5488d6dcc-xg8qm_a8e76c0a-f1ec-48fd-8562-d36abdbb10f7/copy-manifests/0.log" Jul 10 18:57:23.131676 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:23.131590 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-65ccc6b695-22xmh_67ede1b6-441a-4316-818a-c15d4abe3cd4/maas-api/0.log" Jul 10 18:57:24.632070 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:24.632036 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-qwfcp_17c957ee-d78e-4661-8d63-9c1c310d45af/manager/0.log" Jul 10 18:57:24.856233 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:24.856207 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-5xb65_ebecdd62-f455-4a5b-a04c-01435ce434b3/kuadrant-console-plugin/0.log" Jul 10 18:57:24.975008 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:24.974982 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-nl5np_fa9a2be0-bbb7-48c7-94d8-754311222ff8/registry-server/0.log" Jul 10 18:57:25.105297 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:25.105273 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-kpzms_35dde09a-0335-4d16-8176-f32f4042610c/manager/0.log" Jul 10 18:57:25.745393 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:25.745365 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678ggg8d_f2f90090-6b5d-469e-ad26-983000f794b4/istio-proxy/0.log" Jul 10 18:57:26.084454 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:26.084366 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dd47df98c-wkh7n_246f3a19-773d-427c-bcba-c5bee68f4d76/kube-auth-proxy/0.log" Jul 10 18:57:26.202423 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:26.202378 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-gdj7f_5e8a7446-6687-4c74-b561-02347f6148ef/istio-proxy/1.log" Jul 10 18:57:26.435220 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:26.435136 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-jgkjx_8926f5ea-7724-49e2-8855-29e4512fb196/payload-processing/0.log" Jul 10 18:57:26.551984 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:26.551954 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78fd8c8fc4-8wvsg_96b5e2d3-67f8-4bef-a56e-a44799345c04/router/0.log" Jul 10 18:57:26.894479 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:26.894451 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-6b7cc_10ed6a9d-75e6-4af9-8ae2-2428e724e620/main/0.log" Jul 10 18:57:27.121594 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:27.121569 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-2vdrw_5000dfac-bd52-4882-9534-200d28192a2a/main/0.log" Jul 10 18:57:27.351978 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:27.351952 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-9dvfb_1ada87a1-169f-4758-a6ff-3e265854a600/main/0.log" Jul 10 18:57:34.405500 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:34.405466 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6gtxh_94b9498d-bd74-4e9c-8177-c152abdacbb9/global-pull-secret-syncer/0.log" Jul 10 18:57:34.570570 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:34.570538 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h56zp_fc310c5e-2173-456f-ad25-4c5f1d990dca/konnectivity-agent/0.log" Jul 10 18:57:34.648007 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:34.647979 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-57.ec2.internal_f8d1abcbcf866db0239ee93f6a04f030/haproxy/0.log" Jul 10 18:57:40.085789 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:40.085753 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-qwfcp_17c957ee-d78e-4661-8d63-9c1c310d45af/manager/0.log" Jul 10 18:57:40.148905 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:40.148880 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-5xb65_ebecdd62-f455-4a5b-a04c-01435ce434b3/kuadrant-console-plugin/0.log" Jul 10 18:57:40.187693 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:40.187670 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-nl5np_fa9a2be0-bbb7-48c7-94d8-754311222ff8/registry-server/0.log" Jul 10 18:57:40.268001 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:40.267974 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-kpzms_35dde09a-0335-4d16-8176-f32f4042610c/manager/0.log" Jul 10 18:57:41.829719 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:41.829677 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5d53a302-033c-47ca-a20c-e4c141e039b8/alertmanager/0.log" Jul 10 18:57:41.859389 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:41.859367 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5d53a302-033c-47ca-a20c-e4c141e039b8/config-reloader/0.log" Jul 10 18:57:41.886490 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:41.886467 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5d53a302-033c-47ca-a20c-e4c141e039b8/kube-rbac-proxy-web/0.log" Jul 10 18:57:41.913501 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:41.913482 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5d53a302-033c-47ca-a20c-e4c141e039b8/kube-rbac-proxy/0.log" Jul 10 18:57:41.943392 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:41.943367 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5d53a302-033c-47ca-a20c-e4c141e039b8/kube-rbac-proxy-metric/0.log" Jul 10 18:57:41.974481 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:41.974461 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5d53a302-033c-47ca-a20c-e4c141e039b8/prom-label-proxy/0.log" Jul 10 18:57:42.004050 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:42.004033 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5d53a302-033c-47ca-a20c-e4c141e039b8/init-config-reloader/0.log" Jul 10 18:57:42.105158 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:42.105096 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-xrrzm_da15b0c8-588c-4876-9c48-55c4ba22d317/kube-state-metrics/0.log" Jul 10 18:57:42.135473 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:42.135441 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-xrrzm_da15b0c8-588c-4876-9c48-55c4ba22d317/kube-rbac-proxy-main/0.log" Jul 10 18:57:42.163742 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:42.163722 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-xrrzm_da15b0c8-588c-4876-9c48-55c4ba22d317/kube-rbac-proxy-self/0.log" Jul 10 18:57:42.235907 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:42.235889 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-4vvdt_ea501729-9139-4744-85c4-2a1d19691f3f/monitoring-plugin/0.log" Jul 10 18:57:42.276618 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:42.276586 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9gr8x_0d83ab8e-ab03-4450-bd77-cc6c8c3df976/node-exporter/0.log" Jul 10 18:57:42.312784 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:42.312758 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9gr8x_0d83ab8e-ab03-4450-bd77-cc6c8c3df976/kube-rbac-proxy/0.log" Jul 10 18:57:42.346433 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:42.346417 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9gr8x_0d83ab8e-ab03-4450-bd77-cc6c8c3df976/init-textfile/0.log" Jul 10 18:57:43.229117 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:43.229090 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6687456d6c-scxpm_b7a43ed7-470a-45fe-a90e-3465b1a29d9c/telemeter-client/0.log" Jul 10 18:57:43.256461 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:43.256402 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6687456d6c-scxpm_b7a43ed7-470a-45fe-a90e-3465b1a29d9c/reload/0.log" Jul 10 18:57:43.283632 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:43.283610 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6687456d6c-scxpm_b7a43ed7-470a-45fe-a90e-3465b1a29d9c/kube-rbac-proxy/0.log" Jul 10 18:57:44.524439 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:44.524409 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zvmwd/perf-node-gather-daemonset-xrhnc"] Jul 10 18:57:44.528138 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:44.528122 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zvmwd/perf-node-gather-daemonset-xrhnc" Jul 10 18:57:44.530437 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:44.530413 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zvmwd\"/\"kube-root-ca.crt\"" Jul 10 18:57:44.531264 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:44.531243 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zvmwd\"/\"default-dockercfg-b4dbf\"" Jul 10 18:57:44.531374 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:44.531246 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zvmwd\"/\"openshift-service-ca.crt\"" Jul 10 18:57:44.534352 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:44.534332 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zvmwd/perf-node-gather-daemonset-xrhnc"] Jul 10 18:57:44.647104 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:44.647075 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/39e93999-a743-4ef8-b3ae-1ca0e55ab478-proc\") pod \"perf-node-gather-daemonset-xrhnc\" (UID: \"39e93999-a743-4ef8-b3ae-1ca0e55ab478\") " pod="openshift-must-gather-zvmwd/perf-node-gather-daemonset-xrhnc" Jul 10 18:57:44.647312 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:44.647109 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/39e93999-a743-4ef8-b3ae-1ca0e55ab478-podres\") pod \"perf-node-gather-daemonset-xrhnc\" (UID: \"39e93999-a743-4ef8-b3ae-1ca0e55ab478\") " pod="openshift-must-gather-zvmwd/perf-node-gather-daemonset-xrhnc" Jul 10 18:57:44.647312 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:44.647207 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4fmg\" (UniqueName: \"kubernetes.io/projected/39e93999-a743-4ef8-b3ae-1ca0e55ab478-kube-api-access-c4fmg\") pod \"perf-node-gather-daemonset-xrhnc\" (UID: \"39e93999-a743-4ef8-b3ae-1ca0e55ab478\") " pod="openshift-must-gather-zvmwd/perf-node-gather-daemonset-xrhnc" Jul 10 18:57:44.647312 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:44.647241 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39e93999-a743-4ef8-b3ae-1ca0e55ab478-lib-modules\") pod \"perf-node-gather-daemonset-xrhnc\" (UID: \"39e93999-a743-4ef8-b3ae-1ca0e55ab478\") " pod="openshift-must-gather-zvmwd/perf-node-gather-daemonset-xrhnc" Jul 10 18:57:44.647312 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:44.647288 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39e93999-a743-4ef8-b3ae-1ca0e55ab478-sys\") pod \"perf-node-gather-daemonset-xrhnc\" (UID: \"39e93999-a743-4ef8-b3ae-1ca0e55ab478\") " pod="openshift-must-gather-zvmwd/perf-node-gather-daemonset-xrhnc" Jul 10 18:57:44.748069 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:44.748036 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4fmg\" (UniqueName: \"kubernetes.io/projected/39e93999-a743-4ef8-b3ae-1ca0e55ab478-kube-api-access-c4fmg\") pod \"perf-node-gather-daemonset-xrhnc\" (UID: \"39e93999-a743-4ef8-b3ae-1ca0e55ab478\") " pod="openshift-must-gather-zvmwd/perf-node-gather-daemonset-xrhnc" Jul 10 18:57:44.748197 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:44.748076 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39e93999-a743-4ef8-b3ae-1ca0e55ab478-lib-modules\") pod \"perf-node-gather-daemonset-xrhnc\" (UID: \"39e93999-a743-4ef8-b3ae-1ca0e55ab478\") " pod="openshift-must-gather-zvmwd/perf-node-gather-daemonset-xrhnc" Jul 10 18:57:44.748197 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:44.748103 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39e93999-a743-4ef8-b3ae-1ca0e55ab478-sys\") pod \"perf-node-gather-daemonset-xrhnc\" (UID: \"39e93999-a743-4ef8-b3ae-1ca0e55ab478\") " pod="openshift-must-gather-zvmwd/perf-node-gather-daemonset-xrhnc" Jul 10 18:57:44.748197 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:44.748141 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/39e93999-a743-4ef8-b3ae-1ca0e55ab478-proc\") pod \"perf-node-gather-daemonset-xrhnc\" (UID: \"39e93999-a743-4ef8-b3ae-1ca0e55ab478\") " pod="openshift-must-gather-zvmwd/perf-node-gather-daemonset-xrhnc" Jul 10 18:57:44.748197 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:44.748165 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/39e93999-a743-4ef8-b3ae-1ca0e55ab478-podres\") pod \"perf-node-gather-daemonset-xrhnc\" (UID: \"39e93999-a743-4ef8-b3ae-1ca0e55ab478\") " pod="openshift-must-gather-zvmwd/perf-node-gather-daemonset-xrhnc" Jul 10 18:57:44.748361 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:44.748228 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39e93999-a743-4ef8-b3ae-1ca0e55ab478-lib-modules\") pod \"perf-node-gather-daemonset-xrhnc\" (UID: \"39e93999-a743-4ef8-b3ae-1ca0e55ab478\") " pod="openshift-must-gather-zvmwd/perf-node-gather-daemonset-xrhnc" Jul 10 18:57:44.748361 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:44.748234 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39e93999-a743-4ef8-b3ae-1ca0e55ab478-sys\") pod \"perf-node-gather-daemonset-xrhnc\" (UID: \"39e93999-a743-4ef8-b3ae-1ca0e55ab478\") " pod="openshift-must-gather-zvmwd/perf-node-gather-daemonset-xrhnc" Jul 10 18:57:44.748361 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:44.748262 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/39e93999-a743-4ef8-b3ae-1ca0e55ab478-proc\") pod \"perf-node-gather-daemonset-xrhnc\" (UID: \"39e93999-a743-4ef8-b3ae-1ca0e55ab478\") " pod="openshift-must-gather-zvmwd/perf-node-gather-daemonset-xrhnc" Jul 10 18:57:44.748361 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:44.748293 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/39e93999-a743-4ef8-b3ae-1ca0e55ab478-podres\") pod \"perf-node-gather-daemonset-xrhnc\" (UID: \"39e93999-a743-4ef8-b3ae-1ca0e55ab478\") " pod="openshift-must-gather-zvmwd/perf-node-gather-daemonset-xrhnc" Jul 10 18:57:44.757994 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:44.757970 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4fmg\" (UniqueName: \"kubernetes.io/projected/39e93999-a743-4ef8-b3ae-1ca0e55ab478-kube-api-access-c4fmg\") pod \"perf-node-gather-daemonset-xrhnc\" (UID: \"39e93999-a743-4ef8-b3ae-1ca0e55ab478\") " pod="openshift-must-gather-zvmwd/perf-node-gather-daemonset-xrhnc" Jul 10 18:57:44.839940 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:44.839882 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zvmwd/perf-node-gather-daemonset-xrhnc" Jul 10 18:57:44.976915 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:44.976885 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zvmwd/perf-node-gather-daemonset-xrhnc"] Jul 10 18:57:44.978310 ip-10-0-136-57 kubenswrapper[2564]: W0710 18:57:44.978280 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod39e93999_a743_4ef8_b3ae_1ca0e55ab478.slice/crio-be444f8d66fecd2e991f5b6567e30863174bca6ffa3d543ed6bf6f132de87ae5 WatchSource:0}: Error finding container be444f8d66fecd2e991f5b6567e30863174bca6ffa3d543ed6bf6f132de87ae5: Status 404 returned error can't find the container with id be444f8d66fecd2e991f5b6567e30863174bca6ffa3d543ed6bf6f132de87ae5 Jul 10 18:57:45.319110 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:45.319072 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zvmwd/perf-node-gather-daemonset-xrhnc" event={"ID":"39e93999-a743-4ef8-b3ae-1ca0e55ab478","Type":"ContainerStarted","Data":"3f19fbeebb33a2be6a8908e12ba0a888091f4367a694389fb5146af9f30efa60"} Jul 10 18:57:45.319268 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:45.319210 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zvmwd/perf-node-gather-daemonset-xrhnc" Jul 10 18:57:45.319268 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:45.319256 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zvmwd/perf-node-gather-daemonset-xrhnc" event={"ID":"39e93999-a743-4ef8-b3ae-1ca0e55ab478","Type":"ContainerStarted","Data":"be444f8d66fecd2e991f5b6567e30863174bca6ffa3d543ed6bf6f132de87ae5"} Jul 10 18:57:45.336192 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:45.336143 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zvmwd/perf-node-gather-daemonset-xrhnc" podStartSLOduration=1.3361314229999999 podStartE2EDuration="1.336131423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 18:57:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 18:57:45.334153578 +0000 UTC m=+1884.567357849" watchObservedRunningTime="2026-07-10 18:57:45.336131423 +0000 UTC m=+1884.569335683" Jul 10 18:57:45.370512 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:45.370486 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5gqq_cfa37e72-ee06-4ff3-996e-d535b0d28d84/console-operator/1.log" Jul 10 18:57:45.374655 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:45.374629 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c5gqq_cfa37e72-ee06-4ff3-996e-d535b0d28d84/console-operator/2.log" Jul 10 18:57:45.852247 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:45.852205 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5959598658-v4qcv_fca142b2-ae40-47a0-ba7e-3023560eb010/console/0.log" Jul 10 18:57:47.599736 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:47.599690 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6sg5z_c2dcab33-d174-4c8e-92eb-c8a78b94080a/dns/0.log" Jul 10 18:57:47.625069 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:47.625049 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6sg5z_c2dcab33-d174-4c8e-92eb-c8a78b94080a/kube-rbac-proxy/0.log" Jul 10 18:57:47.757989 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:47.757964 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-grgmt_3f2651c8-dc6e-49db-b2f4-b152113e0b78/dns-node-resolver/0.log" Jul 10 18:57:48.361016 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:48.360988 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n95vc_9b8880de-adae-4ec1-93bd-fc39231ad6b0/node-ca/0.log" Jul 10 18:57:49.409887 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:49.409857 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678ggg8d_f2f90090-6b5d-469e-ad26-983000f794b4/istio-proxy/0.log" Jul 10 18:57:49.527850 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:49.527823 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dd47df98c-wkh7n_246f3a19-773d-427c-bcba-c5bee68f4d76/kube-auth-proxy/0.log" Jul 10 18:57:49.565096 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:49.565066 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-gdj7f_5e8a7446-6687-4c74-b561-02347f6148ef/istio-proxy/0.log" Jul 10 18:57:49.595354 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:49.595327 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-gdj7f_5e8a7446-6687-4c74-b561-02347f6148ef/istio-proxy/1.log" Jul 10 18:57:49.675386 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:49.675310 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-jgkjx_8926f5ea-7724-49e2-8855-29e4512fb196/payload-processing/0.log" Jul 10 18:57:49.736268 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:49.736248 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78fd8c8fc4-8wvsg_96b5e2d3-67f8-4bef-a56e-a44799345c04/router/0.log" Jul 10 18:57:50.482630 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:50.482589 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sxdkk_e2ef7c40-e1d7-4e54-abf6-59aa70f9a5eb/serve-healthcheck-canary/0.log" Jul 10 18:57:51.147311 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:51.147271 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nm5ph_442c9e87-d74f-457f-a8ee-e4321cdd9fff/kube-rbac-proxy/0.log" Jul 10 18:57:51.178964 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:51.178927 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nm5ph_442c9e87-d74f-457f-a8ee-e4321cdd9fff/exporter/0.log" Jul 10 18:57:51.202814 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:51.202791 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nm5ph_442c9e87-d74f-457f-a8ee-e4321cdd9fff/extractor/0.log" Jul 10 18:57:51.333653 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:51.333631 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zvmwd/perf-node-gather-daemonset-xrhnc" Jul 10 18:57:53.372417 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:53.372384 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-55gjq_741d8beb-644b-4019-b357-c6aca1f0abfa/manager/0.log" Jul 10 18:57:53.456324 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:53.456295 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-2sxb9_9e15eeeb-5bd4-42d7-8deb-b27f637d58cf/manager/0.log" Jul 10 18:57:53.525238 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:53.525211 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-548fc9658c-qkwf9_1e80b2b1-83e2-4eea-ac8f-af6c36c6c78c/manager/0.log" Jul 10 18:57:53.552397 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:53.552374 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-hxdqc_8d5689f9-7294-4091-b141-014e66ebe175/server/0.log" Jul 10 18:57:53.604181 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:53.604153 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-75kc6_5be58ed1-f611-49d7-baf4-5f7712cf5567/manager/0.log" Jul 10 18:57:53.769360 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:53.769337 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5488d6dcc-xg8qm_a8e76c0a-f1ec-48fd-8562-d36abdbb10f7/manager/0.log" Jul 10 18:57:53.792367 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:53.792350 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5488d6dcc-xg8qm_a8e76c0a-f1ec-48fd-8562-d36abdbb10f7/copy-manifests/0.log" Jul 10 18:57:54.626758 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:54.626729 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678ggg8d_f2f90090-6b5d-469e-ad26-983000f794b4/istio-proxy/0.log" Jul 10 18:57:54.714309 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:54.714291 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dd47df98c-wkh7n_246f3a19-773d-427c-bcba-c5bee68f4d76/kube-auth-proxy/0.log" Jul 10 18:57:54.735978 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:54.735951 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-gdj7f_5e8a7446-6687-4c74-b561-02347f6148ef/istio-proxy/0.log" Jul 10 18:57:54.765254 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:54.765236 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-gdj7f_5e8a7446-6687-4c74-b561-02347f6148ef/istio-proxy/1.log" Jul 10 18:57:54.805781 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:54.805756 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-jgkjx_8926f5ea-7724-49e2-8855-29e4512fb196/payload-processing/0.log" Jul 10 18:57:54.825128 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:54.825108 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78fd8c8fc4-8wvsg_96b5e2d3-67f8-4bef-a56e-a44799345c04/router/0.log" Jul 10 18:57:55.186917 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:55.186890 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-vwr9g_25edbbfc-71c9-4fc9-b658-50fe99d180af/openshift-lws-operator/0.log" Jul 10 18:57:56.147461 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:56.147434 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678ggg8d_f2f90090-6b5d-469e-ad26-983000f794b4/istio-proxy/0.log" Jul 10 18:57:56.243222 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:56.243201 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5dd47df98c-wkh7n_246f3a19-773d-427c-bcba-c5bee68f4d76/kube-auth-proxy/0.log" Jul 10 18:57:56.263493 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:56.263467 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-gdj7f_5e8a7446-6687-4c74-b561-02347f6148ef/istio-proxy/0.log" Jul 10 18:57:56.290453 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:56.290435 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-gdj7f_5e8a7446-6687-4c74-b561-02347f6148ef/istio-proxy/1.log" Jul 10 18:57:56.335783 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:56.335760 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-jgkjx_8926f5ea-7724-49e2-8855-29e4512fb196/payload-processing/0.log" Jul 10 18:57:56.353109 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:57:56.353092 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78fd8c8fc4-8wvsg_96b5e2d3-67f8-4bef-a56e-a44799345c04/router/0.log" Jul 10 18:58:00.373379 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:58:00.373351 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-pbmhx_3469b86f-3416-42f1-a371-d35e4e31633f/migrator/0.log" Jul 10 18:58:00.398492 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:58:00.398463 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-pbmhx_3469b86f-3416-42f1-a371-d35e4e31633f/graceful-termination/0.log" Jul 10 18:58:02.264799 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:58:02.264773 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdspp_779eaa9e-7637-4bcc-886a-81bd645c0956/kube-multus-additional-cni-plugins/0.log" Jul 10 18:58:02.291485 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:58:02.291449 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdspp_779eaa9e-7637-4bcc-886a-81bd645c0956/egress-router-binary-copy/0.log" Jul 10 18:58:02.315595 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:58:02.315568 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdspp_779eaa9e-7637-4bcc-886a-81bd645c0956/cni-plugins/0.log" Jul 10 18:58:02.340275 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:58:02.340252 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdspp_779eaa9e-7637-4bcc-886a-81bd645c0956/bond-cni-plugin/0.log" Jul 10 18:58:02.363954 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:58:02.363931 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdspp_779eaa9e-7637-4bcc-886a-81bd645c0956/routeoverride-cni/0.log" Jul 10 18:58:02.388378 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:58:02.388356 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdspp_779eaa9e-7637-4bcc-886a-81bd645c0956/whereabouts-cni-bincopy/0.log" Jul 10 18:58:02.411327 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:58:02.411307 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdspp_779eaa9e-7637-4bcc-886a-81bd645c0956/whereabouts-cni/0.log" Jul 10 18:58:02.514878 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:58:02.514808 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ww2gt_5a7b8cfb-1da3-4510-b85b-21ce665d6c22/kube-multus/0.log" Jul 10 18:58:02.597318 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:58:02.597291 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l7l77_f4443fb4-d9ef-4a8c-8268-0aacbd93ce13/network-metrics-daemon/0.log" Jul 10 18:58:02.622587 ip-10-0-136-57 kubenswrapper[2564]: I0710 18:58:02.622569 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l7l77_f4443fb4-d9ef-4a8c-8268-0aacbd93ce13/kube-rbac-proxy/0.log"